Data Based Calibration System for Radar Used by Vehicle Activated Signs

Access to the published version may require subscription. Abstract The accurate measurement of a vehicle's velocity is an essential feature in adaptive vehicle activated sign systems. Since the velocities of the vehicles are acquired from a continuous wave Dop-pler radar, the data collection becomes challenging. Data accuracy is sensitive to the calibration of the radar on the road. However, clear methodologies for in-field calibration have not been carefully established. The signs are often installed by subjective judgment which results in measurement errors. This paper develops a calibration method based on mining the data collected and matching individual vehicles travelling between two radars. The data was cleaned and prepared in two ways: cleaning and reconstructing. The results showed that the proposed correction factor derived from the cleaned data corresponded well with the experimental factor done on site. In addition , this proposed factor showed superior performance to the one derived from the reconstructed data.


Introduction
A range of road traffic safety solutions have been recently developed and used by public traffic agencies to ensure safety and traffic efficiency.One such traffic safety solution being investigated by traffic authorities is the Vehicle Activated Sign (VAS).VAS is a digital road sign that displays a message when a vehicle's speed exceeds a pre-set trigger speed.At present, most existing VAS systems are static in nature.These systems have a pre-set trigger speed which is set relative to the static speed limit applied on a specific road.In certain cases, simply setting the trigger speed relative to the speed limit may not be optimal for the existing traffic conditions, thus limiting the efficiency of the VAS [1] [2].Hence it is necessary to develop an adaptive Vehicle Activated Sign system (adaptive VAS) which will respond to traffic and road conditions.The adaptive VAS system consists of two fundamental stages: The first one is to collect accurate and significant data; whereas, the second is to automatically find the suitable trigger speed based on that data.Since the performance of the sign is sensitive to the trigger speed the ability to accurately calibrate the sign is an important factor for VAS systems.The aforementioned data could be detected by many kinds of devices, such as loop detectors, cameras, radar guns and Doppler radars.This study is concerned with the data that is mainly collected by a continuous wave Doppler radar.
The problem of data collection might seem simple and easy to achieve.In reality the problem is complex for several reasons.Firstly, since the velocities of the vehicles are acquired from a continuous wave Doppler radar, the vehicle is not travelling directly towards the radar but is slightly inclined at an angleα (see Figure 1) [3].Therefore, the radar will not measure the actual velocity, but only the relative velocity in the direction of the beam.The cosine of this angle between the radar unit and its target determines the magnitude of the error.This error is known as the cosine error and it becomes significant when the angle to the roadway is large.The greater the angle between the radar and the roadway, the lower is the indicated velocity [4].The relationship between the measured velocity m v and the actual velocity a v is usually expressed by the following Equation (1) [5]: where: m v is the velocity of the vehicle detected by the radar a v is the actual velocity of the vehicle α is the angle between the radar and the traveling direction of the vehicle Secondly, a successful measurement requires a direct view of the radar towards the vehicles.If the radar is installed in a side fire position, the radar must be located parallel to the roadway and face the coming traffic at an angle α .The distance to the oncoming lane should be between 0.5 and 3 metres.The radar is usually mounted in a side fire overhead position where the installation of the radar becomes more challenging.For this mounting, the radar must be set at a fixed height, so that its lower edge is 2.25 to 3.25 metres above the traffic lane's ground.The radar must also be tilted to a 20˚ angle; otherwise the vehicles will not drive through the radar beam (see Figure 2).This installation is expected to be carefully set because precise alignment of the radar is the decisive factor in obtaining an exact velocity measurement and vehicle classification.Setting the radar to a fixed height and distance can be done free from error, but eliminating errors due to the tilt of the radar to the oncoming lane is hard to achieve.Therefore measuring the angles accurately is problematic and requires careful measurement of road gradients and other factors.Thus, calibration has been set by subjective judgment rather than systematic judgment.In other words, the radar is typically placed at the site without a proper method and is simply set up "by eye".A question raised in this paper is how calibration can be established with minimum equipment requirements in the field?Can a speed correction factor be derived from the available measurements collected by the radar?How can validation be completed through finding data driven by the correction factor?This paper proposes a systematic way to design an experiment for calibrating the radar with minimum requirements to be established in the field.The objective of this study is to perform a data driven calibration algorithm, which takes the data collected from two radars and derives the speed correction factor.The rationale behind using two radars is that no specialist or different equipment (or additional field personnel) are needed; once calibration has been done, the second radar can be redeployed to a new site.
The rest of the paper is organized as follows: At first, an overview about the calibration for a Doppler radar done in previous work is given in Section 2. In Section 3, data collection and experiment design are presented.Section 4 describes the calibration algorithm performed in this paper.An experiment is presented in Section 5.The results are explained in Section 6.The paper finally presents conclusions and proposes possible future studies in Section 7.

Related Work
There are several methods that have been used in radar calibration.A common method is a tuning fork that is tuned to vibrate at a certain frequency and placed in front of the radar.This method has been previously tested and proved as a stable and suitable standard for calibrating Doppler police radar guns [6].Another study examined the uncertainties of different methods in calibration of speed enforcement down to road radar.The proposed methods were tuning forks, a vehicle's speedometer, speed simulators, and a fifth wheel [3].The most uncertain method regarding vehicle speed was a vehicle's speedometer and the least uncertain was the laboratory speed simulator.Uncertainty in the tuning fork method was approximately the same as the laboratory speed simulator.Another study developed a radar calibration system of Doppler/range radars with high precision.The developed system provides information regarding several parameters, such as the Doppler frequency shift, the frequency measured with a universal time interval counter, the emulated speed, and the weather conditions [7] and [8].Due to the measurement error of frequency that directly affects the measured velocity, a new radar based velocity measuring system, based on a processor, was incorporated instead of calibrating the radar used in the their study.This system uses the Doppler principle based on underlying hardware design [9].Furthermore, another study proposed a new vehicle speed and traffic flow measurement radar to get higher resolutions in speed and traffic flow management.This study is based on eliminating the interference of other vehicles on the road when detecting a certain vehicle [10].A data fusion of Doppler radar with video camera had been proposed for a traffic surveillance system which was capable of automatically monitoring all vehicle speeds [11].A majority of the work reported above considered a calibration method based on either comparing radar frequency or developing new calibration systems and to the best of our knowledge none have considered a data driven calibration.Data driven calibration methods were used in various traffic models such as speed-density model [12] and time gap model [13].

Data Collection and Experimental Design
A test site on Mjälga roadway in Borlänge, Sweden was selected for the experiment.No external factors, such as the presence of bends, junctions or roundabouts were present to affect the consistency of the data collection.The meaning of data consistency is that each vehicle which travels along the test site should be present in the data set.Since the aim of this study was to calibrate the radar used in the adaptive VAS system, two main components form the data collection system: VAS and three Siersega radars.The VAS used in the current study displays two warning messages in succession.The first is a reminder of the posted speed limit, which is 40 km/h, which is followed by a "SÄNK FARTEN" (reduce speed) message.Typically the messages are displayed only when the vehicle speed exceeds a pre-set threshold speed, i.e. the trigger speed.
The Siersega device is an advanced traffic counter.It consists of a Doppler radar sensor integrated by a Flash RAM data memory, a real time clock, a serial data interface and a battery pack.Individual vehicle data was collected by the Siersega placed across the roads 100 m before the VAS (Position A), at the site of the VAS (Posi-tion B) and 60 m after the VAS (Position C) (see Figure 3).The device at Position A is labelled as A S and the devices at Positions B and C are labelled as B S and C S respectively.On each occasion that the Siersega re- corded a time, the velocity, the direction of travel and the vehicle type for each individual vehicle for 24 hours a day for a whole week.
Data from the radar at the VAS is matched with data collected by two other radars installed at a distance of 60 meters and 100 meters on either side of the VAS (see Figure 3) for further analysis.Note that such radars are placed appropriately to cover the vehicles' prior and posterior VAS velocities.
In addition, several test runs were carried out by the research team by driving a car on the road segment where the radars are installed; to be able to work out the baseline difference in the velocities reported by the radars as opposed to velocity of the car.Such difference has further been used to validate the correction factor obtained in this work (see Section 6).At this point it is worth mentioning that the baseline difference will be referred to as the experimental correction factor from this point forward.The experimental correction factor in the current case is equal to 1.18.

Calibration
Calibration in the current case is mainly based on mining the data collected and finding the distance correction factor.The distance correction factor is the ratio between the actual distance and the distance derived from the two radars.Figure 4 is an overview of the proposed calibration system.Data is preliminary explored to be able to detect discrepancies in the radar detection (see Section 4.1).Data is then preprocessed in two stages; detection and correction respectively (see Sections 4.2.1 and 4.2.2).Finally each individual vehicle is matched to calculate the correction factor that will be based on the distance travelled between the radars (see Section 4.3).

Data Exploration
In ideal conditions, the radars should detect each vehicle and each vehicle should be visible to all of the three radars established on the road.In the real world the detection of the vehicles is often sensitive to some disturbances and this might lead to presence of missing values and outliers.At this point it is worth mentioning that the radars  should be time synchronized where the individual travel time is the time difference between the synchronous radars.However, there can be a delay between the radars' clocks due to an incorrect setup of the clocks.Despite the radars being synchronized initially, the clocks may be delayed due to disturbances in the radar detection of the vehicle.The most challenging disturbance is the arrival of vehicles from different directions at the same time and at the same position.This means that the radar may be occupied by another vehicle passing from the other direction.Besides, overtaking and double counting can also contribute to the presence of missing values and outliers.

Data Preprocessing
Traffic data collected in real time often suffers from incomplete and noisy data.Data pre-processing was therefore employed to eliminate noisy data and also to be able to repair missing data [7].Pre-processing in the current case deals mainly with detection and correction tasks respectively (see Sections 4.2.1 and 4.2.2).

Detection of time delay
The detection of a time delay is first extracted from the data set by using a numerical algorithm.The fixed point iteration method is one of these algorithms that can be used in order to obtain an estimate as to the time delay between radars.The algorithm converges at a fixed point under some conditions given by the theorem described by previous mathematical study [14].Based on the aforementioned study, the proposed algorithm starts at any point and recursively approaches to an approximate solution.In this paper, an optimal time delay δ is applied by the following algorithm [15] and [16]   3) Calculate the estimated distance, ( ) ( ) Most of the outliers are usually detected by using either basic descriptive statistics, such as mean, median and standard deviation, or by visualizing the data using appropriate plots, such as scatter plots or box plots.Both show the mean prevalence of the value in the data.It should be noted that any record that significantly differs from the mean is considered as an outlier.In this work, vehicles traveling at a velocity that is higher or lower than the mean velocity relative to the data are regarded as outliers.For example, the common velocity of a motorcycle or truck differs from the common velocity of a car.Therefore data was grouped into four smaller groups based on the type of vehicle to aid in the detection of outliers.Grouping is based on the length of vehicles detected by the radar as follows: Radar B S are travelling between 30 km/h and 60 km/h.

C. Detection of missing values
In the current work detection of missing values mainly relies on the disturbance of radar detection which has been explained in an earlier section.Detection is therefore done by calculating the time gap.The time gap is the time difference between two successive individual vehicles.Matching is done based on these time gaps.If the difference between the time gaps is insignificant, a missing value is present.The difference is compared to a user defined threshold that cannot exceed 20 seconds.The threshold is chosen, after some in-field trials, based on the average max time gap that may occur between vehicles.

Correction
After the detection of the location of missing values and outliers in the data set, the data is corrected in two ways: • Data cleaning: The data is cleaned by removing records that are detected as outliers and missing values.After this stage, the data contains only the records that are matched with the lowest vehicle variation.• Data construction: The data is completely constructed by filling in missing records and keeping all outliers.
The main idea of the data construction is to build a complete data set without missing any individual vehicle.
The best estimate of the missing value is derived from the time and velocity of the vehicle passing from the opposite direction.

Matching and Correction Factor
The basic idea is to find the velocity obtained by the radar by calculating the expected distance travelled by the vehicles.For instance, time records from Radar A S are matched to time records from Radar B S .The travelled distances are extracted from the matched velocities and time recorded by both radars.The Speed Correction Factor; CF, is based on the estimated distance for each vehicle.CF is entitled by Equations ( 4) and (5).Additionally, the estimated distances are compared to the actual distance between the two radars.The time delay is included in order to find the travel time.
( ) ( ) where: n is the number of vehicles

Analysis
The calibration system presented in previous section (see Section 4) is tested on two data sets: • Data Set 1: Data Set 1 was collected by Radar A S and Radar B S where the distance between the radars is 100 m.
• Data Set 2: Data Set 2 was collected by Radar B S and Radar C S where the distance between the radars is 60 m.As explained earlier (see section 4.2.1), the optimal time delay between the deployed radars should be first noticed.Figure 8 shows the optimal time delay obtained from the numerical algorithm proposed in earlier section.Note that the optimal value is reached when the time delay is approaching the minimum value that the algorithm can provide.
In Figure 8

Results and Discussion
The results of the proposed correction factors are depicted in Table 1.The proposed correction factor is performed on both data sets prepared on either cleaning the data or constructing the data.Note that in the table below, the distance between A S and B S is named as AB and the distance between B S and C S is named as BC.To be able to validate the obtained results, normalized root mean square error (called NRMSE) had been calculated.NRMSE is used as a measure of the difference between the distance estimated by the correction factors and the actual distance between the radars.The NRMSE is basically the square root of the mean square error which (see Equation (6c)).
( ) where: x a is the actual distance between radars x m is the estimated distance used in Equation ( 4) Results obtained clearly indicate that the correction factor obtained after data cleaning was much closer to the reference correction factor than the one obtained through data reconstruction.A fitted linear regression and goodness of fit (R-squared) to identify the relationship between the matched velocities has also been investigated.The fact that the R-squared value for the cleaned Data set 2 is higher when compared to Data Set 1 further reinforces our findings (see Table 1).Note that the correction factor is even closer to the reference correction factor and the normalized root mean squared error(NRMSE) is low when the distance between the radars is equal to 60 meters in particular, cleaned Data Set 2. A good discussion about NRMSE can be found elsewhere [17].The fact that the proposed correction factor reported using cleaned Data Set 2 is closer to the experimental correction factor (see Section 3) i.e. 1.18, further supports the findings.

Conclusion and Future Work
In this paper, a data based calibration system was applied to accurately correct vehicle velocity collected by a Doppler radar and used on the adaptive VAS system.A data driven system entails an ability to preprocess the gathered data and to match individual vehicles to find out the correction factor for vehicle velocities detected by radar.In fact, the correction factor is the ratio for the actual vehicle velocities to the measured velocities by the radar.In this study, the proposed correction factor, extracted directly from data collected by two Doppler radars placed at a pre-set distance apart, corresponds well to the true correction factor derived from the experimental calibration at the site.The proposed correction factor obtained from the cleaned data also showed more superior performance than that from the reconstructed data, indicating that filling the missing values with an estimated time and velocity provided an inaccurate data set.An estimation of time and velocity for missing values could be improved with an intelligent prediction algorithm to get further accuracy of the reconstructed data.However, the study reveals the correction factor for vehicle velocity which allows avoiding dealing with the mounting problem of the Doppler radar.The validation performed is rather a comparison with the experiment on site.Another type of validation needs to be established and explored to ensure the accuracy of the calibration system.One plausible way of testing the accuracy is by comparing the calibration system against a baseline method such as a tuning fork.
Testing the system at other test sites also needs to be done in further studies.
In the near future, an adaptive fuzzy inference system can be developed to calibrate radar installation.The input to such a system can be the distance of the road, the mounting height and the tilted angle and the output is the correction factor.Also, a real time video surveillance algorithm can facilitate the detection of vehicles, the classification of vehicle types, the accurate counting of vehicles and the time difference between records.Using the real time surveillance algorithm, individual vehicles can be definitely tracked where many types of radar can be calibrated simultaneously.Monitoring and voice recording systems can be another way to calibrate the radar by analyzing the voice signals detected from the traffic.A mobile application can be a good tool to calibrate the radar on site.A mobile phone application can make it easier to track the time and velocity at a certain location using the phone's GPS.Finally, a VAS can be developed in a way that is automatically adapted to the location by using artificial intelligence techniques.

Figure 1 .
Figure 1.Relation between actual velocity a v and measured velocity m v [3].

Figure 2 .
Figure 2. Doppler radar mounted on a sidefire overhead position and tiled to 20 degrees.

Figure 3 .
Figure 3. Location of radars A S , B S , C S and VAS on the roadway.

Figure 4 .
Figure 4.The stages of the calibration system.

Figure 5 (
a) presents a sketch showing vehicles and their corresponding times at different locations.

4. 2 . 1 .
Detection In this step, three types of detections are of concern: A. Detection of time delay B. Detection of outliers C. Detection of missing values A.

: 1 )
Start by an initial value to time delay δ :

Figure 5 .
Figure 5. Sketch of the detection problem (a) Vehicle V and V ′ arrive at time A t at Radar A S respectively at time C t′ at Radar C S ; (b) Vehicle V and V ′ arrive at Radar B S at the same time B B t t′ = .

mxFigure 7 .
Figure 7. Histogram for vehicle velocities.(a) At radar A S ; (b) At radar B S ; (c) At radar C S .

Figure 9 and
Figure 10 show the matched velocities for vehicles from Data Set 1 and Data Set 2, respectively.In Figure 9(a) and Figure 10(a), the data is cleaned by removing records of missing occurrences.In Figures 9(b) and Figure 10(b), the data is reconstructed to fill in missing data.

Figure 8 .Figure 9 .Figure 10 .
Figure 8.(a) The optimal time delay between Radar A S and Radar B S respective to the number of iterations; (b) The optimal time delay between Radar B S and Radar C S respective to the number of iterations.
when V and V ′ arrive at Radar B S at the same time, B B t t′ = , the radar detects either V or V ′ .Several cases of missing vehicles can be listed, but only two cases are presented here; missing vehicles by CB t′ .In Figure 5(b),

Table 1 .
Comparison between different correction factors, NRMSE and R-squared respective to Data Set 1 and Data Set 2.