Development of methods for products and services in ENDORSE calls upon meteorological measurements that are used for development, validation or in operation. As always in measurements, meteorological measurements are prone to errors, and gaps in time-series. Hence, ENDORSE has set up a series of activities aiming at producing tools and procedures for an accurate and easy use of meteorological data by the Consortium. Meteorological data measured by ground stations are often a key element in the development and validation of products and methods. Various meteorological variables at surface are handled: air temperature and relative humidity, wind speed and direction, solar exposure. Their quality is seldom known and they should be qualified before entering a method or serving as reference for validation. We performed a review of the state-of-the-art in quality check of meteorological data. The published procedures were tested and their results were analyzed. We finally establish a series of automatic procedures to be performed for assessing the plausibility of the measurements of the meteorological variables under concern.

TABLE OF FIGURES AND TABLES

Black line is the 1-min average time series. Pink line is the horizontal irradiance on top of atmosphere. Green line is the BSRN limit range based on rare observations. Blue line is the BSRN limit range based on extrema. Light blue line is the 1.2 times the normal irradiance at the top of atmosphere, range proposed by [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF]

INTRODUCTION

Development of methods for products and services in ENDORSE calls upon meteorological measurements that are used for development, validation or in operation. As always in measurements, meteorological measurements are prone to errors, and gaps in time-series. Hence, ENDORSE has set up a series of activities aiming at producing tools and procedures for an accurate and easy use of meteorological data by the Consortium.

These activities take place in WP 3 common research activities and are labelled 3001-2, -3, and -4. The present document reports on the work performed under these activities, the conclusions reached and the software, tools and procedures that have been realised.

The work performed covers an effort of 9 person-months. It is a large effort with many results in three different domains though very close. For the sake of simplicity in reading and legibility of the whole document, we have opted for a Chapter Introduction (this present chapter) that offers a brief description of the work performed and an overview of the attained results.

Then, each Activity is documented in a separate part: A, B, and C. Each part is selfcontained and can be read separately from the others.

BRIEF DESCRIPTION OF THE WORK PERFORMED

Various meteorological parameters at surface are handled in ENDORSE: air temperature and relative humidity, wind speed and direction, solar exposure. These data originate from ground-based measuring stations. For a given parameter, measurements can be made over different integration periods, ranging from one minute to one day. They can be made at different time references, e.g. legal time, including daylight saving time, universal time (UT), mean solar time, true solar time (TST). Time stamp, i.e. the time that is attached to the data, should obey standards of the World Meteorological Organization (WMO) but this is not always the case.

The aim of Activity 3001-2 is to develop a series of procedures and advanced mathematical tools to harmonize these data sets to support validation activities as well as the integration of data into product generation and services. First investigations have identified three generic types of problems in harmonization:  the over-sampling of time series of meteorological data (e.g. from a 1-h time series of irradiance to a 1-min time series of irradiance);  the sub-sampling time shift of time series of meteorological data (e.g. application of the sub-hourly time translation to a 1-h TST time series of irradiance to get a 1-h UT time series);  the averaging, inducing a down-sampling, of time series of meteorological data with missing data (e.g. from a sub-daily time series of irradiance with data gaps to daily, monthly or yearly time series of irradiance).

We have reviewed state-of-the-art techniques tackling these problems. We have implemented several of these techniques usually in Matlab and the performances of each new method were compared to those of the current techniques in order to assess the level of innovation.

In the case of over-sampling, we have defined a consistency property following similar work done in fusion of images. This consistency property expresses that the "re-averaging" (or the "re-summarization") of the oversampled time series should be equal to the original time series. We have studied the respect of this property by current techniques. We have proposed a mathematical development that permits to bring a post-processing correction to two current techniques: linear and cubic spline interpolations. The sub-sampling time shift problem is treated the same way.

We have made a series of experiments using Monte-Caro techniques to study the effects of missing sub-daily data on the resulting daily average time series. We have established a relationship between the magnitude of these effects and the percentage in missing data within a day. We also studied a model relating this percentage to an acceptability threshold depending of the foreseen exploitation of the daily data.

Activity 3001-3 deals with the control of the quality of meteorological data. Such data measured by ground stations are a key element in the development and validation of several methods, products and services in ENDORSE. Their quality is seldom known and they should be qualified before entering a method or serving as reference for validation.

We have performed a review of the state-of-the-art in quality check of meteorological data using reports from the WMO, international initiatives, and publications made in journals or conferences. The published procedures were implemented in Matlab and tested over data sets of reputed quality. We have compared these procedures and have selected or modified several of them. This set of recommended procedures permits to assess the plausibility of the measurements and to provide a quality flag for each of them.

Activity 3001-4 deals with the assessment of the quality of retrievals of meteorological data derived from satellite images. The work performed used as a starting point the results attained in solar radiation by previous working groups in international programs. A protocol is defined for assessing the uncertainty of the satellite-derived variable compared to a reference. It can be applied to various meteorological data. We propose a series of measures for quantifying the quality of the retrievals. We have studied how it can be implemented and put forward some recommendations for its application.

MAIN RESULTS AND CONCLUSION

A series of procedures and advanced mathematical tools have been developed to harmonize these data sets to support validation activities as well as the integration of data into product generation and services. We show that in case of over-sampling none of the current techniques respect the consistency property. We propose a correction of two standard techniques (linear and cubic spline interpolations) and demonstrate that it significantly improves the results. It is shown that missing sub-daily data can have significant impact on the resulting daily average time series. This impact is quantified as a function of the percentage in missing data within a day. Furthermore, we propose a limit of acceptable percentage as a function of the foreseen exploitation of the daily data

We have performed a review of the state-of-the-art in quality check of meteorological data. This review was not available in the literature, nor in the Web, and is a one of the results of Activity 3001-3. The published procedures were tested and their results were analyzed. We recommend a series of automatic procedures to be performed for assessing the plausibility of the measurements of the meteorological variables under concern.

Based on the comprehensive work performed for solar radiation in previous international programs, we propose a protocol for assessing the uncertainty of the satellite-derived variable compared to a reference. We propose a series of recommendations for its application. The protocol can be applied to various meteorological data and will be notably applied to the air temperature at 2-m height produced by the partner University of Genova in Task 3002.

Together with scientific results and proper validation of the proposed techniques, software in C and Matlab, tools and procedures were produced and documented that can be exploited by the ENDORSE Consortium.

The deliverable is supplied with a delay of approximately 2 months. This is partly due an underestimation of the amount of efforts necessary to write this document and partly due to the period of summer holidays. However, the tools were available in due time in June 2011 or before for their use by the Consortium. For example, air temperature data provided to University of Genova were screened by these tools.

Therefore, we believe that we have achieved the objectives of Activities 3001-2, -3, and -4 in WP3. .

PROCEDURES FOR

INTRODUCTION

Meteorological data measured by ground stations are often a key element in the development and validation of products and methods, for example, for building services [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF], or monitoring solar power plants [START_REF] Hoyer-Klick | User's guide to the SoDa and SOLEMI services[END_REF].

Long-term radiation and meteorological measurements are available from a large number of measuring stations. However, close examination of the data often reveals a lack of quality data, often for extended periods of time [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF]. This lack of quality has been the reason, in many cases, of the rejection of large amount of available data; see for example [START_REF] Remund | Worldwide Linke turbidity information Proceedings of ISES Solar World Congress[END_REF] who have rejected the 88 % of sites available due to uncertain quality data.

The sources of uncertainty in meteorological data are of very different nature: radiation sensors can be affected by incorrect sensor levelling, shading caused by near building structures, complete or partial shade-ring misalignment in the case of shaded measurements (as for diffuse component of the solar radiation); as well other uncertainty sources that affects all type of measurements like dust, snow, dew, water-droplets, bird droppings, etc.; electric field in the vicinity of cables, mechanical loading on cables and station shut-down or maintenance mishandling [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF].

Data quality is a measure of how well data serve the purpose for which they were produced (WMO, No.488), ensuring that released data is of a known and reasonable quality suitable for scientific research [START_REF] Moore | Analysis of historical ARM measurements to detect trends and assess typical behavior[END_REF].

To control their quality, data are submitted to several conditions or checks. Each control of these conditions will be named in this report a quality control procedure (QCP). Each QCP flags data that does not pass the condition tested; data that are not flagged by this QCP is a plausible data for this specific QCP.

The result of the application of all the QCPs will be named quality control (QC). Data that are not flagged after the application of all the QCPs will be considered as plausible data.

QC has been established in automatic manner with the aim of detect non plausible data which are suspect to be a wrong measure of the variable. The analysis of data flagged by the QC can help to detect the source of the uncertainty. Generally, the goals for QC are [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF]:  to make it easier for data users to identify suspicious data, and to highlight corrected values;  to identify calibration, measurement and communication errors; the detection, ideally, must be as close as possible to the observation source;  to develop a comprehensive flagging system to indicate data quality level for the whole data series, that could be used for downstream processing.

The application of QC is recommended in all stages of transmission data. Even when data come from a national well-known QC-practices climatological or meteorological centre, in the transmission procedure, record of values, etc. data corruption can be induced [START_REF] Zarzalejo | Irradiancia solar global horaria a apritr de imagenes de satéllite[END_REF].

A desirable complement of QC is the quality assurance (QA); it provides information on quality of data through the technical status of the instrument and information on the internal measurement status (Zahumensky, 2004). Very frequently there is no possibility to receive information of the station maintenance or simply there is no maintenance report; the WMO strongly encourages keeping an updated maintenance report in all measuring stations.

It is important to keep in mind that if a disproportional number of observations is rejected by QC, this may be an indication of strongly biased data that should not be considered as outliers (Brönnimann et al., 2009). Also it is possible that the rejection of this amount of data had its source in one of the QCPs which is no longer adequate: this QCP should be further studied and possibly modified.

The objective of ENDORSE project is to stimulate the use of renewable energies (sun, wind and biomass), electricity grid management and building engineering through daylight in buildings, via the downstream services in renewable energies by exploiting the GMES core Services (MACC, SAFER and Geoland 2) together with other EO/in situ data and modelling.

To accomplish these objectives, ENDORSE needs trustful meteorological data.

The task 3001-3 is aimed at performing a likelihood control of the data and checking their plausibility, to guarantee the quality and uniformity of data which will be later used. The objective is not to perform a precise and fine control, an objective out of reach without details on the site and instruments. Examples are null values when a missing-data-code is expected (typically, -999), values much larger than the extraterrestrial irradiance or positive values when the sun is well below the horizon [START_REF] Geiger | A web service controlling the quality of measurements of global solar irradiation[END_REF]. The end user, if possible, will verify the flagged data by other means (for example, asking to the station manager additional information about this period that could explain this non plausible data).

All of the QCPs presented in this document are applicable for all latitudes; they are not optimized regionally nor seasonably with the aim of being generic. The automatic QC allow data series with gaps.

QC is not meant to verify the homogeneity of data series. Homogeneity is an issue of long data series in order to detect differences in trends due to changes in the measure instruments and not due to climate changes. Calibration, on-site self-diagnostic checking by equipment software and metadata maintenance of metadata is not discussed in this document.

The present document has been structured as follows. First it is presented an overview of QC, where it will be explained which meteorological variables will be tested by the QC, which time average periods data series are envisaged and an overview about the order of application of each QCP. Following, the different kind of QCP will be detailed, as those based on ranges of plausibility or those aimed at detecting stranger steps in two following values for a specific variable. The output QC report will be described after that and some guidelines about the interpretation of the output report will be provided. An example of the output QC report applied to a BSRN station is given. Finally, conclusions are done and the scope of the present document is given.

.

OVERVIEW OF THE QUALITY CONTROL PROCEDURES (QCPS)

The QCPs depend on the considered meteorological variable as well as on the time average period of the time series. The QCPs that will be described in this document are not suitable for raw data, but only for average time series. In this section these aspects of the applications of the QCPs used for ENDORSE project will be detailed.

.

Meteorological variables used in ENDORSE project

Presently, there is a request for having auxiliary meteorological data at the Earth surface: air temperature, wind speed and direction, relative humidity and atmospheric pressure, coincident with irradiance data. These data are useful, for example, for computing the radiative budget of the solar energy system, thus having a more accurate assessment of the gains and therefore of the energy production. This is also true in building engineering to compute gains and losses in heat of buildings [START_REF] Hoyer-Klick | User's guide to the SoDa and SOLEMI services[END_REF]. Following this need, the variables envisaged to use in ENDORSE project are the three components of short-wave solar irradiance incident to the Earth surface (normal direct irradiance -or beam irradiance-BNI, horizontal global GHI and horizontal diffuse DHI), ambient temperature (Temp), relative humidity (Hum) and wind speed (WS).

For radiation data, only power is aimed for the QC, that is, irradiance data (W m -2 ) and not energy data (irradiation, W h m-2 ). Test for humidity are selected for relative humidity, in percentage; not other humidity QCPs have been selected, since relative humidity is the more usual measurement among them. Selected QCPs for temperature are aimed at ambient temperature, in Celsius degrees, and not temperature of wet bulb or any inner device's temperature. Finally, QCPs for the wind speed, in m s -1 , are available for average wind speed and not for gusts data.

For irradiance data for time period shorter than one day (i.e. sub-daily time series), the QCP will be applied only for data corresponding to solar elevation angles greater than 7°, according to [START_REF] Younes | Quality control of solar radiation data: present status and proposed new approaches[END_REF] and [START_REF] Ruiz-Arias | Proposal of a new regressive model for the hourly diffuse solar radiation under all sky conditions[END_REF] recommendation. This test deals with the intrinsic cosine error of the pyranometric sensors.

For the application of QCPs, some additional information is necessary, as the geographical coordinates (latitude and longitude in degrees; altitude in meters above sea level) or the code for missing value in the data files. Geographical information is needed for QCPs for irradiance (the relative position of Sun for an observer in the Earth surface is location dependent). The verification of the missing code is another important information: some meteorological services use different codes depending on the reason of the missing value (station shut down, instrument maintenance, etc.). If these values are not replaced for one only missing value before the application of QC, they will be flagged as non plausible and increment the percentage of flagged data.

.

Average time periods envisaged for QCPs

The application of QCPs depends on the time average period of the time series of meteorological data. It is not adequate applying to daily average values QCPs that were aimed to 1-min average time series, due to the different expected variability in these two different time periods.

The average time periods envisaged in this report are monthly averages, daily, hourly and sub-hourly ones (1-min time series for all meteorological variables except for WS, which is 2min time series).

 Monthly average data: statistics at the month time scale, especially the mean values, are considered to be important and useful values for climate research, model performance evaluations and for assessing the quality of satellite (time-and space-averaged) data products [START_REF] Roesch | Assessment of BSRN radiation records for the computation of monthly means Atmospheric Measurement Techniques[END_REF]. There can be two types of monthly average. It is possible that this kind of data will be only one data for a given month: it corresponds to the average of every data in the month in only one average value. This case will be referred here as monthly averages. Otherwise, it can be a series of data along of a day, say hourly series, and then it corresponds to the monthly average of every hour of the day, averaged for the thirty or thirty-one values of this variable at these 24 h of the day. This second case it will be referred here as daily monthly averages. The user must be careful about if he has monthly averages or daily monthly averages. QCP proposed in this document are aimed to monthly averages only.

 Daily average data: they are one of most common series data in resource evaluation. Daily average values are used for monthly average computation for climate variability and climate trend research as well as climate assessment and impact studies.

 Hourly average data: their use is more and more common due to the most sophisticated and powerful means for measure and storage data. Current research on power plant production forecasting (for wind and solar power plants) are examples of domains that require this kind of data.

 Sub-hourly average data: as for hourly average, sub-hourly data are more and more common due to they allow for more accurate result and applications. The sub-hourly time period average QC available is for 1-min average except for wind speed, which is 2-min average time series.

.

Sequence order of application of QCPs

The sequence order of application of the QCPs may have an influence in the portion of data flagged as plausible at the end. The sequence recommended by the WMO and the BSRN organizations are the following since they claim that this order achieves the maximum benefit and minimum impact for missing or bad cases of some values (WMO, No.488, [START_REF] Long | BSRN Global Network recommended QC tests, V2.0 Baseline Surface Radiation Network (BSRN)[END_REF]:  range checks (QCPs that verify values are within a specific range);  step checks (QCPs aimed at detecting unrealistic jumps in the time series);  consistency checks (QCPs that verify the relationship between two or more time series).

The automated QC implemented for ENSORSE flags the non plausible data independently from one QCP to the other, that is, there is no sequence order in their application. At the end of the automated procedure, the user has the data flagged by each of the QCP. It is up to the user to choice the sequence of QCPs application with respect to his objectives.

.

QUALITY CONTROL PROCEDURES

In practice, checking programmes are designed to reveal all gross and substantive non plausible data which recur regularly. The detection of rare and irrelevant measurement events is not worthwhile, as the reliability of tests varies in inverse proportion to the magnitude of errors they are designed to detect (WMO, No.488). There is always the risk of missing a non plausible data or mistaking a correct value for a doubtful one, that is, it must be searched for detection and false alarm probabilities trade-off. Flagged values must be inspected manually to avoid exclusion of extreme weather phenomena [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF].

QCPs have been compiled on the basis of experience. Human experience will continue to play a prominent role in two aspects, firstly, taking advantage of the knowledge of the day to day quality control experience to incorporate it in the computer programs that will do the tough work; secondly, undertaking a routine scheme of supervision of the results of the automatic process, assuring their good performance and keeping alert to unexpected new kind of event that could have not been considered in the initial design of the program [START_REF] Guijarro | Data Quality control of the Spanish surface automatic meteorological station in PYREX[END_REF][START_REF] Moore | Analysis of historical ARM measurements to detect trends and assess typical behavior[END_REF].

An example of this second aspect is the case of the measure of diffuse solar component under clear skies; [START_REF] Cess | Consistency tests applied to the measurement of total, direct and diffuse shortwave radiation at the surface[END_REF] found that measures in these conditions from their radiometrical station were below the quality control low-limit calculated from atmospheric models. Further investigations showed that the problem was not the QCP limit value but the infrared loss of the instrument, which causes too much low measures. A procedure was proposed for the correction of the readings of these instruments [START_REF] Peppler | Quality Assurance of ARM Program Climate Research Facility Data Department of Energy[END_REF].

In this section we are going to define the basic statistical parameters since they are implicit in the QCPs as well as to explain the fundamental of these QCPs found in the references.

.

Basic statistical parameters

The basic statistical parameters (mean, maximum, minimum and standard deviation) are used implicitly in these general QCPs. The most useful and basic statistics for an array of n values of a given parameter are their expected or mean value, standard deviation and their maximum and minimum value (ESRA, 2000).

 The expected value of x, E(x), more usually referred as the average or mean value, enables a user to assess the mean level of the x values. Its mathematical definition is:

( )

x Ex n = å (Eq. -1)
 The standard deviation of x (in respect to its average), (x) can be efficiently computed as:

( ) ( ) ( ) ( ) 2 2 1 x E x E x n1 s = - - (Eq. -2)
The standard deviation of a series of values is a good indicator of the variability in the series. However this statistic should only be applied to series of stationary values, with no underlying trends. For example, computing the standard deviation of a monthly series of clearness index KT (that is, the ratio of global horizontal irradiance with respect the horizontal extraterrestrial irradiance) has some meaning, but there is no much sense in computing the standard deviation of a yearly series of daily global irradiance or of daily series of global hourly values, as the both present strong temporal trends (respectively, seasonal and daily trends).

Finally, the extreme values are often used for evaluating the range of x, but also as actual input to design methods; for instance, photovoltaic systems are often sized for achieving a minimum loss-of-load probability (i.e. the probability of failure to deliver the expected daily amount of energy), and thus the minimum expected irradiance levels during daylight time are relevant for design methods. On the contrary, cooling and ventilation systems for buildings are an example of systems that must be sized taking into account the maximum levels of irradiance.

.

QCPs based on redundancy

The more basic QCP is the redundancy between measures: having two instruments for measuring the same meteorological variable must have the same results within the coupled uncertainty of both instruments [START_REF] Guijarro | Data Quality control of the Spanish surface automatic meteorological station in PYREX[END_REF]. Nevertheless, this is a basic but very expensive mean for QC and, very often, stations have no twin devices.

.

QCPs based on limits within a range

The quality control of observations is guided by basic physical principles and it may also take into account statistical knowledge on the spatial and temporal variability of these variables (ESRA, 2000;[START_REF] Geiger | A web service controlling the quality of measurements of global solar irradiation[END_REF]. Meteorological variables seldom reach these natural limits. In only some scarce cases it is even possible to pass these limits in very particular and local situation, but only for a short time period, as some seconds until one or two minutes. For example, the irradiance that reaches the Earth surface normally should normally be less than the irradiance at the top of the atmosphere. Nevertheless, there exist cases where sunlight reflected by very reflective clouds around the Sun induces the radiometer to measure values greater than the extraterrestrial irradiance.

The first developed and the most extensively used algorithm is the range check that simply compares measurement values against previously defined limit values.

Range checks can be divided into checks based on extrema and checks based on rare observations. Limits for these ranges have been established on the basis of analyses of distributions, examination of climatological statistics and extreme weather events, as well as using general meteorological theory and experience [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF].

The figure 1 illustrates the choice for the limits based on extrema and those based on rare observations. This is the frequency distribution of 1-minute time series of temperature for the BSRN station of Payerne (Switzerland). The great amount of data is between the dotted lines, which are the percentile 1 % and 99 %, respectively. They are one possible choice as QCP based on rare observations. For QCPs based on extrema, when the standard deviation, , has a meaning (see section 3.1), they can be chosen as several times ; if not, other means based on experience may be used for their choice. .

QCPs based on extrema

In the frame of the ENDORSE project, limits for the range check based on extrema have been chosen for the whole geographical area of interest, making QCPs independent of location and setting them broad and general.

In some cases, the range limits depends on the time during the day: the range is not constant with for all possible values of the variable. This is the case, for example, of maximum and minimum range limits determined for irradiance solar components (cf. Table -2). On the contrary, for temperature and wind speed, the range limits are constant, independently of the time during the day.

Table -2 resumes the limits based on extrema for the pyranometric and meteorological variables used in ENDORSE, for 1-min average data series (except for wind speed, which is 2-min average data series).

.

QCPs based on rare observations

The main idea is to estimate the magnitude of the limit value to fulfil the criterion that only a small quota of all data were allowed to exceed these limits (in the lower and upper part of the data distribution). The reason to use limits based on rare observations is that, very often, erroneous data values do not exceed the limits based on extrema even though they are in error. In this way, more measurements can be flagged as suspicious before dissemination. Unfortunately, this does not prevent true values from being flagged [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF].

Values outside of limits based on rare observations are not necessarily non plausible; they must be studied carefully by the station manager or the downstream users to decide if they are actually plausible or not, and therefore, acceptable or not for his purpose. For example, in irradiance databases for sub-hourly average time periods it is possible to find some extremely high values for the solar global component. They are due to broken high, thin clouds, which occur relatively very frequently. The diffuse component is the responsible of these high global values, and not the direct component. In the Figure -3 it has been added the envelope of the horizontal irradiance at the top of atmosphere (GHItoa), the light-grey surface. As we have mentioned above, some measured data are greater than this envelope. The distribution of these data is scattered over the year and over the time in the day, there is no structure in this data except for the sunrise and sunset hours, when the diffusion of irradiance by the atmosphere results in measured data greater than zero while the sun is under the horizon (it is seen as a blue line for very low irradiance values in the figure).

Thus, for the case of irradiance, other range limits have been proposed. The BSRN organization proposes wraparound surfaces that they are, roughly, 1.2 and 1.5 times this irradiance at the top of atmosphere, GHItoa, plus a constant, as range for rare observations limits and extrema ones, respectively (see Tables -2and -3). [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF] propose as range limit 1.2 times the normal irradiance at the top of the atmosphere (corrected from Sun-Earth distance), I 0 , that is, without the projection on the horizontal plane. We have compared this limit with the limits proposed by the BSRN. For the comparison we have chosen to plot a cross-sectional view of the Figure -3. The figure -4 is this cross-sectional view for the same time of the day (8 h, UT) for all along the year, where it has been added the other range limits mentioned. This figure gives a better idea about their gap respect the measurement values, for the measurements from Payerne, at 8 h (UT) during the year 2009.

As we can see in this figure, the limit proposed by Muneer (light-blue line) is a physical version of the limit proposed by the WMO, who suggest a constant limit of 1600 W m -2 for all day long and for all the days in the year (WMO, No.488).

When we plot this kind of graph for midday, again all along the year (Figure -5), we can see that the gap between measured data and the BSRN limit based on extrema is too large, larger than the limit proposed by Muneer based on the normal irradiance at the top of atmosphere I 0 . This is the reason why we propose, in the present report, to choose the range limit based on extrema as the minimum between the two mentioned limits. Nevertheless, we find useful to preserve the lower limits to flag data greater than them: in this case, these data should always be verified.

Note that in the Figure -4, the normal irradiance at the top of the atmosphere is slightly greater in winter than in summer in the case of Nord Hemisphere, since the distance to Sun is smaller in winter than in summer. For the South Hemisphere this trend is the opposite, greater in summer than in winter.

Figure -4: Illustration of different range limit controls for global horizontal irradiance.

Black line is the 1-min average time series. Pink line is the horizontal irradiance on top of atmosphere. Green line is the BSRN limit range based on rare observations. Blue line is the BSRN limit range based on extrema. Light blue line is the 1.2 times the normal irradiance at the top of atmosphere, range proposed by [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF]. With the same idea to illustrate the range limits, we show in Figure -6 the range limits proposed by the BSRN organization for normal direct irradiance, BNI. In this case, 1-min data series has been plotted, for 7 h (UT) all along the year and also for 12 h (UT). Both limits have been retained as quality control for ENDORSE project. Similarly, limits proposed by the BSRN organization as well as from [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF] for 1-min diffuse irradiance (DHI) have been plotted in Figure -7. As for global irradiance, we propose to truncate the BSRN limit based on extrema with the proposition from Muneer when the later is smaller than the former (solid red line in the Figure -7, on the right). For the hourly time average time series, care must be taken with the computation of these limits for QC of irradiance. Commonly the time associated to an hourly average data is the time at the end of the integration period, while the average is done for the whole hour. This fact has some drift effects in the sunrise and sunset time, for example. The limits should be computed for the middle of the hour and not for the end of it. Figures -8 and -9 illustrate the drift effect in limit values in relation to this matter. For morning hourly averages left), limits compute at the end of the period (dotted lines) are greater than they should and, the opposite, in the afternoon right), they are smaller than they should. Note that for noon values (Figure -9), there is almost no difference. Note that, in Table -6, for hourly average values of global irradiance there is another QCP with respect to 1-min average QCPs. For 1-min average values, the local configuration of clouds may yield in values greater than the horizontal irradiance at the top of atmosphere. For hourly average values this event is much less likely (it would mean that the cloud position relative to the Sun has been kept for several minutes, which is unlikely).

For global horizontal irradiance, for the daylight hours (that is between the sunrise and sunset times) also a minimum value has been proposed by [START_REF] Geiger | A web service controlling the quality of measurements of global solar irradiation[END_REF]. This minimum value was set up according to the analysis of the collected data and to the minima of clearness index found in the last and previous editions of the European Solar Radiation Atlas (ESRA, 2000). A global irradiance value of 0.03 times the horizontal extraterrestrial at the top of atmosphere represents a heavily overcast sky. Diffuse irradiance, for daylight hours, share the same minimum than for global irradiance, due to, for overcast conditions, diffuse has nearly the same value than global irradiance, within the precision of the measurement device. Moreover, in general, for irradiance values, for low solar elevation angles there are some refraction and diffusion effects by the atmosphere that are hardly modeled. The limits of the QCP proposed for irradiance values have been validated for different solar altitude angles, depending on the reference: [START_REF] Geiger | A web service controlling the quality of measurements of global solar irradiation[END_REF] use solar altitudes greater than 2°; [START_REF] Kendrick | Guide to recommended practice of daylight measurement[END_REF] is more restrictive and use radiation data only above 4°; [START_REF] Younes | Quality control of solar radiation data: present status and proposed new approaches[END_REF] propose solar altitudes greater than 7°, which has been adopted recently for [START_REF] Ruiz-Arias | Proposal of a new regressive model for the hourly diffuse solar radiation under all sky conditions[END_REF]. In the frame of this report, with the target of generality, we recommend also to apply the QCP for radiation values for solar altitude angles greater than 7°. The Sun covers 15° in the Sun-path every hour, so solar elevation angle greater than 7° means that the Sun is over the horizon at least thirty minutes ago, which permits for hourly averages to have a more representative value for irradiation components for the sunrise and sunset hours.

For temperature values, ranges have been selected from the WMO (WMO, No.488), which are based on the extrema records of temperature on the Earth surface. In fact, the minimum temperature recorded was achieved in Antartica2 in 1983, -89.6 °C, while the maximum value was achieved in Lybia3 in 1922, 57.8 °C.

For wind speed, when a maximum value is given, it is difficult to know exactly its meaning. Most weather agencies use the definition for sustained winds recommended by the WMO, which specifies measuring winds at a height of 10 m for 10-min average time series. However, the United States National Weather Service defines sustained winds within tropical cyclones by averaging winds over a period of one minute, measured at the same 10 m height. This is an important distinction, as the value of a 1-min sustained wind is 14 % greater than a 10-min sustained wind [START_REF] Sampson | Tropical cyclone forecasters reference guide. Chapter 6, Tropical Cyclone Intensity (section 2)[END_REF]. In the present document, we adopt the ranges recommended by WMO (WMO,No.305) for QCP based on extrema and on rare observations for WS, 2-min average time series. Tables -2 and -3 are extracted from Table -6, where all the QCPs for all variables used in ENDORSE and for all the average time periods are shown.

Variable

.

Step QCPs

The aim of the step checks is to verify the rate of change, to detect unrealistic jumps or stagnation in values. The check is best applicable to data of high temporal resolution as the correlation between the adjacent samples increases with the sampling rate (WMO, No.488).

A step check is a temporal check that uses a climatological record of how much variables can change within a certain period of time. For some variables, the limits depend on climate conditions while for others the changes may be less sensitive to local climate [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF].

Of course, the first value which will be used as a starting reference cannot be tested by this procedure. Nevertheless, if this first data has passed the other controls, it will be useful as "plausible value", so it will be useful to be used as reference in the step control.

Sub-hourly and hourly step QCPs are extracted from WMO (No.448), Zahumensky ( 2004) and [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF].

For wind speed, step QC for hourly data series is based on the procedure of NDBC ( 2009).

The standard time continuity check developed at NDBC is based on variogram-based models: these variograms are defined as the expectation of square increment of a widesense stationarity stochastic process between two instants separated by a given time lag.

For wind speed, step QC for hourly data series is based on the procedure of NDBC, 2009.

The standard time continuity check developed at NDBC is based on the following expression:

( ) T 2 1 R(T) s = s - (Eq. -3)
where σ Τ is the standard deviation about the mean difference between measurements at a specific time and the corresponding measurements Τ hours later, x(t+ Τ ). σ is an estimate of the standard deviation of an ensemble of measurements, and R(Τ) is the autocorrelation function of an ensemble of measurements for a time lag, Τ. Statistics were gathered for a number of stations ranging from the Gulf of Alaska to the Gulf of Mexico. It was determined that there is an approximate linear relationship between R(Τ) and Τ for values of Τ less than 12 h. Therefore, σ was recast as follows:

T cT s = s (Eq. -4) This is a practical representation of the general change of a normally distributed meteorological or oceanographic variable with time. NDBC has calculated c equal to 0.58 yielding the following expression:

T 58 . 0 T    (Eq. -5)
This check compares the difference between the last acceptable measurements with the current measurement, Δx, with σ Τ . If Δx is greater than σ Τ , then the measurement is flagged and further investigation is recommended [START_REF] Ndbc | Handbook of Automated Data Quality Control Checks and Procedures National Data Buoy Center[END_REF]. Sigma has an empirically value of 25 m s -1 .

The underlying assumption of wide-sense stationarity is not strictly and directly applicable to all time series of meteorological data, for all time scales: Quality check derived from these variogram models should be then particularized and calibrated for each case. This is the reason why we did not consider these types of quality check for the other meteorological variables.

.4.6.1. Check on a maximum variability between two following values

The table -4 sums up the step limits for the maximum change between two following observations (WMO, No.488) for sub-hourly time series. For wind speed, the time limit is aimed at 2-min average time series: .

Variable Max. Change Unit GHI 1000 (W m -2 ) BNI - (W m -2 ) DHI - (W m -2 ) Temp 3 (°C) Hum 10 (%) WS 20 (m s -1 )

Check on a minimum variability within a given time interval

This is a persistence test, adequate for sub-hourly average time series, when the measurement of the variable has been done for at least 60 min. If the 1-min values do not vary over the past 60 min (for humidity, 120, as we explain below) by more than the specified limit, then the current 1-min value fails the check (Zahumensky, 2004;WMO, No.488).

The limits shown in the Table -5 come from the WMO and are applicable for the whole Earth surface (WMO, No.488).

Variable

Min. Change Unit GHI - (W m -2 ) BNI - (W m -2 ) DHI - (W m -2 ) Temp 0.1 (°C) Hum 0.1 (%) WS 0.5 (m s -1 )

Table -5: Minimum change within 1 h for 1-min observations except for humidity which is within 2 h.

The case of relative humidity is a particular case. In this QCP we have found that the limits proposed in the references where not adequate any more. In fact, the WMO (WMO, No.488) proposition for this limit is a minimum change of 1 % in one hour. Nevertheless, after our check with data from the BSRN organization, the percentage of flagged data with this limit was more than 10 % for every year and location checked.

When a specific QCP flags a very large amount of data, this fact may be an indication that what must be revised is not this large amount of rejected data but the QCP. In this QCP we have found an issue about the improvement of quantization step of the measurement instruments. For the time when this limit was proposed by the WMO (1977) the quantization step for humidity measurements was probably not better than 1 %. In the years after 1977 until now, technology has been improved, so the quantization step of current measurement instruments gets tenths of the unit (0.1 %). So, we propose a narrower limit for this QCP for humidity, which is expressed in the Table 4 (also in Table 5). In this sense also, we proposed this minimum change within two hours instead of only one, since we would like to propose QCP adequate for the whole geographical area of interest of ENDORSE project and it includes some areas with very stable humidity values during early hours in the day. .

Consistency QCPs

When the QCP uses two or more variables, it is named a consistency check. Both, two colocated but different variables or the same variable from two different locations may inform about the plausibility of the data. The former one is named internal consistency check; the latter one is named spatial consistency check.

.

Internal Consistency Checks

In an internal consistency check an observation is compared with at least other co-located parameter value to see if they are physically or climatologically consistent, either instantly or for time series according to adopted observation procedures [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF].

For irradiance time series, when the three components of solar radiation are available simultaneously, the consistency check proposed by most of the references is, within an authorized bias:

GHI = BHI + DHI (Eq. -6)
where BHI is the short-wave horizontal direct irradiance at Earth Surface, computed from BNI in relation with the solar zenith angle, SZA:

BHI = BNI cos(SZA) (Eq. -7)
There are several versions for this authorized bias: for hourly time series, [START_REF] Molineaux | Automatic Quality Control of Daylight Measurements: Software for IDMP Stations International Daylight Measurement Programme[END_REF] propose 100 W m -2 as a margin; [START_REF] Kendrick | Guide to recommended practice of daylight measurement[END_REF] propose 15 % of the value of GHI, for solar elevation angles greater than 4° and GHI > 20 W m -2 ; WMO (No.557) propose a margin of 5 % but they say that this margin is adaptable. For sub-hourly time series, BSRN [START_REF] Long | BSRN Global Network recommended QC tests, V2.0 Baseline Surface Radiation Network (BSRN)[END_REF] proposes this type of QCP only for GHI > 50 W m -2 and, depending on solar zenith angle, the margin allowed is 8 % or 15 % of GHI value (see Table 5). In this report we maintain the authorized bias proposed by BSRN for 1-min time series and from [START_REF] Kendrick | Guide to recommended practice of daylight measurement[END_REF] for hourly time series.

The authorized bias is naturally greater for hourly time series than for 1-min time series. For the calculation of BHI it is needed the SZA for the whole hour; since SZA varies in time, this calculation introduce per se a bias which is greater for hourly average than for 1-min average time series.

Note that the QCPs proposed by BSRN are defined for an interval 0° < SZA < 93°, which is larger than the interval recommended in this document, 0° < SZA < 83°. In fact, in the automated QC developed for ENDORSE, we apply the BSRN QCPs as they are defined originally, and later, we add another column in the file to flag data that corresponds to SZA between 83° and 93°: it is up to the user if he will use these data for low solar elevation angles or not.

Another internal consistency check is proposed when only two solar components are available, GHI and DHI. For hourly time series, [START_REF] Younes | Quality control of solar radiation data: present status and proposed new approaches[END_REF] and WMO (No.557) propose that DHI must be always less than or equal to GHI. On the contrary, de [START_REF] De Miguel | Diffuse solar irradiation model evaluation in the North Mediterranean Belt area Solar Energy[END_REF] propose that DHI may be slightly greater than GHI (10 % of the value of GHI). DHI values slightly greater than GHI are possible since normally they are not registered by the same instrument. Also, when corrections because of the shadow system is applied (shadow band correction or shadow disc correction), the correction may yields slightly greater values than the GHI ones in overcast situations. That is the reason why we proposed the last version than the other one.

For 1-min time series, the BSRN organization proposes an authorized bias, dependent on the solar altitude angle again and only for GHI > 50 W m -2 , between 5 % and 10 % of GHI value (Table -6).

.

Spatial Consistency Checks

For carrying out spatial consistency checks, it is necessary to have instantaneous data from another station sufficiently near to compare them. In these cases, more exact statistics can be applied and different kinds of data can be combined, e.g. by kriging interpolation, HIRLAM analyses, mesoscale analyses, radar and satellite data [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF]. Other spatial consistency checks that can be found in the references are statistical optimal weights, fixed weights, median, simple average, Thiessen weighted average, etc.

Each pair of neighbouring observations is compared; if they agree they are both likely to be either correct or both non plausible. If they disagree, one of them is likely to be correct, the other non plausible (WMO, No.305).

MESoR project4 and IEA SHC5 Task 36 have done a survey about the interest from users by questionnaires and analysis of request of meteorological data from web sites6 . In the MESoR survey, users clearly prefer time series (one or more sites) to maps (i.e. gridded values).

According to IEA SHC Task 36, both types seem useful to respondents. Nevertheless, even for IEA SHC Task 36, the majority of data request are for time series and not for maps [START_REF] Hoyer-Klick | User's guide to the SoDa and SOLEMI services[END_REF]. Due to these facts, the QCPs selected for ENDORSE project are only for individual time series and no for spatial distributed data. .

Summary of innovations in QC from ENDORSE Project

As it has been seen in the previous sections, the QCPs proposed in the table -6 have been taken from -or are based on-different sources from European projects or published articles. Among them, the MESoR Project [START_REF] Hoyer-Klick | Management and exploitation of solar resource knowledge[END_REF] has realised a great effort aiming at removing the uncertainty and improving the management of the solar energy resource knowledge. In MESoR project, the results of past and present large-scale initiatives in Europe, has been integrated, standardised and disseminated in a harmonised way to facilitate their effective exploitation by stakeholders. MESoR has proposed a standard QC based on the BSRN recommendations for hourly and sub-hourly solar time series and based in [START_REF] Geiger | A web service controlling the quality of measurements of global solar irradiation[END_REF] for daily solar time series. It also introduces an additional check based in the comparison with a clear sky model that has not been tackled in the present document.

In this subsection we try to depict clearly the innovations introduced in the proposed QC from ENDORSE Project with respect to MESoR one.

As we could find in the references, except for the Finally, for QCPs for hourly and sub-hourly time series of irradiation, in the QCPs based on extrema, there are also some differences between MESoR and ENDORSE projects. First, the minimum value in the range of plausibility of the QCP based on extrema has been established as 0.03GHItoa instead of an absolute negative threshold set to -4 W m -2 , which is the low limit range in MESoR project. The reason why it has been selected this minimum is that QCPs have been established for daylight time, with a solar elevation angle greater than 7°, and 0.03GHItoa is the minimum radiation value found for daylight hours in the development of the European Solar Radiation Atlas (ESRA, 2000). The second difference is the maximum of this QCP based on extrema, which is defined, in the present document, as the minimum between the maximum based in the BSRN recommendation and the maximum recommended by [START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF]. .

OUTPUT QC REPORT

After checking the plausibility of the data, the automated QC yields two types of new information. First, a new data file is generated with the additional columns of flagged data by each of the QCP. Second, an output QC report is built. This report supply some graphs, histograms and percentages of values which have been flagged by each of the QCP. This output report is aimed at helping the user to interpret the results after de quality check.

If a very large amount of data have been flagged, the user may check that all the metadata introduced are correct: a mistake could have been done when introducing the geographical coordinates, for example, (typically, the use of radians instead of degrees), or also in the unit of the variables, typically, wind speed in km h -1 or solar radiation in energy units (MJ cm -2 or Wh m -2 ) instead of power units (W m -2 ).

The QCPs and the output QC report have been implemented in Matlab©. The output report has two possible formats, pdf or html. The list of output graphs and elements are the following:

1. Horizon representation of the location derived from SRTM digital elevation model. 2. Horizon derived from normal direct irradiance measurements (only for 1-min time series).

3. One-glance graphics representation of data and of flagged data for each of the QCP. 4. Percentage of flagged data for each of the QCP. 5. Histograms of flagged data for each of the QCP. 6. Histogram of the length of missing data periods.

The different sections of the output quality report are explained as follows.

.

General Information

The output QC report begins with the general information corresponding to the measurements: name of the station, geographical location (latitude, longitude and elevation according to SRTM digital elevation model) and finally, the beginning and the end of the time period of measures.

.

Horizon graphics

Two horizon representations are offered in the output report, one from the digital elevation model SRTM [START_REF] Farr | The Shuttle Radar Topography Mission[END_REF], the other one derived from 1-min normal direct irradiance measurements, if available. The x axis in the horizon graph is the azimuth in degrees, beginning, for the North Hemisphere, from zero for the North, 90° for the East, 180° for the South and 270° for the West. In the y axis there is the elevation angle, also in degrees, from zero for the horizontal plain, to 90° for the zenith point in the sky.

Horizon from the digital elevation model SRTM gives the "far" horizon from the meteorological station. It is useful to have an idea of possible far obstacles for the sun light. Horizon derived from normal direct irradiance measures gives the near horizon, which informs about possible near obstacles, as the existence of a building near the measure station, which is not represented by SRTM. It corresponds to the average within a year of measured BNI in two-dimension azimuth-elevation bins.

An example of this representation is shown in the Figure -11, where very low values of normal direct irradiance are registered in the morning, likely due to an obstacle for the sunlight path, near to the station. .

One-glance graphics

This is one of the common graphic for all the variables: irradiance, temperature, humidity and wind speed. The graphical representation of data is done in a way to have an overview of the data series for all year-long at one glance. The x axis is the day of the year (from 1 to 365 or 366) and the y axis is the time in the day (1440 lines in the case of 1-min data series; 24 lines in the case of hourly data). Thus, every column is one day of the year and the day begins at the top of the graph and ends in the bottom. Every line in the graph is the same time for all the days of the year. The colour code gives the value of the measure thanks to the associated colour bar. This kind of graph is useful for the end user to detect, for example in irradiance data, any problem in the expected symmetry with respect to the noon (the morning must be roughly symmetry to the afternoon) and with respect to the June month (the first half of the year must be roughly symmetry to the second half). The Figure 12 shows clearly a discontinuity in the measures; this kind of discontinuity can be explained by a problem in the registration of the time. Missing data for the whole day are also easily recognisable (vertical lines set to zero).

.

Binary graphics

These graphs, based on the same representation of one-glance graphics, are aimed at showing which data have been flagged by one specific QCP. They are only two possible values: zero, that means that the data has not been flagged, and one, which means that the data has been flagged as non plausible for this specific QCP. This binary graph is created only if at least 1 % of data flagged by the QCP. There is one binary graph for each variable and QCP. The fraction of data flagged for each QCP is shown in terms of percentage. Figure 13 is an example of this kind of graph. .

Histograms

The frequency distribution of each variable is also offered in the output report. This kind of graphs may help in detection of blocking sensors, for example. When multi-modal distributions are found in the frequency distribution graph, this may signify trend shifts that may warrant investigation of possible data quality issues. In the Figure 14, a significant shift is detected in the second half of 2005. The current daily inspections of such data do not always flag such subtle changes in the housekeeping data [START_REF] Peppler | Quality Assurance of ARM Program Climate Research Facility Data Department of Energy[END_REF][START_REF] Moore | Analysis of historical ARM measurements to detect trends and assess typical behavior[END_REF]. [START_REF] Moore | Analysis of historical ARM measurements to detect trends and assess typical behavior[END_REF].

Finally, the histogram for each variable of the flagged data after the application of all the QCP is also printed in the output report. The aim of this graph is helping in detection of values too much present and flagged, which may means a problem in the sensor.

.6. CONCLUSION AND PERSPECTIVES

Data quality is a measure of how well data serve the purpose for which they were produced (WMO, No.488), ensuring that released data is of a known and reasonable quality suitable for scientific research [START_REF] Moore | Analysis of historical ARM measurements to detect trends and assess typical behavior[END_REF].

The task 3001-3 is aimed at assessing the plausibility of data that will be used in ENDORSE project to guarantee the quality of data which will be used later. Data that are really far away from usual trend are the target of the quality control (QC) used in this document. The detection of rare measurement events is not worthwhile it this stage of QC.

Finer quality controls are possible for reduced geographical areas. Frequency distributions categorized by month or season will be used to establish valid data ranges specific to those time domains [START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF], keeping in mind that statistics alone are not sufficient for establishing limits and valid data ranges: an understanding of both the physics of the atmosphere with respect to the quantity being measured and also the measuring instrument must be well understood. Such limits should improve problem detection capability and perhaps provide the ability to identify limits that can distinguish between a performance warning and a performance failure [START_REF] Peppler | Quality Assurance of ARM Program Climate Research Facility Data Department of Energy[END_REF].

Other ideas may be studied for finer quality control, as the turbidity deduced from direct normal irradiance, but accurate models of turbidity are necessary for this aspect. [START_REF] Younes | Quality control of solar radiation data: present status and proposed new approaches[END_REF] proposed an internal consistency check for global and diffuse horizontal irradiance based on a two-dimension representation of their ratio with respect to the horizontal extraterrestrial irradiance and the horizontal global irradiance respectively. [START_REF] Ruiz-Arias | Proposal of a new regressive model for the hourly diffuse solar radiation under all sky conditions[END_REF] apply this check and found that a lot of data are rejected. We think that too much data are rejected and we recommend performing further research to refine this check.

We have tried to search for worldwide QC application with the aim of generality. Therefore, these finer controls, only applicable for only some restrictive locations, are out of scope of this document.

Quality control procedures (QCPs) for several meteorological variables (the three components of solar irradiance, ambient temperature, relative humidity and wind speed) and for different time average periods (monthly, daily, hourly and sub-hourly) from the bibliographical references have been selected, analyzed and discussed. Some of the QCPs have been modified, in relation with our experience. For example, for global horizontal irradiance in sub-hourly or hourly averages, QCP based on extrema have been modified with respect to the ranges found in the references, due to the large gap between the limit and the measured data. Also, for relative humidity, minimum step allowed within a specified period

Figure B- 1 :

 1 Figure B-1: Frequency distributions of meteorological variables are studied for each of the variables and average time periods for choosing the limits based on extrema (solid red line) and the limits based on rare observations (dotted red line). .................................................................................................. 17 Figure B-2: Three dimensional representation of 1-min average global horizontal irradiance for Payerne (Switzerland) in 2009. ............................................................................................................. 18 Figure B-3: The same as Figure B-2 where it has been put on top the wraparound limit surface value of the horizontal irradiance on the top of atmosphere. .......................................................................... 19 Figure B-4: Illustration of different range limit controls for global horizontal irradiance. Black line is the 1-min average time series. Pink line is the horizontal irradiance on top of atmosphere. Green line is the BSRN limit range based on rare observations. Blue line is the BSRN limit range based on extrema. Light blue line is the 1.2 times the normal irradiance at the top of atmosphere, range proposed by Muneer and Fairooz (2002). .................................................................................................................. 20 Figure B-5: Choice of the proposed range limit defined as the minimum between BSRN and Muneer limits based on extrema. Colour code lines are the same that in Figure B-4. Solid red line is the proposed range limit for global horizontal irradiance, particularized in this Figure for the midday of all the days of 2009, in the location of Payerne (Switzerland). .................................................................. 20 Figure B-6: Range limits for normal direct irradiance for one minute data series. Blue line: normal irradiance at the top of atmosphere. Green line: BSRN range limit based on rare observations. Black line: measures from BSRN station of Payerne at 7 h (left) and 12 h (right) all along the year 2009. ... 21 Figure B-7: Range limits for horizontal diffuse irradiance for 1-minute average time series. Black line: measures from BSRN station of Payerne at 12h all along the year 2009. Colour code lines are the same that in Figure B-4, particularized for diffuse values shown in the Tables B-2 and B-3. ............... 21 Figure B-8: Drift effect in the computation of limits for QCPs for global hourly irradiance averages for Payerne (Switzerland) in 2009. Colour code lines are the same that in Figure B-4. Solid lines are limits compute in the middle of the hour; dotted lines are limits compute in the end of the hour. On the left, for 8 h for all the days in the year; on the right, for 18 h. In the morning, limits computed at the end of the hour are greater than they should; in the afternoon are smaller than they should. ........................ 22 Figure B-9: Same as Figure B-8 but for midday. The drift effect is almost inexistent at noon. ............. 22 Figure B-10: 1-minute time series data of humidity from the BSRN station of Carpentras (France), 18/09/2008. Red data are flagged by the QCP of the minimum change within 1 h. Nevertheless, further investigations show that these data are plausible. That is the reason why this step quality control has been set within 2 h instead of only 1 h. .............................................................................. 26 Figure B-11: Horizon derived from 1-min time series of normal direct solar irradiance (W m

  Figure B-1: Frequency distributions of meteorological variables are studied for each of the variables and average time periods for choosing the limits based on extrema (solid red line) and the limits based on rare observations (dotted red line). .................................................................................................. 17 Figure B-2: Three dimensional representation of 1-min average global horizontal irradiance for Payerne (Switzerland) in 2009. ............................................................................................................. 18 Figure B-3: The same as Figure B-2 where it has been put on top the wraparound limit surface value of the horizontal irradiance on the top of atmosphere. .......................................................................... 19 Figure B-4: Illustration of different range limit controls for global horizontal irradiance.Black line is the 1-min average time series. Pink line is the horizontal irradiance on top of atmosphere. Green line is the BSRN limit range based on rare observations. Blue line is the BSRN limit range based on extrema. Light blue line is the 1.2 times the normal irradiance at the top of atmosphere, range proposed by[START_REF] Muneer | Quality control of solar radiation and sunshine measurements -lessons learnt from precessing worldwide databases[END_REF]. .................................................................................................................. 20 Figure B-5: Choice of the proposed range limit defined as the minimum between BSRN and Muneer limits based on extrema. Colour code lines are the same that in Figure B-4. Solid red line is the proposed range limit for global horizontal irradiance, particularized in this Figure for the midday of all the days of 2009, in the location of Payerne (Switzerland). .................................................................. 20 Figure B-6: Range limits for normal direct irradiance for one minute data series. Blue line: normal irradiance at the top of atmosphere. Green line: BSRN range limit based on rare observations. Black line: measures from BSRN station of Payerne at 7 h (left) and 12 h (right) all along the year 2009. ... 21 Figure B-7: Range limits for horizontal diffuse irradiance for 1-minute average time series. Black line: measures from BSRN station of Payerne at 12h all along the year 2009. Colour code lines are the same that in Figure B-4, particularized for diffuse values shown in the Tables B-2 and B-3. ............... 21 Figure B-8: Drift effect in the computation of limits for QCPs for global hourly irradiance averages for Payerne (Switzerland) in 2009. Colour code lines are the same that in Figure B-4. Solid lines are limits compute in the middle of the hour; dotted lines are limits compute in the end of the hour. On the left, for 8 h for all the days in the year; on the right, for 18 h. In the morning, limits computed at the end of the hour are greater than they should; in the afternoon are smaller than they should. ........................ 22 Figure B-9: Same as Figure B-8 but for midday. The drift effect is almost inexistent at noon. ............. 22 Figure B-10: 1-minute time series data of humidity from the BSRN station of Carpentras (France), 18/09/2008. Red data are flagged by the QCP of the minimum change within 1 h. Nevertheless, further investigations show that these data are plausible. That is the reason why this step quality control has been set within 2 h instead of only 1 h. .............................................................................. 26 Figure B-11: Horizon derived from 1-min time series of normal direct solar irradiance (W m -2 ) from the BSRN station of Payerne (Switzerland) in 2009, 1-min average data. The red circle shows the very low values likely associated to an obstacle in the sunlight path in the mornings. ....................................... 31 Figure B-12: One-glance graph for global horizontal irradiation where there is an asymmetry in the measurements (marked with the red circle). Missing data for the whole day are easily recognisable as vertical lines set to zero (on the right of the graph). .............................................................................. 31 Figure B-13: Binary graph for 1-min average humidity, for Carpentras station, 2008. Blue colour denotes flagged data for, in this case, minimum step expected within specified period. Axes are the same as for one-glance graphs. ............................................................................................................ 32 Figure B-14: Multi-modal distributions in the frequency distribution graph can signify trend shifts that may warrant investigation of possible data quality issues. Here, a significant shift is detected in the month of June. Mean (green line) and 3 standard deviation values (red lines) are shown for all months, which are shaded gray in the histogram (Moore et al., 2007). .............................................................. 33

Figure - 1 :

 1 Figure -1: Frequency distributions of meteorological variables are studied for each of the variables and average time periods for choosing the limits based on extrema (solid red line) and the limits based on rare observations (dotted red line).

Figure - 2

 2 Figure -2 displays a three-dimension plot for 1-min global irradiance from the Baseline Surface Radiation Network (BSRN 1 ) station of Payerne (Switzerland) in 2009. The intra-year as well as the intra-day trends of the time series are clearly revealed.

Figure - 2 :

 2 Figure -2: Three dimensional representation of 1-min average global horizontal irradiance for Payerne (Switzerland) in 2009.

Figure - 3 :

 3 Figure -3: The same as Figure -2 where it has been put on top the wraparound limit surface value of the horizontal irradiance on the top of atmosphere.

Figure - 5 :

 5 Figure -5: Choice of the proposed range limit defined as the minimum between BSRN and Muneer limits based on extrema. Colour code lines are the same that in Figure -4. Solid red line is the proposed range limit for global horizontal irradiance, particularized in this Figure for the midday of all the days of 2009, in the location of Payerne (Switzerland).

Figure - 6 :

 6 Figure -6: Range limits for normal direct irradiance for one minute data series. Blue line: normal irradiance at the top of atmosphere. Green line: BSRN range limit based on rare observations. Black line: measures from BSRN station of Payerne at 7 h (left) and 12 h (right) all along the year 2009.

Figure - 7 :

 7 Figure -7: Range limits for horizontal diffuse irradiance for 1-minute average time series. Black line: measures from BSRN station of Payerne at 12h all along the year 2009. Colour code lines are the same that in Figure -4, particularized for diffuse values shown in the Tables -2 and -3.

Figure - 8 :

 8 Figure -8: Drift effect in the computation of limits for QCPs for global hourly irradiance averages for Payerne (Switzerland) in 2009. Colour code lines are the same that in Figure -4. Solid lines are limits compute in the middle of the hour; dotted lines are limits compute in the end of the hour. On the left, for 8 h for all the days in the year; on the right, for 18 h. In the morning, limits computed at the end of the hour are greater than they should; in the afternoon are smaller than they should.

Figure - 9 :

 9 Figure -9: Same as Figure -8 but for midday. The drift effect is almost inexistent at noon.

Figure - 10

 10 Figure -10 illustrates values that are flagged by this limit (0.1 % minimum change) when only one hour is checked, data are from the BSRN station in Carpentras (France).

Figure - 10

 10 Figure -10: 1-minute time series data of humidity from the BSRN station of Carpentras (France), 18/09/2008. Red data are flagged by the QCP of the minimum change within 1 h. Nevertheless, further investigations show that these data are plausible. That is the reason why this step quality control has been set within 2 h instead of only 1 h.

  Figure -5 illustrates the selection of this minimum.

Figure - 11 :

 11 Figure -11: Horizon derived from 1-min time series of normal direct solar irradiance (W m -2 ) from the BSRN station of Payerne (Switzerland) in 2009, 1-min average data. The red circle shows the very low values likely associated to an obstacle in the sunlight path in the mornings.

Figure - 12 :

 12 Figure -12: One-glance graph for global horizontal irradiation where there is an asymmetry in the measurements (marked with the red circle). Missing data for the whole day are easily recognisable as vertical lines set to zero (on the right of the graph).

Figure - 13 :

 13 Figure -13: Binary graph for 1-min average humidity, for Carpentras station, 2008. Blue colour denotes flagged data for, in this case, minimum step expected within specified period. Axes are the same as for one-glance graphs.

Figure - 14 :

 14 Figure -14: Multi-modal distributions in the frequency distribution graph can signify trend shifts that may warrant investigation of possible data quality issues. Here, a significant shift is detected in the month of June. Mean (green line) and 3 standard deviation values (red lines) are shown for all months, which are shaded gray in the histogram[START_REF] Moore | Analysis of historical ARM measurements to detect trends and assess typical behavior[END_REF].

QUALITY CHECK OF METEOROLOGICAL DATA .1. TERMS OF REFERENCE

	ACRONYMS
	BHI	Short-wave Direct horizontal irradiance (W m -2 )
	BNI	Short-wave Direct Normal irradiance (W m -2 )
	BSRN	Baseline Surface Radiation Network
	DHI	Short-wave Diffuse horizontal irradiance (W m -2 )
	GHI	Short-wave Global horizontal irradiance (W m -2 )
	GHItoa	Horizontal extraterrestrial irradiance at the top of
		atmosphere (W m -2 )
	HUM	Relative humidity (%)
	I 0	Normal extraterrestrial irradiance corrected from Sun-
		Earth distance (W m -2 )
	QC	Quality control
	QCP	Quality control procedure
	SZA	Solar zenith angle (°)
	Temp	Ambient temperature (°C)
	WS	Wind speed (m s -1 )

Table - 2

 - : QCP based on extrema for sub-hourly average time series (1-min average except for WS which is 2-min average time series). SZA is the solar zenith angle. *For irradiance variables, minimum limits are for daylight time.

		Unit	Minimum*	Maximum
	GHI	(W m -2 )	0.03 GHItoa	Min (1.2*I 0 ,1.5*I 0 *cos(sza) 1.2 + 100)
	BNI	(W m -2 )	0	I 0
	DHI	(W m -2 )	0.03 GHItoa	Min (0.8*I 0 , 0.95*I 0 *cos(sza) 1.2 + 50)
	Temp	(°C)	-90	60
	Hum	(%)	0	100
	WS	(m s -1 )	0	150
	Variable Unit	Minimum *	Maximum
	GHI	(W m -2 )	0.03 GHItoa	1.2*I 0 *cos(sza) 1.2 + 50
	BNI	(W m -2 )	0	0.95*I 0 *cos(sza) 0.2 + 10
	DHI	(W m -2 )	0.03 GHItoa	0.75*I 0 *cos(sza) 1.2 + 30
	Temp	(°C)	-80	50
	Hum	(%)	0	100
	WS	(m s -1 )	0	80

Table - 3

 - : QCP based on rare observations for sub-hourly average time series (1-min average except for WS which is 2-min average time series). *For irradiance variables, minimum limits are for daylight time.

Table - 4

 - : Maximum change between two following observations for sub-hourly average time series

Table - 6

 - : QCPs for all the variables used in ENSORSE Project and all the time average periods.

	Sub-hourly (1-minute average except for WS which is 2-	minute)	QCP based on extrema	0.03 GHItoa < GHI < min (1.2 I0,1.5 I0 cos(SZA) 1.2 + 100)	QCP based on rare observations	0.03 GHItoa < GHI < 1.2 I0 cos(SZA) 1.2 + 50	Step QCP	Maximum step for two following measures: 1000 W m -2	QCP based on extrema	0 < BNI < I0	QCP based on rare observations	0 < BNI < 0.95 I0 cos(SZA) 0.2 + 10	QCP based on extrema	0.03 GHItoa < DHI < min (0.8 I0, 0.95 I0 cos(SZA) 1.2 + 50)	QCP based on rare observations	0.03 GHItoa < DHI < 0.75 I0 cos(SZA) 1.2 + 30	QCP based on extrema	-90 < Temp < + 60	QCP based on rare observations	-80 < Temp < + 50	Step QCP	Maximum step for two following measures: 3 °C	Minimum step over the past 60 minutes: 0.1 °C	QCP based on extrema	0 < Hum < 100	Step QCP	Maximum step for two following values: 10 %	Minimum step over the past 120 minutes: 0.1 %	QCP based on extrema (2-min average)	0 < WS < 150	QCP based on rare observations (2-min average)	0 < WS < 80	Step QCP	maximum step for two following values (2-min average):	20 m s -1	Minimum step over the past 60 minutes	except for no wind periods (1-minute average): 0.5 m s -1	For GHI > 50 (if not, test not possible):	DHI/GHI < 1.05, for SZA < 75°	DHI/GHI < 1.10, for 93° > SZA > 75°	For DHI+BHI > 50 (if not, test not possible)	GHI / (BHI+DHI) ≤ 0.08, for SZA < 75°	GHI / (BHI+DHI) ≤ 0.15, for 75°< SZA <93°
	Hourly		QCP based on extrema	0.03 GHItoa < GHI < min (1.2 I0, 1.5 I0 cos(SZA) 1.2 + 100	QCP based on rare observations	0.03 GHItoa < GHI < 1.2 I0 cos(SZA) 1.2 + 50		QCP based on extrema	0 < BNI < I0	QCP based on rare observations	0 < BNI < 0.95 I0 cos(SZA) 0.2 + 10	QCP based on extrema	+ 50) 0.03 GHItoa < DHI < min (0.8 I0, 0.95 I0 cos(SZA) 1.2	QCP based on rare observations	0.03 GHItoa < DHI < 0.75 I0 cos(SZA) 1.2 + 30	QCP based on extrema	-90 < Temp < + 60	QCP based on rare observations	-80 < Temp < + 50	Step QCP	Maximum step for two following measures: 8 °C	QCP based on extrema	0 < Hum < 100	Step QCP	Maximum step for two following values: 30 %				Step QCP	maximum step for two following values: 15 m s -1						For GHI > 20 W m -2 (if not, test not possible)	GHI / ( BHI + DHI) = 0.15	DHI ≤ 1.1 GHI
	Daily		QCP based on extrema	0.03 GHItoa < GHI < 1.2 I0	QCP based on rare observations	0.03 GHItoa < GHI < GHItoa			QCP based on extrema	0 < BNI < I0			QCP based on extrema	0.03 GHItoa < DHI < 0.8 I0				QCP based on extrema	-90 < Temp < + 60		QCP based on rare observations	-80 < Temp < + 50						QCP based on extrema	0 < Hum < 100														DHI ≤ 1.1 GHI
	Monthly		QCP based on extrema	0.03 GHItoa < GHI < 1.2 I0	QCP based on rare observations	0.03 GHItoa < GHI < GHItoa			QCP based on extrema	0 < BNI < I0			QCP based on extrema	0.03 GHItoa < DHI < 0.8 I0				QCP based on extrema	-90 < Temp < + 60		QCP based on rare observations	-80 < Temp < + 50						QCP based on extrema	0 < Hum < 100														DHI ≤ 1.1 GHI
				GHI (Wm -2 )		BNI (Wm -2 )	DHI (Wm -2 )				Temp (°C)						Hum (%)					WS (m s -1 )				Cosistency checks

  WMO, generally QCPs are meant for either only radiation values or only "other" meteorological variables. For example, MESoR Project has only QCPs proposed for solar radiation time series. On the contrary,[START_REF] Vejen | Quality control of meteorological observations. Automatic methods used in the Nordic countries[END_REF] has only QCPs for temperature, wind and humidity time series. ENDORSE has attempted to propose a QC for a more complete set of energy-related meteorological variables including both radiometrical and meteorological ones.Moreover, in this document, there is a classification of QCPs for four different time-average periods, while in the references, usually, are aimed at a specific time average period. ENDORSE Project enlarges the radiation QCPs proposed by MESoR Project adding QCPs for monthly time series. Daily radiation QCPs are taken from[START_REF] Geiger | A web service controlling the quality of measurements of global solar irradiation[END_REF] as for MESoR Project as well as the consistency check for solar radiation time series.The step QCPs (based on the increment between consecutive observations) are another additional control for quality present in ENDORSE Project with respect to MESoR Project. As well, there is an additional Quality Control flag for radiation, named as "QCPs based on rare observations". The objective of this supplementary QCP is to detect data values that are possible, but only in a very small quota, thus, needing further verification before accepting them or not as plausible data.

-Page Intentionally Left Blank -

www.bsrn.awi.de

http://hypertextbook.com/facts/2000/YongLiLiang.shtml

http://hypertextbook.com/facts/2000/MichaelLevin.shtml

http://project.mesor.net

http://www.iea-shc.org/task36

as SoDa web service, www.soda-is.com.

.5.6. Example of a draft output QC report have been modified with respect to its reference, due to, probably, progresses done in technology that permits more accurate measurements.

With the application of this QC, ENDORSE will have trustful meteorological data in order to achieve its objectives.

The same QC may be applied to the products of the GMES Core Services in order to establish their quality for further exploitation of this quality in the whole chain. In the MESoR survey, all respondents underlined the importance of the Web as a mean to deliver information. They believed that accessing to the data by the Web makes things easier and faster. Indeed, it would not be then necessary to store information and applications in their own information systems, thus reducing the burden in ICT expertise and hardware [START_REF] Hoyer-Klick | User's guide to the SoDa and SOLEMI services[END_REF]. Therefore it is foreseen to create these procedures as Web services for a further exploitation of these by the scientific community at large. This potential tool could be one of the future contributions of this document for general users and for the scientific community.