Evaluation of the Eta Simulations Nested in Three Global Climate Models

To 
provide long-term simulations of climate change at higher resolution, Regional 
Climate Models (RCMs) are nested in global climate models (GCMs). The objective 
of this work is to evaluate the Eta RCM simulations driven by three global 
models, the HadGEM2-ES, BESM, and MIROC5, for the present period, 1961-1990. 
The RCM domain covers South America, Central America, and Caribbean. These simulations will be used for assessment of climate 
change projections in the region. Maximum temperatures are generally 
underestimated in the domain, in particular by MIROC5 driven simulations, in summer and winter seasons. Larger spread 
among the simulations was found in the minimum temperatures, which showed mixed 
signs of errors. The spatial correlations of temperature simulations against 
the CRU observations show better agreement for the MIROC5 driven simulations. 
The nested simulations underestimate precipitation in large areas over the 
continent in austral summer, whereas in winter overestimate occurs in southern 
Amazonia, and underestimate in southern Brazil and eastern coast of Northeast 
Brazil. The annual cycle of the near-surface temperature is underestimated in 
all model simulations, in all regions in Brazil, and in most of the year. The 
temperature and precipitation frequency distributions reveal that the RCM and 
GCM simulations contain more extreme values than the CRU observations. 
Evaluations of the climatic extreme indicators show that in general hot days, 
warm nights, and heat waves are increasing in the period, in agreement with 
observations. The Eta simulations driven by HadGEM2-ES show wet trends in the 
period, whereas the Eta driven by BESM and by MIROC5 show trends for drier 
conditions.


Introduction
The major tool to study future climate change is the global climate models (GCMs). To represent climate variability, these global models require having the ocean, atmosphere, and land surface in a coupled system. From the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4) [1] to the Fifth Assessment Report (AR5) [2], these global models have gone through improvements and added physics complexity. In the AR5, the global models were evaluated and showed a general improvement over the AR4 models, especially in terms of precipitation, in which spatial pattern correlation increased from 0.77 to 0.82 [3].
The AR5 GCMs start their simulations in modern industrial period, 1850, and run until 2005; from 2006 the simulations run using the Representation Concentration Pathway scenarios, generally stabilizing at 2100. To run for such a long period, grid size is a computational constraint. Generally, the resolution of coupled ocean-atmosphere models is about 100 -300 km. Despite the complexity of the physics processes incorporated to the latest versions of the global models, their resolutions in general may not be able to capture details of the underlying surfaces that can be important for assessment of the impacts of future climate change at local scale, for example, impacts on the urban areas, on major crop production, etc.
Regional climate model (RCM) nested to GCMs play the role of providing the details needed for local impact studies. The large-scale features are driven through the lateral boundaries. It is expected that due to resolution, the RCM may be able to improve over the driver [4] and capture more accurately the amplitude of a phenomenon [5]. The resulting climate simulated by the RCM is a combination of the climate informed by the GCM driver and its inner solution. The uncertainty through the lateral boundaries may be considered by including perturbed members of a global model as in [6]. On the other hand, [7] showed some errors shared by some RCM run over South America, driven by different GCMs. RCMs in general underestimate the precipitation and temperature over most of South America, but over the Southern parts of the Andes, it is overestimated. Temperature generally exhibited positive bias in the La Plata Basin area. These errors hint some contribution from the land-surface schemes, which are probably poorly calibrated for those regions due to the scarce observational data. In [7] different RCMs were driven by Era-Interim reanalysis [8] dataset. In this work, different three GCMs will drive the same RCM.
Prior to use the model as a tool for studying the future impacts of the simulated climate change, the model systematic errors of the present climate simulations need to be estimated so we can attribute some degree of confidence to the future climate scenarios. As part of the effort to contribute to the elaboration of the National Communication to the United Nations Framework Convention of Climate Change (UNFCCC) and to contribute to the assessment of impacts on strategic country's issues, simulations at higher resolution were carried out using INPE (Brazilian National Institute for Space Research)'s RCM, the Eta Model. The objective of this work is to evaluate the Eta simulations nested in three GCMs: the HadGEM2-ES, BESM, and MIROC5, for the present period, . The period between 1961 and 1990 is chosen as present climate period so that the simulations of temperature and precipitation can have an additional comparison against the available climatology constructed by the Brazilian National Meteorological Institute [9]. The evaluation is based on mean fields, frequency distribution, and trends of climatic extreme indicators. The projections of the future climate change over South America are assessed in a companion paper [10].

Data and Methodology
Three global coupled ocean-atmosphere models were considered for driving the RCM, and were taken as a minimum number of members to construct an ensemble. This poor's man ensemble is not meant to completely encompass the uncertainty in these simulations, but to give some indication of climate conditions that model diverge or converge in their solutions. These three GCMs have distinct characteristics, which are briefly described below. An issue that rose during nesting the RCM to each global model was the length of the year. The Had-GEM2-ES has 360 days in a year, MIROC5 has 365 days, and BESM has 365 + 1 in leap years. The Eta model was modified according to the global model calendar in order to assure the synchronization with the lateral boundary conditions. The RCM is described briefly following the global models' descriptions.

1) BESM
The Brazilian Earth System Model version 2.3.1 [11] was developed by INPE. It is a spectral model with T62 truncation and 28 levels in the atmosphere. The atmosphere model is coupled to the MOM4 ocean model [12] with 50 levels in the ocean and resolution varying from 0.25 degree between 10˚N and 10˚S, 1 degree between 10˚N/S and 45˚N/S, up to 2 degree between 45˚N/S and 90˚N/S latitudes. In the longitude, the resolution is constant, 1 degree. Land-surface processes are represented by the SSiB model [13], which distinguishes 12 types of vegetation. The sea ice uses SIS model [14]. The radiative fluxes are calculated by the CLIRAD-SW-M model [15] [16] for short wave and by Harshvardhan scheme [17] for long wave radiation. Deep convection uses Grell and Devenyi scheme [18], whereas shallow convection uses Tiedtke scheme [19].
2) HadGEM2-ES The Hadley Centre Global Environmental Model [20] [21] is a grid-point model of resolution N96, which is approximately equivalent to 1.875 degrees in longitude direction and 1.275 degrees in latitude, and 38 levels in the atmosphere. In the ocean, the model has 40 levels in the vertical, and in the horizontal, the resolution varies from 1/3 degree in the tropics to 1 degree in latitudes higher than 30˚. It is a model of earth system category with representation of the carbon cycle. Over land, the carbon cycle is modelled by the dynamic vegetation TRIFFID (Top-down Representation of Interactive Foliage Including Dynamics) [22]. It distinguishes 5 plant functional types, broadleaf and needleleaf trees, C3 and C4 grass, and shrubs. The model includes atmospheric chemistry and aerosol model with organic carbon and dust representation.
3) MIROC5 MIROC5 is a Japanese cooperatively developed model known as Model for Interdisciplinary Research on Climate (MIROC), version 5 [23]. It is spectral in the atmospheric component with resolution T85, which is approximately 150 km in the horizontal, and has 40 vertical atmospheric levels. It is coupled to COCO 4.5 ocean model [24] with 50 levels in depth and 1˚ of horizontal resolution. The radiative fluxes are calculated by a k-distribution scheme [25]. The aerosol model, the SPRINTARS, is coupled to cloud microphysics scheme together with the radiation scheme, it uses the MATSIRO land surface scheme [26] with 6 soil layers. Each grid box is formed by three tiles of potential vegetation, cropland, and lake. The scheme also contains river routing and the effects of snow on albedo. Sea ice thermodynamics and dynamics are represented.

4) Eta Model
The RCM adopted for downscaling in this study is the Eta Model. This model uses the eta vertical coordinate [27], which stays approximately horizontal in mountain areas, and which makes the coordinate suitable for studies in regions of steep topography such as the Andes Mountains in South America. This version uses a refinement, which allows sloping fluxes around the top of the mountains. The model dynamics are in finite volume [28] [29]. Deep and shallow convections are parameterized by the Betts-Miller scheme [30] modified by [31]. Cloud microphysics follow Zhao scheme [32]. The land-surface processes are represented by the NOAH scheme [33] with annual cycle of vegetation greenness. Vegetation distinguishes 12 types and soil 9 types. Radiative fluxes are treated by Lacis-Hansen scheme [34], for short waves, and Fels-Schwarzkopf scheme [35] for long waves. CO 2 is constant and kept at 330 ppm.
This model is used operationally at INPE/CPTEC since 1997 for weather forecasts [36], since 2002 for seasonal climate forecasts [37], and 2010 for the Brazilian Second National Communication to the UNFCCC [38]. Some evaluations carried out on the Eta model have shown the added value of its forecasts over the driver GCM forecasts [37]. A version of the Eta Model was developed for climate change studies [6] [39] [40]. This version has been validated and applied for impact and vulnerability studies [41]- [43].
In this work, the updated version of the Eta model [29] is adapted for climate change studies and it is applied to support the Brazilian Third National Communication to the UNFCCC. The sea surface temperature is taken from the global coupled ocean models: BESM2.3.1, HadGEM2-ES, and MIROC5, and it is daily updated. Initial soil moisture and soil temperatures are derived from the global models. Lateral boundaries are updated every 6 hours. The first year of integration is discarded from the analysis.

Results
Model evaluation is based on comparisons between the Eta simulations and CRU [44] observations of mean values, seasonal cycle, frequency distribution, and climatic extreme indicators. The nested simulations are referred to as Eta-HadGEM2-ES, Eta-BESM, and Eta-MIROC5, when the Eta model is driven by HadGEM2-ES, BESM, and MIROC5, respectively. In order to evaluate the major climatological features, austral summer (December-January-February, DJF) and austral winter (June-July-August, JJA) seasons are examined. Results for three major Brazilian regions will be highlighted. These regions are indicated in Figure 1.

• Maximum and Minimum Temperatures
The maximum temperatures in DJF are simulated in Figure 2. The warmest area is simulated in the region between Paraguay and northern Argentina by the three model runs, as shown in Figures 2(a)-(c). However, a secondary maximum of temperature is simulated in the northern coast, which is not present in the observations as revealed by the errors in The minimum temperatures simulated in DJF show large contrast among the Eta simulation errors (Figure 4). The Eta-MIROC5 is systematically cooler than the other runs in the entire continent, whereas the Eta-BESM is    The spread of the three simulations has shown that the area that encompasses Bolivia, Paraguay, and northern Argentina is where the temperature values show generally largest disagreement, and therefore larger uncertainty.
While the biases show the location of the mean error, i.e., the deviation of the simulation with respect to the observation at each point, the general spatial pattern with the distribution of maxima and minima can be measured by the spatial correlation. Table 1 shows the spatial correlation of maximum and minimum temperatures for each three regions and the whole South America area. The ensemble of the three simulations is also evaluated. Despite the underestimate of maximum temperature in the entire continent, especially by the Eta-MIROC5 simulation, its spatial pattern is generally better positioned in DJF in comparison with the other two simulations; whereas in JJA, the Eta-HadGEM2-ES has generally higher correlation. In terms of minimum temperature, Eta-MIROC5 simulations are generally better for both seasons, DJF and JJA. The Eta-BESM exhibits the lowest correlation among the three simulations. Although the ensemble mean is expected to perform better than the individual simulations, the spatial correlation of the mean is just slightly below the highest correlation of each category.
• Precipitation Figure 6 and Figure 7 show the simulations of DJF and JJA mean precipitation. Precipitation in these two contrasting seasons are generally well captured by the simulations, which show the major precipitation band during DJF related to the South Atlantic Convergence Zone, and the area free of precipitation in the central and Southeast part of Brazil in JJA. In winter, the precipitation in the Southeastern South America area and the band along the eastern coast are represented in these simulations. However, in DJF the simulations show underestimate of precipitation in large areas over the continent that extends from northern Argentina to the northern part of the continent. In opposition, in JJA, the simulations show some overestimate of precipitation in the central part of the continent, in particular in southern Amazonian area. However, in JJA there remains underestimate of precipitation in the northern part, which extends over the Central America countries. In JJA, underestimate is also noticed in southern Brazil and along the eastern coast of northeast Brazil.
Over the ocean, in DJF, the Intertropical Convergence Zone (ITCZ) hints a double band over the adjacent Pacific and Atlantic Oceans. This feature is inherited from the GCMs. In JJA, the ITCZ has become a single band. The Eta-MIROC5 simulations exhibit a wider ITCZ precipitation band in both seasons. This heavier precipitation band in Eta-MIROC5 simulations extends toward the Central America and Caribbean Sea. This feature is in contrast to Eta-BESM simulations, which have little precipitation in that region in both seasons.
The spatial correlations of the mean precipitation ( Table 2) show the highest values for the Eta-Had-GEM2-ES simulations for DJF, when the ensemble of the Eta simulations has shown even higher correlation with CRU observations. However, in JJA, there is no clear advantage of a single simulation or of the ensemble. In this season, the Eta-MIROC5 correlates better in NO and NE regions, whereas Eta-BESM correlates better in CS region.

Annual Cycle
The annual cycle of near-surface temperature (Figure 8) is underestimated in simulations, either by the regional or by the global models, in all three Brazilian regions, and in most time of the year. Nevertheless, the error of the nested simulations does not exhibit the same pattern with respect to the driver global model errors. For example, the Eta-HadGEM2-ES simulations are warmer than HadGEM2-ES in the CS region and during winter in the NO region. While the Eta-MIROC5 simulations are systematically colder than MIROC5, the Eta-BESM simulations are systematically warmer than BESM in all three regions. Therefore, the nested simulations did not reveal a regular pattern of error with respect to the driver global model. The BESM surface temperature may be systematically colder in all regions as it represents the first model layer, which has 60 m of depth and not at 2 m of height as other model near-surface temperature. The annual cycle of precipitation (Figure 9) simulated by the Eta model is generally smaller than the respective driver global models precipitation, especially during the rainy season, DJF. This causes the Eta simulations to reproduce a better annual cycle of precipitation in CS and NE regions, where global model precipitation is excessive during rainy period. In NO region, precipitation is largely underestimated by the regional model. During winter (JJA) in CS, while the global models tend to underestimate the precipitation, the regional simulations

Frequency Distribution
The distributions of monthly temperatures in the major three regions (Figure 10) shows that model simulations reach more extreme values than the monthly CRU observations, although of very small frequency. The frequency is shown logarithmicax is to allow displaying the low frequency in the extreme value ranges. Therefore, the ensemble of model temperatures produces a broader distribution. The feature of narrower distribution in the NO and NE regions, due to small temperature variability in the tropics, is captured by the Eta simulations, as well as the broader distribution in the subtropical CS region. In general, the Eta-MIROC5 produces a distribu-  tion of temperatures lower than its driver global model, whereas the Eta-BESM produces a distribution of temperatures warmer than the BESM. In the case of Eta-HadGEM2-ES, there are mixed results in the three regions. The peaks at the most frequent values are generally displaced in the simulations by about 2˚C to 4˚C. Errors in the distribution of temperature are generally related to the models' land-surface representations. A source of uncertainty in the distribution of the CRU observations is due to the poor distribution of actual observations in Brazil, mostly in the regions such as of complex topography, or in forest of difficult access. In these areas model simulations will produce values, but observations are never recorded. Similar to temperatures, the monthly precipitation simulated by the models tends to reach larger amounts than the recorded by the CRU observations (Figure 11). In particular, the downscaling simulations can produce daily heavier precipitation that accumulates to larger amounts in a monthly total, which occurs in all three regions. In general, the models capture the peaks of most frequent monthly precipitation values, which occur in the range of 1 -9 mm/day. Toward larger precipitation rates, the observations display a linear-log distribution, which is generally captured by the Eta model simulations, with some variations of the slope among the three different regions. The simulated precipitation amount is mostly dependent on individual model convection and cloud schemes. The Eta precipitation distributions do not follow the global model distribution curves or slopes. For example, in CS region, where the Eta-BESM reaches extreme precipitation rates, BESM simulations do not exceed the rate of 13 mm/day; or the opposite case in NO region, where Eta-BESM simulations do not exceed 33 mm/day, and BESM exceeds 41 mm/day. Therefore, the Eta precipitation distributions in all three regions depart from the driver model distributions, but the downscaling distributions still exhibit spread among their members. The uncertainty of the observations mentioned for the temperature values is also valid for the precipitation observations.  Figure 12 shows the linear trends of some climatic extreme indicators [45] derived for temperatures, such as the 90 th percentile of maximum temperatures or warm days (TX90p), the 90 th percentile of minimum temperatures or warm nights (TN90p), and the consecutive days, greater than 6 days, of temperature above the 90 th percentile which is equivalent to heat waves (Warm Spell Duration Indicator-WSDI). The climatic extreme indicators derived for precipitation (Figure 13) are the total annual rainfall PRCPTOT, the maximum annual rainfall on five consecutive days (RX5Day), the annual mount of rainfall falling above the 95 th percentile (R95p), the maximum number of consecutive wet days in the year (CWD) and the maximum number of consecutive dry days in the year (CDD).

Climatic Extreme Indicators
Observational studies on temperature extremes over South America show a general warming in the region [46]- [49]. In [47], the largest warming trends were observed over northeastern Brazil with decrease of cold nights and increase of warm nights. That work also found the second largest warming trends in the Amazon region for both indicators, whereas heat waves increased significantly over Northeast Brazil (approximately 11 days longer), the Amazon, and the western South America. In these simulations, the Eta-HadGEM2-ES and Eta-BESM simulations show increasing trends of TX90p, TN90p and WSDI in agreement with observational studies. However, the largest warming areas in these simulations occur in the northern part of the continent, not in Northeast of Brazil as suggested by those observational studies. The Eta-MIROC5 simulations show temperature indicator trends opposite to the other model simulations. The decrease trends in temperature extreme indicators in Eta-MIROC5 occur due to the period chosen for the trend. After 1990, the trend turns to positive toward 2005 and beyond in the transient period.
Reference [50] showed that for southern Brazil, Uruguay, northern and central Argentina, as well as in northern Peru and Ecuador trends are toward a wetter climate in the period 1960-2000, while in southern Peru and southern Chile there is a tendency toward a drier climate. This is in agreement with [47] who found that the total annual precipitation over the South America is approximately 92 mm higher in the present day than in 1950, with increase of heavy rainfall events. Precipitation indicators show opposite trends between Eta-HadGEM2-ES simulation and the other two model simulations, the Eta-MIROC5, and the Eta-BESM. The Eta-HadGEM2-ES simulations show wet trends in the period 1961-1990, over most of South America, as suggested by the increase in the PRCPTOT, RX5DAY, R95p, and CWD and decrease in CDD. Only in the northeastern South America and in northern Chile, the Eta-HadGEM2-ES simulation displays trends for drier conditions in the period. In contrast, the Eta-MIROC5 and Eta-BESM simulations in general display trends for drier conditions over most of South America, especially in the northern part of the continent. However, some patchy areas of increase of precipitation are found in southeastern South America in these two simulations. In northeast of Brazil, while the Eta-BESM simulations show increase of annual precipitation (PRCPTOT) in most of the region, the Eta-MIROC5 simulations show mostly decrease which agrees with the trend in three stations shown by [47]. For CWD, [49] have found this indicator increasing in the southeastern South America reaching about 12 days, whereas the Eta-HadGEM2-ES and Eta-MIROC5 have CWD increasing in a narrower area of southeast of Brazil. The de- cline of CDD in central and southern part of Brazil, Uruguay, and Paraguay observed in the work [49] is somehow captured by Eta-HadGEM2-ES.

Conclusions
The Eta RCM nested in three GCMs reproduces a 30-year present climate period. The global models adopted to drive the RCM are the HadGEM2-ES, MIROC5, and the BESM. Synchronicity and compatibility with the driver conditions were taken into account in the nested simulations. The evaluation of the present period, 1961-1990 against CRU observations shows that the Eta simulations generally reproduces the general climatological features over the South America continent.
Temperature is generally underestimated in the Eta simulations. This is shown in the spatial distribution and the mean annual cycle. However, simulations show large negative bias of precipitation in the North region of Brazil during summer, and positive bias in southern part of NO in winter. The source of this error requires further investigation, through either the cumulus convection or the land-surface representation parameterization schemes. Some error features are inherited from the global models, such as the double precipitation band of the ITCZ. Model bias over mountains area, either for temperature or precipitation, is still uncertain due to the scarce observations over those areas. Frequency distribution reveals that the RCM and GCM simulations exhibit more extreme values of monthly values of temperature and precipitation than the CRU observations. Despite the errors shown in this evaluation, the nested simulations contain the major features of the South America and Central America climatology.