Frédéric Branger
email: branger@centre-cired.fr

Louis-Gaëtan Giraudet
email: giraudet@centre-cired.fr

Céline Guivarch
email: guivarch@centre-cired.fr

Philippe Quirion
email: quirion@centre-cired.fr

Sensitivity analysis of an energy-economy model of the residential building sector

In this paper, we discuss the results of a sensitivity analysis of Res-IRF, an energy-economy model of the demand for space heating in French dwellings. Res-IRF has been developed for the purpose of increasing behavioral detail in the modeling of energy demand. The different drivers of energy demand, namely the extensive margin of energy efficiency investment, the intensive one and building occupants' behavior are disaggregated and determined endogenously. The model also represents the established barriers to the diffusion of energy efficiency: heterogeneity of consumer preferences, landlord-tenant split incentives and slow diffusion of information. The relevance of these modeling assumptions is assessed through the Morris method of sensitivity analysis, which allows for the exploration of uncertainty over the whole input space. We find that the Res-IRF model is most sensitive to energy prices. It is also found to be quite sensitive to the factors parameterizing the different drivers of energy demand. In contrast, inputs mimicking barriers to energy efficiency have been found to have little influence. These conclusions build confidence in the accuracy of the model and highlight occupants' behavior as a priority area for future empirical research.

Introduction

Numerical energy-economy models used for energy and climate policy assessment carry considerable uncertainty. First, just like any other model, they are incomplete representations of a real-world system. This indeterminacy generates irreducible uncertainty. More specifically, the energy-economy systems they represent involve human behavior, the laws of which cannot be established with the same robustness as in natural sciences. Uncertainty increases further if one considers that energy-economy models are forward-looking tools for decision-making. As such, they are subject to future states of the world, which are unknown by nature.

Such deep, polymorphic uncertainty emphasizes the need to submit energyeconomy models to sensitivity analysis. Though essential for transparency, sensitivity analysis can be a daunting task when models are based on non-linear relationships and involve large numbers of parameters, which is an important characteristic of energy-economy models. This difficulty is reflected by the dominant use of the "One-At-a-Time" (OAT) method of sensitivity analysis, in which model parameters are varied locally one after the other but never together at the same time. This technique does not allow modelers to explore the full space of uncertainty nor interactions between model inputs.

The heterogeneity of energy demand in buildings epitomizes the uncertainty associated with energy-system modelling and thereby the difficulty of sensitivity analysis. Building energy demand involves the use of a variety of technologies (e.g., heating, ventilation and air-conditioning systems, insulation techniques), a building stock that is heterogeneous in terms of its architecture and surrounding climate, and building users whose characteristics vary with respect to their tenancy status, preferences or income. Representing such a disaggregated system expands the sources of uncertainty in the associated models. Individual occupant behaviors, which are to a large extent unobservable, can only be mimicked by tentative functional forms, parameterized with incomplete data. Yet the multiplicity of technologies and agents imposes a large number of parameters. This context reinforces the so-called curse of dimensionality that hampers sensitivity analysis [START_REF] Bellmann | Dynamic Programming-Code[END_REF]. Accordingly, sensitivity analysis is typically rare in energy-economy models of the building sector [START_REF] Mundaca | Evaluating energy efficiency policies with energy-economy models[END_REF][START_REF] Kavgic | A review of bottom-up building stock models for energy consumption in the residential sector[END_REF]. This is unfortunate: reducing energy demand in buildings is considered by scientists of the IPCC [START_REF] Levine | Residential and commercial buildings[END_REF] and many policymakers as the most cost-effective option to mitigate climate change; therefore substantiating this claim and designing practical ways to address it calls for reliable models.

In this paper, we assess an innovative model of building energy demand, Res-IRF, using a sensitivity analysis technique, the Morris method, that is appropriate for the degree of complexity of the model.

Res-IRF has been developed at CIRED to assess the long-term impact of energy efficiency policies on energy demand for space heating in French households [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF](Giraudet et al., , 2011a)). One prerequisite for such an assessment is to have a model that takes into account the complexity of energy-related decisions, an ability existing models of energy demand typically lack [START_REF] Mundaca | Evaluating energy efficiency policies with energy-economy models[END_REF][START_REF] Kavgic | A review of bottom-up building stock models for energy consumption in the residential sector[END_REF]. Accordingly, the purpose with the development of Res-IRF was to improve decision criteria for technical and behavioral change. This materializes through the endogeneization of each of the different drivers of energy use: the intensive margin of energy efficiency investment (at what level to invest?), the extensive one (whether or not to invest?) and building occupants' behavior. In addition, the model incorporates representations of some barriers to energy efficiency, such as heterogeneity in consumer preferences, landlord-tenant split incentives and slow diffusion of information. Up to now, its operation had been assessed through preliminary OAT sensitivity analysis and comparison with other models (see AppendixA), but never submitted to in-depth sensitivity analysis.

The Morris method of sensitivity analysis, also known as the Elementary Effects method, has been introduced by [START_REF] Morris | Factorial sampling plans for preliminary computational experiments[END_REF] and developed in particular by [START_REF] Campolongo | An effective screening design for sensitivity analysis of large models[END_REF]. It can be seen as a randomized OAT design. For each input, elementary effects are computed from different points in the input space. The mean and standard deviation of the elementary effects give a measure of importance of the input and its interactions with other inputs. This method reconciles the low computational cost of OAT techniques with the global focus of more advanced variance-based methods like the Sobol method [START_REF] Saltelli | Global Sensitivity Analysis: The Primer[END_REF]. Application of the Morris method is growing in various fields of science; yet to our knowledge, in the energy-economy field, it has only been applied to the IMAGE model [START_REF] Potting | Sensitivity analysis[END_REF][START_REF] Campolongo | Sensitivity analysis of the IMAGE greenhouse model[END_REF].

The sensitivity analysis reported here went as follows. Preliminary Monte Carlo simulations revealed that Res-IRF's main output, the energy use for space heating in French households in 2050, varied around the reference scenario by 25% at the 95% confidence level. Subsequent application of the Morris method revealed that this variability was due for the most part to future energy prices, which are exogenous to the model. The model is also quite sensitive to the factors parameterizing the different drivers of energy demand; in contrast, inputs mimicking barriers to energy efficiency are less important. Less than 3% of the simulations crashed, which builds confidence in the stability of the model. Interactions between inputs did not prove important, so more advanced sensitivity analysis was not necessary. Even though the exercise did not eliminate all sources of uncertainty, it confirmed for us that the Res-IRF model manages to improve behavioral detail. As such, it provides reliable, intuitive predictions of the effect of energy price on energy demand. Lastly, the analysis highlights the need to systematically present several energy price scenarios, to better understand the nature of the barriers to energy efficiency and to collect more data about building retrofits and occupants' behavior.

Section 2 of this paper presents the Res-IRF model, stressing its innovative aspects as well as the uncertainty they create. Section 3 details the approach for the sensitivity analysis. Section 4 presents the results. Section 5 interprets the results and discusses the reliability of the model. Section 6 concludes.

An overview of the Res-IRF model

Res-IRF1 is a bottom-up simulation model of energy demand in the residential sector. It is calibrated against year 2008 data and run recursively in annual time steps. In the model, energy efficiency improvements materialize through the construction of new buildings and the retrofitting of existing ones. The model is finely detailed with technological and microeconomic representations. As such, it can be seen as a hybrid energy-economy model [START_REF] Hourcade | Hybrid modeling: New answers to old challenges introduction to the special issue of the energy journal[END_REF]. The models to which Res-IRF is most similar to are CIMS, the Canadian Integrated Modeling System [START_REF] Jaccard | Estimating home energy decision parameters for a hybrid energy-economy policy model[END_REF][START_REF] Mau | The 'neighbor effect': Simulating dynamics in consumer preferences for new vehicle technologies[END_REF] and the residential module of NEMS, the U.S. National Energy Modeling System [START_REF] Wilkerson | End use technology choice in the national energy modeling system (NEMS): an analysis of the residential and commercial building sectors[END_REF]. A comprehensive description of the guiding principles, structure and input data needs of the Res-IRF model can be found in [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]. AppendixB of the present paper updates that description with some recent model developments.

Motivation

Before describing Res-IRF, it is worth mentioning the context in which it was developed. At a fundamental level, energy demand for heating in existing buildings can be decomposed into three drivers: the extensive margin of energy efficiency investment (how many dwellings are retrofitted); the intensive one (how energy efficient are these retrofits); and building occupants' behavior (how do occupiers set their heating thermostat?). State-of-the-art energy-economy models typically endogenize the intensive margin of energy efficiency investment, keep the extensive one exogenous and hold occupants' behavior constant.

A specific challenge to the modeling of energy demand is the representation of the alleged barriers to energy efficiency. Since the pioneering contribution of [START_REF] Jaffe | The energy-efficiency gap what does it mean?[END_REF] on the "energy efficiency gap", a large body of literature in economic and social sciences has been looking at barriers that misalign private investment in energy efficiency with its socially optimal level. These barriers include landlord-tenant split incentives and information spillovers. The most recent reviews of the literature on this subject conclude that neither the empirical existence of the barriers to energy efficiency nor their theoretical implications are well established [START_REF] Gillingham | Energy efficiency economics and policy[END_REF][START_REF] Allcott | Is there an energy efficiency gap?[END_REF]. This lack of knowledge is reflected in a perfunctory representation of the barriers in energy-economy models, which typically represent them collectively with abnormally high discount rate values 2 . Against this background, Res-IRF introduces two modeling innovations. First, it offers greater detail than just using high discount rates in the representation of the barriers to energy efficiency. Second, it endogenizes all three drivers of energy use in existing buildings. Linking investment and capital utilization allows model users to assess the rebound effect, that is, increases in energy service consumption in response to energy efficiency investment. This issue receives much attention in policy discussions. Furthermore, policy-makers in some countries have defined annual retrofitting targets. Endogenizing the volume of retrofits in Res-IRF allows model users to assess the contribution of policy instruments to meeting such targets. These modelling innovations however lead to the creation of new sources of uncertainty, as the next subsections describe.

Driving forces

At the aggregate level, energy demand is determined as the product of an extensive output, the building stock, measured in square meters, and an intensive output, the specific energy use of the building stock, measured in kW h/m 2 /year. Model outcomes are fully determined by three exogenous input trajectories: population growth, GDP growth and energy prices. GDP growth determines the growth in floor area per capita, according to an elasticity; this, combined with population growth, determines the annual construction of new floor area. The floor area of existing buildings remains constant, except for some demolitions that occur at a constant annual rate. Energy prices drive energy efficiency improvements in both new and existing dwellings.

Technological detail

Res-IRF focuses on the use of electricity, natural gas, fuel oil and fuel wood for space heating. The building stock comprises single-family dwellings, multifamily dwellings and social housing. The technical characteristics of building envelopes and heating systems are not represented explicitly. Rather, the energy performance of existing buildings takes one of seven discrete values, covering label G (the least efficient) to label A (the most efficient) of the French Energy Performance Certificate. Energy efficiency improvements are realized through transitions to higher energy labels and through fuel switches. The performance of new buildings takes one of three discrete values, corresponding to the minimum requirements of the French building codes of 2005, 2012 and 2020 (as currently anticipated for the latter). The heating energy carrier and efficiency level of new constructed buildings are chosen simultaneously.

Representing energy efficiency improvements through energy label transitions facilitates the simulation of microeconomic decisions as discrete choices. It however also creates parametric and empirical uncertainty. As a given transition could in reality be realized through different combinations of building envelope and heating system measures, its cost is hard to specify and likely to be dispersed over a range of possible values.

Microeconomic detail

Homeowners use discrete choice functions on the intensive margin of energy efficiency investment. Logit functions allocate market shares across the seven different energy labels according to their respective life-cycle costs. A heterogeneity parameter controls for the spread in market share allocation. The life-cycle cost of each energy label is given by the sum of investment costs and discounted energy operating costs specific to this label. Investment costs decline with cumulative investment through learning-by-doing. The computation of life-cycle energy operating costs assumes myopic expectations of energy prices.

Res-IRF adds several innovative features to this otherwise standard modeling framework. First, unlike most other models, in which abnormally high discount rates are used to represent all barriers to energy efficiency, the Res-IRF model considers discount rates with split incentives only. Owner-occupiers are assumed to have normal discount rates; homeowners who rent out their dwelling are assumed to have a higher than normal discount rate. Likewise, owner-occupiers of multi-family dwellings, who are not the sole decision-maker when it comes to the renovation of the whole building are assumed to discount the future more sharply than owner-occupiers of single-family dwellings. Second, the life-cycle costs of each energy label factor-in some intangible costs, which are calibrated so as to allow logit functions to replicate the energy label choices observed in 2008. As such, intangible costs can be interpreted as including all possible barriers to energy efficiency other than landlord-tenant split incentives. The impact of barriers is assumed to decrease over time with cumulative investment as a consequence of information spillovers. The introduction of intangible costs in the model and the mechanism by which they decrease come from the CIMS model [START_REF] Jaccard | Estimating home energy decision parameters for a hybrid energy-economy policy model[END_REF][START_REF] Mau | The 'neighbor effect': Simulating dynamics in consumer preferences for new vehicle technologies[END_REF] 3 .

The extensive margin of investment corresponds to annual constructions of new buildings and annual retrofits of existing buildings. While the former derives directly from exogenous inputs in the model, the latter is determined endogenously. For a representative homeowner-dwelling bundle, a logistic function is used to deduce the retrofitting rate from the average net present value of retrofitting. The average net present value is calculated as the difference between the average life-cycle cost of upgrading the dwelling and the life-cycle cost of staying in its current energy label. Beforehand, the average life-cycle cost (including intangible costs) of a retrofitting project is weighted by the market share of each possible energy label transition, determined by logit functions, as described above. This simulation framework is equivalent to assuming that homeowners have a heterogeneous taste for the utility derived from energy services (e.g., some are more sensitive to the cold than others) and that this heterogeneity is normally distributed across the population. In this view, the logistic curve mimics the cumulative distribution function of the taste parameter.

Lastly, in both new and existing buildings, the utilization of newly installed capital adjusts after investment. The underlying idea is that dwelling occupants optimize the consumption of energy services, in the case of this work the heating temperature. Improvements in the energy efficiency of the dwelling typically decrease the marginal cost of heating, hence increasing the quantity of heating consumed, a phenomenon known as the rebound effect. This is represented in Res-IRF as an iso-elastic response of the demand for energy service, measured as the ratio between effective energy use and the conventional one disclosed by the energy label, to the energy efficiency of the dwelling, measured as the conventional energy expenditure, that is, the conventional use disclosed by the label valued at current energy prices (see AppendixB for further detail).

Sensitivity analysis approach of Res-IRF

First, we perform Monte Carlo simulations to quantify overall uncertainty in the model. Second, we use the Morris method to identify the main sources of uncertainty. A preliminary step for both exercises is to assign probability distributions to the inputs of the model. These three steps are described in more detail below.

Variables of interest

In this work, we focus on uncertainty in total primary energy use, the main output of interest of the model. We compare it to its value in a reference scenario 4 at two points in time, 2020 and 2050. Separating short-and longterm effects is important for inputs like the learning rate, which parameterizes a dynamic process. As such the learning rate may be more influential in the long-term than in the short-term.

We use the term input to name any factor that is given a numerical value in the model. Model inputs fall into three categories:

• Exogenous input trajectories (EI) representing future states of the world: energy prices, population growth and GDP growth.

• Calibration targets (CT), which are empirical values the model aims to replicate for the reference year 2008. They include hard-to-measure aggregates such as the reference retrofitting rate and the reference energy label transitions.

• All other model parameters (MP), which reflect current knowledge on behavioral factors (discount rates, information spillover rates, etc.) and technological factors (investment costs, learning rates, etc.)

4 As the motivation of the work is to assess the fitness of the model for the purpose of increasing behavioral detail, we do not assess uncertainty around policy scenarios. Still, estimates of the sensitivity of the model to energy prices give insights into its sensitivity to energy taxes. Likewise, sensitivity to variation in investment costs gives insights into sensitivity to different levels of subsidies.

For each model input in the sensitivity analysis, we make specific assumptions about the mean (which is the value used in the reference scenario), the probability distribution function and the range of values explored. Some factors cannot be manipulated as a simple scalar input and they are assessed through indirect inputs, as detailed in AppendixC. AppendixD provides a complete description of the 71 model inputs, by input type.

Monte Carlo simulations

1,500 Monte Carlo simulations are run. In each simulation, each input value is drawn pseudo-randomly from its probability distribution function. We use Latin Hypercube Sampling (McKay et al. 1979) to efficiently cover the input space. The probability density function of each input is divided into 1,500 regions of equal density. The sampling procedure then ensures that draws occur once in each region. Inputs are drawn from a uniform distribution within each region.

The number of simulations is large enough for us to compute the mean and standard deviation of the output distribution generated, hence get an aggregate view of the magnitude of uncertainty in the model. It is however not large enough for us to compute statistically significant standard regression coefficients (used to rank inputs by importance), so this motivates the use of the Morris method in a second step.

The Morris method

Sensitivity analyses are generally divided into local and global approaches [START_REF] Confalonieri | Comparison of sensitivity analysis techniques: A case study with the rice model WARM[END_REF]. Local sensitivity analyses, also known as "One At a Time" (OAT) techniques, are based on the estimation of partial derivatives [START_REF] Campolongo | From screening to quantitative sensitivity analysis. a unified approach[END_REF]. Partial derivatives are only informative at a global scale if some linearity and additivity conditions are met, which is rarely the case in energy-economy models [START_REF] Saltelli | How to avoid a perfunctory sensitivity analysis[END_REF]. In contrast, global sensitivity analyses evaluate the effect of a factor while all others vary as well. This allows modelers to efficiently explore the multidimensional input space. The global approach includes screening methods (mainly the Morris method), regression-based methods (computation of standard regression coefficients) and variance-based methods (mainly the Sobol method [START_REF] Sobol | Sensitivity analysis for non linear mathematical models[END_REF]).

The Morris method can be thought of as an enhancement on the "perfunctory" OAT method [START_REF] Morris | Factorial sampling plans for preliminary computational experiments[END_REF][START_REF] Saltelli | How to avoid a perfunctory sensitivity analysis[END_REF]. It was developed in 1991 by Morris and went through some refinements with [START_REF] Campolongo | Screening methods[END_REF] and [START_REF] Ruano | An improved sampling strategy based on trajectory design for application of the morris method to systems with many input factors[END_REF]. It is increasingly used5 , for applications in hydrology [START_REF] Braddock | Application of the morris algorithm for sensitivity analysis of the REALM model for the goulburn irrigation system[END_REF][START_REF] Matthews | Analysing the sensitivity behaviour of two hydrology models[END_REF], chemistry [START_REF] Campolongo | An effective screening design for sensitivity analysis of large models[END_REF], agronomy [START_REF] Richter | Sensitivity analysis for a complex crop model applied to durum wheat in the mediterranean[END_REF], biophysics [START_REF] Cooling | Modeling hypertrophic IP3 transients in the cardiac myocyte[END_REF], building thermal simulation (Garcia [START_REF] Sanchez | Application of sensitivity analysis in building energy simulations: Combining first-and second-order elementary effects methods[END_REF] and energy-economy modeling [START_REF] Campolongo | Sensitivity analysis of the IMAGE greenhouse model[END_REF].

The Morris method can be summarized as follows. Consider a model with k random input variables Y = f (X 1 , ...X k ). Each model input (X i ) i∈{1,...,k} varies across a uniform distribution in [0, 1] 6 . In the Morris method, each input varies across p selected levels. The region of experimentation is then a k-dimensional p-level grid. An elementary effect for variable i is defined by:

EE i (X 1 , ..., X k , △) = f (X 1 , .., X i ± ∆, ..X k ) -f (X 1 , ..., X k ) ±△
p is chosen to be even and △ equals p/(2(p -1)) for symmetry considerations. For each input variable, there are p/2 possible values below 0.5 and p/2 corresponding values (+△) above 0.5. This configuration leads to p k /2 different elementary effects per input 7 . The finite distribution of elementary effects corresponding to the i-th input factor is called F i . Then G i is the equivalent distribution of absolute values of elementary effects.

The sensitivity measures proposed by Morris are the estimated mean µ and standard deviation σ of F i [START_REF] Morris | Factorial sampling plans for preliminary computational experiments[END_REF]. [START_REF] Campolongo | From screening to quantitative sensitivity analysis. a unified approach[END_REF] propose a third measure, µ * , the estimated mean of G i . Any significant difference between µ and µ * indicates a non-monotonic influence of the underlying input on the output.

Estimating µ * , µ and σ requires sampling elementary effects from both F i and G i . One efficient random sampling strategy is to build r trajectories of (k + 1) points. As each trajectory gives k elementary effects, the computational cost of the experiment is r(k + 1). The construction of the trajectories requires several steps of randomization which are detailed in [START_REF] Morris | Factorial sampling plans for preliminary computational experiments[END_REF].

A decisive advantage of the Morris method is that it is "computationally cheap". Around 50 simulations per input are needed, while the Monte Carlo regression requires 1,000 and the Sobol method 10,000 [START_REF] Iooss | Revue sur l'analyse de sensibilité globale de modèles numériques[END_REF]. Nonetheless, the measure of importance µ * compares favorably with those used in variancebased methods to rank inputs according to their influence [START_REF] Campolongo | An effective screening design for sensitivity analysis of large models[END_REF][START_REF] Tang | Comparing sensitivity analysis methods to advanced lumped watershed model identification and evaluation[END_REF][START_REF] Confalonieri | Comparison of sensitivity analysis techniques: A case study with the rice model WARM[END_REF]. Furthermore, the Morris method allows one to handle unstable models that may crash when inputs are too different from their reference value. Unlike the Sobol method, it is possible to drop an elementary effect calculation without affecting the full design.

Ex ante, the Morris method seemed well-suited to the size and non-linear nature of Res-IRF. We set the number of trajectories at r = 80, which, when applied to 71 inputs, led to 80×(71+1) = 5, 760 simulations. The computational cost incurred was low 8 . Ex post, the Morris method proved appropriate: Results

6 The normalized inputs are then converted from the original hypercube to their actual distribution as follows: if F Xi is the cumulative distribution function, the corresponding value for the level j

(j/(p -1) in [0, 1]) is F -1
Xi ((j -0.5)/p). The method works best when p is even. In our analysis, p is set to 8.

7 Each input X j with j = i may take the p values of the grid. For X i , half of possible values below 0.5 give the same EE as corresponding values (+△) above 0.5.

8 Res-IRF is coded in the Scilab language. The script is approximately 2000 lines of code (presented below) showed that the non-linearities found in the model were such that no further analysis was necessary.

Results

Global uncertainty

The median output value for residential sector energy demand over all Monte Carlo simulations falls steadily from 378 TWh in 2008 to 344 TWh in 2020 (-9%) and 288 TWh in 2050 (-24%).

Uncertainty increases over time: the standard deviation of the output distribution is increasing, while the mean is decreasing. This may be due to a propagation of the uncertainty attached to those inputs that parameterize the dynamics of the model, e.g., learning and information rates. Overall, uncertainty in primary energy use to 2050 is 25% at the 95% confidence level.

Important inputs

In Figure 2, inputs are ranked on the horizontal axis according to their influence on the output in 2020, measured as their µ * value on the vertical axis. We see that uncertainty is concentrated among a handful of inputs. A similar observation can be made for the long-term output (not reported here). Such a concentration is quite common in sensitivity analysis [START_REF] Saltelli | Global Sensitivity Analysis: The Primer[END_REF]. In the following discussion, we focus on the 10 most important inputs for each of the two outputs examined (Tables 1 and2). This leads us to identify 13 long. Running Res-IRF on a standard computer with CPU of 2.6 GHz and 4 Gb of RAM takes approximately one minute important inputs. To get a more tangible value of importance, we also compute ν * , the ratio between µ * and the output value in the reference scenario. A value of 2% for ν * i means that a change of △ (which is close to 0.5) of input i (assumed to be uniformly distributed in [0,1]) leads, on average, to a 2%/△ increase in the output value, as compared to its value in the reference scenario.

Three inputs consistently stand out as being most influential: the 2050 energy price, the 2008 retrofitting rate and the energy service elasticity. The 2050 energy price is an exogenous input, which is mostly influential in the long-term. The 2008 retrofitting rate is the target against which the retrofitting function is calibrated. It proves to be most influential in the short-term. The energy service elasticity is a model parameter.

After these three most influential inputs, the learning rate proves to be influential in the long-term, which is consistent with it parameterizing an accumulation process. The 2008 energy price has a significant impact in the long-term, but hardly any impact in the short-term. This perhaps counter-intuitive outcome is in fact due to the calibration of the retrofitting function, as will be shown further on in the analysis. The discount rate used to calibrate intangible costs is influential in both the short-and long-term. The discount rate parameterizing the investment behavior of owner-occupiers of existing singe-family dwellings (the biggest category of decision-makers) is influential in the short-term.

The breakdown of retrofitting costs (see AppendixC) is among the top ten most influential inputs in the long-term. Part of its influence is absorbed by the variations of intangible costs in the short-term. In the long-term, as the latter vanish, the variations of investment costs become more visible.

The 2008 Energy label transition share input is also influential. Together with the influence of the 2008 retrofitting rate, this emphasizes the importance of calibration targets. The population growth and the household density growth, which are directly linked to the floor area of new dwellings to be built each year, are also significant. Finally, two building stock calibration targets are important: the 2008 demand for electricity and natural gas.

Robustness of the ranking

Two questions arise: is computing 80 elementary effects per input enough to get reliable estimates of µ * ? Would the ranking change if we had more trajectories? To answer these questions, we compute the position factor index defined by [START_REF] Ruano | An improved sampling strategy based on trajectory design for application of the morris method to systems with many input factors[END_REF]:

P F ri→rj = k l=1 |P l,i -P l,j | 0.5 × (P l,i + P l,j )
where P l,i is the position of input l when r = r i . The P F ri→rj index measures the difference between rankings obtained with samples of size r i and r j . The paramaters found to be most sensitive are given higher weight in the index. A low value of P F (e.g. less than 2) means that the ranking is robust to an increase in the sample size. However, the P F value may increase as sample sizes increase. Thus in the present analysis, we consider a ranking to be stable when P F indices of a parameter tested over a range of sample sizes are all found to have low values.

As shown in Table 3, the position factor indices are found to be consistently low. They are even below 1 when the number of trajectories is shifted from 70 to 80. Whatever the shift examined, the indices tend to be higher when applied to the long-term output as compared to the short-term one. This seems quite logical because as the time horizon gets further away, the chances are greater that an input will become influential and thus change its ranking. Overall, the sensitivity analysis suggests that the ranking obtained in the previous section is robust 9 .

Linearity, monotony and stability of the model

One strength of the Morris method is to give a sense of the nonlinearity of model inputs, that is, the extent to which they interact with each other 10 . 9 For each input, a higher σ means a greater variability of elementary effects. In this case more elementary effects are needed to get an accurate estimate of µ. The efficiency of the Morris method could thus be improved by adjusting the number of elementary effects computed for each input to its σ value. Such a refinement goes beyond the scope of this article.

10 Unlike the Sobol method, the Morris method does not track interactions. That is, it provides an aggregate measure of the interactions between one input and all others, but does Input nonlinearities can be visualized in so-called Morris diagrams, as shown in Figures 3 and4. Each diagram displays, for each of the 13 most important inputs, the standard deviation of elementary effects σ plotted against the mean µ * . The dotted line σ = µ * partitions the space. Inputs located in the upper left space are deemed to be nonlinear. A high value of σ relative to µ * indicates strong interactions of the associated input with other inputs. Inputs located in the lower right space are deemed to be linear.

Three inputs stand out as being nonlinear: the discount rate used to calibrate intangible costs, the one used by owner-occupiers of existing singe-family dwellings, and the retrofitting costs breakdown. These inputs can be seen as different degrees of freedom in the calibration of intangible costs. It is thus coherent that they interact with other inputs. Overall, there are only a few nonlinear inputs and their degree of nonlinearity is relatively low. Therefore, the Morris method has proved to be both relevant and sufficient for a sensitivity analysis of Res-IRF.

Another strength of the Morris method is to give a sense of the monotony of input influence. This can be approximated, for each input, by the value of the µ/µ * ratio. A value of 1 (resp. -1) indicates that an increase in the input value always induces an increase (resp. decrease) in the output, regardless of the values of the other inputs. Table 4 displays the monotony of the 13 most influential inputs based on their µ/µ * ratios in 2020 and 2050. transition shares, the larger the number of retrofits and the lower the energy use. On the other hand, the higher any of the 2008 electricity and natural gas demands or the population growth, the higher the energy use. In contrast, the effects of inputs related to retrofitting costs and intangible costs are ambiguous.

A perhaps counterintuitive result is the positive relation between the 2008 energy price and energy use. It can however be explained by the calibration of the retrofitting function to year 2008. All else being equal, a higher energy price at the calibration step implies a higher net present value associated with a retrofit, hence a lower number of retrofits per unit of profitability in the retrofitting function. In subsequent model dynamics, fewer retrofits lead to a higher energy use.

The shares of energy label transitions in 2008 also exhibits a counterintuitive monotony. A higher value of this input reflects a world with more energy efficient retrofits in the initial year than in the reference scenario. Replication of such a world in the calibration process leads to lower intangible costs. If initial intangible costs are lower, their potential for decrease through information spillovers is also lower. In the short-and long-term, this ultimately leads to less energy savings.

One last strength of the Morris method is that the simulation sequence is not impaired by computation crashes. Computation crashes are hard to avoid in sensitivity analysis, as the calibration step involves the resolution of very non-linear systems. The analysis reported here had a failure rate of 2.2%, that is, 124 crashes happened out of 5,760 simulations. This led us to exclude 138 elementary effect calculations11 . Figure 5 displays the distribution of crashes over the set of inputs. It shows that the excluded elementary effects were not confined to a handful of inputs. No input had more than nine elementary effects excluded out of 80 calculated and most had less than five excluded. Therefore, the low number of crashes experienced in the analysis did not introduce any statistical bias in the results.

Discussion

Fitness for purpose of the model

Sensitivity analysis allows modelers to assess the "fitness for purpose" of a model. This can be seen as a heuristic judgement of its quality [START_REF] Saltelli | Global Sensitivity Analysis: The Primer[END_REF]. The purpose of Res-IRF is to improve behavioral detail in residential sector energy-economy modeling. Several of the model's features are designed to serve this purpose: an endogeneization of the extensive margin of energy efficiency investment, calibrated against the initial retrofitting rate; the utilization of energy carrier, parameterized with an energy service elasticity; the introduction of some barriers to energy efficiency investments. The fact that the initial retrofitting rate and the energy service elasticity are both found to be among the most influential inputs suggests that disaggregating the different drivers of energy use is a relevant modeling choice. The importance found for these inputs is consistent with the energy price being the most influential input. As it impacts all three margins of energy use, it propagates the variability attached to each. Though theoretically uncontroversial, disaggregating different energy drivers is empirically challenging. In particular, data is needed to make a better estimation of the initial retrofitting rate and the energy service elasticity.

In contrast, the barriers to energy efficiency introduced in the model have been found to have little influence. This is notable for discount rates, which is at odds with the importance they have been reported to have in most other models12 . As using discount rates to mimic barriers to energy efficiency raises theoretical and empirical concerns first reported by [START_REF] Jaffe | The energy-efficiency gap what does it mean?[END_REF], the finding of low-influence is perhaps not so problematic. Therefore, if we are to improve behavioral detail in the modeling of residential sector energy demand, a basic disaggregation of the different drivers of energy use should be prioritized over focus on a more elaborate incorporation of barriers to energy efficiency.

Unaddressed uncertainty

The Morris method has allowed us to fully explore the input space. Though such an analysis may give an impression of completeness, it does not clear all sources of uncertainty. The delimitation of the variation in input space by the modeler involves some arbitrary assumptions. So too does the choice of outputs examined. Some outputs that were not examined in this paper may be affected by inputs that were in this work not found to have much influence. Lastly, beyond numbers, the uncertainty embodied in the functional forms and scope of the model can simply not be accounted for in a sensitivity analysis [START_REF] Oreskes | Evaluation (not validation) of quantitative models[END_REF][START_REF] Rotmans | Uncertainty management in integrated assessment modeling: towards a pluralistic approach[END_REF].

Conclusion

In this paper, we have discussed a sensitivity analysis of Res-IRF, a simulation model of energy use for space heating in French dwellings. We used the Morris method of sensitivity analysis, which to date has not been widely used by the energy-economy modeling community. 5,760 simulations were run to assess the influence of all 71 model inputs. We found global uncertainty to be within the acceptable range: the main output of interest, Total Primary Energy Use to 2050 varies by 25% at the 95% confidence level. We also found the model to be quite stable: less than 3% of the simulations crashed. Most inputs have a linear and monotonic influence on the outputs of interest and the polarity of influence is consistent with intuition. Moreover, nearly all exogenous inputs make it among the top most influential inputs, with energy prices ranking first. This means that even though the internal structure of the model accounts for some variability, the model is mainly determined by its exogenous inputs. Thus we conclude that the reliability of the model is good. Disaggregating the three drivers of energy use also proved to be a relevant modeling choice. Although sensitivity analysis seems like a very obvious thing to do for this kind of energy system modelling, it is rarely done in peer models, probably because it is technically challenging.

These conclusions, retrospectively, give more substance to the results in previous work (Giraudet et al., 2011a). The takeaway of that work can be summarized as follows: there are technical and behavioral rigidities that affect energy-related decisions which make ambitious carbon dioxide emissions reductions targets in the residential sector difficult to meet in the near future. Other models have reached the same conclusions (see AppendixA for a review). They thus provide an external corroboration of the model which complements the internal corroboration provided by the sensitivity analysis carried out in this work.

Our evaluation suggests some directions for model development. First, many inputs proved to be unimportant in the sensitivity analysis. Res-IRF could be simplified accordingly. For instance, the growth in floor area per capita could be modelled to follow an exogenous trend rather than respond to GDP growth. Second, data is needed to make a better estimation of the empirical parameters identified as being most important. This applies to the retrofitting rate in particular. Third, the analysis revealed that Res-IRF was not very sensitive to variations in representations of the barriers to energy efficiency. However, this point is controversial, both from a theoretical and empirical point of view. Therefore, more research is needed to clarify which barriers should be described in detail in models of energy demand, before concluding the sensitivity of these models to such barriers.

French residential building sector [START_REF] Giraudet | Evaluation des mesures du grenelle de l'Environnement sur le parc de logements[END_REF]. A carbon tax, subsidies (income tax credits and zero interest rate loans for energy retrofits) and regulations (stringent building codes for new buildings and retrofitting obligations in existing buildings) were assessed against the national targets of reducing energy use in existing buildings by 38% in 2020 compared to 2008, and dividing CO 2 emissions by four in 2050 compared to 1990. The analysis revealed that taxes were the most effective instrument to lower final energy use, although it was the least effective at increasing energy efficiency investment. This result is consistent with insights from microeconomic optimization models (e.g., [START_REF] Giraudet | Efficiency and distributional impacts of tradable white certificates compared to taxes, subsidies and regulations[END_REF]). It rests on the same drivers as those exhibited in the local sensitivity analysis of the model: as all policy instruments improve energy efficiency, thereby generating a rebound effect, carbon taxes impact at the same time capital utilization. The main insight from this policy assessment was that national targets were unlikely to be met, unless policies were set far out of the range discussed in the policy arena 13 .

Comparing Res-IRF to peer models sheds an external light on its reliability. [START_REF] Charlier | Evaluation of the impact of environmental public policy measures on energy consumption and greenhouse gas emissions in the french residential sector[END_REF] developed a bottom-up model of energy demand in French residential buildings which lends itself to such a comparison. Their model shares commonalities with Res-IRF: the retrofitting rate is endogenous and landlord-tenant split incentives are modeled through heterogeneous payback times among decision-makers. Yet the two models have different strengths. Charlier and Risch's model (hereafter the CR model) incorporates greater technological detail than Res-IRF: it is fed by outputs of an engineering model of building energy use, which takes into account explicit technologies for heating and hot water, appliances and lighting uses. It also incorporates rich statistical data on household characteristics, such as income and debt ratio (in addition to the tenancy characteristics mentioned above). On the other hand, in the CR model, capital utilization is held constant and there are neither intangible costs nor dynamic effects such as learning-by-doing or information spillovers. The reference scenarios in both models cannot be compared easily: while both are based on the same population growth projected by INSEE, they assume quite contrasted energy price scenarios, increasing at an annual rate of 3.3% in the CR model and 0.5% in Res-IRF. Models respond to these reference scenarios by a decrease in specific primary energy use through 2050 of 48% in the CR model and 23% in Res-IRF. Charlier and Risch also conducted an assessment of various types of subsidies to meet national targets. They find a higher effectiveness of subsidies than in Res-IRF. One possible explanation for this higher sensitivity is the absence of an endogenous rebound effect in the CR model. Despite their differences, both models share the conclusion that national targets are unlikely to be met with current policies.

Res-IRF was involved in the Energy Modeling Forum's 25th study, focusing on energy efficiency (Energy Modeling Forum, 2011). The study involved a variety of top-down and bottom-up energy-economy models, mostly focusing on the U.S. economy, which were run with standardized assumptions. Compared to other models, sensitivity to energy efficiency policy in Res-IRF14 proved intermediate. The model, however, exhibited two distinct behaviors. First, the relative impact of a carbon tax on residential energy intensity was almost the largest of all models (Ibid., Figure 10). Again, this is likely driven by the endogenous representation of capital utilization, a feature exclusive to Res-IRF in the study. Second, unlike other models, Res-IRF exhibited some slightly overadditive interactions when a carbon tax was combined with energy efficiency standards (Ibid., Figure 15). A decomposition of this stylized fact at the time of the study revealed that it was driven by the logistic shape of the retrofitting curve. As the model and policies were parameterized, most retrofits were occurring in the convex region of the logistic curve; therefore, an increase in the net present value of retrofitting translated into a more-than-proportional increase in the number of retrofits. Beyond this specific result, the key finding of the study was that regardless of the top-down or bottom-up nature of the models involved, all exhibited rigidities that made the attainment of ambitious carbon dioxide emissions reductions through energy efficiency much harder than those found in pure engineering studies, as exemplified by the widely discussed Mc Kinsey study (McKinsey, 2009).

The main takeaway from this preliminary assessment is that Res-IRF results seem plausible, at least compared to past trends and to other models. Still, its main distinctive features, especially information spillovers, capital utilization and retrofitting dynamics proved influential, which motivated the subsequent analysis reported in the present paper.

AppendixB. Model updates

This section updates the description of the model, which was first published in [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF].

AppendixB.1. Data refinement

New corrections have been applied to the database of [START_REF] Marchal | Modélisation des performances thermiques du parc de logements[END_REF] to take better account of secondary residence and vacant units, and match the proportion of landlords and tenants with data from INSEE (2008). Based on the OPEN survey (OPEN, 2009), the initial retrofitting rate has been re-estimated at 3%/year instead of 1%/year. Expert elicitation have led to a downward revision of estimates of retrofitting costs (Table 2 in [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]); the cost matrix is now (in e/m 2 ):

C IN V -0 =        
       
Social housing has been introduced with a 4% discount rate, a value meant to reflect public decision-making. Other discount rates have been adjusted so as to maintain the weighted average discount rate at 20%. The new values are: 8% in owner-occupied single-family dwelling, 15% in owner-occupied multi-family dwellings, 45% in rented single-family dwellings, and 55% in rented multi-family dwellings.

AppendixB.2. Introduction of fuel wood and social housing

Fuel wood has been introduced as a new heating fuel and social housing has been introduced as a new dwelling type. Social housing was directly parameterized from [START_REF] Marchal | Modélisation des performances thermiques du parc de logements[END_REF]. In Marchal's database, fuel wood is mixed with all fuels other than natural gas, electricity and fuel oil in a single category. To match this with data from ADEME (2009), it was assumed that 44% of singlefamily dwellings and 1% of multi-family dwellings in this category were heated with fuel wood.

Fuel wood dwellings are assumed to account for 9% of new dwellings, and social housing 20%. The other categories are adjusted to keep initial proportions (Table 11 in [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]).

Adding a fuel led to an additional row in the matrix of construction costs (Table 8 in [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]). The new row reads as follows: 1200 e/m 2 for constructions meeting the 2005 building code, 1300 e/m 2 for constructions meeting the 2012 building code and 1600 e/m 2 for constructions meeting the 2020 building code.

A column and a row were added to the matrix of fuel switch costs (Table 7 in From ADEME (2009), the initial price of fuel wood in 2007 was assumed to be 0.04 e/kWh. The initial floor area in social housing was assumed to be 60 m 2 in existing dwellings and 65 m 2 in new dwellings. A saturation is placed at 75 m 2 and the growth process is the same as in the preexisting model.

AppendixB.3. Energy Service Function

In the previous version of the model (equation ( 14) [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]), a logistic energy service function was estimated using data from [START_REF] Cayre | There are people in the houses! how the results of purely technical analysis of residential energy consumption are misleading for energy policies[END_REF]. Here, the same data was fitted with an iso-elastic relationship, which is more convenient for subsequent sensitivity analysis: It is easier to vary a constant elasticity than the multiple parameters of a logistic function. The function F k (P ) = K(ρ k P ) e was estimated, with P the price of energy and ρ k the inverse efficiency parameter for a dwelling of type k. With ten points (y i , d i ) where y i is the utilization rate and d i the theoretical expenditure, a log-log linear regression yielded K = 2.72 and e = -0.505.

AppendixC. Indirect inputs used in sensitivity analysis

Some inputs of the model cannot be directly submitted to sensitivity analysis for a variety of reasons. Indirect inputs are built to circumvent this problem.

AppendixC.1. Exogenous inputs

Population, GDP and energy prices follow exogenous trajectories. One common way to assess the influence of input trajectories is to assess sensitivity to a constant annual growth rate. Yet such a factor potentially leads to very high values at the end of the time horizon. We adopt a different approach in our sensitivity analysis.

Each energy price trajectory is parameterized by two random inputs: the short-term price (in 2008) and the long-term price (in 2050). The energy price evolves linearly between these two values over the 2008-2050 period. The energy price value disclosed in table D.5 is for natural gas; the growth pattern is parallel for other fuels.

For the population trajectory, we build a random growth input ξ corresponding to a percentage increase growing over time. The reference values are multiplied by [1 + (1 + (Y ear -2008)/10)ξ]. With proceed similarly with the GDP trajectory.

AppendixC.2. Initial capital stock

Initial capital stock is, together with the learning rate, the input that parameterizes the learning-by-doing process. It is labeled K f (0) in equation ( 7) in [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]. It is given in the model as a hypermatrix and varied in the sensitivity analysis by a scalar k as follows: K f (0)(1 + k).

AppendixC.3. Calibration Targets: Shares

All 2008 shares to be replicated by the model (Energy label transitions in existing dwellings, energy labels in new constructions, fuel shares in new constructions, building type shares in new constructions) are given by matrices, the rows of which sum to 1. Sensitivity of the model to such inputs cannot be assessed by simply multiplying the associated matrix by a scalar. Matrix elements must be changed specifically. To do so, we build indirect inputs.

The matrix of 2008 energy label transitions against which intangible costs are calibrated is:

M S ini =         25% 27% 27% 21% ε% ε% 40% 26% 31% 2% ε% 66% 28% 6% ε% 95% 5% ε% 91% 9% 100%        
For instance, 26% of the dwellings in energy label F reach label C after retrofit. We build an indirect input α that represents the relative efficiency of 2008 energy label transitions: the higher α, the larger the proportion of transitions toward high energy labels. Input α is symmetric around 0, with negative values reflecting a less energy efficient situation than in the reference situation.

If α is positive, we make the following transformation:

a ′ i,i = a i,i (1 -α)
and:

a ′ i,j = a i,j + a i,j 1 -a i,i αa i,i
for i < j.

For α = 0.5, we thus have:

M S ini =         12% 31% 31% 24% ε% ε% 20% 35% 42% 3% ε% 33% 55% 12% ε% 47% 52% ε% 46% 55% 100%        
If α is negative, we make the following transformation:

a ′ i,i = a i,i + (1 -a i,i )|α|
and:

a ′ i,j = (1 -|α|)a i,j
For α = -0.5, we thus have:

M S ini =         62% 13% 13% 10% ε% ε% 70% 13% 16% 1% ε% 83% 14% 3% ε% 98% 2% ε% 95% 5% 100%        
We build a similar input to assess sensitivity of the model to the matrix of initial market shares of new constructions.

For fuel shares and building type shares, we adopt a slightly different approach. We assess sensitivity to one element of the matrix and adjust other elements so that the matrix sums to 1. For instance, for fuel shares, we vary the electricity share through indirect input opt elec :

M S elec = (1 + opt elec )M S elec
We then adjust the shares of other fuels and multiply them by the same scalar λ: M S ′ i =elec = λM S i =elec Solving equation M S i = 1, we find:

λ = 1 - M S elec 1 -M S elec opt elec

AppendixC.4. Retrofitting Costs

Retrofitting costs, that is, energy label transition costs are given in the model as a matrix. We assess the sensitivity of the model to the cost magnitude through a scalar multiplying the matrix. We also assess the sensitivity of the model to the cost breakdown by multiplying the matrix term by term to the following matrix:

             1 1 + γ 5 1 + γ 4 1 + γ 3 1 + γ 2 1 + γ 1 + γ 5 1 + γ 4 1 + γ 3 1 + γ 2 1 + γ 1 + γ 4 1 + γ 3 1 + γ 2 1 + γ 1 + γ 3 1 + γ 2 1 + γ 1 + γ 2 1 + γ 1 + γ             
Indirect input γ, if positive, gives relatively more weight to very energy efficient transitions; it gives them relatively less weight if negative.

AppendixC.5. 2008 Existing Building Stock Factors

The number of existing dwellings in 2008, given as a hypermatrix in the model, is broken down by energy label (labels G to A), heating fuel (electricity, natural gas, fuel oil and fuel wood) and building type (owner-occupied singleand multi-family dwellings, rented single-and multi-family dwellings and social housing).

The influence of each heating fuel is assessed by a scalar multiplying the number of dwellings in the same fuel category. The influence of building types is assessed in a similar way.

The influence of energy labels is assessed in a more aggregate way, using indirect input κ. The higher κ, the larger the proportion of high energy classes in the housing stock compared to the reference situation. Input κ keeps the number of dwellings labelled C unchanged and changes other labels as follows: label A numbers are multiplied by 1 + κ/2, label B numbers by 1 + κ, label D numbers by 1 -κ, label E numbers by 1 -κ/2, label F numbers by 1 -κ/3 and label G numbers by 1 -κ/4.

AppendixC.6. Energy Service Elasticity

The energy service is given by the following function: y = Kd e , with y the capital utilization rate, d the conventional energy expenditure and e the elasticity of utilization to conventional expenditure. Each time we vary e in the sensitivity analysis, we need to re-estimate K to best fit the data.

We introduce function which is the sum of squared distances between points from the regression and real data (k = ln(K)). As e is fixed, we need to find k 0 which minimizes f . We have

f (k) =
f ′ (k) = -2 10

Figure 1 :

 1 Figure 1: Global variations of Total Primary Energy Use

Figure 2 :

 2 Figure 2: Input influence on Total Primary Energy Use to 2020

Figure 3 :Figure 4 :

 34 Figure 3: Morris diagram of inputs affecting Total Primary Energy Use to 2020

Figure 5 :

 5 Figure 5: Distribution of excluded elementary effects among inputs

  [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]):

  y i ) -(k + eln(d i ))] 2

i=1[

  ln(y i ) -(k + eln(d i ))] and f ′′ (K) = 2 × 10 > 0Therefore the function is convex and has a minimum in k 0 = 1 10

Table 1 :

 1 Inputs most influential on Total Primary Energy Use to 2020 (EI: exogenous input; CT: calibration target; MP: model parameter)

	Rank Input

Table 2 :

 2 Inputs most influential on Total Primary Energy Use to 2050 (EI: exogenous input; CT: calibration target; MP: model parameter)

	Rank Input	Input type	µ *	ν *
	1	2050 Energy Price	EI	27.12 7.3%
	2	Energy Service Elasticity	MP	17.87 4.8%
	3	2008 Retrofitting Rate	CT	15.77 4.3%
	4	Learning Rate	MP	13.43 3.6%
	5	Population Growth	EI	12.19 3.3%
	6	2008 Energy Price	EI	11.87 3.2%
	7	Household Density Growth	MP	10.62 2.9%
	8	Retrofitting Costs Breakdown	MP	10.58 2.9%
	9	Discount Rate for Intangible Cost Calibration	MP	9.03 2.4%
	10	2008 Energy Label Transition Shares	CT	8.13 2.2%

Table 3

 3

		: Position Factor Index
		30 to 40 40 to 50 50 to 60 60 to 70 70 to 80
	2020 Energy Use	1.82	1.31	0.46	0.51	0.87
	2050 Energy Use	2.24	1.95	2.27	1.91	0.68

Table 4 :

 4 Monotony of most influential inputs as related to Total Primary Energy Use

	Input

not provide all measures of interaction between one input and another.

Table D .

 D 8: List of Inputs: Building Stock Variation Factors (SFD: single-family dwellings, MFD: multi-family dwellings)

			Input name Building			Unit Mean Std Dev	Min
	18		Household density growth	all			none -0.007	0.001 -0.009
	19	Floor area Elasticity for SFD	all			none	0.2	0.05	0.05
	20	Floor area Elasticity for MFD	all			none	0.01	0.01	0
	21	Floor area Elasticity for social housing	all			none	0.01	0.01	0
	22	Minimum Household Density	all people/household	2	0.1	1.7
	23	Maximum Floor area in SFD	new			m 2	140	10	125
	24	Maximum Floor area in MFD	new			m 2	80	5	75
	25	Maximum Floor area in social housing	new			m 2	80	5	75
	26		Initial Floor area in SFD	new			m 2	120	2	116
	27		Initial Floor area in MFD	new			m 2	70	2	67
	28	Initial Floor area in social housing	new			m 2	70	2	67
	29		Destruction Rate	existing			none 0.35%	0.05% 0.25%
	30 Proportion of Non-refurbishable Dwellings	existing			none	5%	1.5%	2%
		Table D.9: List of Inputs: Investment cost factors
			Input name Building Unit Mean Std Dev Min Max
	31	*Construction Costs	new none	0	0.1 -0.3	0.3
	32 *Retrofitting Costs Magnitude	existing none	0	0.2 -0.4	0.4
	33 *Retrofitting Costs Breakdown	existing none	0	0.2 -0.4	0.4
	34	*Fuel Switch Costs	existing none	0	0.1 -0.3	0.3
	Table D.10: List of Inputs: Theoretical Use of Energy Labels (BC: Building
	Code)
		Input name Building	Unit Mean Std Dev Min Max
	35 Label BC2005	new kWh/m 2 /year	120	3 110	130
	36 Label BC2012	new kWh/m 2 /year	50	2	45	55
	37	Label G	existing kWh/m 2 /year	750	25 710	790
	38	Label F	existing kWh/m 2 /year	390	15 365	415
	39	Label E	existing kWh/m 2 /year	280	10 260	300
	40	Label D	existing kWh/m 2 /year	190	10 175	205
	41	Label C	existing kWh/m 2 /year	120	5 110	130
	42	Label B	existing kWh/m 2 /year	70	5	65	75
	43	Label A	existing kWh/m 2 /year	40	5	35	45

"Res-IRF" stands for the "Residential module of IMACLIM-R France". IMACLIM-R France is a recursive general equilibrium model of the French economy developed at CIRED(Bibas et al.,

2012). Linking Res-IRF and IMACLIM-R France allows for the clearing of energy markets and energy prices to be determined endogenously. This process is described inGiraudet et al. (2011a). In the present paper, Res-IRF is run with no link to IMACLIM-R France.2 "Abnormal" here means any value higher than 7%, which is the value recommended by the U.S. Office of Management and Budget for private cost-benefit assessment[START_REF] Omb | Informing regulatory decisions: report to congress on the costs and benefits of federal regulations and unfunded mandates on state, local, and tribal entities[END_REF]

As discount rates in CIMS are not used to mimic split incentives only, intangible costs cannot be interpreted as representing the same barriers in the two models.

The number of citations of Morris' original paper in Thomson-ISI Web of Knowledge has grown steadily from below 10 per year until 2003 to more than 100 in 2013.

Apart from the first and last simulations of a trajectory, each simulation is used for two elementary effects calculations. One isolated crash then implies the exclusion of two elementary effect calculations. However, if n simulations crash sequentially, only n + 2 calculations are excluded. In the analysis reported here, most crashes occurred sequentially.

Note that the discount rate variations examined in this paper are centered around higher values than those typically examined in integrated assessment models, which usually vary in the [0%,8%] range. This explains partly the lower influence for discount rates found in our analysis.

Supplementary analysis by the French Sustainable Development General Commission, taking into account some levies not included in the model, confirmed this conclusion[START_REF] Giraudet | Evaluation des mesures du grenelle de l'Environnement sur le parc de logements[END_REF].

In that study, Res-IRF was linked to IMACLIM-R France. This overarching framework was simply named "IMACLIM" in the study.

i=1[ln(y i ) -eln(d i )]

AppendixA. Preliminary Assessment of Res-IRF

Res-IRF's defining paper contained a preliminary evaluation of the model [START_REF] Giraudet | Exploring the potential for energy conservation in french households through hybrid modeling[END_REF]. The numerical values generated in the reference scenario proved consistent with those commonly found in the literature for such variables as the growth rate of the building stock, the rebound effect and the price-elasticity of energy demand. Local sensitivity analysis was conducted on a few parameters suspected to be influential: energy prices, information spillovers, the learning-by-doing rate, discount rates and the heterogeneity parameter. This analysis revealed that the information spillovers and the heterogeneity parameters had a significant impact on the retrofitting rate; the impact of the learningby-doing rate and the discount rate was low and the impact of energy prices even lower. However, the impact of the energy price on final energy use was high, whereas the impact of all other inputs was low. This illustrates the fact that the energy price has an impact on both energy efficiency investment and capital utilization. In contrast, the impact of other inputs on energy efficient retrofits is partly taken back by the rebound effect.

Res-IRF has been used with the support of the French Sustainable Development General Commission to simulate the effectiveness of policies targeting the

AppendixD. Complete list of inputs

Tables D.5-D.11, D.12 and D.13 give the list of inputs involved in the sensitivity analysis.

All inputs follow a truncated normal distribution. One exception is the Heterogeneity Parameter, which follows a discrete uniform distribution. Tables D.5-D.11 display their mean, standard deviation, minimum and maximum values. Indirect inputs are introduced with mark "*".