Are decisions well supported for the energy transition? A review on modeling approaches for renewable energy policy evaluation
© The Author(s). 2017
Received: 15 June 2016
Accepted: 18 January 2017
Published: 20 February 2017
This study reviews energy policy evaluation approaches on their capability to estimate a successful implementation of renewable energy policies. This is predominantly done via energy system modeling and analysis. Although modeling the possible success and effects is not a precondition for policy making, it is a powerful tool to support decision makers in policy making. This awareness has led to the development of numerous modeling approaches with many case studies. Therefore, effort has to be made to evaluate recent modeling approaches that could be suitable for renewable energy policy evaluation. It is the aim of this paper to provide an overview on recent renewable energy policy modeling approaches that are capable in evaluating the success and side effects to other sectors of renewable energy policies. We will highlight advantages and drawbacks of these approaches and provide a framework assessing the suitability of the presented methodologies for the evaluation of renewable energy policies. We provide a tabular overview that enables the reader to quickly derive information on the suitability of the several modeling approaches to evaluate renewable energy policies.
In 1980, the term Energiewende was first used in a study of the Öko-Institut . Since then, several policies were installed to follow the idea of a decarbonized energy system. This includes among others the support of the development of renewable energy and associated technologies, efficiency actions, renewable fuels, reduced import independence from fossil fuels, rural development, the decrease of long-term economic costs in kind of external effects, and R&D support [2–4]. International Energy Agency (IEA) defines renewable energy as energy derived from natural sources like sunlight, wind or some forms of biomass in terms of being not finite like fossil fuels having simultaneously a smaller impact on the environment . Interplay between renewable energies, energy efficiency like green buildings, and a sustainable transport sector is crucial for achieving the imposed goals of the German Government and the Energiewende. Renewable energy is characterized by replenishing at a faster rate than being consumed. Like Germany, several countries implemented strategies, policies, and stimulus packages to promote the transition towards a renewable energy system and increase their overall share of renewable energy in the energy system. However, increasing the share of renewable energy is often associated with sustainability challenges [6, 7]. The key elements of a sustainable development like economic performance, environmental protection, and social responsibility need to be considered in designing or evaluating support schemes, policies, or stimulus packages. But the design and evaluation of renewable energy promoting policies is a difficult task considering the multiple aspects policy designers and decision makers have to consider. Governmental interventions aiming at a renewable energy system promotion are expected to fulfill numerous demands but simultaneously affect many areas of human being.
One problem often arising with the implementation of renewable energy promoting instruments is the concentration on one energy sector. For example, in Germany, there are policies promoting the substitution of fossil energy resources in the power sector, like the Renewable Energy Source Act. Biofuel quotas promote the usage of renewable and sustainable fuels. In the heat sector, there is an obligation to use renewable heat for new constructed buildings on state level with an extension to the already existing building stock in one federal state. Each of these policies promotes partially a renewable energy system, the substitution of fossil resources, and an overall low-carbon energy system. However, each of these instruments has a restricted view on its effects, limited to the sector in which they should promote renewable energy. But there are side effects to the other sectors like the promotion of renewable power in Germany that in the recent past has led to an increase of power produced by coal plants having equalizing capacity due to the merit-order effect . Renewable excess power from wind and photovoltaic power plants for example can be stored as gaseous energy carrier (i.e., hydrogen) and used later in combined heat and power plants or as fuel and thus affecting the heat and fuel sector. Hence, there are side effects promoting a renewable energy system.
In recent decades, policy advice has built on the results of mathematical models . The advantages of a combination of computational power and theoretical analyses are only one driver for the widespread use of mathematical models. Furthermore, this follows the idea that decisions are no longer driven by subjective impressions but by profound technical analyses, what Porter called “the pursuit of objectivity” . Although this aim is still a bit up in the air, it has led to efforts of regulators and model developers to analyze and evaluate models. Following MacGillivray and Richards , these analyses and evaluations focus on issues including the plausibility of modeling assumptions, precision, and bias; the adequacy of the treatment of uncertainty and the value judgments that models may implicitly or explicitly encode. They sum these factors up with the term model quality. Determining the quality of a model is a difficult task. There are no formal modeling standards you can compare a model with. To assess the quality of a model is therefore a subjective action. A more impartial way is to assess model quality by comprehensible measures like accuracy, clarity, completeness, conciseness, or consistency. It is important that a model has a message and that this message is fully conveyed.
One problem arising when the effects of many different policies are evaluated by many different modeling techniques is an almost confusing and unclear muddle of possibilities to choose from. In the research literature, there are a number of efforts to evaluate or compare models with regard to energy, but a systematic and comparative study is rarely found. First effort was made by Hoffman and Wood  focusing on the evolution and development of energy system models followed by, among others, Panday  and Urban et al. . Although they have carried out a comparative study, their focus was different from ours. In this study, we want to highlight modeling methodologies that have been used to test policies with regard to the introduction and dissemination of renewable energy. For instance, Teufel et al.  provide a review of system dynamics models for electricity market simulations. Within their extensive model review, they identified among others the trend in system dynamics market simulations to simulate more detailed new aspects and markets like CO2 certificates, green electricity certificates, and integration of RE sources. Besides electricity, green buildings play a major role in achieving the national and international goals of governments to reduce greenhouse gas (GHG) emissions and to increase the energy efficiency. In Coakley et al. , a literature review on methods modeling, building energy, and simulating cost-effectiveness of energy conservation measures was done. The industrial sector, being a sector with huge energy-saving potential, was part of a study of Olanrewaju and Jimoh . They reviewed energy system models to develop a tool for long-term planning of energy supply that is indeed a pillar of the energy revolution. One approach to deal with decision-making is decision analysis in terms of multiple criteria analysis. Wang and Poh  did a survey on decision analysis in energy and environmental modeling. They show the evolution of this modeling technique and recent developments . Summarizing it can be said that numerous models and modeling techniques were surveyed and reviewed that are connected to fields of modeling renewable energy policy evaluation. While all these studies are doubtless useful, a clear gap in the knowledge becomes obvious. What is non-existent in the current research literature is a systematic overview on policy evaluation modeling techniques determining their suitability for renewable energy. This study aims to close this knowledge gap. Accordingly, the objective of the paper is to provide a systematic overview of a set of modeling methodologies capable of evaluating renewable energy policies. We focus on renewable energy alone because their implementation into the energy system is often accompanied by inter alia overcoming market failures. However, their market penetration can be observed globally and is without alternative.
This paper provides a framework to help decision makers or scientists to decide on one policy evaluation modeling approach depending on the question they want to answer regarding the strengths and weaknesses of the several approaches. It is highly advisable to foster a plurality of different modeling approaches as this article is not about choosing one approach over another. Thus, a systematic overview on recent approaches will be provided and highlight which modeling approach fits to which scope of application. It must be said that there is not the one and only modeling approach being free of restrictions. In this paper, we want to answer the question which policy evaluation approach fits best to analyze future policies in the context of the Energiewende. Due to the fact that different policy results affect each other, it is highly advisable to estimate possible outcomes of future policies through modeling and simulation techniques. We combine an extensive literature and model review to assess the characteristics of the different approaches. It is shown that there is not one approach that is the best one but each approach has its advantages and drawbacks in policy evaluation modeling. Nevertheless, hybrid methods tend to are the most balanced ones. A combination of system dynamics and agent-based modeling is a promising approach.
Literature selection and categorization
Clear assignment to one of the modeling approaches illustrated in Fig. 1
Modeling technique and assumptions have to be published in detail
Traceability of modeling approach
Publications in peer-reviewed journals
Recent case studies regarding renewable energy policies
Applying these criteria, 48 case studies remained were used for the evaluation approach. The second step was to identify criteria that can be used to compare the various modeling approaches and to have a basis for the construction of a framework. Applying these criteria, it is possible to deeper investigate the chosen articles, respectively the renewable energy policy evaluation models. Within the analysis of the abovementioned articles, several patterns were observed. As mentioned before, the identified renewable energy (system) modeling techniques were grouped (Fig. 1). To compare the models and their suitability to model and evaluate renewable energy policies, we choose the parameters modeling approach, spatial coverage, sectoral coverage, time horizon, ex-post vs. ex-ante, quality of data sources, assumptions about actor behavior, assumptions about markets and systems, and the possibility to implement the approach in a computer-aided framework. The methods as well as the criteria were chosen with respect to the task of modeling renewable energy policies. They have to meet partially different requirements than modeling techniques used for fossil-based energy systems. This is based on the fact that the introduction of renewable energy is often associated with market failures, subsidies, governmental influence, learning curves, technological progress, cost degression, and etc. It is important that the respective modeling methodology is capable of implementing these factors. More precisely, the criteria for the comparison of the different renewable energy policy evaluation approaches were chosen considering the specific demands of policies aiming at the development of renewable energy. The spatial coverage is an important criterion because policies can be implemented from a regional scale (obligations or subsidies in federal states of a country) up to a global scale (Paris agreement). The sectoral coverage has to be considered because the implementation of renewable energy policies affects many different sectors. In this way, a certain level of disaggregation is important to best possible estimate the effects of renewable energy policies to the different sectors. Time horizon was chosen as criterion because policies can be designed for short term to long term. Besides, these policies can have different effects in the short term than in the long term and vice versa. The differentiation between ex-post and ex-ante is important because it separates between an evaluation of a single policy and a set of policies before (ex-ante) or after (ex-post) the implementation of it (them). The quality of data sources has to be addressed because of the need of a referral system to calibrate the model. The fact how the model reflects the reality is given by the criteria assumptions on actor behavior and assumptions on markets and systems. Finally, the question if the approach could be implemented in a computer-aided framework is considered because this could increase traceability, evaluation time, or the quality of results, just to name a few examples. Questions that shall be asked by a modeler before he decides for a modeling approach to estimate the effects of renewable energy policies comprise, inter alia: Shall the focus be laid on actors (agent-based) or the overall system (system dynamics)? Is there technological progress (system dynamics, CGE, hybrid approach) or not (I/O modeling)? Shall the effects of policies be considered ex-post (qualitative) or ex-ante (quantitative)?
Introduction to energy models for policy evaluation
The implementation of the abovementioned criteria into policy impact analysis frameworks is predominantly done via energy models in a quantitative matter. Another kind of analysis of policy impacts is done via theoretical analysis in a qualitative matter. Furthermore, hybrid forms have been developed. A model is understood as an abstract representation of the real world respectively of a real system. Behavior and interactions of the system elements are described qualitative and quantitative. In this way, a model is a purposeful and simplified reflection of the reality. The main motivation formulating a scientific model is reduction in complexity. Due to extent and diversity of questions and framework conditions, it is obvious that there cannot be one single modeling approach. Just as little, there is one energy system, model there is the “best” methodological approach. The methodological approach is determined by problem formulation and implicit assumptions that were made. To answer the different questions in energy system analysis, various models were used. Based on the diverse methodological approaches and their hybrid forms, a characterization can only be generalized. Long-term energy models are predominantly used for the analysis of energy and environmental policies and politics. Strengths of energy system models are the high level of detail, their flexibility, transferability to new questions, and transparency in modeling results . Energy system models can be separated between optimization models and simulation models. While optimization models try to determine the most cost-efficient option of action, simulation models try to simulate the effects of the given action options.
Although modeling the possible impacts is not a precondition for policy making, it is a powerful tool to support decision makers in policy making. Following Perman (2011), a model is more useful when it is set up inter-sectoral, distinguishing different options of production and consumption . That is done via several types of models namely input-output models, computable general equilibrium models, and linear and non-linear programming (optimization) models . For the difficult task of analyzing the role of energy and climate policies, respectively a set of policies for the development of renewable energies, numerous authors presented their frameworks. The most frequently used models have in common that they assume hyper-rational and homogenous human behavior that ensures tractability but does not consider less-than-rational decision-making. Hyper-rational in the before-mentioned context means that if there was a decision to be made, it is by definition the best choice or else they would have chosen something else. After decades of Integrated Assessment Models (IAMs) that were doubtless helpful to gain insights to mitigation options and climate change dynamics, there truly exist further improvements . The most common modeling approaches for defining and validating a policy or a set of policies are consecutively presented.
We grouped the most commonly used methodologies of policy evaluation design approaches into three categories, namely qualitative, quantitative, and hybrid. Hybrid policy evaluation designs combine quantitative and qualitative attributes. Thereby, the term hybrid is used for a combination of two or more single approaches but not dedicated to one specific combination.
Quantitative designs are handling numerical data within a calculative framework, whereas qualitative ones consist mainly of explanatory descriptions . The major energy and climate policy modeling is done via quantitative methods, namely bottom-up and top-down models. Bottom-up and top-down models are synonyms for aggregate and disaggregate models . Top-down modeling approaches focus on the interaction between the energy sector and the whole economy, whereas bottom-up modeling approaches focus on the energy sector alone. Top-down models, usually input-output models or computable general equilibrium models (CGE), have a closer look at the economy and include inter-sectorial feedback effects. On the contrary, bottom-up models describe technologies in detail, recent, and prospective and come usually as mathematical programming. That is why, they suit best for policies referring to technology changes, like efficiency standards. Drawbacks of bottom-up models lie in their basics. The major drawback, besides their inability to model economy-wide interactions, comes from the mathematical programming itself, i.e., the implementation of tax distortions or market failures [22–24]. Besides this, there are approaches combining bottom-up and top-down. Significant advances in hybrid modeling, meaning the combination of bottom-up and top-down, are made due to the restrictions of both bottom-up and top-down models. The design of hybrid modeling approaches is complicated because of the need of macroeconomic and engineering expertise and data as well as the need of numerical calibration .
Input-output modeling as part of empirical economic research bases mainly on the transaction table and was formulated first by Wassily Leontief in 1936. Although input-output (I/O) models were first designed as economic analysis tools, they often contain an ecological component. In the 1960s, first steps were made in linking economy and environment bringing out lots of environmental I/O models in the following years. Policymakers benefit from insights into changing structures of economical basic data like production, consumption, employment, and import/export. If I/O models contain an ecological component, they can also provide information on environmental impact. I/O models can estimate changes to the whole economy made by single changes in economic activities. They are strong in linking production and consumption . Miller and Blair  provide a comprehensive guide for environmental and energy I/O models. The integration of environmental aspects into economy-dominated I/O models can be done via coupling with life cycle analysis. Case studies representing the I/O methodology are Bruckner et al. (2005), Pettersson et al. (2012), Liu et al. (2009), Cellura et al. (2013), and Li and Jiang (2016) [26–30].
Computable general equilibrium models can show how an economy reacts to changes in policy or technology. They have a neo-classical spirit and are essentially empirical versions of the Walrasian general equilibrium system . CGE models can only be solved computationally, not algebraically. With the increase in computing power and their availability, CGE modeling received a rapid growth. CGE models run mostly midterm to long term. Another approach is presented by Proença and St. Aubyn  with their hybrid bottom-up/top-down, multi-sector, static CGE model. It was developed for a small economy and is an extension of Böhringers and Rutherfords model . Case studies of Wang et al. (2009), Wianwiwat and Asafu-Adjaye (2013), Bretschger et al. (2011), Beckman et al. (2011), Kretschmer and Peterson (2010), Fortes et al. (2014), Guo et al. (2014), and Suttles et al. (2014) were used to evaluate the CGE modeling methodology [33–40].
System dynamics models try to reproduce interdependencies between components of a real system considering the time. The mathematical description of the interdependencies bases on differential equations. System dynamics models are predominantly used analyzing liberalized markets. They can display market mechanisms through differentiated mechanisms of action instead of following a single objective function that allows those models a differentiated image of real markets. Equal to other market simulation models, there is the challenge how to suggest plausible assumptions for future behavior of market actors and how this should be transferred into parameters.
With system dynamics, it is possible to analyze interactions of economic and environmental interactions and feedbacks . Furthermore, coupling system dynamics with evaluation tools and methods, it is possible to simulate medium-term effects of potential futures . As Aslani et al. (2014) stated, only little research has been done using the system dynamics methodology for dynamical modeling of renewable energy policies containing energy and climate policies . The reasons for that are the complexities when it comes to combining energy and climate policies and modeling their feedbacks as well as evaluation of results of such a modeling approach. System dynamics with its possibility to analyze the impact of a variable change to the structure of the system can help to evaluate the behavioral change of a policy instrument. That is important because most policy instruments are often evaluated of their impact on development and adoption of innovations instead of their impact on the system behaviors . There are diverse possibilities for analyzing the impact of energy and climate policy instruments within a system dynamics framework. After achieving confidence in the system dynamics model, i.e., through evaluation with historical data, the analysis is mostly done via experimentation, exhaustive what-if-scenarios, and automatic optimization via external software [45–47]. The main activities within these kinds of analyses are trial-and-error simulation, changing parameter values or switching parameters, and loops on and off . Because of the inherent limitations of these methods especially for large models with 100+ variables, Al-Saleh and Mahroum (2015) developed a method for structured policy analysis. This method combines linearization of the model, the dynamic decompensation weights analysis (DDWA) and the loop eigenvalue elasticity analysis (LEEA). This composition of methods provides a circular process of testing, policy analysis, and policy interpretation for implementation . System dynamics methodology is used by Hsu , Barisa et al. , Li et al. , Aslani et al. , Jeon and Shin , Wang et al. , Wu et al. , Chyong Chi et al. , Szarka et al. , Movilla et al. , and Ansari and Seifi  to model renewable energy policy evaluation. These references were used to evaluate the methodology [42, 43, 48–56].
The method of agent-based modeling enables a researcher to analyze individual behavior in a system. Actions can be simulated on an individual scale, and unique decisions can be observed that cannot be identified on a system scale. So-called market participants are represented by agents. Each agent has kinds of assets that can be made as detailed as in energy systems. In markets, each agent follows his own bidding strategy defined by his individual objective function. Agents communicate with each other and adapt their strategy on market developments. In contrast, multi-agent models focus on solving specific problems using independent agents, while agents in agent-based models focus on whether agents are obeying assigned rules that forms their behavior. Gerst et al.  developed the agent-based model ENGAGE including a scenario discovery tool and a policy discovery tool. A detailed overview on agent-based simulation models is presented in  and . Agent-based approaches for energy system simulations are usually used for short-term meditations in liberalized energy markets. Lee et al. , Nannen et al. , Tang et al. , Gerst et al. , Zhang et al. , Gerst et al. , and Ding et al  are case studies using agent-based modeling methodology. They were used for the evaluation of the methodology [21, 58–63].
Realist evaluation focuses on the importance of CMO (context, mechanism, outcome)
Theory of change considers the importance of short and medium-term effects on long-term effects as well as the connections of programs and outcomes at each step
Contribution analysis tries to identify whether an outcome was produced by a certain program or external effects
The approaches of Harmelink et al. , Harmelink et al. , Murphy et al. , and Abdul-Manan et al.  are case studies representing the theory-based methodology. They were used to evaluate the methodology [65–68].
Multi-criteria analysis (MCA) is part of decision theory and a collective term for any structured approach determining preferences under given options. The options get ranked differently on the criteria that are considered relevant. MCA is a mostly subjective approach founding on the decision makers’ evaluations, although objective data like prices can be added. There are many diverse MCA methods from the simplest method weighted sums to more complex or even hybrid approaches. MCA is used when a single criterion decision analysis approach like a cost-benefit analysis is insufficient. MCA can include social, environmental, technical, economic, and financial criteria. The output of a MCA is a single most preferred option respective a ranking of options. The case studies of Browne et al. (2010), von Stechow et al. (2011), Clo et al. (2013), Yavuz et al. (2015), and Cannemi et al. (2014) represent the theory-based methodology with regard to the evaluation of renewable energy policies [69–73].
Coupling existing large-scale bottom-up and top-down models ; Böhringer and Rutherford call this a “soft-link” because of the substantial problems in consistency and convergence of iterative solution algorithms. Therefore, this approach may face substantial problems
The second approach deals with the combination of one complete model type with a reduced form of the other one. Commonly, bottom-up energy system models are linked with an aggregated one sector top-down model [74, 75].
While most quantitative methods can perform energy and climate policy evaluation on their own, qualitative approaches are often combined. According to Boonekamp (2006) and Sorrell et. al (2003b), there is a need to combine quantitative and qualitative methods for complex tasks [77, 78]. Boonekamp  used a qualitative analysis with a bottom-up energy system model to evaluate interaction effects for policy instruments for household energy efficiency in the Netherlands for 1990–2003. Further hybrid approaches combining quantitative and qualitative evaluation methods were done by [32, 79]. Sarica and Tyner , Igos et al. , and Cai et al. (2015), Proença and St. Aubyn , Strachan and Kannan , Jaccard et al. , Böhringer and Rutherford (2008), Pollitt et al. , and Barker et al.  are case studies that used a hybrid modeling approach to evaluate renewable energy policies. They were used to evaluate the methodology of hybrid modeling approaches [31, 32, 80–86].
Input-output model evaluation for renewable energy policy modeling
Evaluation results of methodologies for renewable energy policy modeling
Regional to global
Regional to multi-regional
Regional to global
Regional to multi-regional
Regional to multi-regional
Regional to global
Medium level of disaggregation
High level of disaggregation
Medium level of disaggregation
High level of disaggregation
High level of disaggregation
High level of disaggregation
High level of disaggregation
Short term to long term
Midterm to long term
Short term to midterm
Short term to long term
Quality of data sources
Medium dependent on data quality
Medium dependent on data quality
Highly dependent on data quality to validate model
Highly dependent on data
Highly dependent on data
Highly dependent on data quality
Assumptions on actor behavior
Combining knowledge of individual agents’ behavior to make inferences about market relationships
Cooperation and an open exchange of information or competition and secrecy
Dependent on the combination of approaches
Assumptions on markets and systems
Constant technological coefficients and linear production functions static system
Perfectly competitive markets
CGE models have an explicit representation of the microeconomic behavior of the economic agents
Single country and open economy
Equilibrium across all the markets (e.g., capital, labor, materials/services)
System behavior is dynamic system components interact with each other through feedbacks
Time dependency of system (structure)
Consistent description of the real system
In evolutionary game theory mostly limited to constant environments
Numeric simulations of multi-agent systems offer much more flexibility
Often based on the economic theory of general equilibrium
Assumptions of how an intervention is supposed to work is linked to the actual outcomes
Uses a variety of different criteria rather than a single criterion to analyze options and alternatives for decision-making
Dependent on the combination of approaches
Wianwiwat & Asafu-Adjaye (2013)  Bretschger et al. (2011)  Wang et al. (2009)  Beckman et al. (2011)  Kretschmer and Peterson (2010) Fortes et al. (2014)  Guo et al. (2014)  Suttles et al. (2014) 
Barisa et al. (2015)  Hsu (2012)  Li et al. (2012)  Aslani et al. (2014)  Jeon & Shin (2014)  Wang et al. (2014)  Wu et al. (2011)  Chyong Chi et al. (2009)  Szarka et al. (2008)  Movilla et al. (2013)  Ansari & Seifi (2012) 
Clo et al (2013) 
Igos et al. (2015)  Sarica and Tyner (2013)  Proença and St. Aubyn (2013)  Strachan and Kannan (2008)  Jaccard et al. (2004)  Böhringer and Rutherford (2008) Pollitt et al. (2014) Barker et al. (2010)  Cai et al. (2015)
CGE models evaluation for renewable energy policy modeling
To determine the applicability of the CGE methodology for evaluation modeling of renewable energy policies, several case studies were investigated in detail. Table 1 shows the evaluation results in more detail. CGE models are mostly used for economic research questions. When investigating the results of environmental policies, CGE models were coupled with environmental indicators. This is mostly done for air pollutants like CO2 . Previously, the combination of equations and databases describing a CGE model were often solved in a custom-written program. Today, most CGE models are embedded in known software systems like GAMS, Matlab, or Excel. This comes along with a cost-reduction for CGE modeling as well as an increase in transparency. Within the CGE approach, it is possible to derive information on success and failure of policy adjustments for short-term to long-term simulations . Because one CGE model is usually set up for one country or region, transferability of one approach to similar ones is tough. Drawbacks of most CGE models are a low degree of detailedness and a higher but still insufficient attention of dynamics. In addition, CGE models assume full price adjustment and equilibrium in all markets, including the labor market, with the effect that there will be no compulsory unemployment, resulting in the fact that results tend to be determined by the supply side rather than the demand side . Mostly, they lack in providing technological details and development. Furthermore, they have problems in assuming how technologies will evolve in the future as well as future cost-development. Additionally, most top-down models violate fundamental physical restrictions such as the conservation of matter and energy . Effects of policies on employment are therefore hardly simulated. Being post-Keynesian in nature, the E3MG model, numerously used for the simulation of effects of renewable energy policies, is able to overcome the before-mentioned shortcoming by being based on the theory of effective demand. It has to be mentioned that using dynamic econometrically estimated equations sets the E3MG model apart from usual CGE model that are static [34, 40]. Following Barker , the E3MG model as well as the E3ME are considered as a hybrid model. An argument is the underlid behavior of consumers and producers which is often not met . Furthermore, the needed data is frequently unavailable and has to be assumed, what is another drawback of CGE models . Being often criticized for not having a sufficient validation, CGE models can often be seen critical. A novel approach with a calibration was done by Beckman et al. .
System dynamics evaluation for renewable energy policy modeling
To evaluate the system dynamics methodology to its applicability to renewable energy policy modeling, several case studies were used. The results of the evaluation are given in Table 1. The methodology distinguishes itself from a high level of traceability. The system dynamics methodology is characterized by being a modeling technique fitting to a broad field of research questions . With a combination of optimization approaches like what Al-Saleh and Mahroum (2015) presented, a comprehensive policy mix optimization could be added. In this way, the most sustainable and successful mix of policies could be derived.
Qualitative system dynamics models like causal loop diagrams reflecting cause-effect relationships can be set up without a simulation or computing environment (Ansari and Seifi, ). The transfer of a qualitative to a quantitative system dynamics model is usually done in software environments like Stella, Vensim, or Powersim because of a better visualization ability and faster solving of the implemented differential equations . Within the system dynamics approach, midterm to long-term simulations can be computed comparing different scenarios [50, 55]. System dynamics modeling distinguishes oneself from a high grade of traceability and transferability. Drawbacks of this modeling approach lie in validation of the interdependencies, defined by the model developer and the necessity of calibrating the model with suitable data, i.e., historic data . If there is no real referral system, a calibration with real or historic data is not possible. Furthermore, system dynamics models are hardly used for modeling short-term effects, because their strength lies in the identification of dynamics in the system that often show their behavior in the mid to long term . A prerequisite for system dynamics modeling is a dynamic behavior of the examined system and interaction between system components through feedbacks, which distinguish it from methodologies assuming a static market, like CGE or partially agent-based modeling [49, 56]. Still, a relationship between system dynamics modeling and agent-based modeling is important to recognize . In addition, system dynamics is strong in considering learning effects and technology innovation .
Agent-based models evaluation for renewable energy policy modeling
The research work of several authors was investigated in more detail to determine the applicability of the agent-based methodology for renewable energy policy evaluation modeling. The results of the evaluation are shown in Table 1. Agent-based modeling has a long tradition in social sciences . Typically, agent-based models are set up within a modeling simulation environment and can be used to derive short-term to midterm simulation results [62, 63]. The approach allows the comparison of different scenarios and an effect estimation of the implementation of renewable economy policies [59, 60, 62]. Agent-based modeling is a traceable technique with a low degree of transferability because of the individual programming that is necessary. But if the whole system has to be analyzed and the individual scale is too small, agent-based modeling is not the right choice [58, 62]. The restriction of an identical objective function like it is part in energy system models is abolished by agent-based models . Agents are supposed to do cooperation and an open exchange of information or competition and secrecy . Agent-based models often base on the economic theory of general equilibrium, which is a controversial theory. In addition, agent-based modeling works well for evolutionary approaches .
Theory-based evaluation for renewable energy policy modeling
Several case studies were investigated to evaluate the methodology of theory-based policy evaluation, illustrated in Table 1. One problem in theory-based evaluation is data availability. Although other evaluation approaches need a certain amount of data too, theory-based evaluation is highly dependent on data availability . Theory-based approaches (TBA) are not set up in a computing environment. It is not possible to derive simulation-driven results from a theory-based analysis of policy impacts . Rather, this approach deals with the question why a program or policy had or had not an impact . Nevertheless, TBA shows good traceability, whereas transferability is not given due to customized analysis. The strengths of theory-based evaluation are the usefulness in niches were other approaches might fail as well as the property that they have a look at the cause-effect elements and that they can contribute to extent existing data [67, 68]. In the meanwhile, the major drawbacks are that the size of a contribution of an intervention cannot be measured. Furthermore, a theory-based evaluation can be very time- and resource-consuming and needs a lot of data which can be difficult.
Multi-criteria analysis evaluation for renewable energy policy modeling
We found several studies using the multi-criteria analysis for the evaluation of renewable energy policies. Those case studies were investigated deeper to evaluate their applicability to renewable energy policy evaluation. Table 1 shows the evaluation results. The evaluation process within our research shows similar results to the evaluation of the theory-based evaluation methodology. Similarities within the modeling approaches, both approaches are based on decision theory, are the reason for this. But in contrast to the theory-based approach, MCA can be implemented into software environments . This is always a plus for better visualization ability. Scenarios can be compared within the methodology deriving information for short-term to long-term impacts of different policy options [70–72]. MCA approaches are in most cases highly traceable . Due to customized analysis framework, a good transferability is not given. A shortcoming of the MCA method is that it cannot show that doing an action for welfare is better than doing nothing.
Hybrid modeling approaches evaluation for renewable energy policy modeling
Link independently developed top-down and bottom-up models
Incorporation of technological detail into a top-down framework or macroeconomic feedback into a bottom-up framework
Creating a fully integrated model using specific solution algorithms
Another possibility to combine quantitative and qualitative approaches is seen by Söderholm et al.  stating that qualitative approaches can be used complementary while constructing scenarios that later can be used for modeling by quantitative approaches.
As mentioned before, quantitative approaches are more often used for the evaluation of renewable energy policies. Reasons for that could be the characteristic of being able to judge on effects of policies ex-post only, a lower degree of traceability and drawbacks with the implementation in computing environments. An important point for the implementation of renewable energy is technological progress. In this way, it is possible to estimate future market shares. I/O modeling is not capable of including endogenous technological progress, whereas the other ex-ante modeling methodologies are able to do so. Furthermore, long-term forecasting and simulations cannot be derived from I/O analysis. Dynamics is also an important issue but also a kind of attitude of the modeler. Whereas I/O and CGE of the quantitative approaches overlook dynamics, system dynamics is built on the fundamentals of dynamics in a system. Agent-based modeling can pay attention to dynamics if it is set-up as a numeric simulation of multi-agent systems.
Each approach can be used for the simulation of effects of regional policies. Due to its strengths, agent-based modeling is the preferred option to model the relation between agents in markets on a regional scale. Usually, I/O modeling and system dynamics approaches are characterized by a medium level of disaggregation, whereas the other approaches are in need of a high level of disaggregation. I/O modeling is used for the simulation of short-term effects. In contrast, system dynamics shall not be used for short-term modeling because its strengths lie in the simulation of the systems behavior to changes that will most likely occur in the midterm to long term. Agent-based modeling is used for short term to midterm because the behavior of the agents cannot be estimated for the long-term. CGE and hybrid methods can be used for short-term to long-term time horizons. The needed quality of data sources varies between the different approaches. Whereas approaches like system dynamics are mainly dependent on data quality because of the need of a referral system to calibrate the model, I/O modeling and CGE are able to compensate a lack of data quality.
This paper has examined seven common modeling approaches that are applicable for renewable energy policy evaluation, namely I/O modeling, computable general equilibrium modeling, system dynamics modeling, agent-based modeling, theory-based evaluation, multi-criteria analysis, and hybrid approaches. As presented above, quantitative, qualitative, and hybrid modeling approaches are widely used in renewable energy policy planning and evaluation, generating lots of dedicated models as well as model extensions. This is important because in most countries, renewable energy needs governmental support in terms of policies to compete in markets. Nevertheless, there are evident features of each methodology that makes it unsuitable for a specific problem. I/O modeling is favorable for economy-related policy evaluation but has its drawbacks in not considering technological progress and dynamic feedbacks. Like I/O modeling, CGE modeling has its strengths in economy-related policy evaluation issues but struggles with a usually low level of detailedness and dynamics. System dynamics is a modeling technique fitting to a broad variety of research questions with a high degree of traceability and transferability. However, validation of the interdependencies, defined by the model developer, and the necessity of calibrating the model with suitable data are difficulties within the system dynamics modeling approach. Agent-based modeling is a modeling technique which allows the consideration of smaller entities that can behave in a predetermined manner. In contrast, agent-based modeling is not the best choice if the overall system has to be analyzed. Theory-based evaluation can be useful in niches where other modeling approaches fail while having a closer look at cause-effect elements. One major drawback is that the size of a policy implementation effect cannot be measured. Like theory-based evaluation, multi-criteria analysis evaluation is an ex-post evaluation method, strong in niches where the other evaluation approaches might fail. In contrast to theory-based evaluation, multi-criteria analysis can be implemented in computing frameworks. However, its major drawback is that it is not possible to derive information on whether doing an action is better than doing nothing. Hybrid models are combinations of the several different policy evaluation methodologies presented in this manuscript. In this way, hybrid models can minimize (or even abolish) drawbacks of using only one single approach. However, they are not a restriction-free solution.
All modeling approaches have their strengths and weakness, which is why, no modeling approach is superior per se. Policymakers should therefore strive for and promote a certain model plurality. The potential of this plurality is twofold: on the one hand side, decision maker can choose those models which are able to address their specific question most adequate. For the decision of a modeling approach, the relevant criteria are the scale of the renewable policy (local, regional, or national); the time horizon, which should be included (short, medium, or long term); and the granularity of the expected results (technical details, dimensions of assessment, and etc.). On the other hand, the parallel application of different approaches can also be taken to understand the robustness of findings in the different models. Additionally, efforts are undertaken to link the different approaches. One promising avenue for further research is hybrid models that use different modeling approaches in a homogenous context achieving more robust results. Another promising avenue is the development of linkages between already existing models. To sum up, there is not one and only modeling methodology that fits to all requirements for the evaluation of renewable energy policies. The methodologies are as diverse as renewable energy policies due to the broad variety of questions that shall be answered with policy evaluation modeling; thus, a plurality of modeling approaches is highly recommended. However, we presented an overview of the most recent and multiple times used methodologies with information on advantages and drawbacks of each modeling methodology. In this way, it is easier to get information which modeling approach shall be used for which kind of renewable energy policy evaluation model.
The research was funded by resources of the Federal Ministry for Economic Affairs and Energy
Availability of data and materials
The datasets supporting the conclusions of this article are included within the article.
The main work (80%) was done by the first author. The co-author contributed significantly to the introduction and conclusions section (20%). Both authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Öko-Institut e.V (1981) Wachstum und Wohlstand ohne Erdöl und Uran. S. Fischer, Frankfurt am MainGoogle Scholar
- Lehmann P, Gawel E (2013) Why should support schemes for renewable electricity complement the EU emissions trading scheme? Energy Policy 52:597–607. doi:10.1016/j.enpol.2012.10.018 View ArticleGoogle Scholar
- Mekhilef S, Barimani M, Safari A, Salam Z (2014) Malaysia’s renewable energy policies and programs with green aspects. Renew Sustain Energy Rev 40:497–504. doi:10.1016/j.rser.2014.07.095 View ArticleGoogle Scholar
- Byrnes L, Brown C, Foster J, Wagner LD (2013) Australian renewable energy policy: barriers and challenges. Renew Energy 60:711–721. doi:10.1016/j.renene.2013.06.024 View ArticleGoogle Scholar
- IEA - Renewable energy (2015) https://www.iea.org/about/faqs/renewableenergy/. Accessed 29 July 2015
- del Río P, Burguillo M (2009) An empirical analysis of the impact of renewable energy deployment on local sustainability. Renew Sustain Energy Rev 13:1314–1325. doi:10.1016/j.rser.2008.08.001 View ArticleGoogle Scholar
- Pierie F, Bekkering J, Benders RMJ et al (2016) A new approach for measuring the environmental sustainability of renewable energy production systems: focused on the modelling of green gas production pathways. Appl Energy 162:131–138. doi:10.1016/j.apenergy.2015.10.037 View ArticleGoogle Scholar
- Sensfuß F, Ragwitz M, Genoese M (2008) The merit-order effect: a detailed analysis of the price effect of renewable electricity generation on spot market prices in Germany. Energy Policy 36:3086–3094. doi:10.1016/j.enpol.2008.03.035 View ArticleGoogle Scholar
- MacGillivray BH, Richards K (2015) Approaches to evaluating model quality across different regime types in environmental and public health governance. Glob Environ Change 33:23–31. doi:10.1016/j.gloenvcha.2015.04.002 View ArticleGoogle Scholar
- Porter T (1995) Trust in numbers: the pursuit of objectivity in science and public life. Princeton University Press, New YorkGoogle Scholar
- Hoffman KC, Wood DO (1976) Energy system modeling and forecasting. Annu Rev Energy 1:423–453. doi:10.1146/annurev.eg.01.110176.002231 View ArticleGoogle Scholar
- Panday R (2002) Energy policy modelling: agenda for developing countries. Energy Policy 30:97–106View ArticleGoogle Scholar
- Urban F, Benders RMJ, Moll HC (2007) Modelling energy systems for developing countries. Energy Policy 35:3473–3482. doi:10.1016/j.enpol.2006.12.025 View ArticleGoogle Scholar
- Teufel F, Miller M, Genoese M, Fichtner W (2013) Review of System Dynamics models for electricity market simulationsGoogle Scholar
- Coakley D, Raftery P, Keane M (2014) A review of methods to match building energy simulation models to measured data. Renew Sustain Energy Rev 37:123–141. doi:10.1016/j.rser.2014.05.007 View ArticleGoogle Scholar
- Olanrewaju O, Jimoh A (2014) Review of energy models to the development of an efficient industrial energy model. Renew Sustain Energy Rev 30:661–671. doi:10.1016/j.rser.2013.11.007 View ArticleGoogle Scholar
- Wang Q, Poh KL (2014) A survey of integrated decision analysis in energy and environmental modeling. Energy 77:691–702. doi:10.1016/j.energy.2014.09.060 View ArticleGoogle Scholar
- Möst D, Fichtner W (2009) Einführung zur EnergiesystemanalyseGoogle Scholar
- Spyridaki N-A, Flamos A (2014) A paper trail of evaluation approaches to energy and climate policy interactions. Renew Sustain Energy Rev 40:1090–1107. doi:10.1016/j.rser.2014.08.001 View ArticleGoogle Scholar
- Perman R (2011) Natural resource and environmental economics, 4th edn. Pearson Addison Wesley, Harlow, Essex, New YorkGoogle Scholar
- Gerst MD, Wang P, Roventini A et al (2013) Agent-based modeling of climate policy: an introduction to the ENGAGE multi-level model framework. Environ Model Softw 44:62–75. doi:10.1016/j.envsoft.2012.09.002 View ArticleGoogle Scholar
- Böhringer C, Rutherford TF (2009) Integrated assessment of energy policies: decomposing top-down and bottom-up. J Econ Dyn Control 33:1648–1661. doi:10.1016/j.jedc.2008.12.007 MathSciNetView ArticleMATHGoogle Scholar
- Pressman I (1970) A mathematical formulation of the peak-load problem. Bell J Econ Manage Sci 1(2):304-326Google Scholar
- Takayma T, Judge G (1971) Spatial and temporal price and allocation models. Netherlands, AmsterdamGoogle Scholar
- Sue Wing I (2008) The synthesis of bottom-up and top-down approaches to climate policy modeling: electric power technology detail in a social accounting framework. Energy Econ 30:547–573. doi:10.1016/j.eneco.2006.06.004 View ArticleGoogle Scholar
- Bruckner T, Morrison R, Wittmann T (2005) Public policy modeling of distributed energy technologies: strategies, attributes, and challenges. Ecol Econ 54:328–345View ArticleGoogle Scholar
- Pettersson F, Söderholm P, Lundmark R (2012) Fuel switching and climate and energy policies in the European power generation sector: a generalized Leontief model. Energy Econ 34:1064–1073. doi:10.1016/j.eneco.2011.09.001 View ArticleGoogle Scholar
- Liu H-T, Guo J-E, Qian D, Xi Y-M (2009) Comprehensive evaluation of household indirect energy consumption and impacts of alternative energy policies in China by input–output analysis. Energy Policy 37:3194–3204. doi:10.1016/j.enpol.2009.04.016 View ArticleGoogle Scholar
- Cellura M, Di Gangi A, Longo S, Orioli A (2013) An Italian input–output model for the assessment of energy and environmental benefits arising from retrofit actions of buildings. Energy Build 62:97–106. doi:10.1016/j.enbuild.2013.02.056 View ArticleGoogle Scholar
- Li K, Jiang Z (2016) The impacts of removing energy subsidies on economy-wide rebound effects in China: an input-output analysis. Energy Policy 98:62–72. doi:10.1016/j.enpol.2016.08.015 View ArticleGoogle Scholar
- Proença S, St. Aubyn M (2013) Hybrid modeling to support energy-climate policy: effects of feed-in tariffs to promote renewable energy in Portugal. Energy Econ 38:176–185. doi:10.1016/j.eneco.2013.02.013 View ArticleGoogle Scholar
- Böhringer C, Rutherford TF (2008) Combining bottom-up and top-down. Energy Econ 30:574–596. doi:10.1016/j.eneco.2007.03.004 View ArticleGoogle Scholar
- Wang K, Wang C, Chen J (2009) Analysis of the economic impact of different Chinese climate policy options based on a CGE model incorporating endogenous technological change. Energy Policy 37:2930–2940. doi:10.1016/j.enpol.2009.03.023 View ArticleGoogle Scholar
- Wianwiwat S, Asafu-Adjaye J (2013) Is there a role for biofuels in promoting energy self sufficiency and security? A CGE analysis of biofuel policy in Thailand. Energy Policy 55:543–555. doi:10.1016/j.enpol.2012.12.054 View ArticleGoogle Scholar
- Bretschger L, Ramer R, Schwark F (2011) Growth effects of carbon policies: applying a fully dynamic CGE model with heterogeneous capital. Resour Energy Econ 33:963–980. doi:10.1016/j.reseneeco.2011.06.004 View ArticleGoogle Scholar
- Beckman J, Hertel T, Tyner W (2011) Validating energy-oriented CGE models. Energy Econ 33:799–806. doi:10.1016/j.eneco.2011.01.005 View ArticleGoogle Scholar
- Kretschmer B, Peterson S (2010) Integrating bioenergy into computable general equilibrium models—a survey. Energy Econ 32:673–686. doi:10.1016/j.eneco.2009.09.011 View ArticleGoogle Scholar
- Fortes P, Pereira R, Pereira A, Seixas J (2014) Integrated technological-economic modeling platform for energy and climate policy analysis. Energy 73:716–730. doi:10.1016/j.energy.2014.06.075 View ArticleGoogle Scholar
- Guo Z, Zhang X, Zheng Y, Rao R (2014) Exploring the impacts of a carbon tax on the Chinese economy using a CGE model with a detailed disaggregation of energy sectors. Energy Econ 45:455–462. doi:10.1016/j.eneco.2014.08.016 View ArticleGoogle Scholar
- Suttles SA, Tyner WE, Shively G et al (2014) Economic effects of bioenergy policy in the United States and Europe: a general equilibrium approach focusing on forest biomass. Renew Energy 69:428–436. doi:10.1016/j.renene.2014.03.067 View ArticleGoogle Scholar
- Berka V, Dobrosi L (2004) High level handling of system dynamics models in rural development planning. In: J. Wolfbauer, H. Kürzl (Eds.), Proceedings of Iron Curtain International Symposium, Geonardo Ltd., Budapest, Hungary, p. 82Google Scholar
- Szarka N, Kakucs O, Wolfbauer J, Bezama A (2008) Atmospheric emissions modeling of energetic biomass alternatives using system dynamics approach. Atmos Environ 42:403–414. doi:10.1016/j.atmosenv.2007.09.051 View ArticleGoogle Scholar
- Aslani A, Helo P, Naaranoja M (2014) Role of renewable energy policies in energy dependency in Finland: system dynamics approach. Appl Energy 113:758–765. doi:10.1016/j.apenergy.2013.08.015 View ArticleGoogle Scholar
- Al-Saleh Y, Mahroum S (2015) A critical review of the interplay between policy instruments and business models: greening the built environment a case in point. J Clean Prod 109:260–270. doi:10.1016/j.jclepro.2014.08.042 View ArticleGoogle Scholar
- Forrester J (1961) Industrial dynamics. Productivity Press, Cambridge, MAGoogle Scholar
- Lane DC, Oliva R (1988) The greater whole: Towards a synthesis of system dynamics and soft systems methodology. Eur J Oper Res 107(1):214–235.Google Scholar
- Morecroft J (1988) System dynamics and microworlds for policymakers. Eur J Oper Res 35:9–27Google Scholar
- Hsu C-W (2012) Using a system dynamics model to assess the effects of capital subsidies and feed-in tariffs on solar PV installations. Appl Energy 100:205–217. doi:10.1016/j.apenergy.2012.02.039 View ArticleGoogle Scholar
- Barisa A, Romagnoli F, Blumberga A, Blumberga D (2015) Future biodiesel policy designs and consumption patterns in Latvia: a system dynamics model. J Clean Prod 88:71–82. doi:10.1016/j.jclepro.2014.05.067 View ArticleGoogle Scholar
- Li F, Dong S, Li Z et al (2012) The improvement of CO2 emission reduction policies based on system dynamics method in traditional industrial region with large CO2 emission. Energy Policy 51:683–695. doi:10.1016/j.enpol.2012.09.014 View ArticleGoogle Scholar
- Jeon C, Shin J (2014) Long-term renewable energy technology valuation using system dynamics and Monte Carlo simulation: photovoltaic technology case. Energy 66:447–457. doi:10.1016/j.energy.2014.01.050 View ArticleGoogle Scholar
- Wang Y, Chang X, Chen Z et al (2014) Impact of subsidy policies on recycling and remanufacturing using system dynamics methodology: a case of auto parts in China. J Clean Prod 74:161–171. doi:10.1016/j.jclepro.2014.03.023 View ArticleGoogle Scholar
- Wu J-H, Huang Y-L, Liu C-C (2011) Effect of floating pricing policy: an application of system dynamics on oil market after liberalization. Energy Policy 39:4235–4252. doi:10.1016/j.enpol.2011.04.039 View ArticleGoogle Scholar
- Chyong Chi K, Nuttall WJ, Reiner DM (2009) Dynamics of the UK natural gas industry: system dynamics modelling and long-term energy policy analysis. Technol Forecast Soc Change 76:339–357. doi:10.1016/j.techfore.2008.06.002 View ArticleGoogle Scholar
- Movilla S, Miguel LJ, Blázquez LF (2013) A system dynamics approach for the photovoltaic energy market in Spain¤. Energy Policy 60:142–154. doi:10.1016/j.enpol.2013.04.072 View ArticleGoogle Scholar
- Ansari N, Seifi A (2012) A system dynamics analysis of energy consumption and corrective policies in Iranian iron and steel industry. Energy 43:334–343. doi:10.1016/j.energy.2012.04.020 View ArticleGoogle Scholar
- Sensfuß F, Genoese M, Ragwitz M, Möst D (2008) Agent-based simulation of electricity markets—a literature review. Energy Stud Rev 15:19–47Google Scholar
- Lee T, Yao R, Coker P (2014) An analysis of UK policies for domestic energy reduction using an agent based tool. Energy Policy 66:267–279. doi:10.1016/j.enpol.2013.11.004 View ArticleGoogle Scholar
- Nannen V, van den Bergh JCJM, Eiben AE (2013) Impact of environmental dynamics on economic evolution: a stylized agent-based policy analysis. Technol Forecast Soc Change 80:329–350. doi:10.1016/j.techfore.2012.08.013 View ArticleGoogle Scholar
- Tang L, Wu J, Yu L, Bao Q (2015) Carbon emissions trading scheme exploration in China: a multi-agent-based model. Energy Policy 81:152–169. doi:10.1016/j.enpol.2015.02.032 View ArticleGoogle Scholar
- Zhang B, Zhang Y, Bi J (2011) An adaptive agent-based modeling approach for analyzing the influence of transaction costs on emissions trading markets. Environ Model Softw 26:482–491. doi:10.1016/j.envsoft.2010.10.011 View ArticleGoogle Scholar
- Gerst MD, Wang P, Borsuk ME (2013) Discovering plausible energy and economic futures under global change using multidimensional scenario discovery. Environ Model Softw 44:76–86. doi:10.1016/j.envsoft.2012.09.001 View ArticleGoogle Scholar
- Ding Z, Wang Y, Zou PXW (2016) An agent based environmental impact assessment of building demolition waste management: conventional versus green management. J Clean Prod 133:1136–1153. doi:10.1016/j.jclepro.2016.06.054 View ArticleGoogle Scholar
- Rossi P, Lipsey M, Freeman H (2004) Evaluation; A systematic approach, 7th ed. SAGE Publications, Thousand OaksGoogle Scholar
- Harmelink M, Joosen S, Blok K (2005) The theory-based policy evaluation method applied to the ex-post evaluation of climate change policies in the built environment in the Netherlands, ECEEE 2005 Summer StudyGoogle Scholar
- Harmelink M, Nilsson L, Harmsen R (2008) Theory-based policy evaluation of 20 energy efficiency instruments. Energy Efficiency 1:131–148Google Scholar
- Murphy L, Meijer F, Visscher H (2012) A qualitative evaluation of policy instruments used to improve energy performance of existing private dwellings in the Netherlands. Energy Policy 45:459–468. doi:10.1016/j.enpol.2012.02.056 View ArticleGoogle Scholar
- Abdul-Manan AFN, Baharuddin A, Chang LW (2015) Application of theory-based evaluation for the critical analysis of national biofuel policy: a case study in Malaysia. Eval Program Plann 52:39–49. doi:10.1016/j.evalprogplan.2015.03.007 View ArticleGoogle Scholar
- Browne D, O’Regan B, Moles R (2010) Use of multi-criteria decision analysis to explore alternative domestic energy and electricity policy scenarios in an Irish city-region☆. Energy 35:518–528. doi:10.1016/j.energy.2009.10.020 View ArticleGoogle Scholar
- von Stechow C, Watson J, Praetorius B (2011) Policy incentives for carbon capture and storage technologies in Europe: a qualitative multi-criteria analysis. Glob Environ Change 21:346–357. doi:10.1016/j.gloenvcha.2011.01.011 View ArticleGoogle Scholar
- Clò S, Battles S, Zoppoli P (2013) Policy options to improve the effectiveness of the EU emissions trading system: a multi-criteria analysis. Energy Policy 57:477–490. doi:10.1016/j.enpol.2013.02.015 View ArticleGoogle Scholar
- Yavuz M, Oztaysi B, Cevik Onar S, Kahraman C (2015) Multi-criteria evaluation of alternative-fuel vehicles via a hierarchical hesitant fuzzy linguistic model. Expert Syst Appl 42:2835–2848. doi:10.1016/j.eswa.2014.11.010 View ArticleGoogle Scholar
- Cannemi M, García-Melón M, Aragonés-Beltrán P, Gómez-Navarro T (2014) Modeling decision making as a support tool for policy making on renewable energy development. Energy Policy 67:127–137. doi:10.1016/j.enpol.2013.12.011 View ArticleGoogle Scholar
- Bosetti V, Carraro C, Galeotti M, Tavoni M (2006) WITCH A: World Induced Technical Change Hybrid Model. Energy J 27(2):13–38Google Scholar
- Messner S, Schrattenholzer L (2000) MESSAGE-ACRO: linking an energy supply model with a macro economic module and solving iteratively. Energy 25:267–282Google Scholar
- Frei CW, Haldi P-A, Sarlos G (2003) Dynamic formulation of a top-down and bottom-up merging energy policy model. Energy Policy 31:1017–1031. doi:10.1016/S0301-4215(02)00170-2 View ArticleGoogle Scholar
- Boonekamp P (2006) Actual interaction effects between policy measures for energy efficiency—a qualitative matrix method and quantitative simulation results for households. Energy 31:2848–2873. doi:10.1016/j.energy.2006.01.004 View ArticleGoogle Scholar
- Sorrell S, Smith A, Betz R (2003) Interaction in EU climate policy. Interact project. Final report to the European Commission. Brussels,BelgiumGoogle Scholar
- De Jonghe C, Delarue E, Belmans R, D’haeseleer W (2009) Interactions between measures for the support of electricity from renewable energy sources and CO2 mitigation. Energy Policy 37:4743–4752. doi:10.1016/j.enpol.2009.06.033 View ArticleGoogle Scholar
- Sarica K, Tyner WE (2013) Alternative policy impacts on US GHG emissions and energy security: a hybrid modeling approach. Energy Econ 40:40–50. doi:10.1016/j.eneco.2013.06.003 View ArticleGoogle Scholar
- Igos E, Rugani B, Rege S et al (2015) Combination of equilibrium models and hybrid life cycle-input–output analysis to predict the environmental impacts of energy policy scenarios. Appl Energy 145:234–245. doi:10.1016/j.apenergy.2015.02.007 View ArticleGoogle Scholar
- Cai Y, Newth D, Finnigan J, Gunasekera D (2015) A hybrid energy-economy model for global integrated assessment of climate change, carbon mitigation and energy transformation. Appl Energy 148:381–395. doi:10.1016/j.apenergy.2015.03.106 View ArticleGoogle Scholar
- Strachan N, Kannan R (2008) Hybrid modelling of long-term carbon reduction scenarios for the UK. Energy Econ 30:2947–2963. doi:10.1016/j.eneco.2008.04.009 View ArticleGoogle Scholar
- Jaccard M, Murphy R, Rivers N (2004) Energy–environment policy modeling of endogenous technological change with personal vehicles: combining top-down and bottom-up methods. Ecol Econ 51:31–46. doi:10.1016/j.ecolecon.2004.06.002 View ArticleGoogle Scholar
- Pollitt H, Park S-J, Lee S, Ueta K (2014) An economic and environmental assessment of future electricity generation mixes in Japan—an assessment using the E3MG macro-econometric model. Energy Policy 67:243–254. doi:10.1016/j.enpol.2013.12.018 View ArticleGoogle Scholar
- Barker T, Anger A, Dessens O et al (2010) Integrated modelling of climate control and air pollution: Methodology and results from one-way coupling of an energy–environment–economy (E3MG) and atmospheric chemistry model (p-TOMCAT) in decarbonising scenarios for Mexico to 2050. Environ Sci Policy 13:661–670. doi:10.1016/j.envsci.2010.09.008 View ArticleGoogle Scholar
- Miller R, Blair P (1985) Input-output analysis : foundations and extentionsMATHGoogle Scholar
- Masouman A (2013) Application of an input-output econometric model to investigate the Illawarra economyGoogle Scholar
- Sarker RA, Ray T (2010) Agent based evolutionary approach: an introduction. In: Sarker RA, Ray T (eds) Agent-Based Evol. Search. Springer Berlin Heidelberg, Berlin, Heidelberg, pp 1–11View ArticleGoogle Scholar
- Söderholm P, Hildingsson R, Johansson B et al (2011) Governing the transition to low-carbon futures: a critical survey of energy scenarios for 2050. Futures 43:1105–1116. doi:10.1016/j.futures.2011.07.009 View ArticleGoogle Scholar