This is a summative qualitative performance evaluation (PE) of the solar panel component of the solar panel component of the RE Sub-Activity. The final report will include information from the impact evaluation (IE) of the grid component of the project as a complement to the data collected on the PE for the solar panel component. The PE will utilize the IE data--understanding that it examined a different population-as a benchmark, along with the additional data gathered from field visits, the literature review on the solar panels, and basic implementation to evaluate the Sub-Activity.
All of the evaluation questions are derived from the program logic and are ultimately linked to the economic rate of return (ERR). The ERR measures the effectiveness of a program by contrasting the discounted flows of costs and benefits of a specific intervention. This is directly tied to the outcome of reduced price of electricity, which should yield a positive ERR for the intervention. Data from the IE of the RE Sub-Activity shows an ERR of 19.4 percent. This specific aspect of the RE Sub-Activity is assumed to yield a similar positive ERR. However, without any quantitative data, this PE will not be able to determine the exact ERR of the solar component.
Based on the evaluation scoping mission, conducted in El Salvador in January 2017, SI proposes a slight re-wording of the evaluation questions proposed by MCC to focus on the solar component and reflect the availability of data. Adjustments are denoted in italics.
Effectiveness:
i. To what extent was the solar panel component of the RE Sub-Activity implemented according to the original plans? (Include analysis of scope, timing, costs, and public perceptions)
a. Were the process and output targets achieved according to original plans and according to revised plans? If not, why?
ii. To what extent did the solar panel component reach the intended beneficiaries?
a. Were there any unintended beneficiaries?
b. Were some targeted households more likely than others to actually become beneficiaries?
iii. What were the facilitators of implementation and what challenges were encountered?
Outcomes:
iv. What are the perceived or observed outcomes of the solar panel component on the following:
a. Are households using the solar panels?
b. How have energy consumption patterns changed (i.e. sources of energy)?
c. Has the cost of energy changed?
d. How has total energy consumption by source changed?
e. Has household member time allocation changed (for women, men, children)?
f. Has air quality improved?
g. Has the household changed or increased their productive activities/income-generating activities?
v. What, if any, are the differential outcomes for women vs. men?
Sustainability:
vi. How sustainable are the outcomes likely to be from the solar panel component?
a. Are systems being maintained properly? Why or why not?
b. What types of households are able to maintain the solar panels?
c. Do households expect the grid to reach their homes in the near future?
Lessons Learned:
vii. What lessons can be learned from the solar component?
ERR
i. To what extent have the assumptions underlying the ERR held true?