AKATIGA conducted a formative evaluation study of TFCA-Kalimantan program implementation and governance with the aim of (i) obtaining an overview of TFCA Kalimantan program and project performance by looking at aspects of relevance, efficiency, effectiveness, participation, impact, and sustainability; (ii) compile a learning synthesis as a Knowledge Management (KM) material for TFCA Kalimantan; (iii) provide recommendations for improvement and scale up of the achievements of TFCA Kalimantan programs and projects.
AKATIGA builds an evaluation approach that can link effectiveness, efficiency, impact, participation, and sustainability in one conceptual framework. In this evaluation process, we combine several conceptual approaches consisting of Theory of Change (Weiss, 1997), measurement of effectiveness and efficiency / cost-effectiveness analysis for the public sector (World Bank, 2007), environmental valuation through a proxy for measuring the value of forest carbon (Rochmayanto, et al., 2014), Gender Analysis Pathway (BAPPENAS, 2007) and stakeholder analysis (Reed et al., 2009).
The process of extracting data on TFCA-Kalimantan stakeholders was conducted qualitatively using in-depth/ semi-structured interviews (either by telephone or in person), discussions groups, and field observations. Overall, interviews were conducted with 169 informants who represented each stakeholder in TFCA-Kalimantan, which includes the Oversight Committee, OCTM, Administrator, Regional Facilitators, 14 TFCA-Kalimantan Partners, local government and beneficiary communities.
