Monitoring and Evaluation References
Households survey for “Evaluation of the Peacebuilding Impact: Water Supply Improvement in the Host Communities of Syrian Refugees in Jordan” (EPIWaSI):
JICA has promoted impact evaluation in order to verify the usefulness of its project/programme. JICA commissioned International Development Center of Japan Inc. (IDCJ) in 2020 to conduct the impact evaluation of the Programme for Urgent Improvement of Water Sector for the Host Communities of Syrian Refugees in Northern Governorates of Jordan. International Development Center of Japan (IDCJ) partnered with Dajani Consulting to collect baseline and end-line data from households existing in two districts in Irbid (Hawarra and Sarieh). The sample size included treatment group consisting of 500 households, and another control group consisting of 500 households. The sample was prepared using GIS maps and AUTOCAD maps of UNOPS, Yarmouk Water Company and Department of Statistics. The data collection tools include face-to-face household questionnaire, and Key Informant Interview / Focus Group Guide. More than 20 enumerators participated in the data collection.
Valuation of the Targeting Mechanism for TAKAFUL Program at the National Aid Fund
As a part of the National Aid Fund expansion in providing services for more vulnerable Jordanians, the World Bank hired Dajani Consulting to evaluate and audit the accuracy of the current model process, and identify sources of error and propose improvements, examine the ability of the Cash Transfer Program “TAKAFUL” to reach and address the vulnerabilities and needs of informal workers, identify bottlenecks in the implementation of outreach, registration, data verification, enrolment processes, and addressing grievances. A survey of 2640 households was launched by Dajani Consulting and data collected, analyzed and presented to the World Bank with feedback on the applicability of selection measure of most vulnerable Jordanian.
Program Final Evaluation Data Collection Services - Mercy Corps
Mercy Corps contracted Dajani Consulting as a data collection firm to collect quantitative and qualitative data for the programme’s final evaluation. The data collection took place in four phases, covering more than 950 youth, in addition to 39 key informant interviews with implementing partners (coaches, coordinators, volunteers) and 45 focus groups discussion sessions with youth. The enumerators provided by Dajani Consulting ensured quality and validity of data. Enumerators collected quantitative and qualitative data across three targeted sites (Ajloun, Mafraq, Karak) with youth aged between 12-19, under guidance of MEAL team of Nubader. Dajani Consulting recruited, trained, managed and supervised the fieldwork and data collection, to provide clean datasets and reports.
Independent verification of use of services by targeted beneficiaries for the Jordan Emergency Health Program (JEHP)
Jordan has received financing from the World Bank and the Islamic Development Bank in the form of loan implemented by Ministry of Planning and International Cooperation with support of Ministry of Health and Audit Bureau, to cover the running cost resulting from providing healthcare services to Syrian refugees and poor Jordanians under the project “Jordan Emergency Health Program”. The objective of the verification assignment is to provide solid evidence about the actual utilization of the healthcare services by target beneficiaries, through employing the services of Dajani Consulting as an independent, unbiased audit/ verification entity (UVE). The resulting reports of the UVE will be adopted by Ministry of Planning to support the decision of financial reimbursements by World Bank and Islamic Development Bank to Ministry of Health. The assignment includes sample preparation of the healthcare centers and hospitals as well as patients, field visits to verify the records at healthcare facilities, analysis and reporting. The assignment will be implemented for 5 rounds which started 2016 until 2019.
Process Evaluation of the Integrated Outreach Worker Program (IOWP) under the Project “National Unified Registry and Integrated Outreach Worker Program for Targeting Social Assistance
The Government of Jordan, with support from the World Bank, is implementing the project "Support to Implementation of a National Unified Registry and Outreach Program for Targeting Social Assistance”. The project development objective (PDO) is to improve the targeting of social safety net programs and developing an efficient outreach mechanism. It has two main components: Component 1: Building and Using the National Unified Registry (NUR) for Targeting; and Component 2: Piloting Integrated Outreach Worker Program (IOWP). MOPIC contracted Dajani Consulting to evaluate the impact of the program after three years of implementation in three governorates by International Youth Foundation (IYF) in coordination with the PMU at MOPIC. The scope of work includes literature review, desk study of the reports and the case Management System (CMS), evaluation methodology design, data collection targeting different segments (social workers, beneficiaries, stakeholders) using a range of tool and instruments (focus groups, key person structured interviews, in-person survey of more than 1000 households, and on-line survey of social workers and supervisors. The analysis of the research yields a final evaluation report of the efficiency, effectiveness, lessons learned and sustainability strategy for the program.
Jordan Economic Growth Plan (JEGP) Development of Operational Plan
Jordan Economic Growth Plan (JEGP) 2018 – 2022 was issued by the Economic Policy Council in May 2017 as a road map to double economic growth from 2.5% to 5 % over the coming five years in spite of regional instability. Dajani Consulting in close cooperation with Ministry of Planning and International Cooperation, translated JEGP interventions into action plans . Operational plans included exact steps to be taken by each intervention to achieve final results, exact budget needed to implement the each and every activities, dates of achievements, evidence of achievements as well as other detailed information that can lead Jordan towards achievements of tangible results on the ground .
JEGP operational plans was produced as a first step towards achievement of computerized Monitoring and Evaluation platform that monitoring the level of achievement and gives out self-generating reports about the current and achievements . The new monitoring system will be hosted at the Ministry of Planning. Dajani Consulting was assigned by Ministry of Planning International Cooperation to review, develop and finalize the action plans. The tasks included working with about 19 sectors and more than 30 line ministries and governmental institutions on a Secretary General level to produce measurable action plans for interventions and projects with specific KPIs in terms of time and financial requirements. The tasks also included development of standard template of action plans (in Excel format), review of ministries inputs, verify listed activities and finance needs, discuss and finalize interventions and activities, discuss and finalize budgets of the action plans for 2018 – 2022. More Information about JEGP can be found on www.egp.jo
Baseline Survey of the project for strengthening the capacity of career counseling for the youth in Jordan – JICA
The Ministry of Labour (MOL) and their employment offices (EOs), The King Abdullah II Fund for Development (KAFD) and Career Guidance Office at universities (CGOs) are the responsible organizations for career counseling. These organizations need to acquire the skills of career counseling in order to provide proper services, enhance marketing skills, and provide career counseling in cooperation with the private sector. In order to tackle these issues, the Jordanian government requested the Japanese government to implement the “Project for Strengthening the Capacity for Career Counseling for the Youth”. Dajani Consulting was contracted by JICA to perform the baseline study of the project, including data collection of the counseling activities and achievements (such as career guidance sessions, job fairs, private sector promotion visits and career counseling meetings) during the last year from more than 20 EOs and CGOs around Jordan. Dajani Consulting used a special questionnaire form to collect that data through personal visits to the EOs and CGOs. The collected data was then translated and cleaned to be submitted to JICA project as part of the final report.
Training on PCM and M&E for Mission East and Humanity Organization – Kurdistan – Iraq
In February 2017, Dajani Consulting prepared and carried out two training workshops for project managers, project officers and monitoring coordinators working with International NGO (Mission East) local NGO (Humanity Organization) in Duhok, Northern Iraq. More than 25 participants attended 4-day Project Cycle Management (PCM) and 4-day Monitoring & Evaluation (M&E) workshops at the premises of the organizations. A senior trainer from Dajani Consulting delivered the training, which presented the principles of PCM and M&E in the development projects, and offered real life examples, interactive exercises and group work. The participants engaged in the training, and evaluated the workshops, then received certificates. By the end of the training workshops, the trainer developed and submitted a final report of the training evaluation results, as well as recommendations for additional capacity building programs for the participants.
Consulting Services and Capacity Building in the Field of Monitoring & Evaluation for INJAZ KSA
Capitalizing on the work done for INJAZ Al Arab organization, Dajani Consulting provided consulting services to INJAZ program in Jeddah - Saudi Arabia, with the aim to develop a monitoring and evaluation mechanism for youth and entrepreneurship initiatives. In addition, customized on-the-job training was offered to INJAZ KSA to build their capacity in operating and maintaining the M&E system and use the tools to collect information and keep records of performance and achievement in the initiatives.
Youth Finance Program Impact Assessment
FINCA Jordan, a reputable microfinance company, implemented the Youth Finance (YF) program funded by USAID during 2012-2014, with the aim to test a development model that pairs financing with training to youth entrepreneurs in order to help them develop income generating activities and run their small business. By the end of 2014, Dajani Consulting was contracted to conduct an impact assessment of the program. The team of Dajani Consulting designed a study methodology based on a survey tool, conducted over telephone interviews with sample of about 200 beneficiaries, to collect information about their experience and perception of the youth finance program. The analysis of the data resulted in a final report presented during information dissemination session held at FINCA’s headquarter, and attended by USAID and other microfinance providers.
Measuring E-TVET Performance Assessment Indicators
Dajani Consulting was contracted by International Labor Organization (ILO) to design and implement a monitoring mechanism for Key Performance Indicators (KPIs) of the technical and vocational education and training (TVET) sector in Jordan, as part of ILO’s project on Monitoring and Evaluation for the ETVET System in Jordan. The selected indicators for measurement included:
- Average TVET Trainee Cost
- Public Perception of TVET
- Policy Coordination among TVET institutions
The consultants of Dajani Consulting reviewed the indicators description, and discussed the methodology with the ILO project manager and E-TVET Council secretariat. The consultants prepared data collection tools and analysis mechanism. At the end of the assignment, Dajani Consulting delivered three reports to be introduced in a workshop at the end of the ILO project.
Monitoring and Evaluation workshops for key players of the Employment Technical Vocational Education
As part of the support to the E-TVET reform project managed by GOPA Consultants, Dajani Consulting delivered 4-day training program titled “Monitoring and Evaluation, Program/Project Cycle and Results Based Management and Related Reporting and Proposal Development/Writing” for two groups. The objective of workshops is contributed to improved capacity for E-TVET program and project monitoring, evaluation and reporting at management and operational levels for officials of the E- TVET institutions through providing training and capacity building in Monitoring and Evaluation, Program/Project Cycle and Results Based Management, and Reporting and Proposal Development/Writing. The training workshop included examples, case studies and group exercises. The workshop was organized by "Support to Employment and TVET Reform Program” a project funded by the EU. The workshop was attended by Ministry of Labour, Ministry of Education, Vocational Training Corporation, Jordan Enterprise Development Corporation, National Employment and Training company, Central Bank of Jordan, Technical Vocational Education and Training Fund, Employment-Technical and Vocational Education and Training Council, National Employment Strategy Monitoring Unit, Center of Accreditation and Quality Assurance and Balqa Applied University.
Developing Monitoring system for National Employment Strategy Unit at the Ministry of Labor
As part of the technical assistance provided by support to ETVET reform project –EU funded project, Dajani Consulting has been assigned to help the monitoring unit at the Ministry of Labor to establish monitoring system for all employment initiatives and projects adopted by the National Employment Strategy. The newly established system can monitor progress on the ground on a regular basis and can provide reports to higher managers at the ministry. This system is also an evidence of the required commitment of Government of Jordan to meet the bench-marks of the financing agreement with EU.
“Yalla Watheefa” Program : Monitoring and Documenting Labor Market Dynamics in Jordan
As a follow up to the Jordan NOW wage subsidy voucher and soft skills training pilot project and the Jordan NOW 2.0 screening and matching pilot project, the World Bank assigned Dajani Consulting to study and evaluate (a) shortages on the demand side of the labor market across a variety of sectors and (b) educated youth’s reservation wage and willingness to pursue available jobs. Therefore, World Bank hired Dajani Consulting to collect monthly employment data from a sample of firms in Amman and to manage an experiment to document the job search process of educated youth in Amman. The project included updating of listing information of previous participants in employment programs, as well as listing newly-graduated college and university students to take part in the “Yalla Watheefa” experimental project. During the project, a large team of project managers, supervisors and field researchers surveyed more than 500 firms for 6 months to collect employment and recruitment data. The researchers also matched between the vacancies announced by 40 companies and the job preferences of more than 2500 graduate. Latest electronic data collection technology was used to control the quality of the collected data.
Ex-post Evaluation Study of the Second Human Resources Development Sector Investment Project II in Jordan
International Development Center of Japan (IDCJ) has carried out the ex-post evaluation study of the 2nd human resources development sector investment project for Jordan implemented during 1997-2005, which was funded by a loan from Japan Bank for International Development (JBIC). Dajani Consulting Co. was contracted by IDCJ to coordinate the study activities in Jordan, and to conduct the field research. Dajani Consulting started the project October 2007 and completed it by early April 2008. The project included a national survey of JBIC-supported and non-supported comprehensive schools, vocational centers and community colleges for the purpose of collection of information about the effect and the impact of the project after its completion. The information was collected suing standard questionnaire distributed to all principals and sample of current students. The field survey also covered a sample of private firms employing vocational graduates. At the end of the survey, Dajani Consulting submitted a complete set of information entered in an Excel database to IDCJ for analysis. The final study report was submitted to JBIC and the government of Japan.
Assessment of Current Status of Conditions Precedents for the Cash Transfer/Budget Support Program
The Cash Transfer/Budget Support component of USAID’s assistance to Jordan is a cross-cutting development support mechanism that significantly contributed to the implementation of several reform initiatives in various sectors since the program was launched in 1997.
The Cash Transfer program is on a grant basis. Disbursements of the Program funds to the Government of Jordan’s Budget Account are based on achieving a list of agreed-upon reform measures (referred to as CPs matrix) that support Jordan’s broader economic reform and restructuring process. These reform measures are known as the Condition Precedents (CPs) for the Cash Transfer/Budget Support Program.
USAID/Jordan ensures that conditions precedents are met before disbursing the cash transfer to the Government of Jordan Budget account. For this purpose, USAID/Jordan has established effective controls to ensure that the GoJ have met the conditions precedent through the provision of evidence to support the completion of each condition precedent, and provision of evidence that the GoJ have met the general terms and conditions relating to use of the cash transfer in accordance with the terms of the Cash Transfer agreement. The CPs are aligned with USAID/Jordan strategic growth and development objectives in each sector.
USAID’s objective of implementing this assessment is to assist USAID/Jordan with analysis of the status of the Conditions Precedent that triggered annual disbursements under the Cash Transfer/Budget Support Program for the period 1997 - 2009.
More than 100 CPs were assessed in economic growth sector; water and environment; health; and democracy governance sectors. The results of assessment as well as strategic recommendations were reported to USAID.
Evaluation and Impact Assessment of Jordan Service Modernization Programme – phases I & II
As part of the final evaluation for Jordan Service Modernization Programme (JSMP), Dajani Consulting was contracted to take part in the final evaluation and impact assessment of the JSMP, focusing on the grant schemes to SMEs. The purpose of the evaluation was to measure the actual gained benefits and impacts of the intervention on the growth, expansion and export development of SMEs. During the survey, more than 200 companies (including control group) were contacted and interviewed to collect information about their performance before and after the grant. JSMP is a project managed by Jordan Enterprise Development Corporation (JEDCO) and funded by the EU which aims at helping Jordanian SMEs to be better prepared companies for new jobs creation export markets. Phases I and II were implemented during 2010 – 2012.
Evaluation and Needs Assessment Survey of SMEs for National Fund for Enterprise Support (NaFES)
NaFES has managed to provide support to over 600 Jordanian SMEs throughout the years of 2002 -2013. The technical assistant ranged from building organization structure to provide full diagnostics and implementation plans. Dajani Consulting was contracted to carry out final evaluation for the fund to measure actual impact of the intervention and to measure level of gained benefits. The project also included identifications of future needs for technical assistant of the SMEs in Jordan. More than 400 SMEs were contacted and interviewed to formulate a comprehensive picture about the extent of impact and sustainability of the support and technical assistance provided through NaFES.
In depth Study of Gender Pay Equity in the Private Education sector in Jordan
The International Labor Organization (ILO) contracted Dajani Consulting to implement a study with the objective of provide substantive evidence the gender pay gap in the private education sector (KG, primary and secondary schools, and universities) to inform the corrective actions needed (e.g. legislative measures, collective bargaining, and application of gender-neutral job evaluation methods) and recommend improvements in measures towards achieving robust systems of pay equity. The study was supervised by National Steering Committee on Pay Equity (NSCPE) in Jordan hosted by Ministry of Labor. The study included desk research and mapping of the private education sector in Jordan, in addition to development of field research methodology and tools. The experts of Dajani Consulting used the job evaluation guide developed by ILO to design the study and questionnaires, and then data collection and analysis to identify the gaps in pay between genders. The study covered more than 250 staff working at 25 private educational institutions in Jordan. A final report was produced in Arabic and English, and shared regionally with other countries adopting the pay equity concept.
Tracer Study of STIMI and Sahab Vocational Training Center - Japan International Development Agency (JICA)
Dajani Consulting conducted a study to collect basic data of the two centers and a field survey on the trainers/instructors, graduates, and business owners related to Specialized Training Institute of Metal Industries (STIMI) and Sahab vocational center. The study aimed at comparing the JICA-supported STIMI with non-supported Sahab vocational center in terms of performance, efficiency, quality, outputs, sustainability and other aspects.
Royal Scientific Society Evaluation of vocational training program - Royal Scientific Society / Japan International development Agency (JICA)
The Impact Assessment of the Third country training program (TCTP) that was dedicated for Palestinian trainees in the field of medical equipment maintenance. The training institute was the Royal Scientific Society and the training program continued for 4 years, where more than 40 participants were involved in the program. The aim of the assessment was to measure the relevance and utilization of the learned skills by trainees in their jobs compared to the needed skills and information according to the actual job duties and responsibilities at Palestinian hospitals. Complete evaluation of the gain and effectiveness of the program was carried out through a survey covering trainees, trainers, and trainees’ supervisors. The results were analyzed and reported to JICA office – Jordan.
SDNP Project Final Evaluation
UNDP and The sustainable development networking program (SDNP) supported the government of Jordan decided to create a network to connect several ministries together within one network. Evaluating the outcomes of such project was very essential for continuation of the project.
The project objectives were:
1- Assess and evaluate the network in terms of (Efficiency, Effectiveness, Impact, and Sustainability).
2- Assessment of extent of achieving the targets agreed upon in the project document, evaluation of key indicators, utilization of funds in conducting project activities & purchasing equipment, and finally preparation of a business plan for the next phase of the SDNP project.
3- Review of original document of the project, preparation of list of questions, assessment of utilization of fund donated for implementing agency (NIC) through interviews, the timeliness of the activities compared to the original planning, study of the performance of the network and flow of information, recording technical remarks, determination actual requirements needed by participating institutions by meeting key personnel, making conclusions and recommendation for future implementation & planning, preparation & submission of final report.
Research Study to Assess the Gap between the Academic Output and the Labor Market Needs
Ministry of Higher Education and Scientific Research through the Higher Education Project funded by UNDP decided to commission Dajani Consulting services to conduct the gap assessment study. Dajani Consulting was responsible to carry out a research (Qualitative and Quantitative) to determine the level of gap between the university output and the labor market demand with special focus on Business Administration and Information Technology graduates. Dajani Consulting completed a study research to assess the gaps between knowledge and skills acquired through higher education and labor market demands in Jordan. The study aimed at improving the output of universities, to address the needs of labor market. The study included carrying out research (focus groups, surveys) to assess both the supply side through assessing the qualifications attained through universities, and the demand side through assessing the needs of the labor market particularly SMEs in terms of skills, knowledge, academic qualifications, etc. in two specializations; Computer Science /Information Technology (IT), Business Administration (BA). Three target groups were subject to research; Jordanian public and private universities (12 universities), fresh graduates employed by the private sector (more than 400 graduates), and SMEs/employers (50 enterprises). The study was financed and monitored by UNDP’s Higher Education Project at the Ministry of Higher Education and Scientific Research, and published by UNDP.
Impact Assessment of the Third Country Training Program (TCTP)
As a part of the technical assistance provided by Japan International Cooperation Agency to the Palestinian National Authority , JICA provided technical training for the Employees of the Ministry of Health on the maintenance of medical equipment to be able to fix and repair equipment for available at the Palestinian hospitals in the West Bank and Gaze . Dajani Consulting carried out evaluation study for the vocational skills gained from the program. It also evaluated the program again impact, effectiveness, efficiency, relevance and sustainability.
Impact Assessment and Tracer Study of Training and Employment Support Program (TESP)
The Training and Employment Support Program (TESP) funded by the World Bank in the form of a loan to the Jordanian Government with an amount of 5 million US$. TESP was a labor market, demand-driven vocational training and employment program that targeted the young unemployed, poor and females in Jordan. The impact and benefits of the project after 5 years of implementation were evaluated. The assignment included review of the database of trainees, survey of beneficiaries and employers, identification of the weak points of the programmed from the employer’s point of view and suggesting developments and modifications on the components of the program.
Sector Diagnostic Study- European Commission (EU)
Dajani was contracted by the EU to assess Pharmaceuticals manufacturers in Jordan development needs in technical and marketing development needs as a part of the technical assistance to the Jordanian private sectors, a sector study was demanded to identify development needs of all pharmaceuticals manufacturers in Jordan.
Gap analysis and diagnostic study
MEDMAC, a chemical fertilizers and pesticides manufacturer, was facing great challenges increasing competition; they wanted to create a business plan and a marketing plan to be able to compete with other manufacturers. The main purpose of this study is to identify the weaknesses in production, quality and marketing and to create a business and marketing plans.
Ex-Post Evaluation of grant aid to public hospitals
JICA provided Ministry of Health public hospitals and Jordan University Hospital with grant aid in the form of medical instruments and emergency equipment from JICA. More than 20 public hospitals were contacted an visited during the study to perform Ex-post Monitoring & Evaluation study of Ministry of Health public hospitals and Jordan University Hospital.
Training Workshop on Project Cycle Management and M&E for Municipalities
Project Cycle Management and Monitoring & Evaluation was held in Dubai for several regional municipalities within the region, in cooperation with Arab Urban Development Institute (AUDI). The workshop included real life examples from actual projects managed by the municipalities in the region. The five days workshop have covered stages of project cycle management and how a project can be executed using the latest technology. The workshop also covered the monitoring and evaluation of techniques using latest international best practice.
Monitoring & Evaluation Training – The Department of Palestinian Affairs (DPA)
The DPA is the governmental body which overlooks the refugee camps in Jordan. The department is in charge of the physical infrastructure including the land provision, the infrastructure services and the follow-up on the needed projects in the camps. DPA is supported by several donors, such as JICA. It implements capacity building projects for the improvement of livelihood of Palestinian refugees at the camps. In order to qualify DPA staff to carry out their programs and projects, it is essential to equip them with knowledge and skills of Monitoring & Evaluation mechanism.
Project Cycle Management and M&E training
International Organization for Migration has many assistance and relief programs in Iraq, supervised by its local staff in Iraq (monitors). Field monitors of IOM needed to learn the international best practices in managing, monitoring and evaluating programs. The six days training workshop consisted of practical training to equip the participants with needed tools for M&E. The workshop was held at IOM premises in Amman.