You are here

External Programmatic Evaluation 2021

Closing Date: 
Wednesday, 23 December, 2020

Call for Applications

ARM External Programmatic Evaluation 2020

Consultancy Terms of Reference

Background and Context

Anti-Racism Movement (ARM) is a local NGO established in 2011 by a group of local activists who work together with migrant workers to secure social, economic, and gender justice for all migrant workers and racialized groups in Lebanon. We work for a just society where all migrants enjoy decent living and working conditions. Our theory of change shifts the positionality of migrant workers from beneficiaries and recipients of services to leaders and agents of social change in Lebanon. ARM currently runs several programs that focus on advocacy, community-building, and casework.

Building on our philosophy that recognizes the importance of community-building work, ARM created the Migrant Community Centers (MCCs) which grew from one small center in 2011 in Beirut to centers in three major cities by 2016, in addition to a Sunday educational space. We do most of our work through the centers in direct collaboration with migrant workers, especially migrant domestic workers. The MCCs are free and safe spaces tailored to migrant workers and evolving according to their needs, where they can meet, learn new skills, work together, and access information, resources and assistance. Since their creation, they have been offering free classes and other educational, social, and capacity-building activities, such as language classes, computer classes, health awareness sessions, rights education, advocacy training, cultural exchange events, social gatherings, and various holiday celebrations. The MCCs also serve as a hub where initiatives are launched, a space to have celebrations and get-togethers, and a casual space for migrant workers to spend time with each other. MCC’s operations are run by ARM staff members and migrant community leaders. Since March 2020, the community centers have been closed due to the Covid-19 pandemic, which meant that ARM’s efforts were directed into emergency relief, advocacy, and casework since then. After the COVID-19 pandemic and economic crisis hit Lebanon, ARM established a Relief Project where migrant workers in need receive food packages, in addition to limited funding for housing support and evacuations. The relief project currently encompasses a large portion of ARM’s overall work, as opposed to our regular community center work.

Since the end of 2019, the ARM team decided to focus their work around three strategic goals, each including a set of objectives (as per an organizational logframe). The strategic goals are mentioned in the below box. More information will be shared with the evaluator(s) during the evaluation process.

A) Advancing structural change against racism in Lebanon through:

  1. Building a stronger anti-racism movement in Lebanon that is able to shift the prevalent narrative, public opinion and individual behaviour to reject all forms of racism (social change)

  2. Achieving political change for social justice for racialized groups on a systemic level (legal, institutional change)

The first objective above refers to advocacy efforts primarily led by ARM staff, aiming to foster stronger movements against racist violence in local communities & to have more allies for migrant workers in their struggles. It envisions a more powerful & vocal anti-racist movement in Lebanon, a wider movement against Kafala and racism, increased pressure on government to replace racist policies and increase protections for racialized groups. It includes the organization of awareness sessions, media campaigns, collaborations with other activist groups, knowledge production, statements, lobbying, and/or direct action.

B) Achieving stronger migrant worker action to end abuse and exploitation in Lebanon, with focus on women domestic workers, through achieving:

  1. Stronger community relationships among migrant workers in Lebanon through the Migrant Community Centers

  2. Stronger collective action & self-advocacy among migrant worker communities and racialized groups in Lebanon

  3. Increased access to direct services and support for migrant workers facing abuse and labour violations

  4. Increased access to essential supplies and shelter for migrant workers severely affected by the ongoing crises in Lebanon

The second objective aims to foster strong, large, and supported communities of migrant workers (MWs) who can in turn reach out to & assist other isolated MWs, to decrease isolation and barriers among MWs, and to decrease structural barriers facing MW community building and self-advocacy. It includes providing resources to migrant workers through our work in order to organize social activities and events, capacity-building, and the provision of casework and relief services to migrant workers in emergency situations. This is done through a dedicated casework team, relief team, and an MCC team (which was put on hold since March 2020).

C) Improving ARM’s internal organizational development efforts through:

  1. Enhancing the performance and wellbeing of team members

  2. Increasing the financial sustainability of our work

The third objective aims to decrease donor-dependency and to build organizational systems that can help ensure the sustainability of our work and the wellbeing of our team.

For each of the above objectives, we’ve developed a set of outputs and activities through an organizational logframe we’ve drafted in 2019 which was adapted to cover the upcoming period.

ARM conducts its activities within Lebanon’s challenging political and economic context, where achieving positive legal change is very difficult and where migrant workers are treated as valueless temporary workers whose labor rights are withheld by the Lebanese sponsorship system.

Evaluation Objective and Scope

ARM is undertaking an external evaluation in 2021 to better understand the impact of our different programs in order to improve and inform our next steps. The results of the evaluation will be used primarily by ARM’s management, and will also be shared with ARM’s major donors.

The objectives of this evaluation are to examine and analyze the impact of the following components of ARM’s work: (1) advocacy work, (2) migrant community-building, (3) migrant-led self-advocacy, (4) casework, (5) relief project, and (6) organizational development efforts. Due to the large scope of the evaluated programs, a special focus can be placed on 2 components which can be prioritized by the evaluation team in coordination with the ARM team, while still conducting an overall review and impact analysis of all components.

The scope of this evaluation covers the areas of Greater Beirut, and is to take place within a period of up to 4 months. It evaluates work implemented from December 2018 to November 2020. It focuses on the impact the programs have had on migrant workers who were directly engaged with them, in addition to their impact on local movement-building against racism in Lebanon. The relevant themes for this evaluation are self-advocacy, community-building, community-organizing, access to justice, and influence on policy change. The knowledge generated through this evaluation will inform ARM’s future strategies and ways of working.

Evaluation Questions and Tasks

When it comes to analyzing the different components of our work as mentioned in the previous section, evaluators can utilize the following guiding questions to facilitate their work:

  1. What changes occurred as a result of ARM’s advocacy efforts? What mechanisms derived its impact?

  2. How did ARM’s support for women migrant domestic workers’ community organizing impact their ability to self-advocate? What mechanisms derived this impact?

  3. How did ARM’s community-building strategies (through the MCCs) impact the relationships between migrant workers who were involved in its activities? What mechanisms derived this impact?

  4. How did ARM’s casework interventions impact the lives of migrant workers who received casework support? What mechanisms derived this impact?

  5. What is the impact of ARM’s relief efforts on migrant workers who received support? How does this relate to the question of political organizing and community building?

  6. What did ARM’s organizational development efforts result in?

In evaluating the mechanisms in each of the above questions, evaluators are encouraged to utilize the following standards: relevance, effectiveness, efficiency, impact, and sustainability. Evaluators are expected to analyze ARM’s administrative data and implement methodological triangulation in their data collection in order to answer the above research questions through focus groups, individual interviews, case studies, observations, and/or statistical analyses. Evaluators are expected to analyze their data in relation to the wider context in Lebanon (i.e. Lebanon’s political economy, gender analysis, care labor, etc.) whenever possible. A theory-based evaluation that explains what caused the observed changes and sufficiently engages with the assumptions of our interventions is preferred. Based on the above questions and after examining ARM’s documents, the evaluators will be developing specific sub-questions and data collection strategies in coordination with ARM management.

Timing and Deliverables (can be adapted if need be in coordination with ARM team)

  • ARM shortlists and selects the evaluation team (by end of December 2020)

  • Organizing support for the evaluation team (compilation of documents, possible logistical support, etc.) (by end of Jan 2021)

  • Organisation of an introductory workshop (by end of Jan 2021)

  • Evaluators review documents and create a plan of action accordingly (Jan to Feb 2021)

  • Organisation of a workshop for the presentation of an inception report (detailing upcoming plan of action) (Feb 2021).

  • ARM directors approve the inception report (by Feb 2021)

  • Evaluators conduct data collection, analysis, and produce a draft evaluation report (by April 2021)

  • Organisation of a workshop for the presentation of the draft evaluation report (by April 2021)

  • ARM management approving the draft evaluation report (by April 2021)

  • Presenting the final report (by end of April 2021) - at least 30 single-spaced pages.

  • Management approving the final report (April 2021)

  • Developing an action plan based on the evaluation (Management Response) (starting with a meeting in May 2021)

The final evaluation report should include an executive summary, a description of the interventions evaluated, the purpose of the evaluation, the methodology adopted, findings, conclusions, recommendations (in case any could be immediately drawn from the evaluation), and a list of annexes detailing the sources of information.

Evaluation Team Composition and Required Competencies

This evaluation can be conducted by one evaluator or a team of two or more evaluators. Since this evaluation covers several programs, preference goes to groups of two (or more) evaluators. Evaluators are expected to have knowledge of the Lebanese context, skills in data analysis, and experience in designing and leading formal evaluations. Knowledge of English and Arabic is a must. Knowledge of French is a plus.

Candidates with past research experience in migrant worker issues, feminist community organizing strategies, and/or Lebanon’s political economy and security systems are highly encouraged to apply.

Interested applicants should email their CV, cover letter, and at least one work sample to (subject line: External Evaluation 2021) by December 23rd, 2021. Applications will be reviewed on a rolling basis - interested applicants are encouraged to apply ahead of the deadline. Only shortlisted candidates will be contacted.

The consultancy period starts in January 2021 and must be completed by May 2021.

Budget range: $6,000 to $9,000. Applicants to specify their quotations accordingly.