Definition

ROM is a regular rapid external assessment of the quality and progress of technical cooperation projects, based on standard evaluation methodology through short missions.

Mid-term or final evaluations usually take place when important parts of or even the whole project is already implemented and corrective action comes late. Meanwhile, donors often lack resources for a timely in-depth and on site monitoring of projects beyond an analysis of reports and participation in Steering Committee Meetings.

The key idea of ROM is that project performance is regularly assessed throughout the lifecycle of a project and not just towards its end. This allows for timely corrective action to optimize project performance.

The methodology applied by Swiss Consulting builds upon the ROM System used by the European Union since 2002, while addressing some of its limitations.

We specifically enhanced stakeholder involvement into the process, included a mechanism for regular follow-up on recommendations, and improved the depth of the analysis.

Methodology

The methodology applied by Swiss Consulting builds upon the ROM System used by the European Union since 2002 (see EUROPEAN COMMISSION EuropeAid Co-operation Office, Handbook for Results-Oriented Monitoring of EC External Assistance, Brussels, 2008), while addressing some of its limitations. ROM is a regular onsite assessment an ongoing project or program, typically through 2 – 4 missions per year. It is based on an analysis of documents and interviews with stakeholder representatives, including direct and indirect beneficiaries. ROM missions are prepared through a self-assessment of projects and are complementary to internal monitoring by the project partners. ROM gives simple scores against standard evaluation criteria developed by the Organization for Economic Cooperation and Development/Development Assistance Committee (OECD/DAC) using a structured and consistent methodology.

• Quality of Project Design : quality of project preparation and design, logic and completeness of the project planning process, and the internal logic and coherence of the project design, organizational structure and processes
• Ongoing relevance of objectives
• Efficiency of implementation to date
• Effectiveness (achievement of objectives) to date
• Prospects of impact and sustainability of results
• Follow-up on previous recommendations

Please refer to the description of the different evaluation criteria under Project Design and Evaluations. Deliverable is a brief report highlighting key issues, explanations and practical recommendations for quality improvement addressed to all stakeholders. The content of the report is presented and discussed at a de-briefing meeting with stakeholders and the donor.

What are the benefits of ROM for stakeholders?

• An independent outside assessment on project quality
• Recommendations based on experience from a whole range of other projects, donors, thematic areas and countries
• The possibility to take timely remedial action in case of problems and to obtain a sound basis for decision making
• Receive additional information to complement and validate project reports
• Support to the strengthening of internal monitoring systems
  
  

How is ROM implemented?

Depending on factors such as the complexity of the project, absorption capacities of partners, project management resources, we recommend at least 2 ROM missions per year, complemented by regular internal result-based self-monitoring by the project. A ROM mission takes typically around 2 - 3 days of field work, 1 – 2 days of report writing and 1 day for a thorough de-briefing with the donor.

Particularly beneficial for organizational learning are ROM assignments conducted by the same consultants, but covering similar interventions of the donor in different countries.