top of page
EVALUATION SERVICES
Full-record evaluation

Experienced evaluators, working on our own evidence infrastructure. We assess the full set of relevant documents, not a sample, trace every finding to its source, and show where commitments are starting to slip.

The full record, not a sample of documents

​

Every finding traceable to the sentence behind it

​

Early warning built in, so recommendations look ahead

​

Your own Hive to keep using after the evaluation

What the full record makes possible

Most evaluations work from a sample of documents, a round of interviews and whatever baseline was set at the start. Our infrastructure gives the evaluation team the full document set.

WHERE IT STARTED
A baseline for the starting point

What was committed, planned and reported when the intervention began, rebuilt from the documents of that time rather than recalled in interviews.

WHAT HAPPENED
The full picture over the whole period

Every relevant strategy, report, statement and budget document from start to finish, so findings rest on the complete record.

WHAT COMES NEXT
Early-warning signals

Where commitments are already weakening, turned into indicators you can keep monitoring after the evaluation ends.

The evaluators run the evaluation and shape the evidence base: they choose which sources go in and train and check how commitments are classified. The infrastructure does the reading at scale, so the team's time goes into judgment.

Commitments weaken in the written record first

An evaluation usually reports on what has already happened. Ours also shows what the record suggests will happen next, so problems can be raised earlier than the next evaluation cycle.

​

None of these signals proves failure. Each is a reason to ask a question sooner.

Softening

"Will" and "shall" give way to "aims to" and "where feasible".

Disappearance

A commitment in one strategy is missing from the next, without explanation.

Divergence

Strategy documents and budgets begin to say different things.

Silence

A scheduled report, review or statement does not appear.

Every OECD DAC criterion, on a firmer base

We evaluate against all six criteria with the standard mix of methods: document review, interviews, fieldwork and analysis of monitoring and financial data. The infrastructure adds most to coherence and sustainability.

Relevance

Stated priorities mapped over the whole period, with dates

Efficiency

Commitment language aligned with public budget and procurement documents

Coherence

Commitments compared across ministries, documents and partners; contradictions and gaps identified

Impact

Documentary context for the impact evidence our evaluators gather in the field

Effectiveness

Reported results checked against earlier commitments in wording, scope and timing

Sustainability

Commitments tracked across successive strategies, budgets and governments

How an assignment runs

1
Scoping

Questions, criteria, period and sources agreed with you.

2
Evidence base

Evaluators select the sources; the infrastructure builds the Hive, every commitment linked to its source.

3
Analysis

Baseline set and claims tested against the record.

4
Interviews and validation

Fieldwork fills the gaps documents cannot, and tests our reading.

5
Reporting and handover

Traceable findings, recommendations, warning indicators, and your Hive.

WHAT YOU KEEP

The report, and the Hive behind it

At the end of the assignment you receive the searchable library built for your evaluation: every document used, with commitments extracted, classified and linked to their source. Continued access and support can be agreed as an option.

01   Better than a folder

Search by commitment, actor, date or topic, and see how wording changed.

02   Kept up to date

Add new documents as they appear, ready for the next review.

03   Warnings that keep running

The early-warning indicators run on the same Hive.

FOR COMMISSIONERS
Donors, ministries, UN agencies and NGOs

We lead your evaluation of a program, policy or portfolio, or co-lead it with your chosen team.

FOR EVALUATION FIRMS
A specialist component in your team

We join larger evaluations to deliver the documentary and coherence analysis as a defined part of the work.

The evaluators

Eva Veble

More than 20 years in mine action, civilian protection and donor compliance, mostly with Norwegian People's Aid. Specialist in monitoring, evaluation, accountability and learning (MEAL) and in U.S. State Department WRA grants; certified in 2 CFR 200.

​

Advanced university degree in Political Science, International Relations (University of Ljubljana); postgraduate certificate in Business Administration (Warwick Business School)

​

eva@lighthousehive.org

Bruce Atle Karlsen

More than 20 years in humanitarian disarmament, international development and the private sector, in over 35 countries. Designed the M&E system adopted across Norwegian People's Aid, led evaluations as a consultant with Scanteam, and built NPA Laos from start-up to more than 400 staff.

​

MA in Development Economics (University of East Anglia)

​

atle@lighthousehive.org

For larger assignments, we bring in subject specialists and national evaluators as the terms of reference require.

Commissioning or planning an evaluation?

Send us the terms of reference or a short description of the program. We'll tell you what the record can show and how we would approach it.

bottom of page