EVALUATION SERVICES
Full-record evaluation
Experienced evaluators, working on our own evidence infrastructure. We assess the full set of relevant documents, not a sample, trace every finding to its source, and show where commitments are starting to slip.
The full record, not a sample of documents
Every finding traceable to the sentence behind it
Early warning built in, so recommendations look ahead
Your own Hive to keep using after the evaluation
What the full record makes possible
Most evaluations work from a sample of documents, a round of interviews and whatever baseline was set at the start. Our infrastructure gives the evaluation team the full document set.
WHERE IT STARTED
A baseline for the starting point
What was committed, planned and reported when the intervention began, rebuilt from the documents of that time rather than recalled in interviews.
WHAT HAPPENED
The full picture over the whole period
Every relevant strategy, report, statement and budget document from start to finish, so findings rest on the complete record.
WHAT COMES NEXT
Early-warning signals
Where commitments are already weakening, turned into indicators you can keep monitoring after the evaluation ends.
The evaluators run the evaluation and shape the evidence base: they choose which sources go in and train and check how commitments are classified. The infrastructure does the reading at scale, so the team's time goes into judgment.
Commitments weaken in the written record first
An evaluation usually reports on what has already happened. Ours also shows what the record suggests will happen next, so problems can be raised earlier than the next evaluation cycle.
None of these signals proves failure. Each is a reason to ask a question sooner.
Softening
"Will" and "shall" give way to "aims to" and "where feasible".
Disappearance
A commitment in one strategy is missing from the next, without explanation.
Divergence
Strategy documents and budgets begin to say different things.
Silence
A scheduled report, review or statement does not appear.
Every OECD DAC criterion, on a firmer base
We evaluate against all six criteria with the standard mix of methods: document review, interviews, fieldwork and analysis of monitoring and financial data. The infrastructure adds most to coherence and sustainability.
Relevance
Stated priorities mapped over the whole period, with dates
Efficiency
Commitment language aligned with public budget and procurement documents
Coherence
Commitments compared across ministries, documents and partners; contradictions and gaps identified
Impact
Documentary context for the impact evidence our evaluators gather in the field
Effectiveness
Reported results checked against earlier commitments in wording, scope and timing
Sustainability
Commitments tracked across successive strategies, budgets and governments
How an assignment runs
1
Scoping
Questions, criteria, period and sources agreed with you.
2
Evidence base
Evaluators select the sources; the infrastructure builds the Hive, every commitment linked to its source.
3
Analysis
Baseline set and claims tested against the record.
4
Interviews and validation
Fieldwork fills the gaps documents cannot, and tests our reading.
5
Reporting and handover
Traceable findings, recommendations, warning indicators, and your Hive.
WHAT YOU KEEP
The report, and the Hive behind it
At the end of the assignment you receive the searchable library built for your evaluation: every document used, with commitments extracted, classified and linked to their source. Continued access and support can be agreed as an option.
01 Better than a folder
Search by commitment, actor, date or topic, and see how wording changed.
02 Kept up to date
Add new documents as they appear, ready for the next review.
03 Warnings that keep running
The early-warning indicators run on the same Hive.
FOR COMMISSIONERS
Donors, ministries, UN agencies and NGOs
We lead your evaluation of a program, policy or portfolio, or co-lead it with your chosen team.
FOR EVALUATION FIRMS
A specialist component in your team
We join larger evaluations to deliver the documentary and coherence analysis as a defined part of the work.
The evaluators
Eva Veble
More than 20 years in mine action, civilian protection and donor compliance, mostly with Norwegian People's Aid. Specialist in monitoring, evaluation, accountability and learning (MEAL) and in U.S. State Department WRA grants; certified in 2 CFR 200.
Advanced university degree in Political Science, International Relations (University of Ljubljana); postgraduate certificate in Business Administration (Warwick Business School)
Bruce Atle Karlsen
More than 20 years in humanitarian disarmament, international development and the private sector, in over 35 countries. Designed the M&E system adopted across Norwegian People's Aid, led evaluations as a consultant with Scanteam, and built NPA Laos from start-up to more than 400 staff.
MA in Development Economics (University of East Anglia)
For larger assignments, we bring in subject specialists and national evaluators as the terms of reference require.
Commissioning or planning an evaluation?
Send us the terms of reference or a short description of the program. We'll tell you what the record can show and how we would approach it.