Are We Measuring What Matters, or Just What is Easiest to Count?

Performance measures remain essential. They support accountability, highlight emerging issues and allow organisations to understand whether services are operating as intended. The challenge is to avoid confusing activity with impact.

AuthorEliot JeffriesPublished22nd September 20264 minute read
Are We Measuring What Matters, or Just What is Easiest to Count?

A repair has been completed. A complaint has been closed. A customer has been contacted. All are useful measures of activity. They help organisations understand whether services are being delivered, monitor performance against targets and identify where processes may be falling behind. But what do they tell leaders about the outcome for the customer?

This question sat underneath a wider conversation at a recent Neemar Search Community Breakfast about data, performance and decision-making. The consensus was clear: activity data tells us what happened, but its value is limited unless we can also understand whether it worked.

Activity Is Important

There is an obvious reason organisations gravitate towards measuring activity. It is tangible. Appointments, calls, repairs, complaints, response times, visits and completions can all be counted. They can be compared against a target, tracked over time and presented clearly through a dashboard. These measures genuinely matter. Organisations need to understand whether services are being delivered, resources are being used effectively and agreed standards are being met. Activity data is often the clearest and most auditable way of demonstrating this. However, activity and outcomes are not the same thing.

A completed repair does not necessarily mean the underlying problem has gone away. Closing a complaint does not necessarily mean the customer believes the issue has been resolved. Making contact does not necessarily mean somebody received the support they needed. The activity happened, but the outcome may tell a different story.

Outcomes Are Harder to Measure

The leaders involved in the discussion recognised that many of the things organisations care about most cannot easily be captured through a single measure.

  • Did the customer feel listened to?
  • Did an intervention prevent the problem from happening again?
  • Did a colleague make a better decision because of the training they received?
  • Did a change genuinely improve somebody’s experience, rather than simply speeding up a process?

These questions are harder to answer and harder still to translate into a number.

That does not make activity measures irrelevant. It simply means organisations need to be clear about what those measures can tell them and where further insight is required. Repair completion rates, for example, can show whether work is moving through the system. They cannot, on their own, demonstrate whether the repair was completed to the right standard, resolved the original issue or left the customer satisfied. Complaint response times can show whether an organisation is meeting its obligations. They do not necessarily show whether the investigation was thorough, the response addressed every element of the complaint or the agreed actions were completed.

Both perspectives are needed.

More Data Does Not Always Mean Better Insight

As organisations invest further in technology, it is becoming easier to collect, combine and visualise significant amounts of information. This creates opportunities to understand services in much greater depth. Data from different systems can be brought together, patterns can be identified earlier and leaders can access information more quickly. However, more information can also create more things to report.

Dashboards become larger, performance packs become longer and more indicators compete for the limited attention of executive teams and boards. The risk is that the measures which are easiest to count become the measures that receive the most attention. A dashboard can show that a repair was completed within target. It may not show that the customer made repeated calls before the appointment, took several days off work or experienced the same problem again the following month.

If organisations focus only on the completion measure, the service may appear successful even though the customer experienced something very different. The question is not simply whether the data is accurate. It is whether the data is helping leaders understand what is really happening.

Moving From Reporting to Understanding

The most useful performance conversations do not begin and end with whether an indicator is green or red. They explore what sits behind the number. Four questions are worth holding onto whenever a leadership team reviews performance:

  • What happened?
  • Why did it happen?
  • What changed as a result?
  • Did it make the outcome any better?

Answering the first question is largely a data exercise. Answering the remaining three also requires interpretation, curiosity and professional judgement.

It may require leaders to bring together performance data, customer feedback, colleague experience, complaints insight and operational knowledge. It may also require them to look beyond a positive headline measure and ask whether it reflects the full experience of the service. This is particularly important when performance appears strong but customer satisfaction is moving in the opposite direction. A service can meet its internal targets while still creating frustration for customers. Understanding that gap is often where the most valuable insight can be found.

Measuring With Purpose

Performance measures remain essential. They support accountability, highlight emerging issues and allow organisations to understand whether services are operating as intended. The challenge is to avoid confusing activity with impact.

The strongest performance frameworks are likely to combine clear operational measures with a deeper understanding of outcomes. They explain not only what the organisation did, but whether it resolved the issue, improved the service and made a meaningful difference to the customer. This requires organisations to be selective about what they measure and clear about why each measure matters. It also requires leaders to create space for challenge. If a measure is regularly reported but does not influence a decision, improve a service or reveal something useful, it may be worth asking why it remains there.

The aim is not to measure everything. It is to identify the information that helps people make better decisions. So, when your organisation next reviews its performance, the question should not only be whether the numbers are right. It should be whether you are measuring what matters, or simply what is easiest to count.

 


 

This article draws on themes discussed at a recent Neemar Communities Breakfast, bringing together senior leaders from across the social housing sector. Read the full report.

 

Let’s Connect

Have a question or need assistance? Fill in the form, and our team will get back to you as soon as possible.