Skip to content

Details

“Not everything that can be counted counts, and not everything that counts can be counted." – William Bruce Cameron (American Sociologist)

Your fitness tracker says you slept well. You wake up exhausted. A school's exam results improve year on year, but the teachers say the students seem less curious than they used to be. A social media post gets thousands of likes, but was it actually worth reading?

In each case, the numbers are telling us something. The question is whether they're telling us what we wanted to know.

There's an old economics joke about a man searching for his car keys under a streetlight. A passerby asks where he dropped them. "Over there," he says, pointing into the dark. "Then why are you looking here?" "Because this is where the light is." Measurement can work the same way.

We gravitate toward what we can quantify but not necessarily what we need to know.

And yet measurement matters. It challenges assumptions, compares alternatives, and holds powerful institutions to account. Without objective measurements, "trust my judgement" can quietly become an excuse for prejudice, incompetence, or avoiding scrutiny.

But every measurement involves choices: what to count, what to leave out, and what to call success. Once a number becomes a target, something subtle also happens : People start improving the score while losing sight of the purpose behind it. We may even begin to want what the scoring system rewards vs what it was originally set out to achieve.

Some tensions we'll explore together:

Clarity vs. simplification. Numbers make comparison possible. But what gets lost when we flatten different experiences into a single score?

Accountability vs. hidden assumptions. Measurements can challenge bias and hold authority to account. But can they also smuggle in the assumptions of whoever designed them?

Tracking vs. motivation. Monitoring progress can help us improve. But can it also change our reasons for doing something in the first place?

Questions we will discuss together
These are starting points for an open discussion rather than a checklist. We may follow some further than others.

  1. Is something less real because we can't measure it? We can survey trust, count acts of generosity, or record time spent together. Do those numbers tell us something valuable, or do they flatten the thing they're trying to capture? When is a partial measure good enough, and when does it mislead?
  2. Does measurement reveal what we value, or change what we value? Imagine two schools - one has excellent standardized exam results but disengaged students, another with average results but curious learners and vibrant extracurricular societies. Which school is “better”? Does the way we measure schools reshape what schools try to be? What changes when a measure becomes a target?
  3. Is measuring the wrong thing better than measuring nothing? Is flawed objectivity preferable to no subjective judgment? For example, police often use crime statistics to allocate resources. But the data often reflects where police already look - not necessarily where crime happens.
  4. Who gets to decide what's worth measuring? A CTOS credit score reduces a person's financial life to a single metric. A university ranking flattens research, teaching, and student experience into a league table. Who chose those criteria, and whose interests do they serve?
  5. Can everything we value ultimately be compared? A government has to choose between healthcare, education, environmental protection, and the arts. Is $ truly a common scale or are some values fundamentally incomparable?
  6. When does measuring ourselves in the relentless pursuit of self-optimisation change who we are? You start tracking your runs to train for a half-marathon. A year later you haven't signed up for one, but you can't skip a day without guilt. At what point did the tracker stop serving your goal and start setting it?
  7. Can quantifiable evidence ever tell us what we ought to value? Even with perfect data, could we determine what constitutes a good life? If we reject a measure as inadequate, what should take its place?

Optional reading and viewing
No prior reading or philosophical background is required.
Start here

  1. James Vincent — “Made to measure: why we can’t stop quantifying our lives”
    The Guardian · approximately 15–20 minutes · edited book extract
    Why we find numbers compelling and what we ask them to do.
    https://www.theguardian.com/news/2022/may/26/measurement-why-we-cant-stop-quantifying-our-lives
  2. Tom Geraghty — “Goodhart’s Law, Campbell’s Law, and the Cobra Effect”
    Psych Safety · allow approximately 8–12 minutes for the main article
    How targets can distort behaviour and incentives can backfire.
    https://psychsafety.com/goodharts-law-campbells-law-and-the-cobra-effect/
  3. Joey Beachum — “7 Simple Principles for Measuring Anything”
    Hubbard Decision Research · approximately 7–10 minutes
    A defence of measurement from a decision-analysis perspective. Argues that the act of measuring reduces uncertainty and that can be enough to improve a decision.
    https://hubbardresearch.com/7-simple-principles-for-measuring-anything/

Two further perspectives
4. Theodore Talbot and Owen Barder — “Snakes on a Log Frame: Cobra Effects and Payment by Results”
Center for Global Development · approximately 4–6 minutes
Going beyond just identifying perverse incentives to asking how we might design them better.
https://www.cgdev.org/blog/snakes-log-frame-cobra-effects-and-payment-results
5. Travis M. — “In Defense of Unanswerable Questions (They Are Not Pointless or Unscientific)”
Clearer Thinking · approximately 13 minutes
Argues that a question can remain meaningful even when empirical evidence cannot decisively settle it
https://www.clearerthinking.org/post/in-defense-of-unanswerable-questions-they-are-not-pointless-or-unscientific
6. Lauren Leek — “There’s No Such Thing as Society in the Objective Function” Substack · approximately 12–15 minutes
Examines how public-service KPI-s can neglect the outcomes that matter. Asks who defines success, whose interests count, and how neutral formulas can be challenged.
https://laurenleek.substack.com/p/theres-no-such-thing-as-society-in

Deeper philosophical readings
7. C. Thi Nguyen — “Value Capture”
Journal of Ethics and Social Philosophy, 2024 · 36 pages · approximately 60–90 minutes for a careful full reading
Examines how simplified measures-grades, step counts or social-media engagement-can come to replace richer personal values.
https://www.jesp.org/paper/36346f73-90e0-81ae-bf22-ebd3754e0a2f
8. Julian Reiss and Jan Sprenger — “Scientific Objectivity”
Stanford Encyclopedia of Philosophy · selected sections approximately 25–40 minutes
Explores how facts, values and judgement interact in scientific inquiry.
Suggested sections: §3.1 — Epistemic and Contextual Values, §3.3 — Science, Policy and the Value-Free Ideal, §4.1 — Measurement and Quantification
https://plato.stanford.edu/entries/scientific-objectivity/

Related topics

Events in Kuala Lumpur, MY
Critical Thinking
Intellectual Discussions
Learning
Philosophy
Socrates Cafe

You may also like