And why we have it all wrong.
The private sector has a universal scoreboard. There is only one goal: have more tomorrow than you have today. You won’t hear investors or entrepreneurs or CEOs debating how to define success. It’s understood by everyone.
The public and non-profit sectors don’t have a scoreboard. This isn’t our fault. Our work is distributed, nuanced, and complex. What is our fault is that we keep wasting time trying to build one.
When we try, we end up with two things:
1.) Quantitative measures (web traffic, bodies in a room, test scores) that can easily be mistaken for impact; and
2.) Qualitative measures (feedback, expert observations, personal stories) that prove impact in specific instances, but don’t provide a definitive ‘Yes, we were successful.’
Businesses use metrics to measure efficiencies and conversion rates. To track how employees are performing. To see if advertising dollars are being well spent. Metrics inform the path to success.
We, on the other hand, attempt to use metrics to indicate success. To have the metrics be our scoreboard. And then screw ourselves by working towards an arbitrary, artificial, and largely inaccurate standard.
To end the interminable ‘metrics’ discussions and put a lot of great people back to work on the stuff that matters, I suggest the following consensus:
Give up. Accept the scoreboard will never exist.
Instead, do one of two things:
1.) Define your mission as something that can be measured, success as achieving the desired score, and stop there. Make the metric the mission, not an indicator of the mission. Increase graduation rates by 5%. Reduce hospital wait times by 20 minutes. Get 100km above the earth.
2.) Or, if you’re particularly enlightened, agree that you’ll know it when you see it. That everyone working on the project is smart, well-intentioned, and will try to make the right decisions. Use metrics to help with those decisions.
We’ll be happier, our resources will be put to better use, and we’ll all stop chasing our tails.
UPDATE: Working on a constructive follow-up post mashing Most Significant Change with iterative development and open funding models.
