"OKR, KPI, MBO: How to manage Night Watch by objectives and what about Project Metrics for Battle of the Blackwater project"
KPI, OKR, MBO, etc. Managers seem to like 3-letter abbreviations. Let's make them easy to remember. So, what is a Key Performance Indicator (KPI)? KPI's have been here for ages, and they are just about setting up quantifiable parameters and measuring those. It can be used as objectives for organization units or team members. What parameter can be measured when we look at the Battle of the Blackwater (from the side of King's Landing - Cersei seems profound in management techniques)? If you don't know what I'm talking about, I suggest you close the article right here - otherwise, read on. So let's look first at the parameter she is interested in - it is the percentage of Stannis Baratheon ships destroyed by the wildfire. It is an essential parameter for the protecting army in King's Landing. And it is nicely cascaded downwards. The group target is set (while the outcome is slightly lower).
Can this one be a Key Performance Indicator for your organization? Unless you run such battles on a recurrent basic (and they didn't do that even in Seven Kingdoms) - I would not refer to it as a KPI. You would like to use KPIs to monitor organization performance and improve it over periods, and this one is a unique project. You can have Project KPIs, but I suggest sticking with the name Project Metrics. Advanced reader note - terms you use do not matter. You can have project KPIs in your organization. What matters is that you don't confuse different management tools and use them only for what they are. Project Metrics are parameters set on a project level, measured throughout its execution, and reviewed at project retrospective or lessons learned.
Let's move to the North and set some KPIs for Night Watch. Quickly for those who've forgotten: there are Seven Kingdoms, and the Wall built 8000 years ago. North or the Wall, there are bad things - wildling, giants, White Walkers maybe. The Night Watch aims to guard the Wall to keep the wildlings and White Walkers from crossing into the Seven Kingdoms. So, what can we measure:
Is this a set of KPIs for the Night Watch organization? It can be.
Do organizations need KPIs? Yes, especially the bigger ones. The larger organization is, the more it will get focused on KPIs. How do you get your KPIs? You know your department goal: Consultancy unit aims to generate Profit by delivering Professional Services, Night Watch aims to kill wildling and White Walkers. Then you set up a measurement system to capture this performance and cascade it—pure, straightforward, top-down.
Now, you are a Lord Commander sitting in Castle Black, and you need to cascade the KPIs we've mentioned above. Are they good ones? Think of them for a second. How will you measure it and make it transparent? You are a new generation Lord Commander and set up bonuses for your Leadership Team and the Watch's members. The Oath is "I shall take no wife, hold no lands, father no children. I shall wear no crowns and win no glory. I shall live and die at my post..." but nothing about "I shall take no performance-based yearly bonus." Can you set up a yearly bonus based on the parameters above and reflect your leaders' performance? Let's focus on Rangers first (they fight, defend the Wall, and patrol the Haunted Forest). Well, if you just take numbers above, every leader gets the same KPI (because those are measured globally). Moreover, how do you know how many White Walkers are out there? Adjustment required.
You get some ale, think, and develop a KPI cascade. You end up with individual KPIs like:
The second KPI is loosely aligned with the organizational objective, and that's what typically happens in organizations. Leadership KPIs are based on their team averages (e.g., 60% of bonus) and organization KPIs (40% of bonus then). So, years pass, and your team knows that their yearly bonus depends on those KPIs. You get different types of performers. Some truly follow your Vision Statement ("I am the sword in the darkness. I am the watcher on the walls. I am the shield that guards the realms of men."), but most do not. For those, you observe two behaviors (or a combination of both). Some rangers will go to patrol, take some ale (should we prohibit it during working hours?), and camp a few miles outside. They get patrol KPIs high, and Leadership closes its eyes on that - because their bonus goes up as well. Some will want to be heroes and go kill wildlings in crazy numbers, doing a lot of overtime (that's not what you've wanted, but it helps to promote the company image and hire recruits). Some will raid into the North, kill villagers and present them as wildlings. If you find out, you classify it as not-compliance and apply sanctions (up to execution).
And such an organization works well as long as times are not too turbulent. How? Your individual KPIs are loosely aligned to the organization's objective, but they are somewhat aligned. There are a lot of camps around (you cap performance component at 200% percent, so it makes sense to patrol a lot), so you are likely to spot a White Walker. Wildlings go deeper into the woods and thus are not trying to cross the Wall either. In a more volatile environment, when you need to innovate because of changing business settings, your organization appears less efficient.
Peter Drucker, in his 1954 book The Practice of Management, proposed an approach called Management by Objectives (MBO). You're a Lord Commander, and you have not read that, but Maester referred you to something similar from a thousand years back. You don't want to rely solely on KPIs in appraisals (as too many members seem to do nearly nothing valuable and still get to 100%). You want to reward performance based on objectives that every sworn brother agrees to individually - so make this process more tailor-made.
You split your brotherhood into the Rangers, the Builders, and the Stewards with 3 Leaders (First Ranger, First Builder, and First Steward). You've seen giants yourself, and they are enormous. So you talk to the First Builder and agree on specific objectives:
Such objectives allow the Leadership team to cascade it further in a way that is tailored to their groups or team members, each having their strengths and weaknesses. You no longer set up the same KPIs within a unit, but you align on every individual's objective on a yearly meeting. Now you are even more competent Lord Commander - you Manage by Objectives. Brothers define objectives together with their leaders aligned with their skills and interests, and your organization grows. First Ranger also takes a more tailor-made set of objectives:
What's the issue now? Well, typically, your Objectives are defined between a team member and his boss and are not shared around (exceptions possible), and you set them in a way that reaching 100% is possible with reasonable effort. But the White Walkers have been spotted, and you have no clue how to kill those guys.
You are in an even more volatile environment - you probably have to innovate now, and what you need is Objectives and Key Results (OKR). The concept was introduced by Andrew Grove, former CEO of Intel, in the early 1980s. OKRs were popularized by Google using them from the beginning (you have no clue who Andrew Grove is, probably a wise Maester from the past). OKRs are similar to Objectives you used to set up before, with few key differences:
Now we are talking. You Maester gets an OKR for this quarter, and your First Ranger also gets one.
Those are not that easily reachable and will put quite some challenges. In most organizations, you get OKRs where a percentage of completion can be measured, but you can also get a list of more qualitative ones. So now, you can handle innovation better, and your organization strives to grow from inside. Just don't forget your Vision Statement "I am the fire that burns against the cold, the light that brings the dawn, the horn that wakes the sleepers, the shield that guards the realms of men."