Prioritizing features is at the core of the Product Manager’s job. And yet many PMs prioritize based on gut feel, or on the needs of the loudest person at the table. In this post, I explain how to use a scorecard to align all stakeholders on which features to prioritize in your next release. This scorecard approach ensures you remain focused on your customer satisfaction and company strategy, while reducing risk.
Okay, let’s say you already have a clear strategy that has been validated by users. You’ve done customer development, and you have a set of features that were derived from validated hypotheses. Now it’s time to prioritize the features for the next release. So what is your prioritization criteria?
A common mistake many of us make is to “take a stab” at the priorities using our gut and then release them to the development team. After all, we’ve put all that work in learning about our customers, so we know what’s right for them, right? Well, maybe. But no so fast. You still need to get buy-in from your Executive team.
It is true that we are the ones who propose the contents of the release, but we still need to get buy-in from others. After all, you are not the CEO of the product (but more about that in a future post).
You may be concerned that as soon as you start collecting buy-in from others, your original prioritization will go out the window. We’ve all been there. Everybody has different ideas on what the next release should look like. Sales, Marketing, Engineering, and Support all have great arguments for why their features should be the ones to make it in.
Having strong voice of customer behind your prioritization will increase your chances, but you still have to defend your feature set. To make a strong case and get consensus, I recommend using a scorecard framework. It’s easy to use, understand, and implement. A few of the top Product Management tools (like Aha! and ProductPlan) already support this approach, but the good thing is you can also use a simple spreadsheet.
How to use a scorecard
1. Make sure you have a solid strategy and a defined theme for the next release.
2. Agree with your stakeholders on what the scorecard criteria should be for that release, way before the prioritization starts. When defining a scorecard, I suggest you come to the table with your proposed list of parameters and weights, and then work with Executives to fine-tune them. If you start the meeting with a blank sheet of paper, then the process will take much longer. At that point, you are asking them to drive, as opposed to you leading your own process.
For example, here’s a scorecard with some possible categories and weights.
In the example above, features that impact Operational Efficiency have been given the highest weight, because the theme of the release is related to improving that area.
3. Identify the most relevant features related to that theme. If you apply the scorecard criteria to every possible feature in your backlog, you run the risk of losing focus and not driving towards your strategic goals. So first group together features are good candidates for the release theme, and only apply the scorecard to those features.
4. For each of those features, assign a score (1-100) for each of the categories on the scorecard. A score of 100 means the feature will have an extremely high impact on that category.
Here is an example:
The first feature, Monthly Report, has been assigned a score of 90 under the Customer Engagement category, because its release will have a very high impact on customer engagement. The total priority level for the Monthly Report feature is then calculated as follows: Monthly report = 90*20% + 90*10% + 50*30% + 20*40% = 50.
After you complete this calculation for all relevant features, the result will be a prioritized list that is tied to the company strategy.
Pro tip: You can assign a negative weight to a particular category if you want a higher score there to reduce priority. For example, a “Risk of implementation” category could have a negative weight (-20%). Therefore, when you calculate the score, this category subtracts from the total. The result is a prioritized list where riskier features are lower in priority.
Now, keep in mind that the scorecard can change often, even at every release. The scorecard categories and weights should adapt to what’s going on in your company, to ensure you are always focusing on the most important items for that release’s theme.
When creating the scorecard categories, consider other departments’ needs.
Now, notice that in the scorecard example, I’m representing several groups within the organization (sales, UX, operations, etc). I agree that our responsibility is to look after the customer’s needs, but often, Product Managers forget that what the customers need is not only new features or more “innovation.” Sometimes your product is lacking on usability, performance, or stability. Those are “hidden” areas of a product, but they affect the customer as well.
At other times, your product is lacking on internal operational efficiency, meaning that your internal team lacks the tools to manage and support your infrastructure. All those internal tools are very much needed, but because they are not often seen by the customer, it is sometimes difficult to convince executives or others that we need to invest in that functionality.
It is our job as Product Managers to surface those needs and prioritize them accordingly. A scorecard with the right categories and weights can be a great tool to support the short-term direction of a release, without losing focus of the long-term strategy.
For example, let’s assume that you are really lacking in internal tools. Then you can agree with your Execs that operational efficiency should be the theme of the next release, and therefore your scorecard should support this direction. On the table above, notice the values for the “Health monitor” feature. It scores low on all categories except operational efficiency. But because that is the theme of the release, then this feature immediately gets the highest priority.
On the other hand, sometimes you might need to throw features into the scorecard that are highly desired by your colleagues in other departments, but which do not match the current release’s theme. Using the scorecard approach will show them you are truly considering their needs and bringing them to the prioritization table…but there are currently competing priorities that better support the strategy.
The Bottom Line
It’s up to you, the Product Manager, to lead feature prioritization for each release, to make sure you are using your development resources in the best way possible, and to keep both your customers and Executives happy.
Scorecards are just one of the frameworks you can use for prioritization. For other frameworks, here’s a great article by Jim Semick, and here’s an in-depth look at the Kano Model by Jan Moorman. Regardless of which one you pick, make sure you have a method for aligning features with the overall strategy, as well as more immediate internal and external needs.