Project Smart ~ Exploring trends and developments in project management today

Calendar icon
Adobe PDF icon

Project Ranking: The Heart of Project Portfolio Management

~ By George F. Huhn

Ranking grunge blue round stamp

Project ranking is at the heart of Project Portfolio Management (PPM). A good project portfolio ranking system should not only make the job much easier and faster, but also yield a superior result over doing it manually or with simple spreadsheets.

Almost every project portfolio management system comes with its own "twist" on project ranking: some are excellent, some are good, and some are poor or just wrong.

A value-maximising and clearly understandable project ranking system is an essential part of a project portfolio management system. It should be based in sound, quantitative, and modern decision-science.

Here are some key things to consider when thinking about project portfolio ranking systems:

  • Avoid systems that rank based on a financial metrics alone, such as Net Present Value (NPV) or Return on Investment (ROI). The major limitation of using purely financial metrics is that it can underestimate the true value of projects (for example, time to market advantages or increased shareholder value). With NPV, higher discount rates selected to account for higher project risk can bias portfolios toward shorter-term projects with faster payoffs because longer-term projects may be overly discounted.
  • Look for systems that prioritise based on the integration of value-adding criteria into the ranking system. Systems that use Multi-Criteria Decision Analysis (MCDA) or Multi-Attribute Utility Theory (MAUT) usually do this. However, make sure you have flexibility in the type of data you can use and that you can adjust the utility or attractiveness curves to reflect your preferences.
  • Avoid systems that use the Analytic Hierarchy Process (AHP) for project ranking. AHP is one of the more popular project ranking techniques and is appealing by its seeming simplicity; however, it is not a quantitatively sound technique for ranking projects.
  • Look for systems that let you test sensitivity and understand how the portfolio changes under different scenarios. Sensitivity testing can be important in testing the robustness of your ranking. Most systems only let you rank based on a "most-likely" scenario.
  • Select a system that can handle uncertainty in the data and the ranking systems parameters. Systems that use Monte-Carlo simulations to simulate multiple portfolio scenarios automatically are ideal for this.
  • Avoid systems that rank projects based solely on pseudo-quantitative methods like "balance" or "portfolio alignment," or other non-value maximising approach. While these names may sound intuitive and appealing, most are pure snake-oil when it comes to solid project portfolio ranking. They do not create value-maximising portfolios.
  • Look for systems that have clear and understandable graphical presentations of the data, but remember that pretty charts are not a substitute for sound data analysis. If you need too many charts to explain your results then you'll likely confuse your stakeholders.
  • Choose systems that have mathematically and theoretically sound methods. Be sure that you can understand qualitatively how it works and that you can explain it to others (because you'll surely need to later!).
  • Avoid vendors that will not or cannot show you the underlying mathematics and explain to you in plain language how it maximises portfolio value.

Before you buy, try the software you have selected on a small portfolio of 12-20 real or fictional projects using metrics that you expect to be using. The application should prioritise the projects in a way that is understandable and makes sense to you. If it does not, then there may be something wrong in the underlying logic. A portfolio ranking system is an aid to good decision-making, and should reflect your values and strategies.

In summary, be sure that the underlying ranking methodology is sound and testable. Be aware of tools that use pseudo-quantitative methods for project ranking or do not offer any methodology for sensitivity testing. Make sure that you can test the tool on a small project portfolio so you can be certain you understand the results.


If you're a business professional interested in learning more about how project portfolio management applications can maximise the value of your project portfolio, be sure to visit Optsee4.0 to learn about Optsee, an integrated project portfolio management tool for prioritising and optimising corporate project portfolios. By automatically analysing your project portfolio in thousands of scenarios and then optimising against multiple constraints such as limited funding and resources, Optsee quickly shows you your most-likely return from an optimal portfolio.

Data Machines also offer a free spreadsheet/worksheet for easily calculating the return on investment (ROI) for any project portfolio management tool.


Comments (1)

Topic: Project Ranking: The Heart of Project Portfolio Management
4/5 (1)
Gravatar
Full StarFull StarFull StarFull StarEmpty Star
11th September 2015 8:30am
Sam Sharp (Sydney) says...
Can you justify your rejection of AHP methods for project ranking? What is the basis for your statement, "it is not a quantitatively sound technique for ranking projects." In what way does it fail as a quantitative technique?

Thank you.

Add a comment



(never displayed)



 
2000
Is it true or false that green is a number?
Notify me of new comments via email.
Remember my form inputs on this computer.

Top Three Causes of Project Failure

Businessman in a black suit holding up a white sign reading failed

The top three causes of project failure, which if addressed will greatly increase the chances of project success.

Project Planning Essentials

Tablet computer with project manager app and documents with Gantt and financial charts

Planning a project requires putting a series of tasks in order and determining dependencies between them. In practice it's never so straightforward.

PMP vs. PRINCE2 Certificates

Senior lecturer in front of his class

What's the difference between the PMP and PRINCE2 certifications? Which one should I choose? Which one's better for my career?

Project Cost Management

Pile of British one pound coins

How do we know what a project will cost? We really don't until the project is complete because we can't accurately predict the future. What we can do is create an estimate.

PROJECT SMART is the project management resource that helps managers at all levels improve their performance. We provide an important knowledge base for those involved in managing projects of all kinds. With weekly exclusive updates, we keep you in touch with the latest project management thinking.

WE ARE CONNECTED ~ Follow us on social media to get regular updates and opinion on what's happening in the world of project management.


Latest Comments

Paula commented on…
How to Deal with the People Factor of Change Management
- Thu 16 May 2:52am

Billy Rane commented on…
6 Success Factors for Managing Project Quality
- Tue 14 May 4:30am

Duncan Haughey commented on…
When is a Project Manager not a Project Manager
- Fri 10 May 3:10pm

Latest tweets

In his short, but insightful article, A Thought-Provoking Idea on the Dangers of 'Nouns', Vishen Lakhiani looks at… https://t.co/PZ7MgdRqzw about 2 hours ago

General Project Management • Some advice on software https://t.co/VX5cy3IdLb about 5 days ago

General Project Management • Advice for Best Complimentary Qualification https://t.co/djava71tDD about 7 days ago