This website uses cookies to store information on your computer. Some of these cookies are used for visitor analysis, others are essential to making our site function properly and improve the user experience. By using this site, you consent to the placement of these cookies. Click Accept to consent and dismiss this message or Deny to leave this website. Read our Privacy Statement for more.
From Performance to Value: Measuring in Agile
From Performance to Value: Measuring in Agile

In This White Paper

June 2015 | Agile Research Network | Agile Transformation

Download

Faster delivery of business value is often cited as a reason for adopting Agile. However, measuring the value achieved through IT development is challenging.

Created by the Agile Research Network

From Performance to Value: Measuring in Agile


Summary

Faster delivery of business value is often cited as a reason for adopting Agile. However, measuring the value achieved through IT development is challenging. For those relatively new to Agile, measurement is not straightforward, as traditional project and portfolio metrics are often hardwired into management report requirements and are hard to change. During Agile adoption it makes sense to start by measuring team performance, as this can aid learning. From small beginnings, an Agile measurement approach can iteratively be developed to meet the requirements of the business.

This white paper from the Agile Research Network (ARN) presents the case of a department within a multinational organisation in the insurance sector that adopted Dynamic Systems Development Method (DSDM) in the first quarter of 2013. One of the issues they faced was how to shift from a traditional approach to measuring IT development to one that is compatible with Agile development. The ARN present the challenges they were asked to investigate along with suggestions from the published literature about how to overcome them, and a summary of proposed mitigation strategies. The primary challenge was ‘understanding and measuring value in Agile projects’.

In order to do this, the ARN were asked to investigate the three levels of performance measurement that the department already used, and explore how they may be adapted to be more suitable for Agile working. The three levels we looked at were:

  1. Personal performance: how to gauge individual contribution to the success of a project
  2. Project performance: how to identify, track and report on project progress and delivery in a meaningful way in order to demonstrate strong delivery of benefits, along with improvements compared to more traditional projects
  3. Department performance: how to use the information in existing KPIs at departmental level

The department already had a well-established measurement process at all three levels for their waterfall projects. As they started adopting Agile processes they wanted to shift their measurement practices in order to ensure that they were capturing the right management information as well as driving the right behaviour. Three types of recommendation for how to approach these challenge areas are identified from the literature:

  1. Guidelines and frameworks for measuring business value and Agile processes in Agile projects
  2. Specific measurement techniques
  3. Approaches for dealing with individual, team and portfolio measurement in Agile environments

2 Introduction

The measurement of IT products and development processes is a well-established practice, and is a core part of the traditional project manager’s job. As software development is a complex process, some sort of measurement is necessary in order to understand what is going on and to improve. The agile approach to measurement is to focus on improvement and to ensure that value is achieved. Metrics can be devised to assess different aspects of an agile project, for example aspects of team learning, process improvement, product quality, and stakeholder satisfaction. The main point is that in agile, measurement is a tool and not an end in itself.

In this case study we (the Agile Research Network) worked with a department that was undergoing a transformation from waterfall to agile IT development. They wanted to know how best to measure the success of that transformation to ensure that the new approaches they were adopting were delivering value to the company.

We also found that there were differences between how the directors and assistant directors viewed the future of the organisation compared to how middle management, as represented in the strategic board, expressed their preferences for the future culture of the organisation.

Value in the context of Agile IT projects often refers to the delivery of ‘business value’, which includes any benefits that maintain the general health of a company. It is closely linked to economic value, and ultimately may be assessed by measures such as return on investment (ROI). In order to justify an IT investment, a calculation may be required to show that the income generated or the cost savings made will be greater than the cost of producing the software. However, economic value is also embedded in many features of a business. Information technology does not exist in a vacuum; it is a complementary system that works with other factors in the business [1]. Value can accrue, for example, through knowledge production, brand awareness, loyalty, customer satisfaction, and trust. Some IT developments may only yield economic benefits over time and may not show immediate gains. For some projects, such as infrastructure projects, it may be very difficult to measure their precise economic value to the business. A long-term perspective may be required for some developments, such as those aimed at gaining competitive advantage, improving supplier relationships or achieving strategic alignment.

In the rest of this paper we report our investigation, which starts by looking at the story of agile adoption in the department. We explore when, how and why they started using agile, their existing performance measures, and how these relate to project and personnel management. We identify the specific challenges they face in the current context, and we make suggestions about performance measurement from the literature. Finally we come back to the issue of value, and we propose an approach they can adopt for identifying and measuring value.

Contact Us

Tel: + 44 (0)1233 611162
Email: info@agilebusiness.org

Agile Business Consortium
Second Floor
International House
Dover Place
Ashford, Kent
TN23 1HU
United Kingdom

About Us

The Agile Business Consortium is the professional body for Business Agility, and our high value, low cost membership is open to everyone.

Wherever you are on your journey to agility, we are there to support you. We create and share agile research, case studies, resources and tools that help you to compete in today’s disrupted world.

We’ve been contributing to agile knowledge for 25 years and are the world’s oldest agility-oriented organisation. A registered not-for-profit, we’re the brains behind AgilePM®, AgileBA®, AgilePgM® and AgileDS™ and organise the longest running annual Agile Business Conference on the planet. Over 100,000 people around the globe are now AgilePM certified.

© 2019 Agile Business Consortium Limited

Agile Business Consortium Limited is a not-for-profit organisation limited by guarantee.

Registered address: Second Floor, International House, Dover Place, Ashford, Kent, TN23 1HU

Registered in England & Wales. Registration No. 3030597.