blog > rethinking-agile-metrics-beyond-story-points

Rethinking Agile Metrics: Beyond Story Points

by Craig Fraser
Published on: 2/29/2024


In the dynamic world of Agile methodologies, Story Points have long reigned as the golden metric, guiding teams through the maze of sprint planning and backlog grooming. However, what if I told you that this cherished tool might not be the panacea we once believed it to be? Join me on a journey as we unravel the complexities of Story Points, exploring their virtues, pitfalls, and the path to a brighter Agile future.

The Story Behind Story Points

Imagine, if you will, a fine wine—a symbol of sophistication and refinement. Much like wine, Story Points can be a delightful accompaniment to the Agile process when used judiciously. They offer teams a means of quantifying effort, facilitating more accurate sprint planning and providing stakeholders with a glimpse into project progress.

Yet, beneath the veneer of utility lies a darker truth: the misuse and misinterpretation of Story Points can sow discord within Agile teams. In my decade-long tenure in the IT realm, I’ve witnessed firsthand the havoc wrought by blind adherence to this metric. Teams, consumed by the pursuit of point tallies, lose sight of the ultimate goal: delivering value to the customer.

The Good, The Bad, and The Ugly

Let’s delve deeper into the dichotomy of Story Points. On one hand, they offer tangible benefits:

  • Facilitated Planning: Story Points enable teams to estimate the effort required for each user story, aiding in sprint planning and resource allocation.
  • Stakeholder Communication: By providing a common language for discussing complexity, Story Points enhance communication between development teams and stakeholders.
  • Velocity Tracking: Over time, Story Points help teams gauge their velocity and refine their estimations, leading to more accurate forecasting.

However, the road paved with Story Points is not without its pitfalls:

Gamification Gone Awry

Picture this: a development team locked in a race to amass Story Points, akin to contestants vying for the highest score in a video game. In their fervor to outdo one another, developers may succumb to the allure of gaming the system, manipulating their estimates to inflate or deflate their point tallies.

Example: In a bid to impress management and meet aggressive deadlines, a developer may deliberately underestimate the complexity of a task, artificially lowering their Story Point estimate. Conversely, fearing repercussions for missing targets, another developer might inflate their estimates, padding their workload with unnecessary complexity to ensure they meet their quota.

Managerial Myopia

As the old adage goes, “What gets measured gets managed.” However, in the case of Story Points, this adage can morph into a double-edged sword. Managers, fixated on point tallies and burndown charts, may lose sight of the forest for the trees, reducing Agile development to a mere numbers game.

Example: Imagine a scenario where a team diligently delivers high-quality software that meets user needs but falls short of their Story Point target. Despite the tangible value delivered, managers, obsessed with hitting arbitrary point quotas, express dissatisfaction, undermining team morale and sowing seeds of discontent.

Straying from Agile Principles

At its core, Agile is a philosophy—a mindset that prioritizes individuals and interactions over processes and tools. However, blind adherence to Story Points can lead teams down a treacherous path, steering them away from Agile’s guiding principles and towards a mechanistic approach to software development.

Example: Consider a team embroiled in the throes of Story Point estimation, where every user story is dissected, analyzed, and assigned a numerical value. In their quest for precision, team members lose sight of the bigger picture, neglecting to engage in meaningful collaboration or adapt their approach based on customer feedback. The result? A process mired in bureaucracy, devoid of the flexibility and responsiveness that define true Agile practices.

A New Paradigm: Beyond Story Points

In light of these challenges, it’s time to chart a new course for Agile metrics. Imagine a world where teams unite under a singular sprint goal, transcending individual point tallies in favor of collective synergy. This paradigm shift not only fosters a sense of camaraderie but also reinvigorates Agile with a renewed focus on customer value and collaboration.

But what metrics should supplant Story Points? Here, the possibilities are manifold:

Lead Time: A Barometer of Efficiency

Lead time serves as the compass guiding teams through the labyrinth of development cycles, offering invaluable insights into their efficiency and responsiveness. From the inception of a user story to its deployment in production, every minute counts—a testament to a team’s ability to navigate obstacles and deliver value swiftly.

Example: Imagine a development team tasked with implementing a critical feature. By streamlining their processes and reducing lead time, they accelerate the time-to-market, delighting stakeholders and gaining a competitive edge in the market. Through a relentless pursuit of efficiency, they position themselves as industry leaders, setting the standard for Agile excellence.

Deployment Frequency: Paving the Road to Innovation

In the age of rapid digital transformation, the ability to deploy code frequently and reliably is paramount. A high deployment frequency not only signifies a team’s agility but also fosters a culture of continuous improvement and innovation. By embracing automated testing and deployment pipelines, teams can unleash the full potential of their creativity and drive transformative change.

Example: Consider a software development team that adopts a DevOps mindset, leveraging continuous integration and continuous deployment (CI/CD) pipelines to streamline their release process. With each iteration, they iterate, innovate, and deliver value to customers with unprecedented speed and precision. Through a relentless commitment to deployment frequency, they pave the road to innovation and cement their status as industry pioneers.

Mean Time to Restore (MTTR): Building Resilience

In the face of disruptions or failures, the mean time to restore service serves as a litmus test of a team’s resilience and problem-solving capabilities. By swiftly identifying and remedying incidents, teams can minimize downtime, safeguard user experience, and fortify their reputation as trusted custodians of quality.

Example: Picture a scenario where a critical system outage threatens to disrupt operations and tarnish the company’s reputation. Through meticulous monitoring and rapid incident response, a cross-functional team springs into action, swiftly restoring service and mitigating potential losses. By embracing a culture of accountability and collaboration, they transform adversity into opportunity, emerging stronger and more resilient than before.

Change Fail Percentage: Upholding Quality Standards

In the fast-paced world of Agile development, change is inevitable—but so too are the risks of failure. The change fail percentage serves as a barometer of a team’s adherence to quality standards and the effectiveness of their testing practices. By embracing rigorous testing methodologies and embracing a culture of continuous improvement, teams can minimize the risk of failed deployments and deliver flawless experiences to their users.

Example: Imagine a development team committed to delivering software of the highest caliber. Through rigorous automated testing, code reviews, and quality assurance processes, they maintain a low change fail percentage, ensuring that every deployment is met with confidence and reliability. By upholding stringent quality standards, they earn the trust and loyalty of their users, solidifying their reputation as guardians of excellence.

By embracing these alternative metrics, teams can recalibrate their focus, prioritizing outcomes over outputs and fostering a culture of continuous improvement.

Conclusion: A New Dawn for Agile

As we bid adieu to the era of Story Points, let us embark on a new chapter in the Agile saga—one defined by collaboration, customer-centricity, and a relentless pursuit of excellence. By challenging the status quo and embracing alternative metrics, we can usher in a new dawn for Agile—one where teams thrive, stakeholders rejoice, and customer value reigns supreme.

So, my fellow Agilists, I leave you with this challenge: dare to question, dare to innovate, and dare to forge a brighter future for Agile—one sprint at a time.

Are you ready to embark on this journey with me? Let’s redefine Agile excellence together, one metric at a time.


Craig Fraser

Location Icon
Cascades Office Park, Wasbank St,
Little Falls,
Roodepoort, 1724,
Gauteng, South Africa
Runninghill Logo
Stay connected
LinkedinX platformFacebook