SlideShare a Scribd company logo
Building a more accurate burndown   Using Range Estimation in Scrum Agile 2010 Conference August 2010 Arin Sime 434 996 5226 [email_address]
Pitfalls of traditional estimation techniques
How long does it take you to get to work? traffic optimistic every day? method of travel
68% http://www1.standishgroup.com/newsroom/chaos_2009.php
A little about me… Senior Consultant, OpenSource Connections in Charlottesville, Virginia Masters in Management of I.T., University of Virginia, McIntire School of Commerce We tweaked our Scrum process to incorporate Range Estimation based on my studies at Uva Please take the Estimation Survey:  http://www.surveymonkey.com/s/SWNNYQJ
The root of all estimation evil:  Single point estimates Chart taken from:  Software Estimation , Steve McConnell, Figure 1-1, p6 “ A single-point estimate is usually a target masquerading as an estimate.” -Steve McConnell
A realistic estimate distribution Chart taken from:  Software Estimation , Steve McConnell, Figure 1-3, p8 “ There is a limit to how well a project can go but no limit to how many problems can occur.” -Steve McConnell Nominal Outcome (50/50 estimate)
Reasons we are wrong so often Different information Different methods Psychological Biases The Expert Problem
Bias in Estimation Imagine this scenario: “ Can you build me that CMS website in 2 weeks?” How would you respond?  What estimate would you give?
Bias in Estimation By supplying my own estimate (or desire) in my question, I have anchored your response. This is called  “The anchoring or framing trap” “ Because anchors can establish the terms on which a decision will be made, they are often used as a bargaining tactic by savvy negotiators.”  From “The Hidden Traps in Decision Making”  from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
You’re not as good as you think “ The Expert Problem” Experts consistently underestimate their margins of error, and discount the reasons they were wrong in the past. Excuses for past mistakes: You were playing a different game  Invoke the outlier “ Almost right” defense The Black Swan:  The impact of the Highly Improbable ,  by Nassim Nicholas Taleb, 2007, Chapter 10: The Scandal of Prediction
The best protection “ The best protection against all psychological traps – in isolation or in combination – is awareness.”  From “The Hidden Traps in Decision Making”  from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
Agile estimation techniques
How agile already avoids pitfalls Encourages team airing of estimates Done before assignment of tasks Scrum poker
How agile already avoids pitfalls Separates story from time units, more relative Story Points & Velocity Image from:  http://leadinganswers.typepad.com/leading_answers/2007/09/agile-exception.html
Agile and Scrum can run into other pitfalls though…
Potential pitfalls: Single-point estimates What about Risk? Implies a set delivery of features Story points are hard to explain
Better accuracy using range estimation
The Cone of Uncertainty http://www.construx.com/Page.aspx?hid=1648
Range estimation … Recognizes uncertainty Alleviates our tendency towards optimism Incorporates risk Allows for better financial projections Better informs our bosses and clients
Incorporating range estimation into Scrum
Incorporating range estimation into Scrum Team originally estimated 108 hours Range estimate went from 114-245 hours. Note the single point was a low estimate! They were able to finish original tasks a little early
Range estimation in Scrum Poker It’s very simple – just hold two cards instead of one! The same rules apply about creating discussion between low and high estimators, but you might resolve them differently...
On the high end Range estimation in Scrum Poker On the low end On the high end The likely discussion: Hey Orange, why do you say “2”?  Yellow and Blue both say “5”. Likely Outcome:  3 or 5 Middle of the road
Range estimation in Scrum Poker Still middle of the road, but Green recognizes some risk Orange sees this as really easy  Blue sees this as more complicated The likely discussion: Orange and Blue need to compare their visions for this task. Likely Outcome:  8-13? Red and Blue no longer agree:  Red is confused or sees big risks
Using ranges in your task list
Using ranges in your task list Enter Low/High =(Lo*0.33)+(Hi*0.67) Sums of Lo, Hi, 2/3; then trend them to zero update daily
Using ranges in your burndown
Ranges help to highlight obstacles and know when to cancel an iteration
We were able to improve on the next iteration, but it was still hard
Ranges help reinforce obstacles Obstacle removed
Why 2/3? Because it is both simple and pessimistic PERT does a similar thing: Expected = [BestCase + (4*MostLikely) + WorstCase] / 6 Source on PERT:  Software Estimation , Steve McConnell, p109
Using ranges to better communicate
Using range estimation to communicate risk Size of your range communicates the risk of your task May encourage you to break up tasks, or better define them. Scrum is all about better communication with the customer – so are ranges
How long? Um… 2 days 4 days Do you know your fudge factor? You Your Boss Big Boss
How long? 2-4 days 2-4 days Ranges help you control your fudge factor You Your Boss Big Boss
Another example:  Use ranges to better empower your boss or client You Your Boss Big Boss
Perfect – Do it! How long? How much for X? GRRR Umm….. You Your Boss Big Boss 2 days Actually … 4 days 4 days later… 2 days * rate Budget Left:  2 days
Instead…. You Your Boss Big Boss
No thx, do something easier How long? How much for X? YES! You Your Boss Big Boss 2-4 days Done! 2 days later… 2-4 days * rate Budget Left:  2 days
Potential pitfalls of range estimation
Potential pitfalls of range estimation Really Wide Ranges Not everything can take  2 – 200 hours or you lose all credibility
Potential pitfalls of range estimation Bosses who don’t get it You’re going to have to sell them on how your estimates will improve their decision  making ability.
Potential pitfalls of range estimation Pushed back deadlines Ranges are not an excuse to always miss deadlines.  But they do make it less of a surprise, and encourage you to be more cautious.
Potential pitfalls of range estimation Is 2/3 the new single-point? Be careful not to just start treating the 2/3 calculated estimate, use the ranges.
Further Reading
Questions? Arin Sime 434 996 5226 [email_address] Twitter.com/ArinSime
Ad

More Related Content

What's hot (20)

Estimating and planning Agile projects
Estimating and planning Agile projectsEstimating and planning Agile projects
Estimating and planning Agile projects
Murray Robinson
 
Estimation techniques for Scrum Teams
Estimation techniques for Scrum TeamsEstimation techniques for Scrum Teams
Estimation techniques for Scrum Teams
Jesus Mendez
 
Agile estimates - Insights about the basic
Agile estimates -  Insights about the basicAgile estimates -  Insights about the basic
Agile estimates - Insights about the basic
Diogo S. Del Gaudio
 
Agile estimating user stories
Agile estimating user storiesAgile estimating user stories
Agile estimating user stories
fungfung Chen
 
An introduction to agile estimation and release planning
An introduction to agile estimation and release planningAn introduction to agile estimation and release planning
An introduction to agile estimation and release planning
James Whitehead
 
Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015
Juliano Ribeiro
 
Agile Estimation
Agile EstimationAgile Estimation
Agile Estimation
Saltmarch Media
 
Agile Scrum Estimation
Agile   Scrum EstimationAgile   Scrum Estimation
Agile Scrum Estimation
Prasad Prabhakaran
 
Software management...for people who just want to get stuff done
Software management...for people who just want to get stuff doneSoftware management...for people who just want to get stuff done
Software management...for people who just want to get stuff done
Ciff McCollum
 
AgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation WorkshopAgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation Workshop
Stephen Vance
 
Introduction to Agile Estimation & Planning
Introduction to Agile Estimation & PlanningIntroduction to Agile Estimation & Planning
Introduction to Agile Estimation & Planning
Amaad Qureshi
 
Agile 2010 Estimation Games
Agile 2010 Estimation  GamesAgile 2010 Estimation  Games
Agile 2010 Estimation Games
AgileCoach.net
 
Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.
Mikalai Alimenkou
 
Agile stories, estimating and planning
Agile stories, estimating and planningAgile stories, estimating and planning
Agile stories, estimating and planning
Dimitri Ponomareff
 
Agile Projects | Rapid Estimation | Techniques | Tips
Agile Projects | Rapid Estimation | Techniques | TipsAgile Projects | Rapid Estimation | Techniques | Tips
Agile Projects | Rapid Estimation | Techniques | Tips
cPrime | Project Management | Agile | Consulting | Staffing | Training
 
How to estimate in scrum
How to estimate in scrumHow to estimate in scrum
How to estimate in scrum
Gloria Stoilova
 
Estimation and Release Planning in Scrum
Estimation and Release Planning in ScrumEstimation and Release Planning in Scrum
Estimation and Release Planning in Scrum
Leapfrog Technology Inc.
 
Agile estimation and planning
Agile estimation and planning Agile estimation and planning
Agile estimation and planning
Elad Sofer
 
Agile Estimating
Agile EstimatingAgile Estimating
Agile Estimating
Robert Dempsey
 
Planning Poker estimating technique
Planning Poker estimating techniquePlanning Poker estimating technique
Planning Poker estimating technique
Suhail Jamaldeen
 
Estimating and planning Agile projects
Estimating and planning Agile projectsEstimating and planning Agile projects
Estimating and planning Agile projects
Murray Robinson
 
Estimation techniques for Scrum Teams
Estimation techniques for Scrum TeamsEstimation techniques for Scrum Teams
Estimation techniques for Scrum Teams
Jesus Mendez
 
Agile estimates - Insights about the basic
Agile estimates -  Insights about the basicAgile estimates -  Insights about the basic
Agile estimates - Insights about the basic
Diogo S. Del Gaudio
 
Agile estimating user stories
Agile estimating user storiesAgile estimating user stories
Agile estimating user stories
fungfung Chen
 
An introduction to agile estimation and release planning
An introduction to agile estimation and release planningAn introduction to agile estimation and release planning
An introduction to agile estimation and release planning
James Whitehead
 
Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015
Juliano Ribeiro
 
Software management...for people who just want to get stuff done
Software management...for people who just want to get stuff doneSoftware management...for people who just want to get stuff done
Software management...for people who just want to get stuff done
Ciff McCollum
 
AgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation WorkshopAgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation Workshop
Stephen Vance
 
Introduction to Agile Estimation & Planning
Introduction to Agile Estimation & PlanningIntroduction to Agile Estimation & Planning
Introduction to Agile Estimation & Planning
Amaad Qureshi
 
Agile 2010 Estimation Games
Agile 2010 Estimation  GamesAgile 2010 Estimation  Games
Agile 2010 Estimation Games
AgileCoach.net
 
Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.
Mikalai Alimenkou
 
Agile stories, estimating and planning
Agile stories, estimating and planningAgile stories, estimating and planning
Agile stories, estimating and planning
Dimitri Ponomareff
 
How to estimate in scrum
How to estimate in scrumHow to estimate in scrum
How to estimate in scrum
Gloria Stoilova
 
Agile estimation and planning
Agile estimation and planning Agile estimation and planning
Agile estimation and planning
Elad Sofer
 
Planning Poker estimating technique
Planning Poker estimating techniquePlanning Poker estimating technique
Planning Poker estimating technique
Suhail Jamaldeen
 

Similar to Range estimation in Scrum (20)

Madhur Kathuria Release planning using feature points
Madhur Kathuria Release planning using feature pointsMadhur Kathuria Release planning using feature points
Madhur Kathuria Release planning using feature points
India Scrum Enthusiasts Community
 
So when will it be done
So when will it be doneSo when will it be done
So when will it be done
John Donoghue
 
Estimation Protips - NCDevCon 2014
Estimation Protips - NCDevCon 2014Estimation Protips - NCDevCon 2014
Estimation Protips - NCDevCon 2014
Jonathon Hill
 
Software Estimation - part 1 of 2
Software Estimation - part 1 of 2Software Estimation - part 1 of 2
Software Estimation - part 1 of 2
Adi Dancu
 
Improving Estimates
Improving EstimatesImproving Estimates
Improving Estimates
Giovanni Scerra ☃
 
Release planning using feature points
Release planning using feature pointsRelease planning using feature points
Release planning using feature points
Madhur Kathuria
 
Ryan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovementRyan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovement
ProjectCon
 
The art of estimation
The art of estimationThe art of estimation
The art of estimation
Kshitij Agrawal
 
Software estimation is crap
Software estimation is crapSoftware estimation is crap
Software estimation is crap
Ian Garrison
 
Estimates or #NoEstimates by Enes Pelko
Estimates or #NoEstimates by Enes PelkoEstimates or #NoEstimates by Enes Pelko
Estimates or #NoEstimates by Enes Pelko
Bosnia Agile
 
Estimation
EstimationEstimation
Estimation
Dev9Com
 
When Will This Be Done?
When Will This Be Done?When Will This Be Done?
When Will This Be Done?
Rod Bray
 
Esteem and Estimates (Ti Stimo Fratello)
Esteem and Estimates (Ti Stimo Fratello)Esteem and Estimates (Ti Stimo Fratello)
Esteem and Estimates (Ti Stimo Fratello)
Gaetano Mazzanti
 
Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?
Michael McKeon
 
Estimation Protips
Estimation ProtipsEstimation Protips
Estimation Protips
Jonathon Hill
 
significance_of_test_estimating_in_the_software_development.pdf
significance_of_test_estimating_in_the_software_development.pdfsignificance_of_test_estimating_in_the_software_development.pdf
significance_of_test_estimating_in_the_software_development.pdf
sarah david
 
Want better estimation ?
Want better estimation ?Want better estimation ?
Want better estimation ?
Alexandre Cuva
 
Software estimation techniques
Software estimation techniquesSoftware estimation techniques
Software estimation techniques
André Pitombeira
 
[HCM Scrum Breakfast] Agile estimation - Story points
[HCM Scrum Breakfast] Agile estimation - Story points[HCM Scrum Breakfast] Agile estimation - Story points
[HCM Scrum Breakfast] Agile estimation - Story points
Scrum Breakfast Vietnam
 
Dark Art of Software Estimation 360iDev2014
Dark Art of Software Estimation 360iDev2014Dark Art of Software Estimation 360iDev2014
Dark Art of Software Estimation 360iDev2014
Carl Brown
 
So when will it be done
So when will it be doneSo when will it be done
So when will it be done
John Donoghue
 
Estimation Protips - NCDevCon 2014
Estimation Protips - NCDevCon 2014Estimation Protips - NCDevCon 2014
Estimation Protips - NCDevCon 2014
Jonathon Hill
 
Software Estimation - part 1 of 2
Software Estimation - part 1 of 2Software Estimation - part 1 of 2
Software Estimation - part 1 of 2
Adi Dancu
 
Release planning using feature points
Release planning using feature pointsRelease planning using feature points
Release planning using feature points
Madhur Kathuria
 
Ryan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovementRyan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovement
ProjectCon
 
Software estimation is crap
Software estimation is crapSoftware estimation is crap
Software estimation is crap
Ian Garrison
 
Estimates or #NoEstimates by Enes Pelko
Estimates or #NoEstimates by Enes PelkoEstimates or #NoEstimates by Enes Pelko
Estimates or #NoEstimates by Enes Pelko
Bosnia Agile
 
Estimation
EstimationEstimation
Estimation
Dev9Com
 
When Will This Be Done?
When Will This Be Done?When Will This Be Done?
When Will This Be Done?
Rod Bray
 
Esteem and Estimates (Ti Stimo Fratello)
Esteem and Estimates (Ti Stimo Fratello)Esteem and Estimates (Ti Stimo Fratello)
Esteem and Estimates (Ti Stimo Fratello)
Gaetano Mazzanti
 
Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?
Michael McKeon
 
significance_of_test_estimating_in_the_software_development.pdf
significance_of_test_estimating_in_the_software_development.pdfsignificance_of_test_estimating_in_the_software_development.pdf
significance_of_test_estimating_in_the_software_development.pdf
sarah david
 
Want better estimation ?
Want better estimation ?Want better estimation ?
Want better estimation ?
Alexandre Cuva
 
Software estimation techniques
Software estimation techniquesSoftware estimation techniques
Software estimation techniques
André Pitombeira
 
[HCM Scrum Breakfast] Agile estimation - Story points
[HCM Scrum Breakfast] Agile estimation - Story points[HCM Scrum Breakfast] Agile estimation - Story points
[HCM Scrum Breakfast] Agile estimation - Story points
Scrum Breakfast Vietnam
 
Dark Art of Software Estimation 360iDev2014
Dark Art of Software Estimation 360iDev2014Dark Art of Software Estimation 360iDev2014
Dark Art of Software Estimation 360iDev2014
Carl Brown
 
Ad

More from OpenSource Connections (20)

Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024
Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
OpenSource Connections
 
Encores
EncoresEncores
Encores
OpenSource Connections
 
Test driven relevancy
Test driven relevancyTest driven relevancy
Test driven relevancy
OpenSource Connections
 
How To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessHow To Structure Your Search Team for Success
How To Structure Your Search Team for Success
OpenSource Connections
 
The right path to making search relevant - Taxonomy Bootcamp London 2019
The right path to making search relevant  - Taxonomy Bootcamp London 2019The right path to making search relevant  - Taxonomy Bootcamp London 2019
The right path to making search relevant - Taxonomy Bootcamp London 2019
OpenSource Connections
 
Payloads and OCR with Solr
Payloads and OCR with SolrPayloads and OCR with Solr
Payloads and OCR with Solr
OpenSource Connections
 
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullHaystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
OpenSource Connections
 
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonHaystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
OpenSource Connections
 
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
OpenSource Connections
 
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajHaystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
OpenSource Connections
 
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
OpenSource Connections
 
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlHaystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
OpenSource Connections
 
Haystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesHaystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon Hughes
OpenSource Connections
 
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerHaystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
OpenSource Connections
 
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
OpenSource Connections
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
OpenSource Connections
 
Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...
OpenSource Connections
 
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
OpenSource Connections
 
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
OpenSource Connections
 
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
OpenSource Connections
 
Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024
Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
OpenSource Connections
 
How To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessHow To Structure Your Search Team for Success
How To Structure Your Search Team for Success
OpenSource Connections
 
The right path to making search relevant - Taxonomy Bootcamp London 2019
The right path to making search relevant  - Taxonomy Bootcamp London 2019The right path to making search relevant  - Taxonomy Bootcamp London 2019
The right path to making search relevant - Taxonomy Bootcamp London 2019
OpenSource Connections
 
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullHaystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
OpenSource Connections
 
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonHaystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
OpenSource Connections
 
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
OpenSource Connections
 
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajHaystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
OpenSource Connections
 
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
OpenSource Connections
 
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlHaystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
OpenSource Connections
 
Haystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesHaystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon Hughes
OpenSource Connections
 
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerHaystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
OpenSource Connections
 
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
OpenSource Connections
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
OpenSource Connections
 
Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...
OpenSource Connections
 
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
OpenSource Connections
 
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
OpenSource Connections
 
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
OpenSource Connections
 
Ad

Recently uploaded (20)

STKI Israel Market Study 2025 final v1 version
STKI Israel Market Study 2025 final v1 versionSTKI Israel Market Study 2025 final v1 version
STKI Israel Market Study 2025 final v1 version
Dr. Jimmy Schwarzkopf
 
Measuring Microsoft 365 Copilot and Gen AI Success
Measuring Microsoft 365 Copilot and Gen AI SuccessMeasuring Microsoft 365 Copilot and Gen AI Success
Measuring Microsoft 365 Copilot and Gen AI Success
Nikki Chapple
 
Splunk Leadership Forum Wien - 20.05.2025
Splunk Leadership Forum Wien - 20.05.2025Splunk Leadership Forum Wien - 20.05.2025
Splunk Leadership Forum Wien - 20.05.2025
Splunk
 
Dev Dives: System-to-system integration with UiPath API Workflows
Dev Dives: System-to-system integration with UiPath API WorkflowsDev Dives: System-to-system integration with UiPath API Workflows
Dev Dives: System-to-system integration with UiPath API Workflows
UiPathCommunity
 
SDG 9000 Series: Unleashing multigigabit everywhere
SDG 9000 Series: Unleashing multigigabit everywhereSDG 9000 Series: Unleashing multigigabit everywhere
SDG 9000 Series: Unleashing multigigabit everywhere
Adtran
 
AI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AI
AI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AIAI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AI
AI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AI
Buhake Sindi
 
European Accessibility Act & Integrated Accessibility Testing
European Accessibility Act & Integrated Accessibility TestingEuropean Accessibility Act & Integrated Accessibility Testing
European Accessibility Act & Integrated Accessibility Testing
Julia Undeutsch
 
Fully Open-Source Private Clouds: Freedom, Security, and Control
Fully Open-Source Private Clouds: Freedom, Security, and ControlFully Open-Source Private Clouds: Freedom, Security, and Control
Fully Open-Source Private Clouds: Freedom, Security, and Control
ShapeBlue
 
Cyber security cyber security cyber security cyber security cyber security cy...
Cyber security cyber security cyber security cyber security cyber security cy...Cyber security cyber security cyber security cyber security cyber security cy...
Cyber security cyber security cyber security cyber security cyber security cy...
pranavbodhak
 
Multistream in SIP and NoSIP @ OpenSIPS Summit 2025
Multistream in SIP and NoSIP @ OpenSIPS Summit 2025Multistream in SIP and NoSIP @ OpenSIPS Summit 2025
Multistream in SIP and NoSIP @ OpenSIPS Summit 2025
Lorenzo Miniero
 
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCPMCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
Sambhav Kothari
 
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
SOFTTECHHUB
 
The 2025 Digital Adoption Blueprint.pptx
The 2025 Digital Adoption Blueprint.pptxThe 2025 Digital Adoption Blueprint.pptx
The 2025 Digital Adoption Blueprint.pptx
aptyai
 
AI Emotional Actors: “When Machines Learn to Feel and Perform"
AI Emotional Actors:  “When Machines Learn to Feel and Perform"AI Emotional Actors:  “When Machines Learn to Feel and Perform"
AI Emotional Actors: “When Machines Learn to Feel and Perform"
AkashKumar809858
 
Cognitive Chasms - A Typology of GenAI Failure Failure Modes
Cognitive Chasms - A Typology of GenAI Failure Failure ModesCognitive Chasms - A Typology of GenAI Failure Failure Modes
Cognitive Chasms - A Typology of GenAI Failure Failure Modes
Dr. Tathagat Varma
 
What is DePIN? The Hottest Trend in Web3 Right Now!
What is DePIN? The Hottest Trend in Web3 Right Now!What is DePIN? The Hottest Trend in Web3 Right Now!
What is DePIN? The Hottest Trend in Web3 Right Now!
cryptouniversityoffi
 
Gihbli AI and Geo sitution |use/misuse of Ai Technology
Gihbli AI and Geo sitution |use/misuse of Ai TechnologyGihbli AI and Geo sitution |use/misuse of Ai Technology
Gihbli AI and Geo sitution |use/misuse of Ai Technology
zainkhurram1111
 
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptxECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
Jasper Oosterveld
 
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Eugene Fidelin
 
Talk: On an adventure into the depths of Maven - Kaya Weers
Talk: On an adventure into the depths of Maven - Kaya WeersTalk: On an adventure into the depths of Maven - Kaya Weers
Talk: On an adventure into the depths of Maven - Kaya Weers
Kaya Weers
 
STKI Israel Market Study 2025 final v1 version
STKI Israel Market Study 2025 final v1 versionSTKI Israel Market Study 2025 final v1 version
STKI Israel Market Study 2025 final v1 version
Dr. Jimmy Schwarzkopf
 
Measuring Microsoft 365 Copilot and Gen AI Success
Measuring Microsoft 365 Copilot and Gen AI SuccessMeasuring Microsoft 365 Copilot and Gen AI Success
Measuring Microsoft 365 Copilot and Gen AI Success
Nikki Chapple
 
Splunk Leadership Forum Wien - 20.05.2025
Splunk Leadership Forum Wien - 20.05.2025Splunk Leadership Forum Wien - 20.05.2025
Splunk Leadership Forum Wien - 20.05.2025
Splunk
 
Dev Dives: System-to-system integration with UiPath API Workflows
Dev Dives: System-to-system integration with UiPath API WorkflowsDev Dives: System-to-system integration with UiPath API Workflows
Dev Dives: System-to-system integration with UiPath API Workflows
UiPathCommunity
 
SDG 9000 Series: Unleashing multigigabit everywhere
SDG 9000 Series: Unleashing multigigabit everywhereSDG 9000 Series: Unleashing multigigabit everywhere
SDG 9000 Series: Unleashing multigigabit everywhere
Adtran
 
AI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AI
AI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AIAI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AI
AI in Java - MCP in Action, Langchain4J-CDI, SmallRye-LLM, Spring AI
Buhake Sindi
 
European Accessibility Act & Integrated Accessibility Testing
European Accessibility Act & Integrated Accessibility TestingEuropean Accessibility Act & Integrated Accessibility Testing
European Accessibility Act & Integrated Accessibility Testing
Julia Undeutsch
 
Fully Open-Source Private Clouds: Freedom, Security, and Control
Fully Open-Source Private Clouds: Freedom, Security, and ControlFully Open-Source Private Clouds: Freedom, Security, and Control
Fully Open-Source Private Clouds: Freedom, Security, and Control
ShapeBlue
 
Cyber security cyber security cyber security cyber security cyber security cy...
Cyber security cyber security cyber security cyber security cyber security cy...Cyber security cyber security cyber security cyber security cyber security cy...
Cyber security cyber security cyber security cyber security cyber security cy...
pranavbodhak
 
Multistream in SIP and NoSIP @ OpenSIPS Summit 2025
Multistream in SIP and NoSIP @ OpenSIPS Summit 2025Multistream in SIP and NoSIP @ OpenSIPS Summit 2025
Multistream in SIP and NoSIP @ OpenSIPS Summit 2025
Lorenzo Miniero
 
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCPMCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
MCP Dev Summit - Pragmatic Scaling of Enterprise GenAI with MCP
Sambhav Kothari
 
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
With Claude 4, Anthropic redefines AI capabilities, effectively unleashing a ...
SOFTTECHHUB
 
The 2025 Digital Adoption Blueprint.pptx
The 2025 Digital Adoption Blueprint.pptxThe 2025 Digital Adoption Blueprint.pptx
The 2025 Digital Adoption Blueprint.pptx
aptyai
 
AI Emotional Actors: “When Machines Learn to Feel and Perform"
AI Emotional Actors:  “When Machines Learn to Feel and Perform"AI Emotional Actors:  “When Machines Learn to Feel and Perform"
AI Emotional Actors: “When Machines Learn to Feel and Perform"
AkashKumar809858
 
Cognitive Chasms - A Typology of GenAI Failure Failure Modes
Cognitive Chasms - A Typology of GenAI Failure Failure ModesCognitive Chasms - A Typology of GenAI Failure Failure Modes
Cognitive Chasms - A Typology of GenAI Failure Failure Modes
Dr. Tathagat Varma
 
What is DePIN? The Hottest Trend in Web3 Right Now!
What is DePIN? The Hottest Trend in Web3 Right Now!What is DePIN? The Hottest Trend in Web3 Right Now!
What is DePIN? The Hottest Trend in Web3 Right Now!
cryptouniversityoffi
 
Gihbli AI and Geo sitution |use/misuse of Ai Technology
Gihbli AI and Geo sitution |use/misuse of Ai TechnologyGihbli AI and Geo sitution |use/misuse of Ai Technology
Gihbli AI and Geo sitution |use/misuse of Ai Technology
zainkhurram1111
 
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptxECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
ECS25 - The adventures of a Microsoft 365 Platform Owner - Website.pptx
Jasper Oosterveld
 
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Marko.js - Unsung Hero of Scalable Web Frameworks (DevDays 2025)
Eugene Fidelin
 
Talk: On an adventure into the depths of Maven - Kaya Weers
Talk: On an adventure into the depths of Maven - Kaya WeersTalk: On an adventure into the depths of Maven - Kaya Weers
Talk: On an adventure into the depths of Maven - Kaya Weers
Kaya Weers
 

Range estimation in Scrum

  • 1. Building a more accurate burndown Using Range Estimation in Scrum Agile 2010 Conference August 2010 Arin Sime 434 996 5226 [email_address]
  • 2. Pitfalls of traditional estimation techniques
  • 3. How long does it take you to get to work? traffic optimistic every day? method of travel
  • 5. A little about me… Senior Consultant, OpenSource Connections in Charlottesville, Virginia Masters in Management of I.T., University of Virginia, McIntire School of Commerce We tweaked our Scrum process to incorporate Range Estimation based on my studies at Uva Please take the Estimation Survey: http://www.surveymonkey.com/s/SWNNYQJ
  • 6. The root of all estimation evil: Single point estimates Chart taken from: Software Estimation , Steve McConnell, Figure 1-1, p6 “ A single-point estimate is usually a target masquerading as an estimate.” -Steve McConnell
  • 7. A realistic estimate distribution Chart taken from: Software Estimation , Steve McConnell, Figure 1-3, p8 “ There is a limit to how well a project can go but no limit to how many problems can occur.” -Steve McConnell Nominal Outcome (50/50 estimate)
  • 8. Reasons we are wrong so often Different information Different methods Psychological Biases The Expert Problem
  • 9. Bias in Estimation Imagine this scenario: “ Can you build me that CMS website in 2 weeks?” How would you respond? What estimate would you give?
  • 10. Bias in Estimation By supplying my own estimate (or desire) in my question, I have anchored your response. This is called “The anchoring or framing trap” “ Because anchors can establish the terms on which a decision will be made, they are often used as a bargaining tactic by savvy negotiators.” From “The Hidden Traps in Decision Making” from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
  • 11. You’re not as good as you think “ The Expert Problem” Experts consistently underestimate their margins of error, and discount the reasons they were wrong in the past. Excuses for past mistakes: You were playing a different game Invoke the outlier “ Almost right” defense The Black Swan: The impact of the Highly Improbable , by Nassim Nicholas Taleb, 2007, Chapter 10: The Scandal of Prediction
  • 12. The best protection “ The best protection against all psychological traps – in isolation or in combination – is awareness.” From “The Hidden Traps in Decision Making” from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
  • 14. How agile already avoids pitfalls Encourages team airing of estimates Done before assignment of tasks Scrum poker
  • 15. How agile already avoids pitfalls Separates story from time units, more relative Story Points & Velocity Image from: http://leadinganswers.typepad.com/leading_answers/2007/09/agile-exception.html
  • 16. Agile and Scrum can run into other pitfalls though…
  • 17. Potential pitfalls: Single-point estimates What about Risk? Implies a set delivery of features Story points are hard to explain
  • 18. Better accuracy using range estimation
  • 19. The Cone of Uncertainty http://www.construx.com/Page.aspx?hid=1648
  • 20. Range estimation … Recognizes uncertainty Alleviates our tendency towards optimism Incorporates risk Allows for better financial projections Better informs our bosses and clients
  • 22. Incorporating range estimation into Scrum Team originally estimated 108 hours Range estimate went from 114-245 hours. Note the single point was a low estimate! They were able to finish original tasks a little early
  • 23. Range estimation in Scrum Poker It’s very simple – just hold two cards instead of one! The same rules apply about creating discussion between low and high estimators, but you might resolve them differently...
  • 24. On the high end Range estimation in Scrum Poker On the low end On the high end The likely discussion: Hey Orange, why do you say “2”? Yellow and Blue both say “5”. Likely Outcome: 3 or 5 Middle of the road
  • 25. Range estimation in Scrum Poker Still middle of the road, but Green recognizes some risk Orange sees this as really easy Blue sees this as more complicated The likely discussion: Orange and Blue need to compare their visions for this task. Likely Outcome: 8-13? Red and Blue no longer agree: Red is confused or sees big risks
  • 26. Using ranges in your task list
  • 27. Using ranges in your task list Enter Low/High =(Lo*0.33)+(Hi*0.67) Sums of Lo, Hi, 2/3; then trend them to zero update daily
  • 28. Using ranges in your burndown
  • 29. Ranges help to highlight obstacles and know when to cancel an iteration
  • 30. We were able to improve on the next iteration, but it was still hard
  • 31. Ranges help reinforce obstacles Obstacle removed
  • 32. Why 2/3? Because it is both simple and pessimistic PERT does a similar thing: Expected = [BestCase + (4*MostLikely) + WorstCase] / 6 Source on PERT: Software Estimation , Steve McConnell, p109
  • 33. Using ranges to better communicate
  • 34. Using range estimation to communicate risk Size of your range communicates the risk of your task May encourage you to break up tasks, or better define them. Scrum is all about better communication with the customer – so are ranges
  • 35. How long? Um… 2 days 4 days Do you know your fudge factor? You Your Boss Big Boss
  • 36. How long? 2-4 days 2-4 days Ranges help you control your fudge factor You Your Boss Big Boss
  • 37. Another example: Use ranges to better empower your boss or client You Your Boss Big Boss
  • 38. Perfect – Do it! How long? How much for X? GRRR Umm….. You Your Boss Big Boss 2 days Actually … 4 days 4 days later… 2 days * rate Budget Left: 2 days
  • 39. Instead…. You Your Boss Big Boss
  • 40. No thx, do something easier How long? How much for X? YES! You Your Boss Big Boss 2-4 days Done! 2 days later… 2-4 days * rate Budget Left: 2 days
  • 41. Potential pitfalls of range estimation
  • 42. Potential pitfalls of range estimation Really Wide Ranges Not everything can take 2 – 200 hours or you lose all credibility
  • 43. Potential pitfalls of range estimation Bosses who don’t get it You’re going to have to sell them on how your estimates will improve their decision making ability.
  • 44. Potential pitfalls of range estimation Pushed back deadlines Ranges are not an excuse to always miss deadlines. But they do make it less of a surprise, and encourage you to be more cautious.
  • 45. Potential pitfalls of range estimation Is 2/3 the new single-point? Be careful not to just start treating the 2/3 calculated estimate, use the ranges.
  • 47. Questions? Arin Sime 434 996 5226 [email_address] Twitter.com/ArinSime

Editor's Notes

  • #4: how long does it take you to drive to work? Is that everyday? Traffic? Optimistic?
  • #23: Show single point then double point
  • #26: Yellow doesn’t know what they’re talking about.