SlideShare a Scribd company logo
Building a more accurate burndown   Using Range Estimation in Scrum Agile 2010 Conference August 2010 Arin Sime 434 996 5226 [email_address]
Pitfalls of traditional estimation techniques
How long does it take you to get to work? traffic optimistic every day? method of travel
68% http://www1.standishgroup.com/newsroom/chaos_2009.php
A little about me… Senior Consultant, OpenSource Connections in Charlottesville, Virginia Masters in Management of I.T., University of Virginia, McIntire School of Commerce We tweaked our Scrum process to incorporate Range Estimation based on my studies at Uva Please take the Estimation Survey:  http://www.surveymonkey.com/s/SWNNYQJ
The root of all estimation evil:  Single point estimates Chart taken from:  Software Estimation , Steve McConnell, Figure 1-1, p6 “ A single-point estimate is usually a target masquerading as an estimate.” -Steve McConnell
A realistic estimate distribution Chart taken from:  Software Estimation , Steve McConnell, Figure 1-3, p8 “ There is a limit to how well a project can go but no limit to how many problems can occur.” -Steve McConnell Nominal Outcome (50/50 estimate)
Reasons we are wrong so often Different information Different methods Psychological Biases The Expert Problem
Bias in Estimation Imagine this scenario: “ Can you build me that CMS website in 2 weeks?” How would you respond?  What estimate would you give?
Bias in Estimation By supplying my own estimate (or desire) in my question, I have anchored your response. This is called  “The anchoring or framing trap” “ Because anchors can establish the terms on which a decision will be made, they are often used as a bargaining tactic by savvy negotiators.”  From “The Hidden Traps in Decision Making”  from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
You’re not as good as you think “ The Expert Problem” Experts consistently underestimate their margins of error, and discount the reasons they were wrong in the past. Excuses for past mistakes: You were playing a different game  Invoke the outlier “ Almost right” defense The Black Swan:  The impact of the Highly Improbable ,  by Nassim Nicholas Taleb, 2007, Chapter 10: The Scandal of Prediction
The best protection “ The best protection against all psychological traps – in isolation or in combination – is awareness.”  From “The Hidden Traps in Decision Making”  from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
Agile estimation techniques
How agile already avoids pitfalls Encourages team airing of estimates Done before assignment of tasks Scrum poker
How agile already avoids pitfalls Separates story from time units, more relative Story Points & Velocity Image from:  http://leadinganswers.typepad.com/leading_answers/2007/09/agile-exception.html
Agile and Scrum can run into other pitfalls though…
Potential pitfalls: Single-point estimates What about Risk? Implies a set delivery of features Story points are hard to explain
Better accuracy using range estimation
The Cone of Uncertainty http://www.construx.com/Page.aspx?hid=1648
Range estimation … Recognizes uncertainty Alleviates our tendency towards optimism Incorporates risk Allows for better financial projections Better informs our bosses and clients
Incorporating range estimation into Scrum
Incorporating range estimation into Scrum Team originally estimated 108 hours Range estimate went from 114-245 hours. Note the single point was a low estimate! They were able to finish original tasks a little early
Range estimation in Scrum Poker It’s very simple – just hold two cards instead of one! The same rules apply about creating discussion between low and high estimators, but you might resolve them differently...
On the high end Range estimation in Scrum Poker On the low end On the high end The likely discussion: Hey Orange, why do you say “2”?  Yellow and Blue both say “5”. Likely Outcome:  3 or 5 Middle of the road
Range estimation in Scrum Poker Still middle of the road, but Green recognizes some risk Orange sees this as really easy  Blue sees this as more complicated The likely discussion: Orange and Blue need to compare their visions for this task. Likely Outcome:  8-13? Red and Blue no longer agree:  Red is confused or sees big risks
Using ranges in your task list
Using ranges in your task list Enter Low/High =(Lo*0.33)+(Hi*0.67) Sums of Lo, Hi, 2/3; then trend them to zero update daily
Using ranges in your burndown
Ranges help to highlight obstacles and know when to cancel an iteration
We were able to improve on the next iteration, but it was still hard
Ranges help reinforce obstacles Obstacle removed
Why 2/3? Because it is both simple and pessimistic PERT does a similar thing: Expected = [BestCase + (4*MostLikely) + WorstCase] / 6 Source on PERT:  Software Estimation , Steve McConnell, p109
Using ranges to better communicate
Using range estimation to communicate risk Size of your range communicates the risk of your task May encourage you to break up tasks, or better define them. Scrum is all about better communication with the customer – so are ranges
How long? Um… 2 days 4 days Do you know your fudge factor? You Your Boss Big Boss
How long? 2-4 days 2-4 days Ranges help you control your fudge factor You Your Boss Big Boss
Another example:  Use ranges to better empower your boss or client You Your Boss Big Boss
Perfect – Do it! How long? How much for X? GRRR Umm….. You Your Boss Big Boss 2 days Actually … 4 days 4 days later… 2 days * rate Budget Left:  2 days
Instead…. You Your Boss Big Boss
No thx, do something easier How long? How much for X? YES! You Your Boss Big Boss 2-4 days Done! 2 days later… 2-4 days * rate Budget Left:  2 days
Potential pitfalls of range estimation
Potential pitfalls of range estimation Really Wide Ranges Not everything can take  2 – 200 hours or you lose all credibility
Potential pitfalls of range estimation Bosses who don’t get it You’re going to have to sell them on how your estimates will improve their decision  making ability.
Potential pitfalls of range estimation Pushed back deadlines Ranges are not an excuse to always miss deadlines.  But they do make it less of a surprise, and encourage you to be more cautious.
Potential pitfalls of range estimation Is 2/3 the new single-point? Be careful not to just start treating the 2/3 calculated estimate, use the ranges.
Further Reading
Questions? Arin Sime 434 996 5226 [email_address] Twitter.com/ArinSime

More Related Content

What's hot (20)

Estimating and planning Agile projects
Estimating and planning Agile projectsEstimating and planning Agile projects
Estimating and planning Agile projects
Murray Robinson
 
Estimation techniques for Scrum Teams
Estimation techniques for Scrum TeamsEstimation techniques for Scrum Teams
Estimation techniques for Scrum Teams
Jesus Mendez
 
Agile estimates - Insights about the basic
Agile estimates -  Insights about the basicAgile estimates -  Insights about the basic
Agile estimates - Insights about the basic
Diogo S. Del Gaudio
 
Agile estimating user stories
Agile estimating user storiesAgile estimating user stories
Agile estimating user stories
fungfung Chen
 
An introduction to agile estimation and release planning
An introduction to agile estimation and release planningAn introduction to agile estimation and release planning
An introduction to agile estimation and release planning
James Whitehead
 
Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015
Juliano Ribeiro
 
Agile Estimation
Agile EstimationAgile Estimation
Agile Estimation
Saltmarch Media
 
Agile Scrum Estimation
Agile   Scrum EstimationAgile   Scrum Estimation
Agile Scrum Estimation
Prasad Prabhakaran
 
Software management...for people who just want to get stuff done
Software management...for people who just want to get stuff doneSoftware management...for people who just want to get stuff done
Software management...for people who just want to get stuff done
Ciff McCollum
 
AgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation WorkshopAgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation Workshop
Stephen Vance
 
Introduction to Agile Estimation & Planning
Introduction to Agile Estimation & PlanningIntroduction to Agile Estimation & Planning
Introduction to Agile Estimation & Planning
Amaad Qureshi
 
Agile 2010 Estimation Games
Agile 2010 Estimation  GamesAgile 2010 Estimation  Games
Agile 2010 Estimation Games
AgileCoach.net
 
Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.
Mikalai Alimenkou
 
Agile stories, estimating and planning
Agile stories, estimating and planningAgile stories, estimating and planning
Agile stories, estimating and planning
Dimitri Ponomareff
 
Agile Projects | Rapid Estimation | Techniques | Tips
Agile Projects | Rapid Estimation | Techniques | TipsAgile Projects | Rapid Estimation | Techniques | Tips
Agile Projects | Rapid Estimation | Techniques | Tips
cPrime | Project Management | Agile | Consulting | Staffing | Training
 
How to estimate in scrum
How to estimate in scrumHow to estimate in scrum
How to estimate in scrum
Gloria Stoilova
 
Estimation and Release Planning in Scrum
Estimation and Release Planning in ScrumEstimation and Release Planning in Scrum
Estimation and Release Planning in Scrum
Leapfrog Technology Inc.
 
Agile estimation and planning
Agile estimation and planning Agile estimation and planning
Agile estimation and planning
Elad Sofer
 
Agile Estimating
Agile EstimatingAgile Estimating
Agile Estimating
Robert Dempsey
 
Planning Poker estimating technique
Planning Poker estimating techniquePlanning Poker estimating technique
Planning Poker estimating technique
Suhail Jamaldeen
 
Estimating and planning Agile projects
Estimating and planning Agile projectsEstimating and planning Agile projects
Estimating and planning Agile projects
Murray Robinson
 
Estimation techniques for Scrum Teams
Estimation techniques for Scrum TeamsEstimation techniques for Scrum Teams
Estimation techniques for Scrum Teams
Jesus Mendez
 
Agile estimates - Insights about the basic
Agile estimates -  Insights about the basicAgile estimates -  Insights about the basic
Agile estimates - Insights about the basic
Diogo S. Del Gaudio
 
Agile estimating user stories
Agile estimating user storiesAgile estimating user stories
Agile estimating user stories
fungfung Chen
 
An introduction to agile estimation and release planning
An introduction to agile estimation and release planningAn introduction to agile estimation and release planning
An introduction to agile estimation and release planning
James Whitehead
 
Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015Is it a crime to estimate - #RSGECU2015
Is it a crime to estimate - #RSGECU2015
Juliano Ribeiro
 
Software management...for people who just want to get stuff done
Software management...for people who just want to get stuff doneSoftware management...for people who just want to get stuff done
Software management...for people who just want to get stuff done
Ciff McCollum
 
AgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation WorkshopAgileChina 2015: Agile Estimation Workshop
AgileChina 2015: Agile Estimation Workshop
Stephen Vance
 
Introduction to Agile Estimation & Planning
Introduction to Agile Estimation & PlanningIntroduction to Agile Estimation & Planning
Introduction to Agile Estimation & Planning
Amaad Qureshi
 
Agile 2010 Estimation Games
Agile 2010 Estimation  GamesAgile 2010 Estimation  Games
Agile 2010 Estimation Games
AgileCoach.net
 
Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.Rise and fall of Story Points. Capacity based planning from the trenches.
Rise and fall of Story Points. Capacity based planning from the trenches.
Mikalai Alimenkou
 
Agile stories, estimating and planning
Agile stories, estimating and planningAgile stories, estimating and planning
Agile stories, estimating and planning
Dimitri Ponomareff
 
How to estimate in scrum
How to estimate in scrumHow to estimate in scrum
How to estimate in scrum
Gloria Stoilova
 
Agile estimation and planning
Agile estimation and planning Agile estimation and planning
Agile estimation and planning
Elad Sofer
 
Planning Poker estimating technique
Planning Poker estimating techniquePlanning Poker estimating technique
Planning Poker estimating technique
Suhail Jamaldeen
 

Similar to Range estimation in Scrum (20)

Software estimation is crap
Software estimation is crapSoftware estimation is crap
Software estimation is crap
Ian Garrison
 
Effort estimation for software development
Effort estimation for software developmentEffort estimation for software development
Effort estimation for software development
Spyros Ktenas
 
Want better estimation ?
Want better estimation ?Want better estimation ?
Want better estimation ?
Alexandre Cuva
 
Estimations: hit the target. Tips & Technics
Estimations: hit the target. Tips & TechnicsEstimations: hit the target. Tips & Technics
Estimations: hit the target. Tips & Technics
Alex Tymokhovsky
 
What are the odds of making that number risk analysis with crystal ball - O...
What are the odds of making that number   risk analysis with crystal ball - O...What are the odds of making that number   risk analysis with crystal ball - O...
What are the odds of making that number risk analysis with crystal ball - O...
p6academy
 
Risk And Relevance 20080414ppt
Risk And Relevance 20080414pptRisk And Relevance 20080414ppt
Risk And Relevance 20080414ppt
gregoryg
 
Risk And Relevance 20080414ppt
Risk And Relevance 20080414pptRisk And Relevance 20080414ppt
Risk And Relevance 20080414ppt
gregoryg
 
GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...
GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...
GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...
James Anderson
 
Lecture3 Modelling Decision Processes
Lecture3 Modelling Decision ProcessesLecture3 Modelling Decision Processes
Lecture3 Modelling Decision Processes
Kodok Ngorex
 
Software Test Estimation
Software Test EstimationSoftware Test Estimation
Software Test Estimation
Jatin Kochhar
 
Predictability at Axial
Predictability at AxialPredictability at Axial
Predictability at Axial
Matt Story
 
Chapter 6 Decision Making The Essence Of The Managers Job Ppt06
Chapter 6 Decision Making The Essence Of The Managers Job Ppt06Chapter 6 Decision Making The Essence Of The Managers Job Ppt06
Chapter 6 Decision Making The Essence Of The Managers Job Ppt06
D
 
Agile Estimating and Planning
Agile Estimating and PlanningAgile Estimating and Planning
Agile Estimating and Planning
Derek Neighbors
 
Introduction to scrum
Introduction to scrumIntroduction to scrum
Introduction to scrum
Mojammel Haque
 
Stephen cresswell risk are we missing a trick - 25th june
Stephen cresswell   risk are we missing a trick - 25th juneStephen cresswell   risk are we missing a trick - 25th june
Stephen cresswell risk are we missing a trick - 25th june
Association for Project Management
 
Comp-1807-week5-abcbahsbchsa12345@ba.pdf
Comp-1807-week5-abcbahsbchsa12345@ba.pdfComp-1807-week5-abcbahsbchsa12345@ba.pdf
Comp-1807-week5-abcbahsbchsa12345@ba.pdf
GoogleAnh
 
Selling lean development
Selling lean developmentSelling lean development
Selling lean development
wozmir
 
Room to Breathe: The BA's role in project estimation
Room to Breathe: The BA's role in project estimationRoom to Breathe: The BA's role in project estimation
Room to Breathe: The BA's role in project estimation
ufunctional
 
اهم برزنتيشن لجنك2222
اهم برزنتيشن لجنك2222اهم برزنتيشن لجنك2222
اهم برزنتيشن لجنك2222
nashaat algrara
 
Effective prob. solving technique
Effective prob. solving techniqueEffective prob. solving technique
Effective prob. solving technique
Mohd Shahjahan
 
Software estimation is crap
Software estimation is crapSoftware estimation is crap
Software estimation is crap
Ian Garrison
 
Effort estimation for software development
Effort estimation for software developmentEffort estimation for software development
Effort estimation for software development
Spyros Ktenas
 
Want better estimation ?
Want better estimation ?Want better estimation ?
Want better estimation ?
Alexandre Cuva
 
Estimations: hit the target. Tips & Technics
Estimations: hit the target. Tips & TechnicsEstimations: hit the target. Tips & Technics
Estimations: hit the target. Tips & Technics
Alex Tymokhovsky
 
What are the odds of making that number risk analysis with crystal ball - O...
What are the odds of making that number   risk analysis with crystal ball - O...What are the odds of making that number   risk analysis with crystal ball - O...
What are the odds of making that number risk analysis with crystal ball - O...
p6academy
 
Risk And Relevance 20080414ppt
Risk And Relevance 20080414pptRisk And Relevance 20080414ppt
Risk And Relevance 20080414ppt
gregoryg
 
Risk And Relevance 20080414ppt
Risk And Relevance 20080414pptRisk And Relevance 20080414ppt
Risk And Relevance 20080414ppt
gregoryg
 
GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...
GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...
GDG Cloud Southlake #5 Eric Harvieux: Site Reliability Engineering (SRE) in P...
James Anderson
 
Lecture3 Modelling Decision Processes
Lecture3 Modelling Decision ProcessesLecture3 Modelling Decision Processes
Lecture3 Modelling Decision Processes
Kodok Ngorex
 
Software Test Estimation
Software Test EstimationSoftware Test Estimation
Software Test Estimation
Jatin Kochhar
 
Predictability at Axial
Predictability at AxialPredictability at Axial
Predictability at Axial
Matt Story
 
Chapter 6 Decision Making The Essence Of The Managers Job Ppt06
Chapter 6 Decision Making The Essence Of The Managers Job Ppt06Chapter 6 Decision Making The Essence Of The Managers Job Ppt06
Chapter 6 Decision Making The Essence Of The Managers Job Ppt06
D
 
Agile Estimating and Planning
Agile Estimating and PlanningAgile Estimating and Planning
Agile Estimating and Planning
Derek Neighbors
 
Comp-1807-week5-abcbahsbchsa12345@ba.pdf
Comp-1807-week5-abcbahsbchsa12345@ba.pdfComp-1807-week5-abcbahsbchsa12345@ba.pdf
Comp-1807-week5-abcbahsbchsa12345@ba.pdf
GoogleAnh
 
Selling lean development
Selling lean developmentSelling lean development
Selling lean development
wozmir
 
Room to Breathe: The BA's role in project estimation
Room to Breathe: The BA's role in project estimationRoom to Breathe: The BA's role in project estimation
Room to Breathe: The BA's role in project estimation
ufunctional
 
اهم برزنتيشن لجنك2222
اهم برزنتيشن لجنك2222اهم برزنتيشن لجنك2222
اهم برزنتيشن لجنك2222
nashaat algrara
 
Effective prob. solving technique
Effective prob. solving techniqueEffective prob. solving technique
Effective prob. solving technique
Mohd Shahjahan
 

More from OpenSource Connections (20)

Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024
Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
OpenSource Connections
 
Encores
EncoresEncores
Encores
OpenSource Connections
 
Test driven relevancy
Test driven relevancyTest driven relevancy
Test driven relevancy
OpenSource Connections
 
How To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessHow To Structure Your Search Team for Success
How To Structure Your Search Team for Success
OpenSource Connections
 
The right path to making search relevant - Taxonomy Bootcamp London 2019
The right path to making search relevant  - Taxonomy Bootcamp London 2019The right path to making search relevant  - Taxonomy Bootcamp London 2019
The right path to making search relevant - Taxonomy Bootcamp London 2019
OpenSource Connections
 
Payloads and OCR with Solr
Payloads and OCR with SolrPayloads and OCR with Solr
Payloads and OCR with Solr
OpenSource Connections
 
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullHaystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
OpenSource Connections
 
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonHaystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
OpenSource Connections
 
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
OpenSource Connections
 
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajHaystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
OpenSource Connections
 
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
OpenSource Connections
 
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlHaystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
OpenSource Connections
 
Haystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesHaystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon Hughes
OpenSource Connections
 
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerHaystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
OpenSource Connections
 
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
OpenSource Connections
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
OpenSource Connections
 
Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...
OpenSource Connections
 
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
OpenSource Connections
 
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
OpenSource Connections
 
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
OpenSource Connections
 
Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024Why User Behavior Insights?  KMWorld Enterprise Search & Discovery  2024
Why User Behavior Insights? KMWorld Enterprise Search & Discovery 2024
OpenSource Connections
 
How To Structure Your Search Team for Success
How To Structure Your Search Team for SuccessHow To Structure Your Search Team for Success
How To Structure Your Search Team for Success
OpenSource Connections
 
The right path to making search relevant - Taxonomy Bootcamp London 2019
The right path to making search relevant  - Taxonomy Bootcamp London 2019The right path to making search relevant  - Taxonomy Bootcamp London 2019
The right path to making search relevant - Taxonomy Bootcamp London 2019
OpenSource Connections
 
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie HullHaystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
Haystack 2019 Lightning Talk - The Future of Quepid - Charlie Hull
OpenSource Connections
 
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim AllisonHaystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
Haystack 2019 Lightning Talk - State of Apache Tika - Tim Allison
OpenSource Connections
 
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
Haystack 2019 Lightning Talk - Relevance on 17 million full text documents - ...
OpenSource Connections
 
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj BharadwajHaystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
Haystack 2019 Lightning Talk - Solr Cloud on Kubernetes - Manoj Bharadwaj
OpenSource Connections
 
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
Haystack 2019 Lightning Talk - Quaerite a Search relevance evaluation toolkit...
OpenSource Connections
 
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan KohlHaystack 2019 - Search-based recommendations at Politico - Ryan Kohl
Haystack 2019 - Search-based recommendations at Politico - Ryan Kohl
OpenSource Connections
 
Haystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon HughesHaystack 2019 - Search with Vectors - Simon Hughes
Haystack 2019 - Search with Vectors - Simon Hughes
OpenSource Connections
 
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey GraingerHaystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
Haystack 2019 - Natural Language Search with Knowledge Graphs - Trey Grainger
OpenSource Connections
 
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
Haystack 2019 - Search Logs + Machine Learning = Auto-Tagging Inventory - Joh...
OpenSource Connections
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
OpenSource Connections
 
Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...Haystack 2019 - Architectural considerations on search relevancy in the conte...
Haystack 2019 - Architectural considerations on search relevancy in the conte...
OpenSource Connections
 
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
Haystack 2019 - Custom Solr Query Parser Design Option, and Pros & Cons - Ber...
OpenSource Connections
 
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...Haystack 2019 - Establishing a relevance focused culture in a large organizat...
Haystack 2019 - Establishing a relevance focused culture in a large organizat...
OpenSource Connections
 
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
Haystack 2019 - Solving for Satisfaction: Introduction to Click Models - Eliz...
OpenSource Connections
 

Recently uploaded (20)

Graphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAIGraphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAI
Neo4j
 
Presentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdfPresentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdf
Mukesh Kala
 
Making GenAI Work: A structured approach to implementation
Making GenAI Work: A structured approach to implementationMaking GenAI Work: A structured approach to implementation
Making GenAI Work: A structured approach to implementation
Jeffrey Funk
 
STARLINK-JIO-AIRTEL Security issues to Ponder
STARLINK-JIO-AIRTEL Security issues to PonderSTARLINK-JIO-AIRTEL Security issues to Ponder
STARLINK-JIO-AIRTEL Security issues to Ponder
anupriti
 
Testing Tools for Accessibility Enhancement Part II.pptx
Testing Tools for Accessibility Enhancement Part II.pptxTesting Tools for Accessibility Enhancement Part II.pptx
Testing Tools for Accessibility Enhancement Part II.pptx
Julia Undeutsch
 
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
ScyllaDB
 
UiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio Web
UiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio WebUiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio Web
UiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio Web
DianaGray10
 
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptxRBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
quinlan4
 
Building High-Impact Teams Beyond the Product Triad.pdf
Building High-Impact Teams Beyond the Product Triad.pdfBuilding High-Impact Teams Beyond the Product Triad.pdf
Building High-Impact Teams Beyond the Product Triad.pdf
Rafael Burity
 
Digital Nepal Framework 2.0: A Step Towards a Digitally Empowered Nepal
Digital Nepal Framework 2.0: A Step Towards a Digitally Empowered NepalDigital Nepal Framework 2.0: A Step Towards a Digitally Empowered Nepal
Digital Nepal Framework 2.0: A Step Towards a Digitally Empowered Nepal
ICT Frame Magazine Pvt. Ltd.
 
techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...
techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...
techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...
Usman siddiqui
 
Dev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPathDev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPath
UiPathCommunity
 
When Platform Engineers meet SREs - The Birth of O11y-as-a-Service Superpowers
When Platform Engineers meet SREs - The Birth of O11y-as-a-Service SuperpowersWhen Platform Engineers meet SREs - The Birth of O11y-as-a-Service Superpowers
When Platform Engineers meet SREs - The Birth of O11y-as-a-Service Superpowers
Eric D. Schabell
 
Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]
Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]
Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]
jackalen173
 
UiPath NY AI Series: Session 3: UiPath Autopilot for Everyone with Clipboard AI
UiPath NY AI Series: Session 3:  UiPath Autopilot for Everyone with Clipboard AIUiPath NY AI Series: Session 3:  UiPath Autopilot for Everyone with Clipboard AI
UiPath NY AI Series: Session 3: UiPath Autopilot for Everyone with Clipboard AI
DianaGray10
 
How to manage technology risk and corporate growth
How to manage technology risk and corporate growthHow to manage technology risk and corporate growth
How to manage technology risk and corporate growth
Arlen Meyers, MD, MBA
 
Mastering NIST CSF 2.0 - The New Govern Function.pdf
Mastering NIST CSF 2.0 - The New Govern Function.pdfMastering NIST CSF 2.0 - The New Govern Function.pdf
Mastering NIST CSF 2.0 - The New Govern Function.pdf
Bachir Benyammi
 
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No KubernetesJava on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
VictorSzoltysek
 
UiPath Agentic automation with Autopilot for everyone + new features/releases
UiPath Agentic  automation with Autopilot for everyone + new features/releasesUiPath Agentic  automation with Autopilot for everyone + new features/releases
UiPath Agentic automation with Autopilot for everyone + new features/releases
DianaGray10
 
Windows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptxWindows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptx
Oddvar Moe
 
Graphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAIGraphs & GraphRAG - Essential Ingredients for GenAI
Graphs & GraphRAG - Essential Ingredients for GenAI
Neo4j
 
Presentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdfPresentation Session 2 -Context Grounding.pdf
Presentation Session 2 -Context Grounding.pdf
Mukesh Kala
 
Making GenAI Work: A structured approach to implementation
Making GenAI Work: A structured approach to implementationMaking GenAI Work: A structured approach to implementation
Making GenAI Work: A structured approach to implementation
Jeffrey Funk
 
STARLINK-JIO-AIRTEL Security issues to Ponder
STARLINK-JIO-AIRTEL Security issues to PonderSTARLINK-JIO-AIRTEL Security issues to Ponder
STARLINK-JIO-AIRTEL Security issues to Ponder
anupriti
 
Testing Tools for Accessibility Enhancement Part II.pptx
Testing Tools for Accessibility Enhancement Part II.pptxTesting Tools for Accessibility Enhancement Part II.pptx
Testing Tools for Accessibility Enhancement Part II.pptx
Julia Undeutsch
 
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
ScyllaDB
 
UiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio Web
UiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio WebUiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio Web
UiPath NY AI Series: Session 4: UiPath AutoPilot for Developers using Studio Web
DianaGray10
 
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptxRBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
RBM - PIXIAGE - AskPixi Page - Inpixon-MWC 2025.pptx
quinlan4
 
Building High-Impact Teams Beyond the Product Triad.pdf
Building High-Impact Teams Beyond the Product Triad.pdfBuilding High-Impact Teams Beyond the Product Triad.pdf
Building High-Impact Teams Beyond the Product Triad.pdf
Rafael Burity
 
Digital Nepal Framework 2.0: A Step Towards a Digitally Empowered Nepal
Digital Nepal Framework 2.0: A Step Towards a Digitally Empowered NepalDigital Nepal Framework 2.0: A Step Towards a Digitally Empowered Nepal
Digital Nepal Framework 2.0: A Step Towards a Digitally Empowered Nepal
ICT Frame Magazine Pvt. Ltd.
 
techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...
techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...
techfuturism.com-Autonomous Underwater Vehicles Navigating the Future of Ocea...
Usman siddiqui
 
Dev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPathDev Dives: Unleash the power of macOS Automation with UiPath
Dev Dives: Unleash the power of macOS Automation with UiPath
UiPathCommunity
 
When Platform Engineers meet SREs - The Birth of O11y-as-a-Service Superpowers
When Platform Engineers meet SREs - The Birth of O11y-as-a-Service SuperpowersWhen Platform Engineers meet SREs - The Birth of O11y-as-a-Service Superpowers
When Platform Engineers meet SREs - The Birth of O11y-as-a-Service Superpowers
Eric D. Schabell
 
Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]
Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]
Fast Screen Recorder v2.1.0.11 Crack Updated [April-2025]
jackalen173
 
UiPath NY AI Series: Session 3: UiPath Autopilot for Everyone with Clipboard AI
UiPath NY AI Series: Session 3:  UiPath Autopilot for Everyone with Clipboard AIUiPath NY AI Series: Session 3:  UiPath Autopilot for Everyone with Clipboard AI
UiPath NY AI Series: Session 3: UiPath Autopilot for Everyone with Clipboard AI
DianaGray10
 
How to manage technology risk and corporate growth
How to manage technology risk and corporate growthHow to manage technology risk and corporate growth
How to manage technology risk and corporate growth
Arlen Meyers, MD, MBA
 
Mastering NIST CSF 2.0 - The New Govern Function.pdf
Mastering NIST CSF 2.0 - The New Govern Function.pdfMastering NIST CSF 2.0 - The New Govern Function.pdf
Mastering NIST CSF 2.0 - The New Govern Function.pdf
Bachir Benyammi
 
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No KubernetesJava on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
Java on AWS Without the Headaches - Fast Builds, Cheap Deploys, No Kubernetes
VictorSzoltysek
 
UiPath Agentic automation with Autopilot for everyone + new features/releases
UiPath Agentic  automation with Autopilot for everyone + new features/releasesUiPath Agentic  automation with Autopilot for everyone + new features/releases
UiPath Agentic automation with Autopilot for everyone + new features/releases
DianaGray10
 
Windows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptxWindows Client Privilege Escalation-Shared.pptx
Windows Client Privilege Escalation-Shared.pptx
Oddvar Moe
 

Range estimation in Scrum

  • 1. Building a more accurate burndown Using Range Estimation in Scrum Agile 2010 Conference August 2010 Arin Sime 434 996 5226 [email_address]
  • 2. Pitfalls of traditional estimation techniques
  • 3. How long does it take you to get to work? traffic optimistic every day? method of travel
  • 5. A little about me… Senior Consultant, OpenSource Connections in Charlottesville, Virginia Masters in Management of I.T., University of Virginia, McIntire School of Commerce We tweaked our Scrum process to incorporate Range Estimation based on my studies at Uva Please take the Estimation Survey: http://www.surveymonkey.com/s/SWNNYQJ
  • 6. The root of all estimation evil: Single point estimates Chart taken from: Software Estimation , Steve McConnell, Figure 1-1, p6 “ A single-point estimate is usually a target masquerading as an estimate.” -Steve McConnell
  • 7. A realistic estimate distribution Chart taken from: Software Estimation , Steve McConnell, Figure 1-3, p8 “ There is a limit to how well a project can go but no limit to how many problems can occur.” -Steve McConnell Nominal Outcome (50/50 estimate)
  • 8. Reasons we are wrong so often Different information Different methods Psychological Biases The Expert Problem
  • 9. Bias in Estimation Imagine this scenario: “ Can you build me that CMS website in 2 weeks?” How would you respond? What estimate would you give?
  • 10. Bias in Estimation By supplying my own estimate (or desire) in my question, I have anchored your response. This is called “The anchoring or framing trap” “ Because anchors can establish the terms on which a decision will be made, they are often used as a bargaining tactic by savvy negotiators.” From “The Hidden Traps in Decision Making” from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
  • 11. You’re not as good as you think “ The Expert Problem” Experts consistently underestimate their margins of error, and discount the reasons they were wrong in the past. Excuses for past mistakes: You were playing a different game Invoke the outlier “ Almost right” defense The Black Swan: The impact of the Highly Improbable , by Nassim Nicholas Taleb, 2007, Chapter 10: The Scandal of Prediction
  • 12. The best protection “ The best protection against all psychological traps – in isolation or in combination – is awareness.” From “The Hidden Traps in Decision Making” from Harvard Business Review, 1998, John Hammond, Ralph L. Keeney, and Howard Raiffa
  • 14. How agile already avoids pitfalls Encourages team airing of estimates Done before assignment of tasks Scrum poker
  • 15. How agile already avoids pitfalls Separates story from time units, more relative Story Points & Velocity Image from: http://leadinganswers.typepad.com/leading_answers/2007/09/agile-exception.html
  • 16. Agile and Scrum can run into other pitfalls though…
  • 17. Potential pitfalls: Single-point estimates What about Risk? Implies a set delivery of features Story points are hard to explain
  • 18. Better accuracy using range estimation
  • 19. The Cone of Uncertainty http://www.construx.com/Page.aspx?hid=1648
  • 20. Range estimation … Recognizes uncertainty Alleviates our tendency towards optimism Incorporates risk Allows for better financial projections Better informs our bosses and clients
  • 22. Incorporating range estimation into Scrum Team originally estimated 108 hours Range estimate went from 114-245 hours. Note the single point was a low estimate! They were able to finish original tasks a little early
  • 23. Range estimation in Scrum Poker It’s very simple – just hold two cards instead of one! The same rules apply about creating discussion between low and high estimators, but you might resolve them differently...
  • 24. On the high end Range estimation in Scrum Poker On the low end On the high end The likely discussion: Hey Orange, why do you say “2”? Yellow and Blue both say “5”. Likely Outcome: 3 or 5 Middle of the road
  • 25. Range estimation in Scrum Poker Still middle of the road, but Green recognizes some risk Orange sees this as really easy Blue sees this as more complicated The likely discussion: Orange and Blue need to compare their visions for this task. Likely Outcome: 8-13? Red and Blue no longer agree: Red is confused or sees big risks
  • 26. Using ranges in your task list
  • 27. Using ranges in your task list Enter Low/High =(Lo*0.33)+(Hi*0.67) Sums of Lo, Hi, 2/3; then trend them to zero update daily
  • 28. Using ranges in your burndown
  • 29. Ranges help to highlight obstacles and know when to cancel an iteration
  • 30. We were able to improve on the next iteration, but it was still hard
  • 31. Ranges help reinforce obstacles Obstacle removed
  • 32. Why 2/3? Because it is both simple and pessimistic PERT does a similar thing: Expected = [BestCase + (4*MostLikely) + WorstCase] / 6 Source on PERT: Software Estimation , Steve McConnell, p109
  • 33. Using ranges to better communicate
  • 34. Using range estimation to communicate risk Size of your range communicates the risk of your task May encourage you to break up tasks, or better define them. Scrum is all about better communication with the customer – so are ranges
  • 35. How long? Um… 2 days 4 days Do you know your fudge factor? You Your Boss Big Boss
  • 36. How long? 2-4 days 2-4 days Ranges help you control your fudge factor You Your Boss Big Boss
  • 37. Another example: Use ranges to better empower your boss or client You Your Boss Big Boss
  • 38. Perfect – Do it! How long? How much for X? GRRR Umm….. You Your Boss Big Boss 2 days Actually … 4 days 4 days later… 2 days * rate Budget Left: 2 days
  • 39. Instead…. You Your Boss Big Boss
  • 40. No thx, do something easier How long? How much for X? YES! You Your Boss Big Boss 2-4 days Done! 2 days later… 2-4 days * rate Budget Left: 2 days
  • 41. Potential pitfalls of range estimation
  • 42. Potential pitfalls of range estimation Really Wide Ranges Not everything can take 2 – 200 hours or you lose all credibility
  • 43. Potential pitfalls of range estimation Bosses who don’t get it You’re going to have to sell them on how your estimates will improve their decision making ability.
  • 44. Potential pitfalls of range estimation Pushed back deadlines Ranges are not an excuse to always miss deadlines. But they do make it less of a surprise, and encourage you to be more cautious.
  • 45. Potential pitfalls of range estimation Is 2/3 the new single-point? Be careful not to just start treating the 2/3 calculated estimate, use the ranges.
  • 47. Questions? Arin Sime 434 996 5226 [email_address] Twitter.com/ArinSime

Editor's Notes

  • #4: how long does it take you to drive to work? Is that everyday? Traffic? Optimistic?
  • #23: Show single point then double point
  • #26: Yellow doesn’t know what they’re talking about.