#DataDrivenDevOps ”Without data you are just another person with an opinion” W. Edwards Deming @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Cobbler’s children have no shoes

Software I know really well Software I like @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

“ Every software is 80% ready 80% of the time Every developer, ever @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

It’s fine @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

How departments measure Support Marketing Sales HR Finance @jbaruch #DataDrivenDevOps Engineering Anecdotes from daily standup #DevOpsDays http://jfrog.com/shownotes

@jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

@jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

shownotes http://jfrog.com/shownotes Slides Video Links Comments, Ratings Raffle @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Engineering metrics in pre-devops era Ops Dev • Velocity • Architecture • Compliance @jbaruch • SLA • Cost env setup • Average customer cost • Tools stability #DataDrivenDevOps #DevOpsDays • • • • • QA Incidents Defects MTTR Code coverage Test suite stability http://jfrog.com/shownotes

How do metrics collaborate? influenced affected dev ops qa dev ops qa • Time to build • False reopen count • Release pipelines • QA coverage stability • Artifact replication topology • Avg cost of customer • Smoke tests quality Test suite stability • Time to create new Incoming defect QA lab velocity @jbaruch • #DataDrivenDevOps Test execution time#DevOpsDays http://jfrog.com/shownotes • •

Meet scrum team “avengers”

anecdotes from the daily scrum stand-ups “ We never get enough testing environments from Ops, QA is suffering. Scrum team “Avengers” @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Let’s gather some data! Environment Utilization 10 8 6 4 2 0 week 1 week 2 week 3 week 4 week 5 week 6 week 7 Utilized @jbaruch #DataDrivenDevOps week 8 week 9 week 10 week 11 week 12 week 13 week 14 Available #DevOpsDays http://jfrog.com/shownotes

That doesn’t look good! But why? Days the environment stays checked out 25 25 20 18 15 13 13 John Scott 14 15 16 10 10 6 5 1 2 7 3 0 Raj Jane Christina Helen Lee Baruch Nataly Ruppert Josh Patrick Michael Days checked out @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Environment Utilization 16 14 12 Continuous improvement 10 8 6 4 2 0 week 1 week 3 week 5 week 7 week 9 week 11 week 13 week 15 week 17 week 19 week 21 week 23 Utilized @jbaruch #DataDrivenDevOps #DevOpsDays Available http://jfrog.com/shownotes

anecdotes from the daily scrum stand-ups “ Tests are failing, because the test suite is not stable, QA makes our builds fail without reason. Scrum team “Avengers” @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Let’s gather some data!

Return on investment @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

anecdotes from the daily scrum stand-ups “ Those developers want to deploy new GC, its tons of work, without any profit. Scrum team “Avengers” @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Let’s gather some data! @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

0:00 0:40 1:20 2:00 2:40 3:20 4:00 4:40 5:20 6:00 6:40 7:20 8:00 8:40 9:20 10:00 10:40 11:20 12:00 12:40 13:20 14:00 14:40 15:20 16:00 16:40 17:20 18:00 18:40 19:20 20:00 20:40 21:20 22:00 22:40 23:20 GC time Trust and predictability GC time @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Dos and Don’ts

Measuring the right thing

LoC LOL, anyone? @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Avoid data overload

Use reliable data

”medium” In brazil ”medium” In russia Common vocabulary is important

Metrics generate incentives, be aware! @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Tweak as you go

Elevate! Integrated Dashboards Product Specific Dashboards Raw Data @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

How departments measure Support Marketing Sales HR Finance @jbaruch #DataDrivenDevOps Engineering Anecdotes from daily standup #DevOpsDays http://jfrog.com/shownotes

Step into data-driven life Removes blame game Builds accountability and trust Creates common base for discussion Enables DevOps @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes

Q&A and twitter ads @jbaruch #DevOpsDays #DataDrivenDevOps http://jfrog.com/shownotes