#DataDrivenDevOps ”Without data you are just another person with an opinion” W. Edwards Deming @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 1
Slide 2
Cobbler’s children have no shoes
Slide 3
Software I know really well Software I like @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 4
“ Every software is 80% ready 80% of the time Every developer, ever @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 5
It’s fine @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 6
How departments measure Support Marketing Sales HR Finance @jbaruch #DataDrivenDevOps Engineering Anecdotes from daily standup #DevOpsDays http://jfrog.com/shownotes
Slide 7
@jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 8
@jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 9
Slide 10
shownotes http://jfrog.com/shownotes Slides Video Links Comments, Ratings Raffle @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 11
Engineering metrics in pre-devops era Ops Dev • Velocity • Architecture • Compliance @jbaruch • SLA • Cost env setup • Average customer cost • Tools stability #DataDrivenDevOps #DevOpsDays • • • • • QA Incidents Defects MTTR Code coverage Test suite stability http://jfrog.com/shownotes
Slide 12
How do metrics collaborate? influenced affected dev ops qa dev ops qa • Time to build • False reopen count • Release pipelines • QA coverage stability • Artifact replication topology • Avg cost of customer • Smoke tests quality Test suite stability • Time to create new Incoming defect QA lab velocity @jbaruch • #DataDrivenDevOps Test execution time#DevOpsDays http://jfrog.com/shownotes • •
Slide 13
Meet scrum team “avengers”
Slide 14
anecdotes from the daily scrum stand-ups “ We never get enough testing environments from Ops, QA is suffering. Scrum team “Avengers” @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 15
Let’s gather some data! Environment Utilization 10 8 6 4 2 0 week 1 week 2 week 3 week 4 week 5 week 6 week 7 Utilized @jbaruch #DataDrivenDevOps week 8 week 9 week 10 week 11 week 12 week 13 week 14 Available #DevOpsDays http://jfrog.com/shownotes
Slide 16
That doesn’t look good! But why? Days the environment stays checked out 25 25 20 18 15 13 13 John Scott 14 15 16 10 10 6 5 1 2 7 3 0 Raj Jane Christina Helen Lee Baruch Nataly Ruppert Josh Patrick Michael Days checked out @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 17
Environment Utilization 16 14 12 Continuous improvement 10 8 6 4 2 0 week 1 week 3 week 5 week 7 week 9 week 11 week 13 week 15 week 17 week 19 week 21 week 23 Utilized @jbaruch #DataDrivenDevOps #DevOpsDays Available http://jfrog.com/shownotes
Slide 18
anecdotes from the daily scrum stand-ups “ Tests are failing, because the test suite is not stable, QA makes our builds fail without reason. Scrum team “Avengers” @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 19
Let’s gather some data!
Slide 20
Return on investment @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 21
anecdotes from the daily scrum stand-ups “ Those developers want to deploy new GC, its tons of work, without any profit. Scrum team “Avengers” @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 22
Let’s gather some data! @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 23
0:00 0:40 1:20 2:00 2:40 3:20 4:00 4:40 5:20 6:00 6:40 7:20 8:00 8:40 9:20 10:00 10:40 11:20 12:00 12:40 13:20 14:00 14:40 15:20 16:00 16:40 17:20 18:00 18:40 19:20 20:00 20:40 21:20 22:00 22:40 23:20 GC time Trust and predictability GC time @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 24
Dos and Don’ts
Slide 25
Measuring the right thing
Slide 26
LoC LOL, anyone? @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 27
Avoid data overload
Slide 28
Use reliable data
Slide 29
”medium” In brazil ”medium” In russia Common vocabulary is important
Slide 30
Metrics generate incentives, be aware! @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 31
Tweak as you go
Slide 32
Elevate! Integrated Dashboards Product Specific Dashboards Raw Data @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 33
How departments measure Support Marketing Sales HR Finance @jbaruch #DataDrivenDevOps Engineering Anecdotes from daily standup #DevOpsDays http://jfrog.com/shownotes
Slide 34
Step into data-driven life Removes blame game Builds accountability and trust Creates common base for discussion Enables DevOps @jbaruch #DataDrivenDevOps #DevOpsDays http://jfrog.com/shownotes
Slide 35
Q&A and twitter ads @jbaruch #DevOpsDays #DataDrivenDevOps http://jfrog.com/shownotes
