A Research Study into DevOps Bottlenecks
A presentation at DevOps Summit Amsterdam 2019 in in Amsterdam, Netherlands by Baruch Sadogursky
Research into DevOps bottlenecks
Why “research”? We interview people ￭ VP R&D @ JFrog ￭ CTO @ Bugsee ￭ CTO @ Top Israeli Finance Firm ￭ VP Engineering at CA Technologies ￭ CTO @ ScentBird ￭ Architect, a top Fortune-Rated Privately-Held Tech Firm ￭ Applications Engineering Manager at Fortune 500 SW Company ￭ Architect, US Army (Contractor) @jbaruch http://jfrog.com/shownotes #DOSAMS
What is DevOps? @jbaruch http://jfrog.com/shownotes #DOSAMS
This is devops* Ops Deep specialization Dev Common goals, tools, culture QA *Unless you’re Netflix **You’re not @jbaruch http://jfrog.com/shownotes #DOSAMS
Collaboration Ops Dev @jbaruch QA http://jfrog.com/shownotes #DOSAMS
Collaboration People Process @jbaruch Tools http://jfrog.com/shownotes #DOSAMS
🎩 @jbaruch #dockercon jfrog.com/shownotes @ErinMeyerINSEAD’s “Culture Map”
Shownotes ￭The slides ￭The video ￭All the links ￭Comments, ratings ￭Raffle! @jbaruch http://jfrog.com/shownotes #DOSAMS
What bottlenecks?
DevOps and Delivery Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DOSAMS
Release cycles 2 years 6 months 2 weeks 1 day 2 hours @jbaruch http://jfrog.com/shownotes #DOSAMS
@jbaruch http://jfrog.com/shownotes #DOSAMS
Are they happy with it? 0% Satisfied 20% Satisfied 50% Satisfied 80% Satisfied 100% Satisfied @jbaruch http://jfrog.com/shownotes #DOSAMS
@jbaruch http://jfrog.com/shownotes #DOSAMS
How do you know it’s good? @jbaruch http://jfrog.com/shownotes #DOSAMS
“ I don’t measure it because I’ve had no complaints @jbaruch http://jfrog.com/shownotes #DOSAMS
“ When the bug queue is empty, we are good @jbaruch http://jfrog.com/shownotes #DOSAMS
“ When I get fewer tickets on the process @jbaruch http://jfrog.com/shownotes #DOSAMS
“ Automation of every single piece @jbaruch http://jfrog.com/shownotes #DOSAMS
Other measures ￭ Version adoption ￭ Bug Burn-down diagram ￭ Productivity Gains “used to be 2 days, now its 2 minutes” ￭ Quality, No Regressions! ￭MTTR ￭ Business metrics @jbaruch http://jfrog.com/shownotes #DOSAMS
What’s the right release cycle? @jbaruch http://jfrog.com/shownotes #DOSAMS
@jbaruch #LiquidSoftware
Update available Yes No Do we trust the update? Yes How about no Let’s update! Yes Are there any high risks? No Do we want it? No
“ ￭Acceptance tests @jbaruch http://jfrog.com/shownotes #DOSAMS
“ ￭The dreadful updates @jbaruch http://jfrog.com/shownotes #DOSAMS
“ ￭Impossible dilemma: we need the update, but it will break things @jbaruch http://jfrog.com/shownotes #DOSAMS
Update available Yes No Can we verify the update? No Yes Yes How about no Do we trust the update? Time consuming verification Let’s update! Yes Are there any high risks? No Do we want it? No
Features that we want @jbaruch Acceptance tests costs http://jfrog.com/shownotes #DOSAMS
@jbaruch http://jfrog.com/shownotes #DOSAMS
This is not a new idea! ￭ XP: short feedback ￭ Scrum: reducing cycle time to absolute minimum ￭ TPS: Decide as late as possible and Deliver as fast as possible ￭ Kanban: Incremental change @jbaruch http://jfrog.com/shownotes #DOSAMS
Continuous updates ￭ Frequent ￭ Automatic ￭ Tested ￭ Canary ￭ State-aware ￭ Observability ￭ *Local Rollbacks @jbaruch http://jfrog.com/shownotes #DOSAMS
You don’t offload quality tests to customers The customers are always ready to update You just lost the last excuse for not releasing fast
Education @jbaruch Automation http://jfrog.com/shownotes Trust #DOSAMS
“ Pain is instructional @jbaruch http://jfrog.com/shownotes #DOSAMS
“ You need to know, You need to believe, You need to give a sh*t @jbaruch http://jfrog.com/shownotes #DOSAMS
Also, @jbaruch http://jfrog.com/shownotes #DOSAMS
“Activation Energy” @jbaruch http://jfrog.com/shownotes #DOSAMS
@jbaruch http://jfrog.com/shownotes #DOSAMS
RESIST FAKE NEWS @jbaruch http://jfrog.com/shownotes #DOSAMS
First push is hard “ Keep your eye on the prize For an older code base this could take more than a year to achieve, but its still worth it @jbaruch http://jfrog.com/shownotes #DOSAMS
Tools @jbaruch http://jfrog.com/shownotes #DOSAMS
Immutable Scriptable “ @jbaruch Universal http://jfrog.com/shownotes #DOSAMS
Guide, don’t dictate Aim for the 80% Tool Java JFrog Artifactory JFrog Xray Gradle Maven Ant Rating Invest Invest Research Invest Maintain Divest
Let’s talk about trust @jbaruch http://jfrog.com/shownotes #DOSAMS
Remember this? Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DOSAMS
Some commits should fail! Develop Test @jbaruch Build http://jfrog.com/shownotes #DOSAMS
“ Quality is the bottleneck Automatic testing is not enough The “big green button” concept is lack of trust in quality @jbaruch http://jfrog.com/shownotes #DOSAMS
“ Quality is the bottleneck Automatic testing is not enough, but we can use our customers as testers Canary releases @jbaruch http://jfrog.com/shownotes #DOSAMS
DevOps Ops Dev @jbaruch QA http://jfrog.com/shownotes #DOSAMS
DevOps People Process @jbaruch Tools http://jfrog.com/shownotes #DOSAMS
DevOps Automation Trust @jbaruch Education http://jfrog.com/shownotes #DOSAMS
QA & Twitter Ads ◇@jbaruch ◇#DOSAMS ◇https://jfrog.com/shownotes ◇https://liquidSoftware.com
We asked a Fortune 500 software delivery leaders what holds them back. This talk is their analysis of the bottlenecks they encountered in their DevOps journey. We share discoveries on what helped them to overcome the bottlenecks and how they plan to deliver even faster. Using this information, we define some unifying themes on what areas provide the greatest return on investments of time and resources.
