A Research Study into DevOps Bottlenecks
A presentation at DevNexus 2019 in in Atlanta, GA, USA by Baruch Sadogursky
Research into DevOps bottlenecks
Who am I Baruch Sadogursky Head of Developer Relations @jfrog @jbaruch @jbaruch http://jfrog.com/shownotes #DevNexus
Also, jfrog.com/shownotes
Why “research”? We interview people VP R&D @ JFrog CTO @ Bugsee CTO @ Top Israeli Finance Firm VP Engineering at CA Technologies CTO @ ScentBird Architect, a top Fortune-Rated Privately-Held Tech Firm Applications Engineering Manager at Fortune 500 SW Company Architect, US Army (Contractor) @jbaruch http://jfrog.com/shownotes #DevNexus
What is DevOps? @jbaruch http://jfrog.com/shownotes #DevNexus
Development Operations @jbaruch QA http://jfrog.com/shownotes #DevNexus
Devops! Development Operations @jbaruch QA http://jfrog.com/shownotes #DevNexus
Devops! Development Operations QA @jbaruch http://jfrog.com/shownotes #DevNexus
What bottlenecks?
DevOps and Delivery Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DevNexus
Release cycles 2 years 6 months 2 weeks 1 day 2 hours @jbaruch http://jfrog.com/shownotes #DevNexus
@jbaruch http://jfrog.com/shownotes #DevNexus
Are they happy with it? 0% Satisfied 20% Satisfied 50% Satisfied 80% Satisfied 100% Satisfied @jbaruch http://jfrog.com/shownotes #DevNexus
@jbaruch http://jfrog.com/shownotes #DevNexus
How do you know it’s good? @jbaruch http://jfrog.com/shownotes #DevNexus
“ I don’t measure it because I’ve had no complaints @jbaruch http://jfrog.com/shownotes #DevNexus
“ When the bug queue is empty we are good @jbaruch http://jfrog.com/shownotes #DevNexus
“ When I get fewer tickets on the process @jbaruch http://jfrog.com/shownotes #DevNexus
“ Automation of every single piece @jbaruch http://jfrog.com/shownotes #DevNexus
Other measures Version adoption Bug Burn-down diagram Productivity Gains “used to be 2 days, now its 2 minutes” Quality, No Regressions! MTTR Business metrics @jbaruch http://jfrog.com/shownotes #DevNexus
What’s the right release cycle? @jbaruch http://jfrog.com/shownotes #DevNexus
Why not to update @jbaruch http://jfrog.com/shownotes #DevNexus
“ Acceptance tests @jbaruch http://jfrog.com/shownotes #DevNexus
“ The dreadful updates @jbaruch http://jfrog.com/shownotes #DevNexus
“ Impossible dilemma: we need the update, but it will break things @jbaruch http://jfrog.com/shownotes #DevNexus
Update available Yes No Can we verify the update? No Yes Yes How about no Do we trust the update? Time consuming verification Let’s update! Yes Are there any high risks? No Do we want it? No
@jbaruch @jfrog #LiquidSoftware www.liquidsoftware.com
Update available Yes Do we want it? Are there any high risks? Sure, why not? (auto update) No Let’s update!
@jbaruch @jfrog #LiquidSoftware www.liquidsoftware.com
@jbaruch @jfrog #LiquidSoftware www.liquidsoftware.com
Update available Yes Do we trust the update? Yes Let’s update! Yes Do we want it? Are there any high risks? Sure, why not? (auto update) No
You don’t offload quality tests to customers The customers are always ready to update You just lost the last excuse for not releasing fast
But what about the quality?… @jbaruch http://jfrog.com/shownotes #DevNexus
No, not really.
No, not really.
No, not really.
No, not really.
Education @jbaruch Automation http://jfrog.com/shownotes Trust #DevNexus
“ Pain is instructional @jbaruch http://jfrog.com/shownotes #DevNexus
“ You need to know, You need to believe, You need to give a sh*t @jbaruch http://jfrog.com/shownotes #DevNexus
Also, @jbaruch http://jfrog.com/shownotes #DevNexus
“Activation Energy” @jbaruch http://jfrog.com/shownotes #DevNexus
@jbaruch http://jfrog.com/shownotes #DevNexus
RESIST FAKE NEWS @jbaruch http://jfrog.com/shownotes #DevNexus
First push is hard “ Keep your eye on the prize For an older code base this could take more than a year to achieve, but its still worth it @jbaruch http://jfrog.com/shownotes #DevNexus
Tools @jbaruch http://jfrog.com/shownotes #DevNexus
Immutable Scriptable “ @jbaruch Universal http://jfrog.com/shownotes #DevNexus
Guide, don’t dictate Aim for the 80% Tool Java JFrog Artifactory JFrog Xray Gradle Maven Ant Rating Invest Invest Research Invest Maintain Divest
Let’s talk about trust @jbaruch http://jfrog.com/shownotes #DevNexus
Remember this? Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DevNexus
Some commits should fail! Develop Test @jbaruch Build http://jfrog.com/shownotes #DevNexus
“ Quality is the bottleneck Automatic testing is not enough The “big green button” concept is lack of trust in quality @jbaruch http://jfrog.com/shownotes #DevNexus
“ Quality is the bottleneck Automatic testing is not enough, but we can use our customers as testers Canary releases @jbaruch http://jfrog.com/shownotes #DevNexus
Technology Process @jbaruch Devops! People http://jfrog.com/shownotes #DevNexus
Automation Trust @jbaruch Devops! Education http://jfrog.com/shownotes #DevNexus
Devops! Education TrustAutomation @jbaruch http://jfrog.com/shownotes #DevNexus
QA & Show notes ◇@jbaruch ◇#DevNexus ◇http://jfrog.com/shownotes Video Slides Links Feedback Raffle! (come early)
We asked a Fortune 500 software delivery leaders what holds them back. This talk is their analysis of the bottlenecks they encountered in their DevOps journey. We share discoveries on what helped them to overcome the bottlenecks and how they plan to deliver even faster. Using this information, we define some unifying themes on what areas provide the greatest return on investments of time and resources.
