Research into DevOps bottlenecks

Why “research”? We interview people ￭ VP R&D @ JFrog ￭ CTO @ Bugsee ￭ CTO @ Top Israeli Finance Firm ￭ VP Engineering at CA Technologies ￭ CTO @ ScentBird ￭ Architect, a top Fortune-Rated Privately-Held Tech Firm ￭ Applications Engineering Manager at Fortune 500 SW Company ￭ Architect, US Army (Contractor) @jbaruch http://jfrog.com/shownotes #DOSAMS

What is DevOps? @jbaruch http://jfrog.com/shownotes #DOSAMS

This is devops* Ops Deep specialization Dev Common goals, tools, culture QA *Unless you’re Netflix **You’re not @jbaruch http://jfrog.com/shownotes #DOSAMS

Collaboration Ops Dev @jbaruch QA http://jfrog.com/shownotes #DOSAMS

Collaboration People Process @jbaruch Tools http://jfrog.com/shownotes #DOSAMS

🎩 @jbaruch #dockercon jfrog.com/shownotes @ErinMeyerINSEAD’s “Culture Map”

Shownotes ￭The slides ￭The video ￭All the links ￭Comments, ratings ￭Raffle! @jbaruch http://jfrog.com/shownotes #DOSAMS

What bottlenecks?

DevOps and Delivery Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DOSAMS

Release cycles 2 years 6 months 2 weeks 1 day 2 hours @jbaruch http://jfrog.com/shownotes #DOSAMS

@jbaruch http://jfrog.com/shownotes #DOSAMS

Are they happy with it? 0% Satisfied 20% Satisfied 50% Satisfied 80% Satisfied 100% Satisfied @jbaruch http://jfrog.com/shownotes #DOSAMS

@jbaruch http://jfrog.com/shownotes #DOSAMS

How do you know it’s good? @jbaruch http://jfrog.com/shownotes #DOSAMS

“ I don’t measure it because I’ve had no complaints @jbaruch http://jfrog.com/shownotes #DOSAMS

“ When the bug queue is empty, we are good @jbaruch http://jfrog.com/shownotes #DOSAMS

“ When I get fewer tickets on the process @jbaruch http://jfrog.com/shownotes #DOSAMS

“ Automation of every single piece @jbaruch http://jfrog.com/shownotes #DOSAMS

Other measures ￭ Version adoption ￭ Bug Burn-down diagram ￭ Productivity Gains “used to be 2 days, now its 2 minutes” ￭ Quality, No Regressions! ￭MTTR ￭ Business metrics @jbaruch http://jfrog.com/shownotes #DOSAMS

What’s the right release cycle? @jbaruch http://jfrog.com/shownotes #DOSAMS

@jbaruch #LiquidSoftware

Update available Yes No Do we trust the update? Yes How about no Let’s update! Yes Are there any high risks? No Do we want it? No

“ ￭Acceptance tests @jbaruch http://jfrog.com/shownotes #DOSAMS

“ ￭The dreadful updates @jbaruch http://jfrog.com/shownotes #DOSAMS

“ ￭Impossible dilemma: we need the update, but it will break things @jbaruch http://jfrog.com/shownotes #DOSAMS

Update available Yes No Can we verify the update? No Yes Yes How about no Do we trust the update? Time consuming verification Let’s update! Yes Are there any high risks? No Do we want it? No

Features that we want @jbaruch Acceptance tests costs http://jfrog.com/shownotes #DOSAMS

@jbaruch http://jfrog.com/shownotes #DOSAMS

This is not a new idea! ￭ XP: short feedback ￭ Scrum: reducing cycle time to absolute minimum ￭ TPS: Decide as late as possible and Deliver as fast as possible ￭ Kanban: Incremental change @jbaruch http://jfrog.com/shownotes #DOSAMS

Continuous updates ￭ Frequent ￭ Automatic ￭ Tested ￭ Canary ￭ State-aware ￭ Observability ￭ *Local Rollbacks @jbaruch http://jfrog.com/shownotes #DOSAMS

You don’t offload quality tests to customers The customers are always ready to update You just lost the last excuse for not releasing fast

Education @jbaruch Automation http://jfrog.com/shownotes Trust #DOSAMS

“ Pain is instructional @jbaruch http://jfrog.com/shownotes #DOSAMS

“ You need to know, You need to believe, You need to give a sh*t @jbaruch http://jfrog.com/shownotes #DOSAMS

Also, @jbaruch http://jfrog.com/shownotes #DOSAMS

“Activation Energy” @jbaruch http://jfrog.com/shownotes #DOSAMS

@jbaruch http://jfrog.com/shownotes #DOSAMS

RESIST FAKE NEWS @jbaruch http://jfrog.com/shownotes #DOSAMS

First push is hard “ Keep your eye on the prize For an older code base this could take more than a year to achieve, but its still worth it @jbaruch http://jfrog.com/shownotes #DOSAMS

Tools @jbaruch http://jfrog.com/shownotes #DOSAMS

Immutable Scriptable “ @jbaruch Universal http://jfrog.com/shownotes #DOSAMS

Guide, don’t dictate Aim for the 80% Tool Java JFrog Artifactory JFrog Xray Gradle Maven Ant Rating Invest Invest Research Invest Maintain Divest

Let’s talk about trust @jbaruch http://jfrog.com/shownotes #DOSAMS

Remember this? Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DOSAMS

Some commits should fail! Develop Test @jbaruch Build http://jfrog.com/shownotes #DOSAMS

“ Quality is the bottleneck Automatic testing is not enough The “big green button” concept is lack of trust in quality @jbaruch http://jfrog.com/shownotes #DOSAMS

“ Quality is the bottleneck Automatic testing is not enough, but we can use our customers as testers Canary releases @jbaruch http://jfrog.com/shownotes #DOSAMS

DevOps Ops Dev @jbaruch QA http://jfrog.com/shownotes #DOSAMS

DevOps People Process @jbaruch Tools http://jfrog.com/shownotes #DOSAMS

DevOps Automation Trust @jbaruch Education http://jfrog.com/shownotes #DOSAMS

QA & Twitter Ads ◇@jbaruch ◇#DOSAMS ◇https://jfrog.com/shownotes ◇https://liquidSoftware.com