A Research Study into DevOps Bottlenecks

A presentation at DevNexus 2019 in March 2019 in Atlanta, GA, USA by Baruch Sadogursky

Slide 1

Slide 1

Research into DevOps bottlenecks

Slide 2

Slide 2

Who am I Baruch Sadogursky Head of Developer Relations @jfrog @jbaruch @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 3

Slide 3

Also, jfrog.com/shownotes

Slide 4

Slide 4

Why “research”? We interview people VP R&D @ JFrog CTO @ Bugsee CTO @ Top Israeli Finance Firm VP Engineering at CA Technologies CTO @ ScentBird Architect, a top Fortune-Rated Privately-Held Tech Firm Applications Engineering Manager at Fortune 500 SW Company Architect, US Army (Contractor) @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 5

Slide 5

What is DevOps? @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 6

Slide 6

Development Operations @jbaruch QA http://jfrog.com/shownotes #DevNexus

Slide 7

Slide 7

Devops! Development Operations @jbaruch QA http://jfrog.com/shownotes #DevNexus

Slide 8

Slide 8

Devops! Development Operations QA @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 9

Slide 9

What bottlenecks?

Slide 10

Slide 10

DevOps and Delivery Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 11

Slide 11

Release cycles 2 years 6 months 2 weeks 1 day 2 hours @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 12

Slide 12

@jbaruch http://jfrog.com/shownotes #DevNexus

Slide 13

Slide 13

Are they happy with it? 0% Satisfied 20% Satisfied 50% Satisfied 80% Satisfied 100% Satisfied @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 14

Slide 14

@jbaruch http://jfrog.com/shownotes #DevNexus

Slide 15

Slide 15

How do you know it’s good? @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 16

Slide 16

“ I don’t measure it because I’ve had no complaints @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 17

Slide 17

“ When the bug queue is empty we are good @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 18

Slide 18

“ When I get fewer tickets on the process @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 19

Slide 19

“ Automation of every single piece @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 20

Slide 20

Other measures Version adoption Bug Burn-down diagram Productivity Gains “used to be 2 days, now its 2 minutes” Quality, No Regressions! MTTR Business metrics @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 21

Slide 21

What’s the right release cycle? @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 22

Slide 22

Slide 23

Slide 23

Why not to update @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 24

Slide 24

“ Acceptance tests @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 25

Slide 25

“ The dreadful updates @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 26

Slide 26

“ Impossible dilemma: we need the update, but it will break things @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 27

Slide 27

Update available Yes No Can we verify the update? No Yes Yes How about no Do we trust the update? Time consuming verification Let’s update! Yes Are there any high risks? No Do we want it? No

Slide 28

Slide 28

@jbaruch @jfrog #LiquidSoftware www.liquidsoftware.com

Slide 29

Slide 29

Update available Yes Do we want it? Are there any high risks? Sure, why not? (auto update) No Let’s update!

Slide 30

Slide 30

@jbaruch @jfrog #LiquidSoftware www.liquidsoftware.com

Slide 31

Slide 31

@jbaruch @jfrog #LiquidSoftware www.liquidsoftware.com

Slide 32

Slide 32

Update available Yes Do we trust the update? Yes Let’s update! Yes Do we want it? Are there any high risks? Sure, why not? (auto update) No

Slide 33

Slide 33

Slide 34

Slide 34

You don’t offload quality tests to customers The customers are always ready to update You just lost the last excuse for not releasing fast

Slide 35

Slide 35

But what about the quality?… @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 36

Slide 36

Slide 37

Slide 37

No, not really.

Slide 38

Slide 38

No, not really.

Slide 39

Slide 39

No, not really.

Slide 40

Slide 40

No, not really.

Slide 41

Slide 41

Slide 42

Slide 42

Education @jbaruch Automation http://jfrog.com/shownotes Trust #DevNexus

Slide 43

Slide 43

“ Pain is instructional @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 44

Slide 44

“ You need to know, You need to believe, You need to give a sh*t @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 45

Slide 45

Also, @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 46

Slide 46

“Activation Energy” @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 47

Slide 47

@jbaruch http://jfrog.com/shownotes #DevNexus

Slide 48

Slide 48

RESIST FAKE NEWS @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 49

Slide 49

First push is hard “ Keep your eye on the prize For an older code base this could take more than a year to achieve, but its still worth it @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 50

Slide 50

Tools @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 51

Slide 51

Immutable Scriptable “ @jbaruch Universal http://jfrog.com/shownotes #DevNexus

Slide 52

Slide 52

Guide, don’t dictate Aim for the 80% Tool Java JFrog Artifactory JFrog Xray Gradle Maven Ant Rating Invest Invest Research Invest Maintain Divest

Slide 53

Slide 53

Let’s talk about trust @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 54

Slide 54

Remember this? Develop Operate Build Release Test Deploy @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 55

Slide 55

Some commits should fail! Develop Test @jbaruch Build http://jfrog.com/shownotes #DevNexus

Slide 56

Slide 56

Slide 57

Slide 57

“ Quality is the bottleneck Automatic testing is not enough The “big green button” concept is lack of trust in quality @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 58

Slide 58

“ Quality is the bottleneck Automatic testing is not enough, but we can use our customers as testers Canary releases @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 59

Slide 59

Technology Process @jbaruch Devops! People http://jfrog.com/shownotes #DevNexus

Slide 60

Slide 60

Automation Trust @jbaruch Devops! Education http://jfrog.com/shownotes #DevNexus

Slide 61

Slide 61

Devops! Education TrustAutomation @jbaruch http://jfrog.com/shownotes #DevNexus

Slide 62

Slide 62

QA & Show notes ◇@jbaruch ◇#DevNexus ◇http://jfrog.com/shownotes Video Slides Links Feedback Raffle! (come early)