Running Internal Events – The Goat Farm – S1E5

A guy in Belgium inspires a bank in the Netherlands to hold an internal DevOps Days. A weekly newsletter in the UK picks up a presentation from that internal event, and a team in Minneapolis, MN is inspired to hold their own event.

Internal events are becoming more and more popular in Enterprise IT. Cloud Symposiums, Automation Symposiums, DevOps Leadership Summits, and DevOps Days are all internal events I have participated in this year alone. Ross and I talk to Heather Mickman (Target), Brent Nelson (Target), and Mark Heistek (ING Bank) about the events they have run in their organizations, how they got started, what challenges they faced, and any tips for people wanting to run their own events.

If you’d like to see some of the tweets and activities from Target’s last two DevOps events, you can search twitter for the hashtag #dotgt.

We also talk briefly about “The Prince of DevOps“, and reviews we’ve gotten about the podcast (sorry for the heavy breathing last time).

Download MP3 – iTunesStitcherRSS

Guest Info:

Heather Mickman – LinkedInTwitter

Heather Mickman is the leader for the API and Integration team at Target and a DevOps enthusiast.  Throughout her career, Heather has continuously embraced hard technology challenges from consulting large Fortune 50 companies on Supply Chain approach, implementing warehouse automation technologies, running large Ops & Support organizations, and establishing enterprise security approaches.  She has a passion for technology, building high performing teams, driving a culture of innovation, and having fun along the way.  Heather lives in Minneapolis with her 2 sons and 2 dachshunds.


Brent Nelson – LinkedInTwitter2014-ProfilePic

Husband, father and life-long resident of Minnesota. I’ve been with Target for 26+ years and for the last year have been an internal DevOps collaboration and social media evangelist involved in hosting internal DevOpsDays events, creating/delivering internal educational materials, co-curating the #make_awesome_happen Flipboard ezine and much more.


fotoMarkHeistekMark Heistek – LinkedInTwitter

Father of two children, sport fanatic, having fun in life and working at ING Bank Netherlands since 2008. Currently in a continuous delivery team to facilitate in an enterprise continuous delivery pipeline. Furthermore a Continuous Delivery and DevOps evangelist in and outside ING.

The Goat Farm

goats

There’s been a lot of focus on DevOps in the Enterprise as of late. The DevOps Enterprise Summit showed that DevOps in the Enterprise is a hot topic, and that large enterprises can be successful with DevOps.

One thing that critics say we need more of is prescriptive guidance on implementing DevOps in the Enterprise. This has created this pseudo-movement known as “Enterprise DevOps” to try and fill the perceived gap.  But what the DevOps Enterprise Summit has shown us is that there is sufficient guidance out there to transform enterprises with the ideas of DevOps.

However, a recent podcast highlighted to me that it is often hard for some people to find the information they need to get started with DevOps. That is why the DevOps Enterprise Summit was great. It consolidated Enterprise success stories into one place, and is easier to find.

In continuing this vein, I am happy to announce that I’ll be starting a new podcast on DevOps in the Enterprise. I am also excited to be joined by Ross Clanton on this journey. Ross is an Ops leader at Target, brings years of experience in Enterprise IT, and has been a champion of DevOps transformation. Ross and I will focus on real world DevOps transformations in the Enterprise by interviewing leaders in the space.

We will launch our podcast in mid December, so watch this space for our first few episodes of “The Goat Farm”.

What if Everything We’ve Been Doing is Wrong?

60-wrong-way

After I wrote my last post, I was talking with Donnie Berkholz as we traveled to FOSDEM. Donnie commented on how powerful of a post it was, yet it left the reader hanging. He, and other readers, wanted more. So I’ve taken the liberty of breaking down more of the reasons Enterprise IT needs a “special kind of DevOps” as posted by Andi Mann. I don’t want anyone to think I am picking on Andi personally. Rather, his post reminds me of all the excuses Enterprises give as to why “We can’t change”. As Mick told Rocky, “There ain’t no can’ts!”

  • They cannot achieve the same levels of agility and personal responsibility as a smaller or less complex organization.

Why Not? Principles that teach agility and speed have long been used at large companies such as Microsoft. (Yes, feel free to say Microsoft is a bad example, they are still one of the world’s largest software companies.) Additionally, if one doesn’t want to take personal responsibility for what they produce for a company, maybe they are in the wrong job for the wrong company?

  • They cannot stream new code into production and just shut down for a couple of hours to fallback if it fails.

This is fool-hardy to begin with. The goal of methods such as Continuous Integration is to be constantly building releases and testing them to catch problems before they are released to production. Also, the idea is to test small changes, so you know exactly what breaks, rather than large chunks of code. Large enterprises “cannot stream new code” because they haven’t built the necessary flows in front of production releases to effectively and efficiently test and verify code changes. This requires IT organizations to fully automate their processes all the way down to server builds, a process they often are incapable of doing because of an attachment to the “old way of doing things”.

  • They rarely ever have ‘two pizza teams’ for development or operations (indeed, they are lucky if they have ‘two Pizza Hut teams’).

The size of the team is nearly always irrelevant. Within each Pizza Hut there are tables, and each table consumes the pizza buffet. The goal of DevOps is to increase the flow of the work through those tables so the teams can eat their pizza and leave quicker. As I’ve said before, focusing on the Silos is the wrong way to solve the problem. Rather focus on the grain elevators that move the grain to produce something meaningful.

  • They cannot sign up for cloud services with a credit card without exceeding their monthly limit and/or being fired.

Get an MSA/PO with the cloud vendor or build a Private Cloud. Cloud or no cloud, building strong automation on top of existing VM or server infrastructure can help alleviate many problems in service delivery.

  • They cannot allow developers to access raw production data, let alone copy it to their laptop for development or testing.

Scrub the data. DevOps or not, this is a problem that we’ve solved years ago. When I worked at a major e-commerce site, real data was often required for testing, but that data was always cleaned of any sensitive PII. This is not an issue that is unique to DevOps.

  • They cannot choose to stream new code into production in violation of a change freeze, or even without the prior approval of a CAB.

Once again, one assumes that DevOps is all about willy nilly pushing of code to production. One aspect of DevOps is about increasing the flow of the work through the system by optimizing the centers where value is added. As I’ve discussed before, principles and practices of DevOps actually help things like Change Control.

  • They cannot just tell developers to carry pagers ‘until their software is bedded in’ (not least because their developers have always carried pagers, and on a full-time basis).

If Devs already carry pagers, then they’ve already been told to carry pagers, hence, “they” can indeed tell their Devs to carry pagers. Additionally, bedding in of the software should happen in the lower environments as discussed previously. If you’ve done things right before production, pagers become a tool that is used when things go really badly. It’s a form of monitoring and incident response that becomes meaningful again because you aren’t being paged for endless break fix work.

  • They cannot put developers and operators together because one team works 24×7 shifts in 7data centers while the other works 16-hour days in 12 different locations.

Well, good, they at least have 16 hours a day together. Highly distributed remote teams are becoming more and more common. Technology is evolving to help bring this concept of remote work and people are finding creative ways to work around it. I’m also against the idea that DevOps is all about merging dev and ops onto one team, because that is not the point. The idea, as already stated, is to increase the flow of work between Dev and Ops and build a culture of continuous improvement between the two groups (three groups if you include the business). Dev, Ops, Business, who gives a shit. The point is working towards a common goal, no matter where you sit.

What large IT shops cannot do is be satisfied anymore with the status-quo. They cannot accept the ways of the past any longer, and they have to start thinking about blowing up their way of doing things. They cannot let the castles and fiefdoms of the past get in the way any longer.

I think the single most powerful question any IT shop can ask themselves is, “What if everything we’ve been doing over the last X years is completely wrong?” Start there, and reevaluate everything you’ve been doing to achieve (or not achieve) the results your customers require.

The Evolution of an Idea

goats in towerFive months ago a presentation was given in Amsterdam. In that presentation a comment was made that I woke up with a goat in my hotel room. That coupled with the fact that almost every presentation at the conference had a picture of a grain silo in it made some to think they were at a farmer’s conference, not a technology conference.

A quick google search by Arjen Wolfs  found a calculus problem called “The Goat and Silo”, and a challenge was thrown down. I was challenged to build a presentation around “The Goat and Silo”. But as I researched this idea, and talked to others, I found that the idea was not as half cocked as I thought.

Initially, when I talked to people about the idea they thought I was crazy, but as I explained it more they realized the analogy of a goat tied to a silo was an excellent comparison to some IT organizations and the people within them. I wrote an article for Information Week describing the idea of hiring goats, and the response helped to validate the idea. Further validation on the idea was provided at Cloud Connect Chicago where I presented the ideas of goats, silos, and the misconception that silos must be “torn down”.

So now we circle back to Amsterdam, and the Cloudstack Collaboration Conference. I’m excited to be heading back to some of the people that initially hatched the concept, and reflect together with them on the journey over the last five months. Am I crazy (maybe), or do the ideas really reflect what we see on a day to day basis in IT. But what is more exciting is getting to interact with the great attendees and speakers, as well as attend the great talks scheduled.

Image credit: http://www.flickr.com/photos/valkyrieh116/1209010274/in/photostream/