WEBVTT

00:00:10.800 --> 00:00:13.080
<v Jim Hirschauer>Welcome to ShipTalk, the SRE edition.

00:00:13.349 --> 00:00:14.199
<v Jim Hirschauer>I'm Jim Hirschauer.

00:00:14.224 --> 00:00:15.150
<v Jim Hirschauer>Your host for today.

00:00:16.000 --> 00:00:23.850
<v Jim Hirschauer>ShipTalk is a DevOps podcast, brought to you by Harness, the software delivery platform, and the SRE edition focuses on reliability topics.

00:00:24.390 --> 00:00:26.879
<v Jim Hirschauer>My guest here today is Steve McGee from Google.

00:00:26.969 --> 00:00:28.190
<v Jim Hirschauer>Steve, welcome to the show.

00:00:29.440 --> 00:00:30.390
<v Steve McGhee>Hey, nice to be here.

00:00:30.809 --> 00:00:32.579
<v Jim Hirschauer>Great to have you, Steve.

00:00:32.579 --> 00:00:36.549
<v Jim Hirschauer>Could you please take a minute to fill in our listeners on your background and what you're up to today?

00:00:36.552 --> 00:00:36.912
<v Steve McGhee>Sure.

00:00:36.962 --> 00:00:38.215
<v Steve McGhee>So I'm Steve.

00:00:38.215 --> 00:00:39.054
<v Steve McGhee>I work at Google.

00:00:39.136 --> 00:00:40.570
<v Steve McGhee>worked there for a long time.

00:00:40.570 --> 00:00:43.810
<v Steve McGhee>I was a, an SRE inside of Google for about a decade.

00:00:43.854 --> 00:00:47.820
<v Steve McGhee>I worked on things like Android and Google Fiber as well as YouTube.

00:00:47.820 --> 00:00:49.243
<v Steve McGhee>I actually then left Google.

00:00:49.243 --> 00:00:57.042
<v Steve McGhee>I, I joined a, a company here in California to help move them to the cloud, which is like a super common thing for, for companies to be doing right now.

00:00:57.051 --> 00:00:58.837
<v Steve McGhee>And in, man, it was, it was hard.

00:00:58.896 --> 00:00:59.587
<v Steve McGhee>It was really hard.

00:00:59.947 --> 00:01:04.060
<v Steve McGhee>And I learned a heck of a lot in that you know, one to two years.

00:01:04.134 --> 00:01:07.414
<v Steve McGhee>I, I actually ended up going back to Google to kind of help more people.

00:01:08.599 --> 00:01:14.683
<v Steve McGhee>So for a while I was I had a role called Solution Architect which is kind of a common role you see a lot across a lot of providers.

00:01:14.718 --> 00:01:16.108
<v Steve McGhee>But now my job is in DevRel.

00:01:16.108 --> 00:01:20.182
<v Steve McGhee>So I'm a, a reliability advocate, which is a title that I just invented myself.

00:01:20.331 --> 00:01:29.302
<v Steve McGhee>So basically, I talk with customers and I do things like this and I talk about SRE and reliability and DevOps and all kinds of stuff that all kind of like overlap with each other.

00:01:29.781 --> 00:01:32.518
<v Steve McGhee>And I just try to help people understand it cuz there's a lot to learn.

00:01:33.197 --> 00:01:33.638
<v Jim Hirschauer>Awesome.

00:01:33.783 --> 00:01:35.013
<v Jim Hirschauer>Thanks for that background.

00:01:35.643 --> 00:01:38.188
<v Jim Hirschauer>So Steve I know you're familiar with the format of the show.

00:01:38.188 --> 00:01:40.789
<v Jim Hirschauer>We do a little bit of something up front just for fun.

00:01:41.118 --> 00:01:42.498
<v Jim Hirschauer>And so we'll start there.

00:01:43.099 --> 00:01:47.088
<v Jim Hirschauer>I'd love to tell you what is your favorite hobby outside of work?

00:01:47.155 --> 00:01:47.995
<v Steve McGhee>That's a good question.

00:01:48.048 --> 00:01:52.308
<v Steve McGhee>My kids keep me pretty busy, but outside of that I like to describe myself as a former athlete.

00:01:52.399 --> 00:01:56.272
<v Steve McGhee>So I was like a competitive swimmer growing up and I did triathlon in college.

00:01:56.992 --> 00:01:57.531
<v Steve McGhee>Stuff like that.

00:01:57.531 --> 00:02:04.203
<v Steve McGhee>So I, I try to like ride a lot of bikes and mostly mountain bikes these days cuz I'm scared of roads now, And don't blame it.

00:02:04.203 --> 00:02:08.157
<v Steve McGhee>And I lift weights, like that's my, my latest like, departure from like the, or the original thing.

00:02:08.157 --> 00:02:12.669
<v Steve McGhee>And I also coach swimming a little bit, so that's, that's pretty fun too.

00:02:12.675 --> 00:02:13.259
<v Steve McGhee>So like my kids.

00:02:14.050 --> 00:02:22.840
<v Steve McGhee>Are in junior high and high school and it's fun to kind of help with that kind of athletic side of town to, to, I dunno, become better competitive swimmers.

00:02:22.840 --> 00:02:28.662
<v Steve McGhee>It's, it's kind of like my lifelong passion is, I'm strangely good in the water, so I'm gonna keep doing that.

00:02:29.146 --> 00:02:29.447
<v Jim Hirschauer>Yeah.

00:02:29.447 --> 00:02:29.986
<v Jim Hirschauer>That's awesome.

00:02:29.986 --> 00:02:33.076
<v Jim Hirschauer>It's great also to give back and, and do a little bit of coaching at the same time.

00:02:33.106 --> 00:02:33.227
<v Steve McGhee>Yeah.

00:02:33.227 --> 00:02:33.856
<v Steve McGhee>It's really fun.

00:02:33.977 --> 00:02:34.187
<v Steve McGhee>Yeah.

00:02:34.276 --> 00:02:34.606
<v Jim Hirschauer>Yeah.

00:02:35.356 --> 00:02:35.866
<v Jim Hirschauer>Terrific.

00:02:35.866 --> 00:02:38.296
<v Jim Hirschauer>Well, I'm, I'm kind of excited about today's topic.

00:02:38.296 --> 00:02:39.197
<v Jim Hirschauer>Our main topic.

00:02:39.235 --> 00:02:49.820
<v Jim Hirschauer>We're gonna talk about a website called, or a project I should say, that has a website called r9y.dev, and for anyone who wants to check that out, that is the letter R, the number 9.

00:02:50.181 --> 00:02:57.175
<v Jim Hirschauer>The letter Y dot dev so please go ahead and, and jump out there to that website while we're, while we're talking about things.

00:02:57.776 --> 00:02:58.225
<v Jim Hirschauer>So.

00:02:59.135 --> 00:03:05.618
<v Jim Hirschauer>You know, this is something that we, Steve, you and I talked about this when we met at SREcon in Amsterdam last year.

00:03:05.618 --> 00:03:05.709
<v Jim Hirschauer>Yep.

00:03:06.218 --> 00:03:11.288
<v Jim Hirschauer>And I had seen it before that and was excited that we got to talk about it in person.

00:03:11.288 --> 00:03:16.520
<v Jim Hirschauer>So why don't you share with the listeners what is this project and and how did it get started?

00:03:17.605 --> 00:03:27.912
<v Steve McGhee>Well, like it's, it really just started out kind of as a joke as all good projects start out as and the idea was we wanted to build the Civilization tech tree.

00:03:27.912 --> 00:03:30.312
<v Steve McGhee>If you're familiar with the game, civilization love it.

00:03:30.671 --> 00:03:34.782
<v Steve McGhee>But for reliability, for like SRE and DevOps and stuff like that.

00:03:34.782 --> 00:03:40.352
<v Steve McGhee>So, we actually don't call it the SRE tree or the DevOps tree.

00:03:40.352 --> 00:03:49.253
<v Steve McGhee>Like we, we we're specifically constraining it to reliability and not constraining it to the Google SRE form of reliability.

00:03:49.253 --> 00:03:52.008
<v Steve McGhee>So it's like generically, it's just, you know, reliability stuff.

00:03:52.032 --> 00:04:00.578
<v Steve McGhee>And so the, the way that you want to think about it is, In Civilization, if you want to go to space, you have to learn pottery at the very beginning of the game.

00:04:00.668 --> 00:04:00.907
<v Steve McGhee>Right.

00:04:00.967 --> 00:04:03.638
<v Steve McGhee>And you have to know that, you have to learn that first.

00:04:03.638 --> 00:04:08.997
<v Steve McGhee>Like it's a, it's a, it's a hassle if you get all the way to, you know the late technology tree and you have to go back and learn pottery.

00:04:09.057 --> 00:04:09.298
<v Steve McGhee>Right.

00:04:09.302 --> 00:04:10.348
<v Steve McGhee>It's, it's a, that's a bummer.

00:04:10.385 --> 00:04:20.014
<v Steve McGhee>And so the, we, we felt that that was a good analogy to what we saw a lot of customers were struggling with because they would say, yo, I want to do something like super advanced, like space flight.

00:04:20.014 --> 00:04:20.934
<v Steve McGhee>You know, we want to do.

00:04:21.499 --> 00:04:26.771
<v Steve McGhee>Multi cluster canary deployments and like super complicated observability.

00:04:26.800 --> 00:04:27.519
<v Steve McGhee>And we're like, great.

00:04:27.548 --> 00:04:28.689
<v Steve McGhee>Like, let's, let's talk.

00:04:28.689 --> 00:04:36.230
<v Steve McGhee>And then we find out after, you know, a few hours or, or, or days or weeks of talking with the customer that they're actually struggling with something really simple, right?

00:04:36.230 --> 00:04:43.110
<v Steve McGhee>They're, they're, they're way further like to the left, if you will, on the tree than, than we expected.

00:04:43.134 --> 00:04:46.620
<v Steve McGhee>And this was before the tree existed, so we just kind of like, were mentally picturing this.

00:04:47.089 --> 00:04:49.550
<v Steve McGhee>And so we just decided one day to sit down and try to write it down.

00:04:49.595 --> 00:04:59.464
<v Steve McGhee>And so what we, the way that it's structured is the, the far left is like, if you think of it in terms of nines, the far left is like one, nine, like a, a, a not very reliable system.

00:04:59.464 --> 00:05:06.904
<v Steve McGhee>Like this is something that runs on your laptop and, and it's not, it's not available like when you close your laptop, you know, it's just, it's not a production grade system.

00:05:07.384 --> 00:05:08.175
<v Steve McGhee>And on the far right.

00:05:08.524 --> 00:05:10.444
<v Steve McGhee>Is like something that has like five nine.

00:05:10.444 --> 00:05:13.774
<v Steve McGhee>So it's something really like giant and, and you know, robust.

00:05:13.774 --> 00:05:19.574
<v Steve McGhee>And I think of like, Google Ads is like, has all of these capabilities built into its system somewhere.

00:05:19.574 --> 00:05:21.105
<v Steve McGhee>And they do like the super fancy stuff.

00:05:21.165 --> 00:05:23.985
<v Steve McGhee>So the, the trick is to kind of find where you sat, where you are.

00:05:24.935 --> 00:05:27.600
<v Steve McGhee>on the map, like from left to right and then figure out where you want to go.

00:05:27.630 --> 00:05:31.860
<v Steve McGhee>And then the map helps guide your way, helps you discover what it is you should work on next.

00:05:32.310 --> 00:05:33.000
<v Jim Hirschauer>That's amazing.

00:05:33.451 --> 00:05:49.170
<v Jim Hirschauer>So one of the things that really drew me to this when I first saw it was, you know, the conversations that I get to have in, in my work life, I get to talk to a lot of different companies about reliability and how they're approaching reliability within, within their organization.

00:05:49.771 --> 00:05:52.579
<v Jim Hirschauer>And I've often found that many companies.

00:05:52.625 --> 00:06:00.235
<v Jim Hirschauer>Have some ideas on what they want to do for reliability or they're cer they're at a certain maturity level, I'll use that term in their reliability practices.

00:06:00.240 --> 00:06:05.524
<v Jim Hirschauer>But often they are looking for guidance on, you know, what do they do next?

00:06:05.524 --> 00:06:10.855
<v Jim Hirschauer>Or maybe, you know, their, their initiatives aren't Producing the, the results that they really wanted out of them.

00:06:11.274 --> 00:06:13.045
<v Jim Hirschauer>And so they're really looking for some guidance.

00:06:13.045 --> 00:06:20.485
<v Jim Hirschauer>So that's, when I saw this, I thought, hey, this actually looks like something that could help guide people in a vendor agnostic way.

00:06:20.509 --> 00:06:33.259
<v Jim Hirschauer>You know, from a capabilities perspective, help guide them from a kind of a very low level of maturity or wherever they stand today through to as mature as they want to get or as it makes sense for their individual organization and applications.

00:06:34.738 --> 00:06:35.035
<v Steve McGhee>Yeah.

00:06:35.045 --> 00:06:39.276
<v Steve McGhee>We actually, when I talk to customers, I try to avoid the term maturity.

00:06:39.276 --> 00:06:41.646
<v Steve McGhee>I, I, I recognize it's a useful concept.

00:06:41.766 --> 00:06:41.855
<v Steve McGhee>Yeah.

00:06:41.877 --> 00:06:45.178
<v Steve McGhee>But like, if you're more reliable, that doesn't make you more mature.

00:06:45.178 --> 00:06:50.428
<v Steve McGhee>Like those, those I think are like, you know, not exactly the same term.

00:06:50.608 --> 00:06:50.759
<v Steve McGhee>Yeah.

00:06:50.819 --> 00:06:55.930
<v Steve McGhee>And also you can be extremely mature and not need reliability so much.

00:06:55.930 --> 00:06:56.141
<v Steve McGhee>Right.

00:06:56.141 --> 00:07:05.901
<v Steve McGhee>You might have a system that is totally background and like, can fail and it's no big deal and, you know Not, not to to pick on your wording, but like, you won't see a maturity matrix come out of this.

00:07:05.901 --> 00:07:06.975
<v Steve McGhee>Like, that's not the point.

00:07:07.005 --> 00:07:12.415
<v Steve McGhee>We've actually found that it's really com I think we actually put this in our little there's this other little book that we wrote.

00:07:12.564 --> 00:07:27.779
<v Steve McGhee>But, but we, we've found that trying to apply a maturity matrix to reliability is so, like, it feels like such a good idea and it always backfires, like, so we're trying really hard to, to instead focus on just building up of capabilities over time.

00:07:27.839 --> 00:07:30.810
<v Steve McGhee>And as you get more capabilities, you're simply more capable.

00:07:30.870 --> 00:07:32.579
<v Steve McGhee>Like you can, you can just do more things.

00:07:32.615 --> 00:07:39.274
<v Steve McGhee>And it's not actually reflective of, you know, what, you know, are you three out of five or are you four out of five?

00:07:39.274 --> 00:07:40.403
<v Steve McGhee>Or, or, or whatever.

00:07:40.406 --> 00:07:43.456
<v Steve McGhee>And I, I've found that that does help quite a bit.

00:07:43.502 --> 00:07:59.492
<v Steve McGhee>And, but you're right about, Being able to discover, you know, like a, like you said, like a vendor agnostic way through this forest, right across this map is really important because without something like this, all you're stuck with is the, like vendor non agnostic ways, right?

00:07:59.562 --> 00:08:05.882
<v Steve McGhee>And, and it's, you really have to interpret all the marketing material and you have to interpret the historical context that everything was built in.

00:08:05.882 --> 00:08:09.392
<v Steve McGhee>And, and none of it really relates to what it is that you're trying to accomplish as a team.

00:08:09.392 --> 00:08:14.103
<v Steve McGhee>And you just sit there and squint and you have to figure out like, what is, what do you think, how would this actually work if we used it?

00:08:14.627 --> 00:08:19.997
<v Steve McGhee>And that's, that's pretty difficult to do without this kind of like third party system that we're trying to build.

00:08:20.608 --> 00:08:20.908
<v Jim Hirschauer>Yeah.

00:08:20.908 --> 00:08:23.577
<v Jim Hirschauer>And, and I love that term that you used.

00:08:23.577 --> 00:08:28.468
<v Jim Hirschauer>I love looking at it from a perspective of capabilities instead of maturity, because that's absolutely right.

00:08:28.473 --> 00:08:36.981
<v Jim Hirschauer>You, it, you know, maturity is a very different thing than putting together all of these capabilities and being able to accomplish this or achieve certain things within an organization.

00:08:38.182 --> 00:08:52.339
<v Jim Hirschauer>On that line of thinking for, you know, having this matrix of capabilities where you compared it to Civilization where you have kind of a dependency map of capabilities that build upon each other.

00:08:52.339 --> 00:08:56.386
<v Jim Hirschauer>Is the project in that state today where all of those relationships are already built out?

00:08:56.386 --> 00:08:58.004
<v Jim Hirschauer>Wh What is the status of the project?

00:08:58.004 --> 00:08:59.085
<v Jim Hirschauer>How far along is it?

00:08:59.134 --> 00:09:01.092
<v Jim Hirschauer>What could people expect if they go out to the website?

00:09:01.842 --> 00:09:03.552
<v Steve McGhee>Yeah, it's not that far along Okay.

00:09:03.552 --> 00:09:04.159
<v Steve McGhee>So all right.

00:09:04.250 --> 00:09:08.057
<v Steve McGhee>The, we, we tried to have like a, you know, fully directed graph.

00:09:08.062 --> 00:09:08.957
<v Steve McGhee>Like that would be great.

00:09:08.988 --> 00:09:13.788
<v Steve McGhee>Like, you just, you have to do this and then this, and then this, and like, it would be perfect, but like, it doesn't, that doesn't work.

00:09:13.811 --> 00:09:21.089
<v Steve McGhee>It simply is like everything is so loosely related and loosely coupled on like, on purpose, which is great.

00:09:21.089 --> 00:09:25.259
<v Steve McGhee>That it's not that straightforward to have like a fully connected graph.

00:09:25.259 --> 00:09:33.884
<v Steve McGhee>So what we have instead, we have a couple like edges, a few arrows and, and mostly they were there to make sure that like the arrows worked in the ui mm-hmm.

00:09:34.125 --> 00:09:40.163
<v Steve McGhee>But we haven't really found that it makes a lot of sense to have really a, a strong opinion in when it comes to edges.

00:09:40.163 --> 00:09:48.812
<v Steve McGhee>There, there are some where it makes sense and there some of them are in there but, but really at the end of the day, what, what the, the, the part that's important is the kind of the columns, if you will.

00:09:48.812 --> 00:09:53.947
<v Steve McGhee>So like the, the vertical groupings of them like I said there in like, we call them like the nine.

00:09:53.951 --> 00:09:56.136
<v Steve McGhee>So there's the one nine, the two nine, the three nine, the four nine.

00:09:56.177 --> 00:09:58.740
<v Steve McGhee>And those are, those are pretty hand wavy still.

00:09:58.830 --> 00:10:11.106
<v Steve McGhee>But the intent is that the capabilities that are in those columns relate directly to your ability to react to an incident or to have some, like, it has to do with reaction time.

00:10:11.496 --> 00:10:21.263
<v Steve McGhee>And so if a capability involves like a human looking at a dashboard and like running a script that cannot be in the four nines or three nines category, like it, there's humans just aren't fast enough.

00:10:21.274 --> 00:10:30.335
<v Steve McGhee>And if, you know, if, if we have something that is like at, you know, beginning this and in, you know, intermediate that and advanced that, those are gonna be spread out sort of from left to right also.

00:10:30.335 --> 00:10:31.985
<v Steve McGhee>And they, they may have arrows between them.

00:10:32.345 --> 00:10:40.013
<v Steve McGhee>So yeah, if you, if you go and look at it today, you'll find, you know, there's a lot of boxes with words on them and some of the words seem a little ambiguous.

00:10:40.013 --> 00:10:42.759
<v Steve McGhee>And those we can help get, get help on.

00:10:42.759 --> 00:10:44.902
<v Steve McGhee>you click in on them, you'll see a bit more text.

00:10:44.902 --> 00:10:46.642
<v Steve McGhee>That kind of explains things there.

00:10:46.642 --> 00:10:50.302
<v Steve McGhee>I will admit there's plenty of lorem ipsum still in there like that needs to be right.

00:10:50.392 --> 00:10:51.743
<v Steve McGhee>like kind of filled in still.

00:10:51.748 --> 00:10:54.533
<v Steve McGhee>So, so yeah, I mean it's, it's a work in progress for sure.

00:10:54.533 --> 00:10:54.923
<v Steve McGhee>Still.

00:10:54.982 --> 00:10:57.826
<v Steve McGhee>I don't expect it to have a fully populated graph.

00:10:57.855 --> 00:10:59.894
<v Steve McGhee>I don't expect it to ever be done either.

00:10:59.909 --> 00:11:09.081
<v Steve McGhee>If there are, like there, there also are like, you know, the, the nodes that are on the graph today are not the final, you know, like set either.

00:11:09.140 --> 00:11:14.969
<v Steve McGhee>So we want to be able to take recommendations on like direct contributions from the community.

00:11:14.969 --> 00:11:18.113
<v Steve McGhee>Right now actually getting it into the graph is strangely difficult.

00:11:18.113 --> 00:11:19.101
<v Steve McGhee>Adding words is easy.

00:11:19.101 --> 00:11:24.172
<v Steve McGhee>Like we can take PRs directly to add, like, actually you did that, like I remember you were one of our first PRs, right?

00:11:24.381 --> 00:11:24.562
<v Steve McGhee>Yeah.

00:11:24.682 --> 00:11:26.422
<v Steve McGhee>To, to add some, a bunch of text.

00:11:26.782 --> 00:11:32.710
<v Steve McGhee>and then, but adding nodes we have to do it just because the tool we used is like this hassle thing to use.

00:11:32.710 --> 00:11:35.850
<v Steve McGhee>But we do accept, in, in, in that form, we just accept issues.

00:11:35.850 --> 00:11:48.764
<v Steve McGhee>So like we're using GitHub if you want to add or modify the existing like boxes that are on the graph, you, we ask that you just file an issue and, and just kind of explain what you think we should change and then we will figure out how to do it.

00:11:48.884 --> 00:11:51.634
<v Steve McGhee>So that, that, that's the state of, of the game today.

00:11:52.034 --> 00:11:55.336
<v Jim Hirschauer>Alright.So it sounds like the project is off to a pretty good start.

00:11:55.336 --> 00:11:56.759
<v Jim Hirschauer>There's definitely some work that needs to be done.

00:11:56.759 --> 00:11:58.701
<v Jim Hirschauer>It's, it's never gonna be finished, right.

00:11:58.750 --> 00:12:06.990
<v Jim Hirschauer>But you definitely are looking for people to participate in here for people who are passionate about reliability and can I add the word resiliency in there?

00:12:06.990 --> 00:12:18.716
<v Steve McGhee>Well that's a, yeah, I mean, so there's, there's reliability, robustness, and resiliency and, and my impression is, there's humans are the ones who are resilient, generally not, not systems.

00:12:18.721 --> 00:12:18.995
<v Steve McGhee>Mm-hmm.

00:12:19.062 --> 00:12:23.212
<v Steve McGhee>Systems can be made to be robust and out of that you can gain resilience.

00:12:23.243 --> 00:12:28.094
<v Steve McGhee>Like your system will, will be re and it, it will have the quality of being reliable.

00:12:28.124 --> 00:12:28.879
<v Steve McGhee>So, yeah.

00:12:28.879 --> 00:12:35.402
<v Steve McGhee>Yeah, those words tend to be intermingled quite a lot, but like, there are like some clear definitions, but I don't, I don't think the community is, is too.

00:12:36.631 --> 00:12:38.552
<v Steve McGhee>You know, needs it to be perfect every time.

00:12:38.672 --> 00:12:39.422
<v Steve McGhee>It's, it's pretty tricky.

00:12:39.692 --> 00:12:44.761
<v Jim Hirschauer>Alright, so the call to action here is if you are passionate about the subject.

00:12:44.761 --> 00:12:56.100
<v Jim Hirschauer>If you're interested in the subject, please go out, visit the website, look at the project, and see if you have information that you can add to the project where you can go ahead and help the community in general.

00:12:57.159 --> 00:12:57.254
<v Steve McGhee>Yeah.

00:12:57.254 --> 00:13:09.375
<v Steve McGhee>And, and if you have if you represent a tool or a vendor of some kind like just, just like, like you guys do the, the, we don't need to be like, we don't need to like hide the tools and the vendors.

00:13:09.375 --> 00:13:11.926
<v Steve McGhee>Like we actually want to like, put them right in the list.

00:13:11.926 --> 00:13:15.196
<v Steve McGhee>So if you click on something like CI/CD, you'll see there's a list of tools, right?

00:13:15.525 --> 00:13:24.270
<v Steve McGhee>And so the intent is not to have a capability that is named after a tool but when you click into that capability, you should be able to see which tools will get you there.

00:13:24.541 --> 00:13:24.870
<v Steve McGhee>Right?

00:13:24.870 --> 00:13:30.375
<v Steve McGhee>So I don't wanna like hide, I don't want this to be like super abstract, you know, textbook.

00:13:30.705 --> 00:13:33.669
<v Steve McGhee>I do want the presence of vendors to be discoverable.

00:13:33.940 --> 00:13:39.852
<v Steve McGhee>And the idea is that we want to have people who are building out capabilities be able to say like, Hey how do I actually get this?

00:13:39.852 --> 00:13:41.863
<v Steve McGhee>Like, do I need to build it or can I buy it?

00:13:42.043 --> 00:13:44.003
<v Steve McGhee>Or can it, like, is there an open source solution?

00:13:44.533 --> 00:13:48.702
<v Steve McGhee>We want to be able to be able to click into capability and, and be able to make these decisions pretty quickly.

00:13:49.513 --> 00:13:49.962
<v Jim Hirschauer>Awesome.

00:13:50.682 --> 00:13:51.613
<v Jim Hirschauer>That's great to hear.

00:13:51.633 --> 00:13:57.788
<v Jim Hirschauer>I think there's definitely a need for, for that merge of capability with how do you get that capability, right?

00:13:57.788 --> 00:14:01.028
<v Jim Hirschauer>Need to, to help people find a way to get that capability.

00:14:02.408 --> 00:14:02.798
<v Jim Hirschauer>All right.

00:14:02.798 --> 00:14:05.956
<v Jim Hirschauer>So that's the, that's the main topic for today.

00:14:06.005 --> 00:14:09.485
<v Jim Hirschauer>At ShipTalk, we have another section following the main topic.

00:14:09.515 --> 00:14:10.926
<v Jim Hirschauer>Another just for fun section.

00:14:11.645 --> 00:14:15.489
<v Jim Hirschauer>And one of my favorites to hear about is IT mess-ups, right?

00:14:15.489 --> 00:14:20.889
<v Jim Hirschauer>Because I've, I've lived the life, I've had my fair share of mess-ups when I've been working.

00:14:21.339 --> 00:14:24.629
<v Jim Hirschauer>So, Steve, what is your worst IT mess-up that you'd like to share?

00:14:24.716 --> 00:14:26.467
<v Steve McGhee>Well, I have two that I'd like to share.

00:14:26.467 --> 00:14:28.268
<v Steve McGhee>One, I was definitely me.

00:14:28.268 --> 00:14:29.138
<v Steve McGhee>I definitely screwed it up.

00:14:29.138 --> 00:14:31.508
<v Steve McGhee>And the other one isn't really a screw up, but it's just a fun story.

00:14:31.567 --> 00:14:31.668
<v Steve McGhee>Mm-hmm.

00:14:31.668 --> 00:14:35.282
<v Steve McGhee>And so the first one I was a intern at Sun Microsystems.

00:14:35.552 --> 00:14:41.356
<v Steve McGhee>And the, the kinda weirdest thing about this is the place that I was sitting, like my desk is now a Google office.

00:14:41.356 --> 00:14:46.037
<v Steve McGhee>And I used to have a team, you know, 10 years from that point, which sat in the same exact spot.

00:14:46.096 --> 00:14:46.187
<v Steve McGhee>Oh, wow.

00:14:46.506 --> 00:14:48.917
<v Steve McGhee>So it was like kinda this funny Silicon Valley like moment.

00:14:49.067 --> 00:14:49.336
<v Steve McGhee>Yeah.

00:14:49.423 --> 00:14:59.320
<v Steve McGhee>But anyway, when I was an intern, my job was to like move people's computers, like their, their work computers, like from the new office to the old, or from the old office to the new office or whatever.

00:14:59.320 --> 00:15:03.807
<v Steve McGhee>And part of that was moving their data between like filers and like setting up their printers and all this stuff.

00:15:04.317 --> 00:15:13.162
<v Steve McGhee>And at one point, I was doing thankfully it was only a chmod, it wasn't like a rm or a move, or a, or a chown or anything.

00:15:13.461 --> 00:15:20.001
<v Steve McGhee>And I, I definitely like recursively, chmodded, a lot of people's, you know, work files Yeah.

00:15:20.361 --> 00:15:23.091
<v Steve McGhee>In, in like a consistently incorrect way.

00:15:23.272 --> 00:15:23.601
<v Steve McGhee>Yeah.

00:15:23.654 --> 00:15:29.236
<v Steve McGhee>And I got so scared and my, you know, intern host or whatever, like came over and.

00:15:29.236 --> 00:15:30.557
<v Steve McGhee>he's like, this is fine.

00:15:30.576 --> 00:15:31.596
<v Steve McGhee>You didn't delete anything.

00:15:33.067 --> 00:15:34.596
<v Steve McGhee>We can easily change that back.

00:15:34.601 --> 00:15:36.937
<v Steve McGhee>Like Yeah, like the owner of the files can fix this stuff.

00:15:36.937 --> 00:15:37.206
<v Steve McGhee>Fine.

00:15:37.206 --> 00:15:38.797
<v Steve McGhee>Like, you didn't actually destroy anything.

00:15:38.797 --> 00:15:39.756
<v Steve McGhee>You just like made it weird.

00:15:40.152 --> 00:15:40.356
<v Steve McGhee>Yeah.

00:15:40.361 --> 00:15:40.986
<v Steve McGhee>And that's like, that's fine.

00:15:41.197 --> 00:15:44.261
<v Steve McGhee>So that, that scared the heck outta me at the time for some reason.

00:15:44.261 --> 00:15:46.486
<v Steve McGhee>But that was when I was like 20 maybe.

00:15:46.491 --> 00:15:46.777
<v Steve McGhee>Yeah.

00:15:46.873 --> 00:15:51.482
<v Steve McGhee>And I just realized the other day that I've actually been carrying a pager for work since I was 19 years old.

00:15:51.873 --> 00:15:54.687
<v Steve McGhee>and like for computer stuff, Wow.

00:15:54.687 --> 00:15:58.761
<v Steve McGhee>Like I don't know if maybe it was, you know, it was probably 19 and pretty, pretty much consistently.

00:15:58.761 --> 00:16:01.816
<v Steve McGhee>And by pager, I mean, you know, an actual pager and then Okay.

00:16:02.235 --> 00:16:04.360
<v Steve McGhee>Eventually like a, a cell phone I guess.

00:16:04.360 --> 00:16:06.576
<v Steve McGhee>But like with paging capabilities built into it.

00:16:06.576 --> 00:16:13.812
<v Steve McGhee>But the other story that is maybe more interesting cuz it's like involves Google was, I, I was on the team that ran mobile search when it was very small.

00:16:13.871 --> 00:16:13.942
<v Steve McGhee>Mm-hmm.

00:16:13.942 --> 00:16:15.390
<v Steve McGhee>Back when mobile wasn't a big deal.

00:16:15.860 --> 00:16:22.639
<v Steve McGhee>And I think it was actually pre smartphone, so it was like pre Android, pre iPhone or maybe it was like right around the time when they first came out.

00:16:22.788 --> 00:16:23.119
<v Steve McGhee>Yeah.

00:16:23.719 --> 00:16:28.639
<v Steve McGhee>So we had a way that you could search, you know, Google search from your phone, and it was kind of like this niche thing.

00:16:29.464 --> 00:16:34.923
<v Steve McGhee>And that was the, the, the, the moment that sticks in my head is really interesting was the day that Michael Jackson died.

00:16:35.043 --> 00:16:35.133
<v Steve McGhee>Mm-hmm.

00:16:35.403 --> 00:16:44.623
<v Steve McGhee>because that was the first time where like a thing happened in like the worldwide visible culture where everyone immediately like asked their phone if it was true.

00:16:44.623 --> 00:16:44.846
<v Steve McGhee>Yeah.

00:16:44.846 --> 00:16:48.566
<v Steve McGhee>And so we had this like giant, giant, giant spike of requests.

00:16:49.480 --> 00:16:54.791
<v Steve McGhee>like you've seen, you think you've seen big spikes in your past, but this is, I I guarantee you this is bigger than anything you've ever seen.

00:16:54.821 --> 00:16:55.181
<v Steve McGhee>Right.

00:16:55.206 --> 00:17:00.504
<v Steve McGhee>This wave of requests coming in just cuz of, you know, one piece of, you know, very well distributed news.

00:17:00.865 --> 00:17:01.105
<v Steve McGhee>Right?

00:17:01.139 --> 00:17:03.480
<v Steve McGhee>And it was, we were not prepared for it at all.

00:17:03.495 --> 00:17:11.175
<v Steve McGhee>And so we ended up doing this thing where we had all of these, basically we searched front ends that were out in the world and they were all at full capacity.

00:17:11.296 --> 00:17:13.066
<v Steve McGhee>They were just ha just getting hammered.

00:17:13.546 --> 00:17:15.885
<v Steve McGhee>And we basically like went rogue and.

00:17:16.846 --> 00:17:22.726
<v Steve McGhee>Took, you know, essentially like the lowest, cheapest possible machines you could get within Google.

00:17:22.820 --> 00:17:24.530
<v Steve McGhee>They're, you know, virtual machines, not real machines.

00:17:24.530 --> 00:17:26.181
<v Steve McGhee>And we just got as many of them as possible.

00:17:26.240 --> 00:17:26.451
<v Steve McGhee>Yeah.

00:17:26.510 --> 00:17:32.961
<v Steve McGhee>And they, the, the deal with these is that if you get them, someone can take them from you cuz they're not you, they're not actually yours.

00:17:33.201 --> 00:17:38.121
<v Steve McGhee>And so we just got more and more and more and we just kept, like, stealing them as many as we could just to bring up these front ends.

00:17:38.540 --> 00:17:41.510
<v Steve McGhee>And it worked pretty well for a while.

00:17:41.519 --> 00:17:44.170
<v Steve McGhee>And we kind of recovered from the, from this massive wave.

00:17:44.630 --> 00:17:52.259
<v Steve McGhee>but it was like definitely an act of you know, encountering a, a huge external uncontrollable event in a, in a complex system.

00:17:52.263 --> 00:17:53.459
<v Steve McGhee>And it was, it was pretty fun.

00:17:53.515 --> 00:18:02.244
<v Steve McGhee>I have a joke about it, and I hope it's not in bad taste, but like the, the, the event was like, it was so big that I, I want to have like a measurement for it.

00:18:02.244 --> 00:18:03.775
<v Steve McGhee>Like it, and I like to refer to it.

00:18:03.775 --> 00:18:07.855
<v Steve McGhee>Like that was one like Michael Jackson level event, right?

00:18:07.855 --> 00:18:13.180
<v Steve McGhee>And so whenever I have these like huge events and I try to compare them in my head.

00:18:13.509 --> 00:18:20.549
<v Steve McGhee>I, I try to measure them in turn in, and the unit I use is Micro Jacksons So this was a, a 500 micro Jackson event.

00:18:21.160 --> 00:18:22.750
<v Steve McGhee>like it was half as bad as that day.

00:18:22.839 --> 00:18:23.589
<v Steve McGhee>I like that.

00:18:23.648 --> 00:18:30.602
<v Steve McGhee>It's a silly term and, and I, I don't mean offense by, by, you know, using the name, but it's, it's, it's just, it's just too good.

00:18:31.372 --> 00:18:32.061
<v Steve McGhee>To walk by.

00:18:32.122 --> 00:18:33.442
<v Jim Hirschauer>Yeah, totally understood.

00:18:33.494 --> 00:18:42.084
<v Jim Hirschauer>And, and it's incredible what sort of world events can, can, you know, trigger a massive wave that hits a website.

00:18:42.084 --> 00:18:42.144
<v Steve McGhee>Yeah.

00:18:42.144 --> 00:18:42.683
<v Steve McGhee>Why was it that one?

00:18:42.894 --> 00:18:44.394
<v Steve McGhee>Yeah, just it was just timing.

00:18:44.394 --> 00:18:49.943
<v Steve McGhee>Like just people had phones in their pockets and they're like, oh, I've heard you can search for things on these little pocket devices.

00:18:49.943 --> 00:18:50.693
<v Steve McGhee>Like, let's try it.

00:18:50.814 --> 00:18:51.114
<v Steve McGhee>Yeah.

00:18:51.114 --> 00:18:53.784
<v Steve McGhee>You know, it's like people at pubs like going, oh, did you hear?

00:18:53.784 --> 00:18:55.493
<v Steve McGhee>And it used to be when you said, did you hear?

00:18:55.493 --> 00:18:56.394
<v Steve McGhee>You just kinda went, no.

00:18:56.513 --> 00:18:57.084
<v Steve McGhee>And that was it.

00:18:57.084 --> 00:18:58.163
<v Steve McGhee>But now it was, now you would.

00:18:58.608 --> 00:18:59.628
<v Steve McGhee>No, let me look that up.

00:18:59.628 --> 00:19:04.878
<v Steve McGhee>You know, and like, that was a, a, a cultural shift, you know, it was pretty neat to see that on a graph.

00:19:04.969 --> 00:19:05.479
<v Jim Hirschauer>Yeah.

00:19:05.479 --> 00:19:07.759
<v Jim Hirschauer>Amazing times have changed.

00:19:07.759 --> 00:19:11.058
<v Jim Hirschauer>I, I had to explain to my kids the other day what a pager was.

00:19:11.058 --> 00:19:13.489
<v Jim Hirschauer>Like, what the actual device was and how it worked.

00:19:13.489 --> 00:19:14.618
<v Jim Hirschauer>They had no idea what it was.

00:19:15.929 --> 00:19:17.338
<v Steve McGhee>Yeah, try explaining the name too.

00:19:17.338 --> 00:19:19.348
<v Steve McGhee>Like page, like a piece of paper, right.

00:19:19.487 --> 00:19:20.086
<v Steve McGhee>It's kinda weird.

00:19:20.176 --> 00:19:20.326
<v Steve McGhee>Yeah.

00:19:20.326 --> 00:19:21.886
<v Steve McGhee>I'm not really sure how to explain that actually.

00:19:21.977 --> 00:19:22.277
<v Steve McGhee>Yeah.

00:19:23.207 --> 00:19:26.755
<v Jim Hirschauer>Alright, Steve, well listen, thank you for sharing your stories with us.

00:19:26.759 --> 00:19:30.715
<v Jim Hirschauer>Thank you for telling us about r9y.dev it's a great resource.

00:19:30.715 --> 00:19:31.945
<v Jim Hirschauer>So again, call to action.

00:19:31.945 --> 00:19:38.125
<v Jim Hirschauer>If you are interested in it, please jump out there and, and join the project and help the community by sharing your knowledge.

00:19:38.576 --> 00:19:51.780
<v Jim Hirschauer>And to all of our listeners, if you are an SRE or if you're in a related role and you'd like to be a guest on ShipTalk, please go ahead and send an email to podcast@shiptalk.io and we'll get back to you.

00:19:52.590 --> 00:19:53.431
<v Jim Hirschauer>Thanks again, Steve.

00:19:53.490 --> 00:19:54.270
<v Jim Hirschauer>That's all for now.

00:19:54.300 --> 00:19:54.931
<v Jim Hirschauer>Until next time.