Tag Archive for DevOps

TekBytes #1 – CloudSpotting – A New Tech Podcast

CloudSpotting podcast

In the spirit of these new short-form blog posts (see TekBytes: A Blogging Experiment) it’s probably appropriate that I write a quick post on a new short-form podcasting project I am working on; CloudSpotting!

My day job is as a Solutions Architect at Rackspace, where I’m fortunate enough to work for one of the most tech-agnostic global service providers around! A typical week could include me talking about or designing solutions based on VMware, Hyper-V, AWS, Azure, GCP, OpenStack, or even just plain old dedicated servers! Add to that a swathe of security, networking and storage “stuff”, it all adds up to a pretty healthy mix.

CloudSpotting Time!

Myself and my colleague Sai Iyer thought it would be fun to share some of our learnings and experiences in designing and operating customer solutions. What better way (we thought!), than an easy-to-consume 30 minute monthly podcast for architects and engineers… In the first episode, we discuss scaling applications for peak periods and the insane growth of Kubernetes adoption! We already have episodes planned on phishing, cyber kill-chains, encryption, automation & DevOps along with a host of other topics, so watch this space!

Just to be clear though – No Kool aid, just cool tech! 🙂

For those of you who are also regular Open TechCast listeners, this doesn’t mean I am changing lanes in any way, there will just be more of my dulcet tones available on your favourite podcatcher (which may or may not be a good thing!).

Where can I find it?

If you want to catch the first episode, just search for “CloudSpotting” on iTunes or Stitcher, or catch the show on Soundcloud here:

CloudSpotting – Season 1 Ep 1 – Peaking Early – A discussion on Application Scaling

We have also settled on the Twitter hashtag #spottingclouds, as the reverse has lots of great photos, but not so much tech! 🙂cloudspotting-logo-horizontal

7 Reasons Why You Should Read The Phoenix Project

The Phoenix Project

I began reading The Phoenix Project with no preconceptions, other than having been told that it is a great book, and hearing it mentioned many times on Eric Wright‘s GC On Demand podcast.

Written by Gene Kim, Kevin Behr, and George Stafford, it is told as a first-person narrative from the perspective of Bill, a middleware team manager who is promoted into a senior IT management role for a business in jeopardy. Through his experiences and a guiding hand from another key character, together we work through the problems facing the business, the IT department and the individuals within.

The story is told in an easy to read, informal style, and I made quick work of it over the course of just a few days. I really enjoyed it on numerous levels:

  1. I recognised every single character in the book as somebody I have worked with (or indeed currently work with!). I guarantee you will feel the same!
  2. The book was pretty well written, and the story arc itself was compelling. I was really rooting for Bill to succeed in his endeavours! (But did he? You will have to read the book to find out!)
  3. The authors obviously have a great sense of humour! Quotes such as “Show me a dev who isn’t crashing production systems, and I’ll show you one who can’t fog a mirror. Or more likely, is on vacation.” had me laughing out loud on the train in front of other passengers!
  4. The book is approachable and not elitist. You could pick it up as a cable monkey or an IT director (or maybe even a Sales person!!!), and relate to the concepts and methods described.
  5. I learned a huge amount about different methods for handling and improving processes around WIP (Work in Progress), such as the Theory of Constraints or the use of Kanban boards (I am currently testing this with my pre-sales customer workloads using Trello, but I’m told Kanbanize is also very good). Resilience Engineering (think Netflix Simian Army) and numerous other techniques are also covered, along with the overarching “Three Ways” (very Zen!).
  6. I actually picked up a few key tips which could be applied directly to my pre-sales design and requirements gathering workshops with my customer stakeholders.
  7. Finally, it didn’t feel “preachy”, which is always a risk when trying to sell an idea / concept as your main theme and I was initially concerned that the book would be ramming DevOps culture down my neck throughout. This could not be farther from the truth, and the full DevOps concepts do not come into play until the story is almost complete. There are many lessons to be learned throughout the story, which could be applied to any organisation!

The Phoenix Project Cover

Here are another few choice quotes from The Phoenix Project, both humorous and insightful:

“The only thing more dangerous than a developer is a developer conspiring with Security. The two working together gives us means, motive, and opportunity.”

“How can we manage production if we don’t know what the demand, priorities, status of work in process, and resource availability are?”

“You just described ‘technical debt’ that is not being paid down. It comes from taking shortcuts, which may make sense in the short-term. But like financial debt, the compounding interest costs grow over time. If an organization doesn’t pay down its technical debt, every calorie in the organization can be spent just paying interest, in the form of unplanned work.”

“On the other hand, if a resource is ninety percent busy, the wait time is ‘ninety percent divided by ten percent’, or nine hours. In other words, our task would wait in queue nine times longer than if the resource were fifty percent idle.”

In case you hadn’t felt like I was positive enough about The Phoenix Project yet, I would say that this book should be provided as mandatory training to every person working in every IT department today, from the guys plugging in cables to the CIO!

If you do read and enjoy the book, I highly recommend also reading The Goal by Eliyahu M. Goldratt. I was a little surprised, to say the least, that this appears to be a very similar story, following a similar arc and some almost identical characters to The Phoenix Project. That said, I am half way through it at the moment and still thoroughly enjoying it, though I am not too worried about missing the movie version!

The Goal by Eli Goldratt CoverThe Goal delves even deeper into the Theory of Constraints and explains some of the tools we can use to mitigate, bypass or remove constraints in a system. All of these tools and methods can be applied as easily to IT as they can to production lines, which (without stating the bleeding obvious) is exactly the point of The Phoenix Project!

Anyway, if you want to do yourself a favour both in terms of your career development, but also a really compelling story and a thoroughly decent book, you could do a lot worse than spending £5 on the Kindle Edition of The Phoenix Project!

Where To Get Them

For anything technical, I like to buy ebooks these days for both portability and the fact that I wont be chopping down trees needlessly. Both of the above titles are available very inexpensively on Kindle:

And Finally…

Sincerest apologies for one of the most click bait-y blog titles I’ve ever posted! Even worse than this one. Honestly, I feel ashamed!

I’ll get my coat…

VMworld Europe 2015 Day Three Roundup

Day three was quite simply Cloud Native Apps day for me!

I began in the morning with an internal partner briefing with some of the guys in the CNA team. Needless to say this was really interesting and for me it was a total nerdgasm! I did get a real sense that VMware are certainly not planning to get left behind in this new era, in fact far from it as some of their future plans will push the boundaries of what is already bleeding edge today. For the Pratchett fans amongst you, I would suggest that we are indeed living in Interesting Times!

Immediately following this I legged it down to Hall 8 for the CNA panel session, hosted by VMware CTO Joe Baguley, and featuring some regular faces from the London VMUG including Robbie Jerrom and Andy Jenkins. One of the interesting discussions which came up was about DevOps. DevOps is a nice vision, but developers today understand code, point them at a faulty storage array and they will look at you blankly… There is a skills gap there!

If the entire world is expected to become more DevOps focussed, Infrastructure will have to become a hell of a lot easier, or everything will need to just move to the public cloud. The reverse holds true of course, point most infra guys at something much more complex than a PowerShell / Bash / Perl script and you’re asking for trouble.

A true DevOps culture will require people with a very particular set of skills. Skills they have acquired over a very long career. Skills that make them a nightmare for… (ok I’ll stop now!).

Next was a wee session on the performance of Docker on vSphere. This actually turned out to be a stats fest, comparing the relative performance of Docker running on native tin and virtualised. The TLDR for the session was that running docker in a VM provides a minimal overhead to most things. Slightly more impact on network latency than other resources, but depending on the scale out nature of the solution it can actually perform better than native due to optimal NUMA scheduling.

Consider requirements over performance when looking at how to roll out your container platform. If you are running to performance margins of sub 5-10% on any resource then you have under-designed your infrastructure!

The final session of the day (INF5229) was actually probably my favourite of the whole week. If this is released on youtube I recommend you catch it above any other session! Ben Corrie (Lead Engineer on Project Bonneville) took us through a clear and detailed explanation of the differences between running Docker on Linux inside of a standard VM compared to running vSphere Integrated Containers and Photon.

After a quick overview of some of the basics, Ben then proceeded to do several live demos using a one day old build, inside of his Mac Mini test lab (with he appropriate nod given to Mr William Lam of course)! I’m convinced he must have slaughtered many small animals to the gods of the Demos, as the whole thing went off without a hitch! Perhaps Bill Gates could have done with his help back in 1998!

Most importantly, Ben showed that via the use of vSphere Integrated Containers, you are no longer limited to simply containerising Linux, and the same process can be applied to virtually any OS, with his example being MS-DOS running Doom in a container!!! When cloning Windows VMs, the same technology will be used as last year, which enables the ability to generate a new SID and do a domain join almost instantly.

It’s also worth noting that this is not based on the notoriously compromised TPS, and is all new code. Whether that makes it more secure of course, is anyone’s guess! 🙂

MS-DOS Container under Docker and VIC, running Doom!

MS-DOS Container under Docker and VIC, running Doom!

Once the sessions were all done for the day I wandered down to the Solutions Exchange for the annual “Hall Crawl”, where I was admiring Atlantis Computing CTO Ruben Spruijt’s Intel NUC homelab, running in a hyper converged configuration. The only negative I would suggest is that his case is the wrong way round!

IMG_0103

The day finished off with the VMworld party, and a great performance from Faithless on the main stage. As a Brit, this was a great choice, but I did see a few confused faces from many of our EU counterparts, at least until Insomnia started playing!

Day Three QotD

Robbie Jerrom produced Quote of the Day for me on the CNA panel (which was where my Quote of the Event came from, but more of that later). It is very simple but succinct in getting across a relatively complex subject:

A micro service does one thing, really well.

 

VMworld Europe 2014 – Keynote Day Two

Carl Eschenbach (President & COO) opens proceedings with a few minutes recapping the Liquid World and Brave New IT themes from yesterday’s keynote.

First up Carl introduces Martin Heisig from SAP for a bit of a Chinwagâ„¢. They run over 70,000 VMs with a virtualisation rate of over 85%. A key use case for SAP is the 20,000 training users who have access to an on-demand training platform, bringing up and tearing down VMs constantly. Similarly their dev environment, referred to as “The Zoo”, consists of over 30,000 VMs. SAP have reduced deployment times for new platforms from 72 hours to 30 mins, sometimes rebuilding all 30,000 machines in the space of only a month. As Dave Simpson tweeted, “that’s some big numbers right there”! Of course most customers are nowhere near this size, but it definitely gives you ideas as to the kind of things achievable on the platform.

Carl Eschenbach Opens Day Two Keynote

Carl Eschenbach Opens Day Two Keynote

SAP recently certified SAP HANA on vSphere with up to 1TB of RAM. That’s pretty decent scale! Martin mentions vCloud Air in passing. I wonder how long it will be before we get HANAaaS on vCloud Air?

Vodafone’s Tom Stockwell (Head of Hosting Product Management) represents the next customer use case, with their new Hybrid Cloud solution for Enterprises. Vodafone chose VMware in part due to the user community supporting their software. The acquisitive VMware strategy with companies like Nicira and Dynamic Ops was also a key element. Their hybrid platform is based on a number of technologies including NSX, vCD and VCAC.

Summarising the last 30 minutes, Carl states that the SDDC is the Architecture for the Hybrid Cloud.

Next on stage is Raghu Raghuram (Executive VP, SDDC). He starts by a current status on VSAN, NSX and vRealize Suite. All you need is a bunch of commodity servers now, and you “pour” the VMware management software on top.

Raghu invites “Chief Powerpoint Officer” Ben Fathi (CTO) on stage to talk about EVO:RAIL and it’s 15 minute deployment time. For more info on EVO:RAIL see my previous post with links to loads of great official and community content. He goes on to talk about EVO:RACK which includes the entire vCloud Suite, VSAN and NSX included, and has a build time from about 2 hours.

Ben Fathi, CTO

Ben Fathi, EVO:RAIL 15 Minute Deployment

Raghu now addresses the subject of vendor lock in, with VMware’s answer being the use of VIO (VMware Integrated OpenStack). Ben demos how VIO deployment is integrated into the vSphere Web Client, which lets you manage all the common operational elements for OpenStack (e.g. Nova, Glance etc). The integration with vRealize Operations Manager looks pretty cool, letting you drill down into the tenants on the OpenStack platform, among other things.

Raghu then starts to discuss some of the vSphere Beta improvements, starting with SMPFT. This allows you to protect VMs with up to 4vCPUs. This will be great for highly critical services which may not have application layer HA. The element many people would want to protect most is vCenter, but I have heard mixed messaging as to whether this is actually recommended. VMware have some announcements coming around providing HA for vCenter (potentially natively).

Ben’s is back on the Powerpoint clicker, talking about Cloud-Native Applications, typically fault tolerant applications built across containers. Docker augmented the standard Linux LXC container with a simplified interface for building, deploying and transporting these containers. VMware believe you can get the best of both worlds running containers inside VMs, so you can augment your platforms with the flexibility of the VMware ecosystem around things like isolation, ops management, SDN through NSX, etc. VMware have also been working with Google to ensure Kubernetes integration with VMware. VMware have published a blog this morning comparing containers on bare metal vs using VMware and found the typical overhead to be 3% or less.

vRealize Code Stream is designed to help with the release process from dev to prod. Ben demos vRealize Automation’s “Release Automation” feature which lets you drill into a pipeline of functional testing, system integration testing, staging and prod, and the results for each stage of the development lifecycle.

Automation as a Service (vRealize Air Automation) and Compliance as a Service (vRealize Air Compliance) are now available to provide services across multiple clouds, including AWS. These are the first two in what will be a series of SaaS offerings under the vRealize banner.

Next, Policy Management, and a demo on the vRealize Automation Center. A set of networking, security and storage policies have been associated to a demo application. Based on the attachment of the policy blueprints, the VMs under the application will be remediated to meet the applied policy. An example of this would be to apply a Silver storage policy which happens to have a certain performance profile and a number of failures to tolerate (how many copies of the data on VSAN). Once these policies are in place (which will take some work in your environment to define), you can simply then assign apps and VMs to policies, and consumers don’t need to worry about the details on how this works.

NSX Microsegmentation is covered next. This is a brilliant technology as it allows you to effectively firewall VMs within the same security zone. Working for a service provider, this opens up many more options on how we architect multitenant and public cloud solutions. It’s definitely a driver for NSX adoption, even if you ignore all of the other features!

vCloud Air RaaS

vCloud Air RaaS

Simone Brunozzi (VP and Chief Technologist, Hybrid Cloud) comes on to demo an interesting use of APIs; sending alerts to Google Glass! He then demos extending an application out into vCloud Air. This was done by extending the L2 network out to vCloud Air using VXLAN and NSX. Simone confirms that one of the most popular vCloud Air products today is DR-as-a-Service, based on vSphere Replication.

So overall, no real announcements in todays keynote, mainly just reiteration of messaging and focus on demoing the path from a standard virtual platform, to an automated, orchestrated SDDC, with vCloud Air burstability and DR! If you have time to, and want to see these demos, I would recommend watching the keynote replay and jumping to about 30 minutes-ish, when this section starts.

The VMware Vision

The VMware Vision

%d bloggers like this: