Tag Archive for VVOLs

Software Defined Storage Virtualisation – How useful is that then?

Ignoring the buzzword bingo post title, storage virtualisation is not a new thing (and for my American cousins, yes, it should be spelt with an s! 🙂 ).

NetApp have for example been doing a V-Series controller for many years which could virtualise pretty much any storage you stick in the back of it. It would then present it as NFS and layer on all of the standard ONTAP features.

The big advantage then was that you can use the features which might otherwise be missing from your primary or secondary storage tiers, as well as being able to mix and match different tiers of storage from the same platform.

In a previous role, we had an annual process to full backup and restore a 65TB Oracle database from one site to another over a rather slow link, using an ageing VTL that could just about cope with incrementals and not much more on a day to day basis. End to end this process took a month!

Then one year we came up with a plan to used virtualised NFS storage to do compressed RMAN backups, replicate the data using snap mirror and restore on the other side. It took us 3 days; an order of magnitude improvement!

That was 4 years ago, when the quantity of data globally was about 4x less than it is now; the problem of data inertia is only going to get worse as the worlds storage consumption doubles roughly every two years!

What businesses need is the flexibility to use a heterogeneous pool of storage of different tiers and vendors in different locations to move our data around as required to meet our current IT strategy, without having to change paths to data or take downtime (especially on non virtualised workloads which don’t have the benefits of Storage vMotion etc). These tiers need to provide the consistent performance defined by individual application requirements.

It’s for this reason that I was really interested in the presentation from Primary Data at Storage Field Day 8. They were founded just two years ago, came out of stealth at VMworld 2015, and plan to go GA with their first product in less than a month’s time. They also have some big technical guns in the form of their Chief Scientist, the inimitable Steve Wozniak!

One of the limitations of the system I used in the past was that it was ultimately a physical appliance, with all the usual drawbacks thereof. Primary Data are providing the power to abstract data services based on software only, presented in the most appropriate format for the workload at hand (e.g. for vSphere, Windows, Linux etc), so issues with data gravity and inertia are effectively mitigated. I immediately see three big benefits:

  • Not only can we decouple the physical location of the data from it’s logical representation and therefore move that data at will, we can also very quickly take advantage of emerging storage technologies such as VVOLs.
    Some companies who shall remain nameless (and happen to have just been bought by a four letter competitor) won’t have support for VVOLs for up to another 12 months on some of their products, but with the “shim” layer of storage virtualisation from Primary Data, we could do it today on virtually any storage platform whether it is VVOL compliant or not. Now that is cool!
  • By virtualising the data plane and effectively using the underlying storage as object storage / chains of blocks, they enable additional data services which may either not be included with the current storage, or may be an expensive add-on license. A perfect example of this is sync and async replication between heterogenous devices.
    Perhaps then you could spend the bulk of your budget on fast and expensive storage in your primary DC from vendor A, then replicate to your DR site asynchronously onto cheaper storage from vendor B, or even a hyper-converged storage environment using all local server media. The possibilities are broad to say the least!
  • The inclusion of policy based Quality of Service from day one. In Primary Data parlance, they call them SLOs – Service Level Objectives for applications with specific IOPS, latency etc.
    QoS does not even exist as a concept on many recent storage devices, much to the chagrin of many service providers for example, so being able to retrofit it would protect the ROI on existing spend whilst keeping the platform services up to date.

There are however still a few elements which to me are not yet perfect. Access to SMB requires a filter driver in Windows in front of the SMB client, so the client thinks it’s talking to an SMB server but it’s actually going via the control plane to route the data to the physical block chains. A bit of a pain to retrofit to any large legacy environment.

vSphere appears to be a first class tenant in the Primary Data solution, with VASA and NFS-VAAI supported out of the “virtual” box, however it would be nice to have Primary Data as a VASA Client too, so it could read and then surface all capabilities from the underlying storage straight through to the vSphere hosts.

You will still have to do some basic administration on your storage back end to present it through to Primary Data before you can start carving it up in their “Single Pane of Glass”. If they were to create array plugins which would allow you to remote manage many common arrays this would really make that SPoG shine! (Yes, I have a feverish unwavering objection to saying that acronym!)

I will certainly be keeping an eye on Primary Data as they come to market. Their initial offering would have solved a number of issues for me in previous roles if it had been available a few years earlier, and I can definitely see opportunities where it would work well in my current infrastructure. I guess it now becomes up to the market to decide whether they see the benefits too!

Further Reading
Some of the other SFD8 delegates have their own takes on the presentation we saw. Check them out here:

Ray Lucchesi – Primary data’s path to better data storage presented at SFD8

Dan Frith – Primary Data  Because we all want our storage to do well

Disclaimer/Disclosure: My flights, accommodation, meals, etc, at Storage Field Day 8 were provided by Tech Field Day, but there was no expectation or request for me to write about any of the vendors products or services and I was not compensated in any way for my time at the event.

VMworld Europe 2014 – Day Three Roundup and Closing Thoughts

Well that’s it, its all over! Having never been to a VMworld prior to this week, I have to say the event does indeed live up to the hype!

Day Three
Day three started pretty subdued, not only from the point of view of the attendees, but a couple of the presenters as well; it definitely seems people had a good time at the VMworld party the night before!

Mixing in a bit of session time with a visit to the solution exchange and a bit of Hands on Labbing was the order of the day. I did have a quite amusing chat with one of the guys working on the Oracle stand. He said that the vast majority of people who had spoken to him had berated them about licensing and support in virtual environments, along with asking why they were advertising OVM at a VMware event. I think the poor guy was not far from the end of his tether!

My last role was at Oracle, so I can fully feel the pain around the license questions as it was almost always the first thing people asked me about when I told them I worked there! It doesn’t help the fact that the latest licensing hard vs soft partitioning guide is still only from 2011!

Oracle Tastiness!

Oracle Tastiness!

One thing I will be very interested to see is what becomes the defacto stance on how many hosts you must license once share-nothing VMotion between clusters, vCenters and DCs comes along in vSphere 6. It begs the question whether any Oracle auditor might have the audacity to suggest that you need to license all hosts in all DCs?

This of course assumes that the specific auditor will not accept mandatory cluster affinity as per Richard’s comments here: http://www.licenseconsulting.eu/vmworld-tv-oracle-on-licensing-vmware-virtualized-environments-updated/

Hopefully in this scenario, common sense would prevail, but that’s deep enough down that rabbit hole for now! 🙂

The sessions I managed to attend on day 3 were as follows:

STO2521 – VSAN Best Practices
Rawlinson Rivera & Kiran Madnani provided a very useful overview of a number of example use cases and how to apply different VSAN configurations. As this was covering multiple use cases there was some repetition of content, but not so far as to be distracting. Key takeaway, when it comes to disk groups, more = better!

VSAN Use Cases

VSAN Use Cases

STO2496 – Storage Best Practices for Next-Gen Storage Platforms
Being a bit of a storage geek, for me this was one of the best sessions of the entire week. Not only entertaining, but the quantity and quality of the information was intense to say the least! A couple of key areas which they covered were around benchmarking of storage (not just using the standard 4k 100% Read profiles which vendors use to produce stats for their marketing material).

Absurd Testing at the Chad & Vaughn Show

Absurd Testing at the Chad & Vaughn Show

TEX1985 – Lessons Learned from a Real Life VSAN POC at Trend Micro
It’s always interesting to see how real customers found the use of a technology. Arsenio Mateos from Trend Micro was not particularly detailed in any specific issues they experienced, as he concentrated more on the decisions behind the solution, and the benefits it broupght them.  Cormac on the other hand was very open and when into some detail as to some of the configuration issues and bugs which were common among other customer deployments. I was also the grateful recipient of a signed copy of the book Cormac co-wrote with Duncan Epping.

EUC2027 – Characterise Performance in Horizon 6
My final session rounded out the end of the day. I don’t currently use or design VMware Horizon View in my current role, when most commonly customers have managed RDS or Citrix XenApp farms. I mainly went to the session to see the VMware approach to sizing the new session host desktops on Horizon 6. Unsurprisingly it turns out that they come out with very similar ratios and guidelines as Citrix do (shocking)!  The really interesting takeaway for me from this session was the VMware View Planner tool, which looked like it could definitely have some value in load testing and gauging the requirements for customers with or without VMware View.

By this time it was 4.30, and everything had closed. If I’m honest I was a bit gutted as I had believed the HoLs were going to be open until 6. I was most of the way through my NSX lab, so I guess I’ll just have to finish it up from home!

After the event, my remaining colleagues and I wandered into town to check out the Sagrada Familia, and grab some light refreshments + tasty tapas.

Sagrada Familia

Sagrada Familia

Wrapping Up
Session Surveys – The one thing I didn’t actually get done at the show (but I plan to fill in this weekend), was the session surveys. I understand these are as valuable to the speakers as to VMware, so I have no issues spending a bit of time giving feedback. If you haven’t already, then I suggest you do, especially if you want to see the same guys & gals back next year!

If I were to be able to make any suggestions to VMware for next year they would be few and far between:

  • Keep the hang space and hands on labs and/or solution exchange open until 6pm on day 3. It’s minimal extra effort but it will allow attendees to make the absolute most of the event and facilities, especially those who don’t have an early flight back the same day.
  • Make the information on getting to the event a bit easier to find on the VMworld.com site (rather than burying it in the FAQs)
  • Free Segways or (or foot massages) for all attendees!

I enjoyed a wander or two around the solution hall, but for me the best and most useful elements of the entire week were the breakout sessions (and being there live giving me the opportunity to ask questions at the end), and networking with others both in the event and at the vendor sponsored evenings.

As a side note, I will probably be creating PDFs of all of my notes and posting these on the blog imminently for anyone who may find them useful.

So finally a big thank you to everyone who made VMworld a success; the organisers, the vendors, the speakers, the HoL team and all of the people with whom I had the such interesting and entertaining discussions!

Key Stats
Number of days attended4 (including partner day)
Blog articles published6
Blogs word count
6,516
Live breakout / HoL sessions attended14
Total session notes word count10,412
Average notes word count per session743
Hands on Labs Completed2
Number of steps walkedNo idea as I don’t have a Fitbit!
Total hours slept in 4 nights< 24
Contacts madeMany
Knowledge gainedIncalculable

VMworld Europe 2014 – Day One/Two Roundup

It’s now quite late on Wednesday night / Thursday morning and having just returned from the VMworld party, I thought it was worth jotting down a few thoughts about the last two days.

We started with the opening keynote, which I had decided to attempt to blog “as a challenge”. Wow, is it hard work or what? For those of you who read the live blogs from guys like Scott Lowe, Barry Coombs with his Doodles etc, this has given me an even more massive appreciation for what they do. Being able to take in, process and document that level of information is just incredibly hard, never mind adding commentary and analysis on top and live publishing it as they go! I wrote most of my content live, but then took at least an hour later in the day to proof read it, correct it, etc. I honestly don’t know how they do it?!

VMworld Keynote

VMworld Keynote

After the keynote I was really keen to get stuck into some breakout sessions:

INF1349 SDDC – vCloud Suite Roadmap
This one was more focused on the new features in vSphere than anything else, a few interesting nuggets though. I will probably post some of the notes up soon, though much of it is already in the public domain anyway.

STO2554 – HP VVOLs presentation
Great start by VMware but then when HP came on and I was hoping they would do a demo, they pretty much did a marketing exercise instead (not vendor bashing at all btw, I use 3PAR stuff in my designs all the time, but I think they missed a trick there as I know some competitors showed off their tech actually working)

HBC1533 – How to Build a Hybrid Cloud (vCloud Air intro and architecture tips)
Great session by Dave Hill of vCHS (correction, vCloud Air). Including some architectural tips. Worth a watch when it is available online at vmworld.com.

The VMware Vision

The VMware Vision

I then spent a bit of time in the bloggers lounge updating some bits and pieces and catching up with some of the guys there.

My final act of the main part of the day was to hit the Solution Exchange for a bit of a wander. I mainly concentrated my short time on EVO:RAIL, where I happened to bump into none other than Paul Meehan (@paulpmeehan), with whom I have had many a twitter chat but never actually had the pleasure of a tweet up! Following that I spent some time at the Veeam stand, discussing the best practices for Veeam infrastructure design along with some of our more interesting use cases and requirements.

After the main event, myself and a colleague headed over to the service provider reception. Wow, did we turn up under dressed or what?! It was one of those awkward moments when your realise that you are one of the few people in the room who forgot to bring a suit! On the plus side there was some really great discussion around vCD, VCAC etc and much learned from the evening, so well worth it.

I then headed over to the vExpert event at Ocaña to soak up some of the atmosphere and knowledge from some of the most intelligent and influential people I know! There were of course some vRoyalty including VCDX001 (John Arrasjid), VCDX #44 Willy Lee, and many more.

After that a couple of hours were spent at the Veeam party, after which I though it best to head back to my hotel to make sure I don’t wake up tomorrow with a hangover!

Veeam Party

Veeam Party

Day Two
I started Day Two at the keynote again. Today’s one wasn’t really about announcements as much as it was about reiterating the main marketing messages and demoing some of the key VMware products such as NSX and the vRealize Suite. It did remind me just ho much stuff I need to find the time to play with in the home lab! Once again gave it a go at blogging the keynote content for later consumption…

The rest of the day was mainly focussed on breakout sessions. The mains ones I headed to were:

INF1192 – Design advice for SMEs – Ask the experts
Being focussed on the UK mid-market, my organisation spends a lot of time trying to understand the requirements of medium sized businesses. It was great to see some familiar faces in Paul McSharry and Alasdair Cooke, leading the panel discussion.

SMB Design Discussion Panel

SMB Design Discussion Panel

NET1468 – A tale of two perspectives – IT Ops with NSX
This was a funny one as it was Scott Lowe and Brad Hedlund flipping in and out of character as server and network guys respectively. Plenty of great lessons to be learned, with a focus around RBAC, Visibility, Monitoring and Troubleshooting in NSX.

Scott Lowe and Brad Hedlund "In Character"

Scott Lowe and Brad Hedlund “In Character”

NET1589 – Reference Design for SDDC with NSX & vSphere
Nimesh Desai presented one of the most amusing, and most deep dive sessions of the day (for me). Absolutely brilliant content, but afterwards I felt like I needed to hide in a dark room for an hour or two and let my brain catch up! I was lined up to head to another NSX session after this but I will catch it online next week instead.

NSX Design Options

NSX Design Options

After the NSX session I headed down to the blogger area and caught up with some of the chaps. Craig Kilborn kindly shared his VCDX experience with me, along with some of his design. The level of detail and effort you need to go to to even get the opportunity to defend a VCDX design is immense, and it really drove home to me the value of the process. I’m not sure my wife and kids are ready for me to disappear for the next 6 months in order for me to attempt it!

STO2997-SPO – The vExpert Storage Game Show EMEA
Jonathan Medd (famous for automating anything that moves!), and I headed along to the vExpert Storage Game Show, organised by John Mark Troyer and Amy Lewis (in much the same way an asylum is organised by the guards!). It was bedlam, but great fun was had by all, whilst at the same time providing an interesting and engaging atmosphere. If Pure decide to run this again next year I will definitely be attending, given half a chance!

SDDC1176 – Ask the Expert vBloggers
Rounding out the day was an excellent panel session with some of the most well known VMware bloggers / evangelists. Discussions ranged from stretched cluster deign, to book authoring, to VIO, and many topics in between. Quote of the session was from Chad Sakac… “Innovate or Die”.

Ask the Expert vBloggers

Ask the Expert vBloggers

With the sun heading for the horizon, myself and a couple of my colleagues caught the end of the Hall Crawl, followed by the awesome VMworld party. Simple Minds were excellent and the crowd really seemed to get into it. I managed to bump into a few more community people in the cavernous space which is Hall 6 at the Barcelona Fira Gran Via, and finally I grabbed a cab back to the hotel to get an early night (early meaning 1.30am it seems!).

Overall, a thoughrougly entertaining, informative and educational couple of days. Tomorrow the main plan is to hit a number of key sessions including the Chad and Vaughn annual roadshow, then in the afternoon stick around in the Hands on Labs until we get thrown out at closing time!

Until then… sleep!

%d bloggers like this: