futureofstorage

Future of Storage
Software defined storage at petabyte scale - how will storage change in the next five years?
Leo Leung
Third hypothesis - storage software (not management, not replication, not backup), but managing the data like software locked inside the array, will be $5B market https://www.crowdcha...

Chris M Evans
That's a big number. I'd like to see us get to a better definition of SDS - too many non-SDS solutions out there.
Leo Leung
@chrismevans - we're talking just the software, not the gigantic Taiwanese industry that is emerging from the shadows.
Sheryl Koenigsberg
@chrismevans agreed it's overused, but @lleung's descrip of SDS as "managing data like software locked inside the array" is pretty good
Jay Cuthrell jay@cuthrell.com +1-415-763-8343
and yet... $5B seems low if you consider TAM across effective lifecycle of existing storage markets and projections for scale requirements going forward
Stuart Miniman
If SDS also shifts the hw to white box, then the $5B it is likely shifting/replacing at least $10-15B of traditional storage
Chris M Evans
@stu I don't think it all has to be white box; just decouple hardware performance from storage "object" performance.
Kasia Lorenc
@chrismevans "I'd like to see us get to a better definition of SDS" --> +1 seems each company has their own definition of SDS
Stuart Miniman
OK - what do we need for "real" SDS? sw that is independent of hw, simple deployment, 1-click scalability, what else?
Chris M Evans
I feel better placed than say 2 years ago to create a definition, I see more substance around what performance decoupling means and how we should expect storage to be "driven".
Leo Leung
@stu abstraction from the underlying hardware for massive scale effects like protection, performance, self-healing, continuous uptime.
Jérôme Lecat
@chrismevans SDS definition 1) storage infrastructure can be configured via API AND 2) it is delivered in SOFTWARE which can be deployed on STANDARD servers.
Chris M Evans
@stu Not quite - storage object performance that is separated from the hardware e.g. LUN/volume etc gets 1000 IOPS irrespective of hardware speed etc.
Chris M Evans
@jlecat 100% on the API piece. Management (provisioning etc) driven by API not a sysadmin. But that API needs to be (a) rich (b) native, not a false wrapper around an old product.
Jérôme Lecat
@chrismevans The $5B is for the software portion, if you ask how much value of the storage industry is going to shift, it is more $30B or $40B, moving from dedicated HW to standard servers and margin pool reduction (means cheaper for customers!)
Storage Godfather (HPEStorageGuy)
kasia @chrismevans Vendors making up their own definition for a storage trend is nothing new: storage virtualization, ILM (remember that one), SDS. BTW, what happened to the ILM company?
Leo Leung
@chrismevans - FOP - it's any hardware - super dense if you like (approaching 100 drives in a 4U), super fast if you like, super cheap if you like
Jérôme Lecat
@chrismevans Yes Chris on API, my point is SDS needs to be SOFTWARE. HW product that call themselves SDS are just SDS-washing....
Stuart Miniman
@jlecat if $5B shifts $30-40B, is there any way that the current large players can "win" at such different economics?
Leo Leung
@chrismevans - false wrapper around old product - stop talking about JJ Abrams like that
Leo Leung
@HPStorageGuy - ILM... wasn't that Quantum?
Jérôme Lecat
@stu Some large players will adpat quickly ("elephant can dance") others will just die (in the form of merger probably)
Storage Godfather (HPEStorageGuy)
I think every storage vendor talked about it but the guys in Hopkinton made it their corporate slogan; can't remember if it was alongside "Where information lives" or before it.
Storage Godfather (HPEStorageGuy)
And much to my embarrassment, I was marketing employee number 2 at HP. I learned a lot from that experience.
Chris M Evans
@HPStorageGuy I seem to remember Veritas talking ILM around 1996.
Scott Davis
@jlecat @stu The impact of these disruptions in storage market of all these trends will be as large as the VMware/virtualization driven disruption of server & processor vendors.
Leo Leung
@stu - it's like taxis vs. uber, kmart vs. amazon, nokia vs. android, ...
Storage Godfather (HPEStorageGuy)
@chrismevans They started with HSM. They may have been the first to use it, don't remember now. I know Compaq was using some other acronym and we changed it to ILM post merger.
Storage Godfather (HPEStorageGuy)
Totally off topic, but some taxi twitter account in Barcelona tweeted me that Uber is illegal in Spain. So don't take an Uber ride in Spain or risk jail time! LOL
John Furrier
Jeff Kelly @wikibon asked customers if they are using cloud for #bigdata #strataconf what do you guys think ?? https://www.crowdcha...

John Furrier
bigdata and #IoT will drive more storage and cloud usage the consumptions patterns are so clear
Rob Peglar
no question whatsoever. prime driver of the capacity side. Machine, sensor-generated data - exploding, with good reason.
Stuart Miniman
#openstack Juno was just released - does Swift offer a new opportunity for object storage to finally gain traction (the cloud guys are sure using object)
Leo Leung
- ok, fine, I'll say it. object storage is also an enabler, not a market.
Leo Leung
the smart guys are all using object under the covers. they just don't talk about it. they talk about the problems they solve.
Jay Cuthrell jay@cuthrell.com +1-415-763-8343
the only 'eventual consistency' is that of the market -- the technology consideration itself is secondary
John Furrier
Openstack is going thru it's growing pains of consolidation
Andrew Reichman
@lleung yeah, the buyer market doesn't seem to have interest in understanding object storage as a market, but does want the attributes it can provide
Leo Leung
@reichmanIT - folks can keep talking about object storage until they're blue in the face. I pass.
Rob Peglar
@lleung object is too broad a term. Really a simple taxonomy: one type of persistent store is a fixed identified (an LBA) mapping to a fixed collection of bytes (a block)
Chris M Evans
@reichmanIT Perhaps there's a consumption issue; customers struggle to understand how to consume object when application/interface/programming work is involved.
Scott Davis
@lleung Object storage - IMHO real underlying innovation is monolithic Get/Put access interface vs. Posix R/W interface of days past.
Rob Peglar
@lleung the other type is a variable identifier (name, URI) mapped to a variable collection of bytes (an object)
Rob Peglar
@lleung file is really a subset of object, with certain app-facing behavior (e.g. POSIX semantics) and persistency behavior (immediate)
Leo Leung
@shd_9 - somewhere seagate kinetic guys are smiling
Sheryl Koenigsberg
@chrismevans totally - when that isn't abstracted from the customer, the complexity is overwhelming and they just go buy another ultra-dense array.
Leo Leung
@peglarr - it takes a file guy to really talk object ;)
Chris M Evans
@peglarr and perhaps other things like locking, security etc
Andrew Reichman
@chrismevans storage buyers don't typically get down with heavy programming, and programmers don't really think about infrastructure- devops MIGHT be the people shift that allows object systems to get customization they need and increase adoption
Rob Peglar
@chrismevans of course. but all the bloviating over 'object is new & cool' is silly. It has always been cool, but it is not new. How one implements it - as you said, devil in the details.
Sheryl Koenigsberg
@peglarr and the combo of object storage with content addressability is where other value comes out - scalability, load balancing, etc.
Leo Leung
@peglarr object goes back to lustre days (and i'm sure you'll tell me even earlier). but it's still not a market.
Rob Peglar
@lleung I will tell you that, yes :-) Way further back than that. 1960's. Channel-attached h/w with object-oriented access methods.
Leo Leung
@peglarr - we need to have coffee sometime #storagenerdsunite