LocalData

Tiering to Public Cloud
How to think about and manage tiering from the private data center to public cloud.
   7 years ago
#localdataManaging Billions of FilesWhat kinds of data management & backup challenges creep up when your NAS gets to billions of files?
   7 years ago
#LocalDataScale-out ArchitecturesCurrent state of scale-out technologies and where we can go from here.
John Furrier
Q4: What data types are involved in hybrid cloud and cloud tiering? Server backups? SQL databases? NoSQL databases? Unstructured data?
jeff dinisco
structured data a good fit with services like AWS RDS, unstructured a good fit when app can leverage or tier to object
Stephen Pao
@datosIO has an interesting backup app for NoSQL database to cloud and S3 API.
John Furrier
@steve_pao This is very interesting bc it's hard for me at least to figure out which one is growing the fastest bc all are relevant
Chris Dagdigian
vast piles of unstructured data mostly in my world
Stephen Pao
Our focus at @IgneousIO has been helping folks with billions of files.
Andrew Miller
Depending on the customer, see all of them...but largely backups and the archive use case - long term retention where don't want to deal with tape.
Keith Townsend - Light will overcome darkness
All of they above. Archive data has elements of all the data types. However, I see companies focused on parts of the distributed application. Look at ML/AI. You'd never do it in the DC. What type of data is ML & AI in the cloud?
Stephen Pao
Unstructured data is just a bigger % of data. 79% according to IDC and validated by customers.
Andrew Miller
Getting past "checkbox" regulation compliance...with tapes after 5 years who knows if can really restore much less move to new tape media (new LTO formats!).
John Furrier
Tape use case sounds compelling for moving to cloud
Andrew Miller
And lots of test/dev which defies any data type categorization...whatever is inside the "VM container" if you will.
jeff dinisco
file data still a huge challenge on cost, 1PB of NFS in AWS is $65K/month, can show ROI on that with on-prem system in < 1 year
Keith Townsend - Light will overcome darkness
If I decide to deploy HANA in AWS based on elastic compute then it will be structured data. If I want to use cheap and deep storage for AI/ML then it may be unstructured. It gets to the value prop of public cloud for your hybrid cloud use case.
Andrew Miller
@dinisco we've had cloud file gateways around for a while but adoption still seems to be mixed...people get nervous about the potential lack of performance predictability for "stubbed data"
John Furrier
Followup Question: is this an operational efficiency issue or re-platforming motivation?
Andrew Miller
@andriven with using cloud for archive it's still "on disk" and if done right both can keep a catalog plus selectively restore (not pull back a 100 GB vmdk when just need a 100 KB file)
Stephen Pao
Definitely relevancy in all data types. However, noSQL and unstructured seem to growing faster than SQL.
jeff dinisco
@andriven yup, have yet to see one takeoff, avere, nasuni, you name it, thought isilon cloud pools would get more traction, haven't seen it
Andrew Miller
there's hope that using cloud for certain data types will avoid "data migration" due to changing underlying physical media types (new LTO versions, storage array upgrades)
Keith Townsend - Light will overcome darkness
The hard question - Do you need an hybrid cloud data strategy or better yet a global hybrid cloud file system. @dfloyer talk about this concept a lot. I tend to side with him that enterprise need to think through the distributed hybrid FS.
Andrew Miller
@andriven I had customers hoping that with Isilon or VPLEX or other tech (none of them bad per se) but often didn't work out come the refresh cycle.
Stephen Pao
Interesting to see what #gcp #cloudspanner will do to affect hybrid cloud SQL adoption.
Andrew Miller
often cost avoidance...storage is still a big line item but gets more scrutiny every budget cycle due to its size. You have to have options if get pressed harder than last year's budget cycle.
Stephen Pao
@dinisco Problem with stuff like Isilon Cloudpools is that the user experience isn't good when you try to "transparently" stub.
Chris Harney
It will be a long time before local data disappears.
Chris Harney
Companies don't want Cloud vendor lock in. They want their data to be portable
Stephen Pao
@csharney We have also heard the concerns of cloud vendor lock-in.
Chris Harney
@CTOAdvisor agree with mission critical apps, but what about commodity apps O365
Chris Harney
@dinisco Agreed, most of the CI vendors are making it ez
Chris Harney
@steve_pao @chris_dag is there a bigger opportunity for hosted rather than cloud?
Chris Harney
yes, after you move all in, how do you get that data out and move it some where else or what happens when you are given a 30 day notice
Keith Townsend - Light will overcome darkness
@csharney Seems like a no brainer at this point other than the licensing fight.
John Furrier
What are the top changes driving use of hybrid cloud?

What are the top changes driving use of hybrid cloud?

John Furrier
Q3: What applications are driving hybrid cloud use cases? Backup? Archival? Cloud bursting?
Stephen Pao
Cloud bursting is definitely one. Elastic compute in cloud, long term storage in datacenter.
Chris Dagdigian
federated ID management across multi-organizations , bursting, backup and cost reduction (by moving systems out of managed service provider claws)
jeff dinisco
just working with a VFX house who had their busiest pilot season ever, bought zero new gear, burst to cloud for everything
Andrew Miller
Absolutely Archive with Backup a close second - are seeing lots of customers replace tape with cloud archives. Cloud Bursting is great in theory but still really hard in practice given the weight of data and LAN vs. WAN speeds.
Andrew Miller
Also seeing test/dev drive it...spot pricing on AWS can even help there. This works given an underlying mechanism to move data around and leverage EC2/Azure instances on the fly.
Stephen Pao
Backup is an easy way to get started with #hybridcloud. On-premises secondary copies, with tiering to cloud.
jeff dinisco
@andriven agree cloud bursting is a huge challenge, also think if you can make it happen, it provides the most obvious value
Andrew Miller
There's dreams around DR but still automation/orchestration to be worked out there - it's variable across the space how much is baked out there.
John Furrier
All three but bursting has broader use cases that drive variable revenue. backup and archival must be standard so it's a hard decision different both valuable use cases
Keith Townsend - Light will overcome darkness
I think archive and backup is a dominant use case. I'm not sure for how long. Enterprises will figure out Object storage and offer a comparable cost to cloud based storage.
Stephen Pao
Archive in hybrid cloud is real. Just needs to be paired with analytics to understand what might need to be retrieved.
Andrew Miller
@dinisco Absolutely agree - there's huge potential value/market there that no one has truly unlocked yet.
Keith Townsend - Light will overcome darkness
But you have to think beyond the IaaS layer. SAP is a good example. Cloud hosted enterprise apps make sense as cloud providers show greater ability to support the app than the enterprise. SAP in the cloud, bolt on in the private DC.
Chris Dagdigian
I'm starting to see an interesting edge case where people arbitrage against discounted bandwidth from the cloud providers. For instance US-Europe connectivity between branch offices may be cheaper routed through an AWS transit VPC
Andrew Miller
@CTOAdvisor There are even some providers (Cerner for instance) that will host just not just their own app but specific other apps that integrate closely or need to be at LAN speeds to the core app.
Stuart Miniman
@steve_pao cloud-bursting? please explain/defend, because moving data is challenging
Keith Townsend - Light will overcome darkness
Obviously Saleforce dominates the conversation. How many data center managers are building operations based on SF integration?
jeff dinisco
@CTOAdvisor totally agree, very ez to demonstrate the value of SaaS that works, IaaS is harder
Stephen Pao
@CTOAdvisor Agree with integrating IaaS layer with apps. Azure get more interesting because of Azure AD + O365.
Keith Townsend - Light will overcome darkness
@andriven All of the serious providers are offering colocation of the ecosystem of enterprise apps.
Andrew Miller
@CTOAdvisor Hosted @Epic hosted @cerner - there's a long list...
Stephen Pao
@CTOAdvisor Yes. Amazing how even condo HOA's use prem.force.com!
John Furrier
@CTOAdvisor great point about vertical cloud bc that speaks to hybrid use cases expanding imho
Keith Townsend - Light will overcome darkness
IaaS becomes an enablement for legacy software providers to remain relevant. Elastic compute allows for a business model where they run software they write for the customer with heavy capital investment.
John Furrier
@CTOAdvisor I would add to that also by saying moving from large capital investments to operational model key transition factor