localdata

Data Management
Data Management: Protection, Movement, Search & Discovery, Usage
   7 years ago
#LocalDataScale-out ArchitecturesCurrent state of scale-out technologies and where we can go from here.
John Furrier
Q4: How do you see protection of data across these different sources? Single “all-in-one” solutions? Portfolios of Best-of-breed solutions for VM’s, databases, NoSQL, Hadoop, files, etc.?
storageswiss
Everyone will look for all-in-one but end up with a portfolio
Chris Dagdigian
no single method without a single data store. Our protection methods are as scattered as our data
Andrew Miller
Protection has to be more policy-based - call it imperative vs. declarative. Have systems smart enough that you can tell them the desired end state in business relevant terms and they ensure policy compliance.
jeff dinisco
fit for purpose has taken over, platforms have become ez enough to manage, no longer necessary to make a platform do something it's not truly built for because that's what you've already invested or have a skill set in
Andrew Miller
To be truly holistic, it's likely a portfolio approach simply due to all the different levels in the stack right now. Some companies have grand aspirations there (mine included) but there's so many potential data layers to handle.
Peter Smails
Evolving from infrastructure centric (LUN/VM) to app-centric. That's how you eliminate the silos.
Andrew Miller
The challenge becomes keeping operational simplicity as expand to solve more and more business problems (aka handle more data sources). That's a HARD challenge.
Christian Smith
The world of motherhood and apple pie - a single solution that does everything. We could always go back to mainframes.
John Furrier
@csislive Wait isn't the cloud a software mainframe :-)
Andrew Miller
for some reason, it feels like I should say "single pane of glass" right now. :)
Michael Colby
i see a transition from legacy solutions and architectures to cloud friendly solutions and architectures for protecting data
jeff dinisco
@andriven, that's great, had same feeling
Christian Smith
The real innovation will be a portfolio where we automate as much as possible and avoid human interaction.
Michael Colby
that address scalability, costs in the cloud,
Peter Smails
World changing so fast, portfolio of BoB seems today's normal. Definitely higher propensity from customers to deploy BoB as the expense of single throat to choke.
Michael Colby
i sometimes think of the single pane of glass as a meta of a meta
Christian Smith
I think there is a mainframe migration to AWS - double rainbow
Michael Colby
@csislive the scary innovation is when the machines take over ;-)
jeff dinisco
@csislive, yup, it's never worked in the history of IT
Michael Colby
@csislive skynet is coming ;-)
Christian Smith
@chris_dag - How's the yurt - do you have a rack of gear in there yet?
Christian Smith
@michaelcolbypro It's a bet on where it starts Facebook or Google.
Michael Colby
i think that certain categories of data engines can be protected by the same solutions
Stephen Pao
@PeterSmails App-centric still creates silos. The person who owns SAP doesn't always talk to the guy who owns proprietary apps. Infrastructure can provide a common ground. Agree its not LUNS/VM, though!
Michael Colby
@csislive sadly i agree. one day my echo is going to talk back to me. Sirius is going to tell me off
Michael Colby
the biggest challenge to data movement still is the speed of light
John Furrier
Q3: What challenges are you seeing with data living across so many different stores and locations?
Andrew Miller
Security, Accessibility, and Operational Overhead.
jeff dinisco
cost, bring the data to burstable compute is a great concept, works really well with known and manageable data sets, very tough when working sets are hard to identify
Andrew Miller
if you have compliance requirements, tracking where your data lives can be very time-consuming and costly if not done well.
Michael Colby
security for sure. manageability. containing costs
storageswiss
Data Protection, Adhering to compliance
storageswiss
Good luck with GDPR with data scatted in so many places.
Chris Dagdigian
provenance (version control) and secured access plus just the 'weight' of moving all that data ...
Peter Smails
Clouds are the new silo. Data mobility is a huge challenge. Workloads dictate data placement (e.g. test/dev, performance, BI) but only if you can intelligently move data sets.
Michael Colby
under the heading of be careful of what you wish for, you may get it. Data is more accessible, can be generated far more quckly. but that creates new challenges
Christian Smith
Knowing what data you have where and understanding how to protect it. Oh and moving it around. WAN networks are still behind in our ability to generate data. Even cloud is a challenge to make sure you have data in multiple regions.
Stephen Pao
I see 4 data management challenges: data protection, data movement, search & discovery, and learning - the use of the data to extract value.
jeff dinisco
we start by analyzing requirements and selecting the best platform when architecting for data at scale, now we run cost models before we do anything
Michael Colby
absolutely. And yet we have to explain to people, still, the importance and need for backup
Andrew Miller
@storageswiss Ha! GDPR definitely flies in the face of current data dispersion patterns.
Michael Colby
its the old "replication is not backup" discussion all over again.
Stephen Pao
@PeterSmails Totally agree with the data movement point. Got to move data from where it is to where it needs to be. Cloud bursting is in its nascency but under a lot of discussion.
Peter Smails
DM pillars include Protection as table stakes (no matter where), mobility (gotta break the silos), monetization (leverage the data in native format anywhere).
Christian Smith
In the future we have to not care where data is located, just know that it's discoverable, protected, and describable (is that a word?).
Stephen Pao
@andriven definitely agree with the compliance implications. Seems that for certain apps, most of the architecture discussions center around a few key compliance topics.
Michael Colby
ironically the biggest cause of the need for backup and data protection is "human error"
Michael Colby
systems and data need to be protected from the people who use and manage it ;-)
Stephen Pao
@MichaelColbyPro Agree that hybrid and multi-clouds totally change the backup discussion.
Stephen Pao
@MichaelColbyPro Agree. As you replicate, you replicate over your database corruptions, viruses, and accidental deletions! Ouch.
Andrew Miller
@steve_pao So much yes to that - especially when regulations by definition move slower than technology (can't be avoided). Riddle me this - when will specific language requiring tape be removed from some EMEA regulations?
Stephen Pao
@andriven Funny how tape got written into regulation in the storage space; just like how packet inspection gotten written in on the networking side!