eweekchat

Trends in Data Orchestration
JOIN US: This is a chat-based conversation about what we're seeing in the organization of all that data we're collecting. Data orchestration--using Kubernetes or other platforms--is a key topic right about now. We'll have expert guest hosts!
   4 years ago
#eweekchatTrends in New-Gen IT SecurityJOIN US: This is a chat-based conversation about what you think we can expect to see--or won't see--in data security this year. We'll have expert commentators!
   4 years ago
#eweekchatTrends in Collaboration ToolsJOIN US: This is a chat-based conversation about what tools we're using in working from home and in teams and whether we're more (or less) efficient. We'll have expert guest hosts!
Chris Preimesberger
Q2: We have here today several reps from companies that offer data orchestration in a platform or application. Can each of you tell us what sets your edition apart from others in the market?
Scality
A2. Ah - bit of a challenging question given some potential overlap among us.But I will give it a go with all due respect to my fellow panelists. :-)
Scality
A2. Scality's solution is available in both enterprise and open source editions. We can orchestrate data between legacy on-prem solutions and the public cloud. We support both file and object data formats. And we only require a single instance running on-prem or in cloud while...
Scality
...some solutions require running an instance in every location where data needs to be managed. We also support "in-band" and "out-of-band" operations - apps can write to Scality or to the storage location directly and we'll pick up the data after the write.
Sam Lakkundi
A1. #DataOrchestration – not just about collecting #data, but bringing data from different sources together, then enriching & transforming it into insights that translate into actions. #eweekchat
Chris Preimesberger
Q2 coming right up ...
Christopher Merz
A1: we leverage data orchestration, via the NetApp Data Fabric, across our internal, partner, and customer facing AI and telemetry systems. We also heavily leverage orchestration for PVCs (via Trident) in our internal IT "Cloud One", and our engineering hybrid clouds.
Christopher Merz
We also provide data fabric orchestration services (via Fabric Orchestrator) to our customers, spanning all major public clouds and any on premises environment. This allows organizations to have the right data, in the right place, at the right time.
Christopher Merz
[App + Data == Workload] While K8s and containers offer the common solution for App portability between clouds (public, private, hybrid), without comprehensive data orchestration capabilities, one can't achieve true Workload portability.
Eric Kavanagh on #DMRadio
A1: we focus on educating businesses about the power of #DataOrchestration. We're seeing many leading-edge organizations leveraging various types of this tech. Options include scale-out integration via #Kubernetes, or data virtualization layers that connect clouds. #eWeekChat
coshiro
A1: AtScale’s platform is designed to orchestrate data where it lies in response to data usage. We have a concept called Autonomous Data Engineering which uses some ML to understand how to present data and ultimately how to optimize the data for better data analytics.

(edited)

coshiro
Our customers derive the benefit of enhanced performance against their data while leveraging all the data regardless of where it lies. This leads to better historical trending, outlier identification and multi-platform support.
Eric Kavanagh on #DMRadio
Cool! So do you create a marshaling area of data, like a cache? Or if not, how exactly does the data get provisioned from where it lives, to where the user needs it for analysis or reporting? Can can you also enable OLTP applications with this method? #eWeekChat
Chris Preimesberger
Thanks and welcome Chris! Can you explain a bit more about the use of ML in this context?
coshiro
@eric_kavanagh - mainly an OLAP platform. Our Acceleration Structures are not cache. They are not transient. Instead the are heuristically defined and maintained by AtScale.
coshiro
AtScale is tracking queries and query patterns to ‘learn’ and ‘anticipate’ future behavior.
Chris Preimesberger
Q1: How is your company using data orchestration? What business values are you deriving?
Sam Lakkundi
A1. At @BMCSoftware, we use #dataorchestration to bring our #data closer to compute across clusters, regions, clouds, and countries #eweekchat
Chris Preimesberger
Hi Sam, and welcome. What advantages are there in bringing compute closer to the data store itself?
Scality
A1. I can speak for a couple of our customers and open source users. We see people orchestrating data between legacy and modern applications - example, media company with a legacy FTP-based app orchestrating data up to cloud services.
Sean Knapp
A1. At @ascend_io, #dataorchestration is at the heart of our product, and what we also use internally to collect data across disparate systems & clouds, perform complex transformations & modeling (for #analytics and #datascience), and even automate #datagovernance.
Alex Ma
Bringing the data from the datastore itself, closer to the compute or local to the compute has a number of advantages. Reduces network latency, increases throughput for the application itself and minimizes overhead with communicating to the datastore.
Dipti Borkar
A1. At @alluxio , we focus on bringing #dataorchestration to our users, for hybrid cloud and multi cloud environments. Data Orchestration is accelerating compute with remote data and unify data access.
Sam Lakkundi
hi Chris, data orchestration in general simplifies data ecosystems due to new frameworks, cloud adoption/migration, as well as the rise of data-driven and demanded applications #eweekchat
Scality
A1. Business value of #dataorchestration can range from delivering new services to business continuity / DR.
Dipti Borkar
A1. Users like DBS Bank and Walmart, have data on-prem. Accessing this data in other remote environments can be a big challenge and these users and others, use @alluxio 's "Zero-copy" bursting approach to bring data to the cloud to accelerate #bigdata compute
Eric Kavanagh on #DMRadio
@dborkar I love @Alluxio's approach of creating a virtual cache of data that connects on-prem environments to each other, and to the cloud. As such, it enables high-powered analytics on data that's scattered across multiple locations. #DataOrchestration #eWeekChat
Chris Preimesberger
Sound good? Let's get to it ...

All of these are tossup questions for our guest experts: Answer when ready to do so.
Chris Preimesberger
Finally: If you want some great background to read while you're here, go here: https://www.eweek.com/big-data-and-analytics/eweek...
https://www.eweek.com/big-data-and-analytics/eweekchat-feb.-12-down-the-batch-new-trends-in-data-orchestration
#eWEEKchat Feb. 12: Down the Batch: New Trends in Data Orchestration
#eWEEKchat Feb. 12: Down the Batch: New Trends in Data Orchestration
Reserve an hour on Wednesday to participate in an informative, interactive chat session about how massive amounts of data are being controlled and managed to best effect for new-age enterprises.
Chris Preimesberger
For those on Twitter only: To follow our discussion in real time, go here (http://www.crowdchat.net/eweekchat) ... You do have to authorize Twitter to join.
http://www.crowdchat.net/eweekchat
[LIVE CHAT] Promise, Potential of the Edge
[LIVE CHAT] Promise, Potential of the Edge
JOIN US: This is a chat-based conversation about how IT is rapidly evolving into a new phase that may turn out to be as important as, if not more important than, the cloud itself.