DataAutomated

Enterprise Data Automation
Join us for a panel discussion on enterprise data automation with Io-Tahoe & Webster Bank on June 18th at 9 AM (PDT). Sign in with your LinkedIn or Twitter account, and contribute your thoughts on CrowdChat live. Register here: https://iotahoe.typeform.com/to/zJrTBO
Dave Vellante
Q8.
What level of granularity of metadata is required to drive data automation?
https://www.crowdchat.net/s/961n4
https://www.crowdchat.net/s/961n4

David Piester
This is something unique about Io-Tahoe - the discovery of CRE and apply business glossary
with no manual effort
Yusef Khan
Actually, with data automation you can start with no metadata. In reality though there usually is some, the quality of which may be mixed. In which case, data automation will make full use of BUT not rely on what you have.
Lester Waters
Understanding your data begins with a basic catalog of what you have: databases, schemas, tables, and columns. From there, you can do basic exploration and annotation. But really effective data analysis involves examining the data itself. This is how you find what you don't know.
Senthilnathan Karuppaiah
Io-Tahoe goes much deeper than metadata; it inspects the data at row-level / column vs. column comparisons to identify Critical Data Elements (CDE) and Real Matches to find the true flows
Dave Vellante
Q1.
How has the COVID pandemic altered your thinking on data automation and digital transformation
https://www.crowdchat.net/s/261lb
https://www.crowdchat.net/s/261lb

David Piester
I think Covid-19 is a big disruption especially for the Financial Services sector is being unlikely to ever return to the ‘old normal” ways of working.
David Piester
Most firms have worked at an incredible pace to adapt and
transform their business models– incorporating a far greater degree of technology and flexible,
remote working practices.
David Piester
Here is a link to an EY article on the subject
Dave Vellante
I think the thinking on the post-isolation economy is that automation has become an imperative - people are no longer afraid of automation, they see it as a mandate
John Furrier
To me Covid makes the collaboration process hard on the people side so automation or software is more important than ever.
ajay vohora
It's definitely a new normal we are working to that requires more collaboration across organisation teams, particularly if there is more remote working, where silos only get amplified without the ability to share a single version of the truth for enterprise data.

(edited)

Lester Waters
From a development standpoint, it has allowed us to really focus on and understand the various data challenges customers have.
David Floyer
It has emphasized the number of touch-points within an enterprise is much higher than expected, and that automation is essential part of managing the data flows.
Sergio Fernandez
I agree with @dvellante and @David Piester it seems like the landscape will permanently shift, now more people work be working remote than every before so an automated process will be key.
ajay vohora
"people are no longer afraid of automation", they see the obvious opportunity with the convergence of apps, data, infrastructure . . . all three can now be connected via APIs. Data is the fuel, APIs are the engine, people are the creative spark!

(edited)

Dave Vellante
Q6.
Will automated data discovery work
with legacy on-prem and cloud systems?
https://www.crowdchat.net/s/561ms
https://www.crowdchat.net/s/561ms

Lester Waters
Absolutely. Everything starts with automated data discovery - on-premise or cloud. A common use case is to understand existing on-premise data systems and their depenencies in order to plan for a cloud migration. Equally, data discovery can be run on cloud PaaS and IaaS services.
ajay vohora
Without automating data discovery, it is highly unlikely that an enterprise will ever reach their goals for business, data governance, and RPA.
Tim Crawford
Only with limited value. Significant value will come when they can discover data in the myriad of Excel spreadsheets spread around. #data #cloud #CIO
Mark Pittman
@tcrawford Io-Tahoe was born out of, what we call "Death by Excel"
ajay vohora
MS Excel was the original Data Catalog and in lots of cases it still is: Even some Data Governance workflow tools do little more than replicate the same manual overhead for MS Excel with an application UI. With Io-Tahoe, Machine Learning, NLP, distributed processing changes that.

(edited)

Dave Vellante
Q4.
What are the critical business case elements organizations should look at when justifying data automation?
https://www.crowdchat.net/s/961md
https://www.crowdchat.net/s/961md

Dave Vellante
I would put forth end-to-end cycle time reduction as a critical element to measure
ajay vohora
the business case needs to look at the Total Cost of Ownership for reducing cycle times. Spending effort to manually prepare data for that data to then drive automation of tasks ("work") isn't smart. Automate preparing the data required for automating the "work". That's valuable.

(edited)

ajay vohora
business cannot afford to spent millions of $$$ on enterprise data tools, expensive consultants to implement big projects has passed. The economy is in a place where self-service, no-code apps, open systems for simple integration, task automation is reducing cycle times to value.

(edited)

Mark Pittman
Data Science reminds us that 80% of their time is not spent on creating models... but trying to find the right data
Lester Waters
Data quality; data flows; data security - If you don't know what you have, how can you control it?
David Floyer
IMO, reduction in cycle time is the key metric in any business case.
ajay vohora
@dfloyer That's right - time to value from applying data to achieve any business outcome (i.e. from data to value) is accelerated by providing self-service access to trusted data from across business data siloes . . . to drive apps, ML, data-science, RPA, AIOps etc. aka "work".
Dave Vellante
Q3.
What’s the best way to get lines of business people to support a collaborative data culture?
https://www.crowdchat.net/s/761m5
https://www.crowdchat.net/s/761m5

Yusef Khan
Show them the benefits!
Yusef Khan
By that I mean, help people to understand the benefits of a single, correct view of the data
Yusef Khan
That can come from taking ownership as data stewards and active participation in data governance processes

(edited)

Lester Waters
Start with breaking down the business silos that commonly exist. All too often each business unit has its "own" data, resulting in data redundancy and these silos.
Yusef Khan
As more people get involved, act as stewards and Subject Matter Experts and the data quality improves, a positive cycle is created.
Yusef Khan
Yes! 1000 versions of the "truth"
David Floyer
Letting go of your data is relinquishing protection and power over your destiny. IMO, the broader culture has to change top down.
ajay vohora
@dfloyer It's confusing for C-Level leaders to have a clear line of sight between their investment $$$ into IT to manage data and the time it take to see the benefits. The time to implement a manual approach takes away the opportunity to show any RoI before the plug gets pulled

(edited)

Dave Vellante
Q5.
We heard from Webster Bank, some of the successes of automating data...what are some other industry examples?
https://www.crowdchat.net/s/961mo
https://www.crowdchat.net/s/961mo

Senthilnathan Karuppaiah
Some references are below:
Global healthcare Provider - Automatically building and tagging business glossary over 100s of schemas and ~50K GUI attributes maintained in excel spreadsheets
Senthilnathan Karuppaiah
For a large insurance company - Continuous scanning & discovery of PIIs across data sources to be in compliance with CCPA
Senthilnathan Karuppaiah
For a Global Consumer Product Group - Automating the operations for cleaning up “data swamp” by eliminating redundant data in their data lake
ajay vohora
I know you can't be specific about names on social media but Banking, Healthcare, Insurance, CPG, Manufacturing, Retail all rely heavily on automating data across the supply chain - once automating the upfront data discovery has been applied.
Dave Vellante
Q2.
What are the key challenges and blockers organizations face in automating the data pipeline?
https://www.crowdchat.net/s/661lt
https://www.crowdchat.net/s/661lt

Gareth D Miles
Everything starts with automated data discovery, businesses need a reliable, well curated catalog.
In a world with so many different data source system types, vendors, and the nature of constant data growth building a consistent view of your data assets and
Gareth D Miles
inter-relationships is nigh on impossible manually.

Automatically uploading and updating a data catalog with the right, accurate information is key. Eliminating repetitive, labor-intensive data tasks/manual processing of data.
ajay vohora
I've never seen any business automation (supply chain, order processing, marketing, etc.) work well without first knowing the data that is required to drive the process and achieve the outcome. Speed comes from knowing your data quickly then putting it to serve your customers.

(edited)

Sergio Fernandez
I can imagine that having silos and a way to get the data centralized and understood will be one of the biggest challenges. Like Gareth said, automated data discovery is going to be a foundational practice to automating the data pipeline.
John Furrier
I was just talking to a friend and we were talking about how many misunderstand how "work" is impacted by data: WorkFORCE, WorkPLACE, WorkLOADS, and WorkFLOWS... all are integrated from a data perspective
ajay vohora
@furrier That's right John: performing any "work" requires some form of data - to track progress, to make informed decisions etc. Automating tasks to perform work more productively also requires data. We're focused on automating the data required to automate those tasks!

(edited)

Dave Vellante
Where is everyone logging in from today
Yusef Khan
London, UK

(edited)

Gareth D Miles
Nottingham, England
John Furrier
@ajay_vohora Ajay how's it in Tahoe today?
Mark Pittman
Orange County, CA
ajay vohora
@furrier Tahoe is mostly sunny today https://www.crowdchat.net/s/661np

(edited)

https://www.crowdchat.net/s/661np