#DataAutomated - CrowdChat

Enterprise Data Automation

Join us for a panel discussion on enterprise data automation with Io-Tahoe & Webster Bank on June 18th at 9 AM (PDT). Sign in with your LinkedIn or Twitter account, and contribute your thoughts on CrowdChat live. Register here: https://iotahoe.typeform.com/to/zJrTBO

#dataautomated @furrier @digital_iotahoe @dvellante @wikibon @leonardsnelson @stu

LeaderBoard

#DataAutomatedSmart Data LifecycleIo-Tahoe comes together with Ethos, Pure Storage, and Cohesity to talk solutions and strategies that leverage data automation to optimize all stages of your data lifecycle.

Stream Ended

Establishing a secure connection

Dave Vellante15

Q8.
What level of granularity of metadata is required to drive data automation?
https://www.crowdchat.net/s/961n4

[+] Show Hidden Comments

This is something unique about Io-Tahoe - the discovery of CRE and apply business glossary
with no manual effort

Actually, with data automation you can start with no metadata. In reality though there usually is some, the quality of which may be mixed. In which case, data automation will make full use of BUT not rely on what you have.

Understanding your data begins with a basic catalog of what you have: databases, schemas, tables, and columns. From there, you can do basic exploration and annotation. But really effective data analysis involves examining the data itself. This is how you find what you don't know.

Senthilnathan Karuppaiah

Io-Tahoe goes much deeper than metadata; it inspects the data at row-level / column vs. column comparisons to identify Critical Data Elements (CDE) and Real Matches to find the true flows

Dave Vellante18

Q1.
How has the COVID pandemic altered your thinking on data automation and digital transformation
https://www.crowdchat.net/s/261lb

[+] Show Hidden Comments

I think Covid-19 is a big disruption especially for the Financial Services sector is being unlikely to ever return to the ‘old normal” ways of working.

Most firms have worked at an incredible pace to adapt and
transform their business models– incorporating a far greater degree of technology and flexible,
remote working practices.

Here is a link to an EY article on the subject

https://www.ey.com/en_uk/news/2020/06/uk-financial...

I think the thinking on the post-isolation economy is that automation has become an imperative - people are no longer afraid of automation, they see it as a mandate

To me Covid makes the collaboration process hard on the people side so automation or software is more important than ever.

It's definitely a new normal we are working to that requires more collaboration across organisation teams, particularly if there is more remote working, where silos only get amplified without the ability to share a single version of the truth for enterprise data.

(edited)

From a development standpoint, it has allowed us to really focus on and understand the various data challenges customers have.

It has emphasized the number of touch-points within an enterprise is much higher than expected, and that automation is essential part of managing the data flows.

Sergio Fernandez

I agree with @dvellante and @David Piester it seems like the landscape will permanently shift, now more people work be working remote than every before so an automated process will be key.

"people are no longer afraid of automation", they see the obvious opportunity with the convergence of apps, data, infrastructure . . . all three can now be connected via APIs. Data is the fuel, APIs are the engine, people are the creative spark!

(edited)

Dave Vellante17

Q6.
Will automated data discovery work
with legacy on-prem and cloud systems?
https://www.crowdchat.net/s/561ms

[+] Show Hidden Comments

Absolutely. Everything starts with automated data discovery - on-premise or cloud. A common use case is to understand existing on-premise data systems and their depenencies in order to plan for a cloud migration. Equally, data discovery can be run on cloud PaaS and IaaS services.

Without automating data discovery, it is highly unlikely that an enterprise will ever reach their goals for business, data governance, and RPA.

Only with limited value. Significant value will come when they can discover data in the myriad of Excel spreadsheets spread around. #data #cloud #CIO

@tcrawford Io-Tahoe was born out of, what we call "Death by Excel"

MS Excel was the original Data Catalog and in lots of cases it still is: Even some Data Governance workflow tools do little more than replicate the same manual overhead for MS Excel with an application UI. With Io-Tahoe, Machine Learning, NLP, distributed processing changes that.

(edited)

Dave Vellante17

Q4.
What are the critical business case elements organizations should look at when justifying data automation?
https://www.crowdchat.net/s/961md

[+] Show Hidden Comments

I would put forth end-to-end cycle time reduction as a critical element to measure

the business case needs to look at the Total Cost of Ownership for reducing cycle times. Spending effort to manually prepare data for that data to then drive automation of tasks ("work") isn't smart. Automate preparing the data required for automating the "work". That's valuable.

(edited)

business cannot afford to spent millions of $$$ on enterprise data tools, expensive consultants to implement big projects has passed. The economy is in a place where self-service, no-code apps, open systems for simple integration, task automation is reducing cycle times to value.

(edited)

Data Science reminds us that 80% of their time is not spent on creating models... but trying to find the right data

Data quality; data flows; data security - If you don't know what you have, how can you control it?

IMO, reduction in cycle time is the key metric in any business case.

@dfloyer That's right - time to value from applying data to achieve any business outcome (i.e. from data to value) is accelerated by providing self-service access to trusted data from across business data siloes . . . to drive apps, ML, data-science, RPA, AIOps etc. aka "work".

Dave Vellante14

Q3.
What’s the best way to get lines of business people to support a collaborative data culture?
https://www.crowdchat.net/s/761m5

[+] Show Hidden Comments

Show them the benefits!

By that I mean, help people to understand the benefits of a single, correct view of the data

That can come from taking ownership as data stewards and active participation in data governance processes

(edited)

Start with breaking down the business silos that commonly exist. All too often each business unit has its "own" data, resulting in data redundancy and these silos.

As more people get involved, act as stewards and Subject Matter Experts and the data quality improves, a positive cycle is created.

Yes! 1000 versions of the "truth"

Letting go of your data is relinquishing protection and power over your destiny. IMO, the broader culture has to change top down.

@dfloyer It's confusing for C-Level leaders to have a clear line of sight between their investment $$$ into IT to manage data and the time it take to see the benefits. The time to implement a manual approach takes away the opportunity to show any RoI before the plug gets pulled

(edited)

Dave Vellante12

Q5.
We heard from Webster Bank, some of the successes of automating data...what are some other industry examples?
https://www.crowdchat.net/s/961mo

[+] Show Hidden Comments

Senthilnathan Karuppaiah

Some references are below:
Global healthcare Provider - Automatically building and tagging business glossary over 100s of schemas and ~50K GUI attributes maintained in excel spreadsheets

Senthilnathan Karuppaiah

For a large insurance company - Continuous scanning & discovery of PIIs across data sources to be in compliance with CCPA

Senthilnathan Karuppaiah

For a Global Consumer Product Group - Automating the operations for cleaning up “data swamp” by eliminating redundant data in their data lake

I know you can't be specific about names on social media but Banking, Healthcare, Insurance, CPG, Manufacturing, Retail all rely heavily on automating data across the supply chain - once automating the upfront data discovery has been applied.

Dave Vellante12

Q2.
What are the key challenges and blockers organizations face in automating the data pipeline?
https://www.crowdchat.net/s/661lt

[+] Show Hidden Comments

Everything starts with automated data discovery, businesses need a reliable, well curated catalog.
In a world with so many different data source system types, vendors, and the nature of constant data growth building a consistent view of your data assets and

inter-relationships is nigh on impossible manually.

Automatically uploading and updating a data catalog with the right, accurate information is key. Eliminating repetitive, labor-intensive data tasks/manual processing of data.

I've never seen any business automation (supply chain, order processing, marketing, etc.) work well without first knowing the data that is required to drive the process and achieve the outcome. Speed comes from knowing your data quickly then putting it to serve your customers.

(edited)

Sergio Fernandez

I can imagine that having silos and a way to get the data centralized and understood will be one of the biggest challenges. Like Gareth said, automated data discovery is going to be a foundational practice to automating the data pipeline.

I was just talking to a friend and we were talking about how many misunderstand how "work" is impacted by data: WorkFORCE, WorkPLACE, WorkLOADS, and WorkFLOWS... all are integrated from a data perspective

@furrier That's right John: performing any "work" requires some form of data - to track progress, to make informed decisions etc. Automating tasks to perform work more productively also requires data. We're focused on automating the data required to automate those tasks!

(edited)

Dave Vellante12

Where is everyone logging in from today

[+] Show Hidden Comments

Carlsbad, Ca

Atlanta, GA

Sergio Fernandez

Branford, CT

London, UK

(edited)

Palo Alto, CA

Nottingham, England

Lake Tahoe

https://www.crowdchat.net/s/061ko

@ajay_vohora Ajay how's it in Tahoe today?

Orange County, CA

San Francisco!

London, UK!

@furrier Tahoe is mostly sunny today https://www.crowdchat.net/s/661np

(edited)