AskEMCITbigdata

EMC Big Data
Let’s discuss with EMC IT experts how Big Data changes the way IT orgs operate & deliver solutions.
Steven Carr
We don't have much time left, thank you everyone for participating! If you don't see an answer to your question below, or you missed your chance to ask one, our experts are continuing this conversation for 2 weeks, here: http://bit.ly/1OD5eY...
Steven Carr
You may also visit the IT Proven microsite to find the latest blogs, videos, case studies, white papers and much more! www.emc.com/emcitpro...
EMC Big Data
What's the difference between a data lake and 'business data lake' please?
Sean Brown
A Data Lake is a tech platform to store large volumes of data. A Bussiness data lake is used to deliver value to the business via analytics against the data. It is a full stack solution.
John Furrier
Do customers talk in terms of outcomes can you share with us the types of outcomes come out of the data lakes?
Sean Brown
the outcomes should be new insights on how to improve the business. But it also requires integrations with the business processes to capture the value.
David Dietrich
@sbrownpgh, can you give a specific example?
ian breitner
- Customers are starting to talk in terms of outcomes - specifically business value outcomes.
Sean Brown
an example would be a model that was built to score likelihood of a contract renewal. This was integrated with SFDC so the sales team could take action and monetize the insight.
Sudeep Shrivastava
While we have done multiple implementations internally in IT ... here is a video talking about overall implementation http://www.brainshar...
ian breitner
@furrier I believe customers are starting to change and focus on outcomes rather than ask for technology.
Karen Webb
Can you give us a quick overview of EMC's big data implementations?
Don Lynch
Hi Karen, there are a number of Big Data Implementations in EMC - example in SalesOps, Internal IT solutions. One key one to mention is EMC Connected Proactive Services - giving EMC customers visibility to data around their EMC products
David Dietrich
@DonLynch6 ; marketing analytics too, in identifying big data visionaries in companies with disparate data sources
John Furrier
. @SoxMomSection94 @schmarzo the dean of big data would be great for this chat #cc #EMCworld
Sudeep Shrivastava
Is ECPS something which could be leveraged as a solution for other customers ?
Oshry Ben-Harush
the ECPS methodologies for ingesting, storing and processing data as well as the algorithms built on top of these can defintely be leveraged by other customers in different areas of customer engagements
Sudeep Shrivastava
What is the cross-point between social media and internal data , will there be any ? , Does BDL have capabilities to give Business decision making capability in real time as market changes..
Oshry Ben-Harush
There is a strong relation between social media and internal data. To give a simple example, imagine collecting social media to identify interesting technological terms on the rise in order to combine that with installed base data from customers.@subahe
Sudeep Shrivastava
That's something IT can use for sure!
Oshry Ben-Harush
all with the purpose of recommending products and offerings to our customers based on what we identify as technologies on the rise.
David Dietrich
good example @oshryb ; also the work of the Marketing Sciences lab on finding big data visionaries used internal + social data
David Dietrich
mashup of internal customer data + twitter + Facebook data to form profiles of visionary individuals on big data at customer sites
John Furrier
Data velocity is important bc integrated data sets need massive compute. This is a huge technical challenge
Sudeep Shrivastava
@imdaviddietrich is the case study published somewhere,can you share link
Sudeep Shrivastava
For the Data lake to be successful as a project, what kind of buy-ins we need from the Business units , what are the offerings we can provide them to make a case ?
@oshryb
Sean Brown
the biggest thing you need from the business is the willingness to adapt their business processes to harness the value from the analytics.
Sean Brown
and of course their business knowledge to confirm the outputs of the analysis.
David Dietrich
@sbrownpgh excellent answer. The biggest thing you need is an open mind. Big Data Analytics uncovers things the business may not expect, so they need to be flexible
Sudeep Shrivastava
Use @ to reply This will have to start with POCs on smaller use cases, what is the flexibility that IT can offer in terms of ease and access to data for BU users
Sean Brown
speaking for EMC we have an innovation environment where the business can request a workspace and access to any of the data in the lake.
Sudeep Shrivastava
what is the time taken for IT to provisions environment and right tools to business...typically?
Sudeep Shrivastava
What is the Federation Data Lake, Is it only for companies that adopt product stack from Federation , or its available for any kind of environments
David Dietrich
, good question. In short, if you want to get a full stack of EMC Federation software and hardware, we can provide the Business Data Lake that way. We also provide the EMC Business Data Lake such that we can leverage other third party tools
David Dietrich
in other words, customers have choices in terms of what they choose to use ; many customers have heterogeneous environments
ian breitner
David's response might be confusing - the Federation Business Data Lake has components from the EMC Federation, and the EMC Business Data Lake provides for alternatives to Federation only product, but they function identically
Steven Carr
Let’s meet the experts that are happy to share how EMC IT implements big data and business data lakes, including: best practices, lessons learned, architectural choices, and the impact of a data science team.
Steven Carr
@sbrownpgh is an IT leader with over 15 years of specialization in the BI & Analytics domain. He has a proven ability to create & deliver innovative technology strategies that produce business advantage for the enterprise and measurable bottom-line value.
Steven Carr
@oshryb is the lead scientist of a team of data scientists in EMC, focused in developing advanced, data driven solutions to answer complex and varied challenges for different business units and EMC customers.
Steven Carr
Welcome gents!
Sean Brown
thanks Steven
Sudeep Shrivastava
Big Data is something that still smaller companies struggle with , as they don't have any platform purpose built they mostly take up POC project.... what is the starting point for building a strategy around it ?
ian breitner
EMC Global Services provides a Big Data Vision Workshop that helps companies develop a strategy and roadmap for Big Data
David Dietrich
many times our customers begin with our services to help them get started; we offer Vision Workshops to help companies map out their potential projects and identify good candidates for a pilot project
Oshry Ben-Harush
the best strategy IMHO is to build the solution or platform around the use cases, basically starting with one or two interesting use cases of value to the organization and then implementing these solution on a capable platform
Oshry Ben-Harush
the thing that must be taken into account is that the platform should be inherently expandable and scalable so that when new use cases are introduced, the environment can be expanded and scaled to support these
John Furrier
With real time data (not near real-time) what is needed for a customer to have truly real-time. Think about things like self driving cars or other #IoT device
Don Lynch
key for this is ingestion at the speed of the business - that is ingest and act as the events happen
Don Lynch
to acheive this we are utilising EMC Federated products like #SpringXD
David Dietrich
I find your distinction of real time vs. near real time interesting; in essence, what is "real time" ? seconds? milliseconds? microseconds? All these things are units are time, they're just fast
David Dietrich
In other words, the more I work with big data, the less I believe in the concept of "real time"; however, there are certainly things that make it really, really fast
ian breitner
@DonLynch6 It is also using that ingested data to produce insight - of course real-time means that you know what was going to happen before it actually occurred, otherwise any response to the ingested data would not be real-time but near-real time
Sudeep Shrivastava
@oshryb What are some of the risks, if a company has started the BDL as offering to its business ?
Oshry Ben-Harush
there several challenges I can think of, most with respect to utilization. First is governance, we wanrt the data in the BDL to be of quality, and clearly presented so that consumers of that data can easily use it and share it, requires contro
Oshry Ben-Harush
second, the data should be shared so that the entire organization benefits for it, that requires some regulation and meta data management so that some pieces of information are kept protected
Sean Brown
I speak to this a bit in my session. I see the biggest risk being misinterpretation of the data leading to bad conclusions. You still need a way to certify the findings.
Oshry Ben-Harush
one other challenge is educating the business users on the value of the business data lake and the advanced data solutions that can be developed on top of it, eventually, the value of the BDL is also in the value and level of insights it can bring
Karen Webb
Where can customers go to get more information on EMC IT's big data experience or information on FBDL?
Steven Carr
Customers can navigate our EMC IT Proven microsite to find use cases, blogs, videos, and other great assets like infographics, here: http://www.emc.com/c...
ian breitner
Information on EMC's Business Data Lake and the value it brings can be found at EMC.com/bigdata, and greater technical information can be found at EverythingBigData@EMC - on the EMC Community Network