clearstory

Spark & ClearStory
Thought leader conversation about the Spark & the consumerization of data using ClearStory platform
theCUBE
Question: What is the vision of Consumerization of Data? Anyone? This is a very important trend in the connected enterprise that isn't baked out yet in the mainstream. Looking for any perspective?
Jeff Kelly
insights and recommendations gleaned from #BigData analytics need to be seamlessly integrated into apps people use at work everyday
Stephanie McReynolds
Data consumerization is not just about the individual or self-service. It's about getting more people working together with more data to find insights quicker. @theCUBE
John Furrier
to me the iphone in 2007 set the agenda - the connected consumer with a smart phone will change the data and the capability..consumerization of IT will enable new apps and new future Billy Beane's to tie into #moneyball
John Furrier
@clearstorydata can't have #bigdata convo without moneyball reference.. every company will have a Billy Beane just waiting to change the game - #valuecreation can come from anywhere - that is Consumerization of Data - possible from any device
Will Davis
I think this also has to do with a growing shift among organizations to be more open and transparent - making data available to business teams, customers, etc.. so they are making informed decisions and are more productive
Doug VanderMolen
UX perspective: Experiences must be designed that empower all people to understand and utilize data. ClearStory is focused on this; realizing that doing this empowers more people to make data-influenced decisions.
John Furrier hey Doug can you help us redesign our CrowdChat we need your help :-)
John Furrier
hit send too soon #bigdataNYC event we talked about two things in this context: 1) data artist and 2) the new knowledge worker - yes the non-geeks not writing python..the new spreadsheet is visualization -tooling is need HUGE oppty
Stephanie McReynolds Great topic! New opportunity will be defined not just by visualization but also by how quickly teams can access data and find insights.
Jeff Kelly
self-service visualization with collaboration capabilities - analytics is collaborative by nature
Vaibhav
Platform perspective: The data platform needs to support low latency computation, different data formats and operations and understand data semantics to assist the users to make data-driven decisions
Dave Vellante
with what? 8,000 public data source api's looks like the vision of for open, connected and plentiful consumption
Doug VanderMolen
@furrier @clearstorydata is creating a product that will enable companies to have lots of Billy Beanes!
Jeff Kelly
How do enterprise users actually interact with ClearStory? Analytic apps or Analytics integrated into biz processes? Something else?
Vaibhav
Enterprise users interact with ClearStory through an intuitive, browser-based application which has a new user model with built-in support for collaboration
theCUBE
@dvellante loves the data harmonization angle here is Sharmila Mulligan at our #BigDataNYC event http://youtu.be/9fZVK9cyOvY
Doug VanderMolen
The Clearstory experiences was designed so that business users interact directly with both internal and external data through the Clearstory interface.
John Furrier I like how you layout the "data stories" brilliant.. and adding social component on iterative data modeling is genius.. #bigdata done right
Bob Gourley
Question for @ClearStoryData: Can you give top 3 or 4 best practices you have seen when new data based solutions are fielded.
John Furrier
great question
Bob Gourley I'm learning things here that will help me get my job done so I appreciate your bringing attention to this.
Stephanie McReynolds
Getting value from new data based solutions means making the solution easy to use no matter what the use case.
Bob Gourley Thanks for the helpful reply.
Stephanie McReynolds
That said, we see organizations adopting data intelligence for new use cases like: localized market intelligence in retail, multi-screen behavioral analysis in media & entertainment...
Narayan Bharadwaj
There are use cases that cut across verticals- anything that typically involves interactive and iterative analysis to get to one or more fast insights
theCUBE
Bob how you see these guys from say @platfora @benwerther has been on before
Will Davis
Accessing more sources of disparate data both internal & external, providing fast interactive analysis on data at scale and collaboration for making analysis within a team intuitive and productive
Bob Gourley Thanks for those comments
John Furrier
Why are you guys so pumped up about Spark?
Vaibhav
We use Spark and Shark as part of our stack for analytics on Diverse data
Stephanie McReynolds
Data Intelligence requires new technology to deliver more speed to more people. Spark is a technology we've been working with for years now as part of that equation @furrier
Jeff Kelly
to me Spark offers opportunity to build a Unifed Big Data stack on Hadoop rather than disparate components
Vaibhav
Spark's in-memory data processing also allows our users to 'fail fast', in case a particular data exploration reaches a 'dead end'
Crowd Doc
What are @ClearStoryData 's offering w.r.t to #Spark ?
Vaibhav
Spark is one component of our stack. ClearStory Data is a application + platform which enables analytics on diverse data sources, both internal and external
John Furrier
Way to decide what kind of data scientist you are ..ask yourself do you 1) write python or scala or 2) use excel or other off the shelf software.. if #1 you're a hard core data scientist if #2 you're the new data analyst
Dave Vellante
are you a data hacker?
Stephanie McReynolds
In the new world, we all need to be new data analysts. #dataintelligence
Stephanie McReynolds
Data intelligence is a new way to analyze data. How does it compare to the old ways - e.g. data warehousing, business intelligence, dashboarding?
John Furrier
in the #sparksummit CrowdChat the emphasis was on real time analytics what's different now for end users?
John Furrier
to me it's the consumerization of data and that means the data scientist will be the new BI analyst.. 4 million data analysts will soon be data scientists
theCUBE
At #AWS they are seeing #devops driving a new paradigm of applications (aka agile) which will create a new model of "knowledge worker" more #data #artist less math geek..
Will Davis
I think of Data Intelligence as a new way to analyze data by leveraging 'smarts' on the data itself to make working with and analyzing data faster, more intuitive and more flexible
Jeff Kelly
big difference is not needing to pre-define the questions you want to ask or the data models - data intelligence is real-time and iterative
theCUBE
@jeffjonas at IBM always says and I love this quote "big data is like puzzle pieces" need to have them but putting it together is an art & science" this is the new way for analytics which is storytelling and datascience as one #bigdata
Crowd Captain
Welcome to Clearstory @clearstorydata chat on the advances in Spark #sparksummit and #bigdata analytics