datafriction

Modern Infrastructure Mgmt
Accelerating Productivity Through Machine Learning
jameskobielus
Has machine learning made it easier to unlock insights from your infrastructure data?

Has machine learning made it easier to unlock insights from your infrastructure data?

Jason Johnson PMP
Last question is coming up next.
Ralph Finos
@RalphFinos The data is pretty good - the problem is in understanding what the data means in terms of actual operations and whether it is useful for any analytic-driven operations purpose
jameskobielus
How much confidence do users have in the veracity of the infrastructure data?

How much confidence do users have in the veracity of the infrastructure data?

Jason Johnson PMP
http://www.via-cc.at... How much confidence do users have in the veracity of the infrastructure data?

Colin Walker
How much "YES" can I add here? Even as a relatively new tech, in the grand scheme, the immediate effects are huge. Changes the entire paradigm of how we approach issues/monitoring/data/device management. Massive value here and more to come
Ralph Finos
@RalphFinos At least you've got some level of data reduction to work with
Matt Cauthorn
This is where 2016 made things interesting...when machine learning made it to IT Ops in a broad way. We're just now starting to see the potential / implications IMO.
Peter Burris
We're looking at this question closely: ITOM may be one of the "killer apps" for machine learning. Nobody wants to invest in IT, but avoiding it puts any digital business at risk.
Matt Cauthorn
@plburris Yep. From my perspective, this will become another vector for competitive advantage and much of IT will either figure this out or struggle to catch up.
yaron haviv
@plburris so is ITOM goel <cost? security? uptime?
Peter Burris
Very high confidence in highly stylized data. Modest confidence in correlated data. Limited confidence in data that ties to business activity.
yaron haviv
i assume its quite easy for ML to replace users looging @ logs
Colin Walker
@mcauth "Struggle to catch up" is putting it nicely. IMO they'll either figure it out, or become obsolete. It's that big of a differentiator. Not many things are "must have" items. This truly can/will be with data rates increasing.
Matt Cauthorn
@yaronhaviv question not directed to me, but it can (and should) be able to address multiple goals, e.g. all of those, if put into practice.
Peter Burris
@yaronhaviv Immediate business justification: GRS as data use and portfolio complexity explodes. Slightly longer: binary ability to run the digital business.
Jason Johnson PMP
Question #7 coming up.
jameskobielus
How easy is it for users to find the infrastructure data & associated analytics they need?

How easy is it for users to find the infrastructure data & associated analytics they need?

Peter Evans
Sometimes overlooked in the Data Lake conversation - Archive Data or Legacy and Retired Systems of record - Data is still very useful especially for long term trend - but how to place it in the Data Lake and how to control it properly
Matt Cauthorn
Absolutely right. And the governance challenge increases over time if not thought of early.
Randy Arseneau
Hence the perpetual, almost zombie-like resilience of HSM, ILM, linear media, etc... :)
Randy Arseneau
@plburris I like tape, and dammit I'm not ashamed to admit it! :)
Matt Cauthorn
@plburris Lol you said what I was thinking. Well played, sir
Peter Burris
@colin_walker Hey, I could have mentioned punch cards.
Colin Walker
@plburris It's too early in the morning for that kind of cruelty. brb, fetching a shredder.
Chris Selland
@plburris you're dating yourself
jameskobielus
@mcauth Data retention is a key issue, especially for the scads of infastructure data too low-level (or not relevant to compliance) enough to merit long-term retention. There's just so much log data that has marginal value for retaining.
Chris Selland
@cselland probably should have put a ;) on that one
Neil Raden
Look, the proper place to USE that data is still a data warehouse, and they have overcome many of their drawbacks. I say, cloud DW, not data lake if you think it will be used.
Peter Evans
@NeilRaden but surely Clolud DW, Data Lake, EDW are all part of the Enterprise Data Fabric - should we not worry where the data is held as long as it can be used across the Enterprise?
Jason Johnson PMP
http://www.via-cc.at... How easy is it for users to find the infrastructure data & associated analytics they need?

Randy Arseneau
Tough question to answer absent context... Who are the users? What are their specific needs?
yaron haviv
big issue is not the data, its which answers u r looking for
Tyson Supasatit
In other words, how much friction is there for people trying to find the data and analytics: Do they need to know a query language? Can they easily search? How long do they have to wait?
tomgolway
@yaronhaviv I'd argue that you are looking for answers to questions you haven't thought of yet
Matt Cauthorn
I'll parse this along the boundaries of data sources: Machine data (logs, snmp, etc.) Agent data, synthetic data, and wire data. Most are quite easy to get at, it's harder to wrangle it into value.
Peter Burris
No common reference model for what is the data, making it difficult to know what to find. Machine learning can really help there.
Colin Walker
Varies *wildly* with tooling and instrumentation. For some I've spoken with it's hopeless in their current deployment. For others it's seconds to visibility and insight. It's all about surfacing insights rapidly, automatically.
Peter Burris
@dorkninja Great point! But as IT resources become more core to business behavior, a more diverse user community will demand simple ways to find, collaborate on, and act on answers.
yaron haviv
start w a goal (e.g. oper efficiency, security, downtime ..) define the data u need from there
Tyson Supasatit
@yaronhaviv Agree. There is a "half-life" to data value and it differs based on the analytics use case. With incident response and downtime, the half-life of data value is shorter, but for long-term capacity planning the half-life is longer.
Jason Johnson PMP
Question #6 coming up.
jameskobielus
How extensively does decision making, powered by insights from infrastructure data, permeate your organization? (please click one response only.)

How extensively does decision making, powered by insights from infrastructure data, permeate your organization? (please click one response only.)