EMCCloud

Openstack Operations
OpenStack Operations: Challenges and Solutions
Kenneth Hui @rubrikInc HQ
Le's start with our 1st question 4 everyone:

How much and where have you seen progress in terms of OpenStack being more operator friendly?
John Furrier
I didn't go to Paris but I heard that was the focus
Scott Carlson
At the beginning there was so much to the command line that you needed to know. From a pure "L1" operator standpoint, the advances in the 'GUI' have helped tremendously!
cloud foreign
while in the early days Ops was clearly an afterthought, I do like the work being done in the last year or so to engage ops: full days at the summits, mid-cycles, etc. Chance to share war stories/best practices.
cloud foreign
also it seem that most (if not all) of the projects are taking a hard(er) look at what it means to run this thing.
cloud foreign
sat in on a design session about logging for instance: we know it is broken, and we want to get it fixed.
Shamail Tahir
@craig_tracey @relaxed137 Any upcoming changes in Kilo+ that you are looking forward to as operators?
Scott Carlson
Unless your average 'NOC' person can run and support your cloud, it won't penetrate fully. integration into common DC tooling for logging/monitoring needs to continue. It's come a ways, but needs more.
Tim Bell
Upgrade experience has significantly improved in the last release. Since we went production in July 2013, we've done two upgrades without impact on running VMs.
Sean Winn
It's gotten easier to manage over time but still a long way to go especially in the areas of logging and monitoring. Menesca introduces some good ideas, but I'm not sold yet.
cloud foreign
@ShamailXD looking forward to better logging, more robust policy management and a common CLI.
Mike Onsing
Many people are skeptical of openstack based upon the social networks but I'm not an expert
Mike Onsing
I don't understand EMCs connection to openstack? Can you explain for me who is in tech but not in the deep insider #openstack #cloud world
Tyler Britten
@noggin143 what would you say are 'must have' tools in your ops toolchain?
John Furrier
@mikeonsing They make storage and own VMware and IT enterprises all want openstack not pure AWS cloud
Evan Powell
OpenStack is loosing / has lost the hyperscale folks who one w/d think w/d want the 100% API driven infrastructure of OpenStack. And is too tough for mainstream enterprise. Or am I off base?
Rodrigo Gazzaneo
@mikeonsing like many tech leaders, #EMC is interested in #Openstack
David Pollack
Defiinition of mainstream enterprise? Which customers driving this? Finance, hyper-enterprise, retail, Operators?
Tim Bell
@vmtyler There are lots of options. The user survey at http://superuser.ope... gives the common ones.
OpenStack User Survey Insights: November 2014
Results from the latest user survey are revealed at the OpenStack Summit in Paris.
Scott Carlson
@epowell101 there are enterprises who need to build their own and enterprises who want to buy it "in a box" which IMHO is why we see a lot of "in a box" players right now. It does need to "JUS WORK" for your average enterprise.
Rodrigo Gazzaneo
@mikeonsing #EMC first contributed to help integrate leading storage platforms to #OpenStack releases
John Furrier
@epowell101 I am hearing tons of FUD on openstack and hearing great stuff. Someone is getting signals crossed.
Rodrigo Gazzaneo
@mikeonsing leading enterprise storage platforms like @EMCVMAX and @EMC_VNX are fully integrated with #cinder #openstack storage driver
Evan Powell
@relaxed137 Maybe... I think there is a moving target. If we converge OpenStack towards today's enterprise operations we will miss the shift towards "real" DevOps which is a real (and complicated) trend.
Tim Bell
@vmtyler For CERN, we selected Puppet, Kibana/Elastic Search as our config management and monitoring. At mininum, config mgmt is a must. We also use RDO as the base for our installation of OpenStack.
Rodrigo Gazzaneo
@mikeonsing #EMC object storage strategy is compatible with #swift and #glance #openstack services
Evan Powell
@noggin143 How do you wire together the components? mCollective plus scripts plus Puppet and so forth? Very useful info.
Scott Carlson
@epowell101 Dev ops though is iterative and requires infrastructure that allows you to iterate. Code based 'Dev ops', dynamic security controls, and dynamic 'cloud' updates are all required. but it must all work
Rodrigo Gazzaneo
@mikeonsing as #EMC sees a lot of development around #Openstack the company continues to invest
Rodrigo Gazzaneo
@mikeonsing #EMC has recently acquired @cloudscaling a leading #OpenStack solutions provider
Evan Powell
@relaxed137 Agreed. DevOps = far bigger trend than simply cloud X or Y imo. Cloud X or Y or tool Z are just enablers for actually achieving step function agility boost.
Tim Bell
@epowell101 We use the puppetlabs OpenStack modules and rpms based on the RDO packages. some care is needed to avoid all the cloud upgrading at once so we stage updates through QA and cell by cell.
Rodrigo Gazzaneo
@mikeonsing #EMC has announced integrated #HybridCloud @OpenStack flavored solutions for 2015
Rodrigo Gazzaneo
@mikeonsing another good blog post from @hui_kenneth http://cloudarchitec...
What EMC Is Up To With OpenStack Cloud Solutions
Today, EMC is announcing the availability of a family of EMC Enterprise Hybrid Cloud Solutions, including engineered IaaS solutions based on VMware, Microsoft, and OpenStack technologies.  The offi...
Sean Winn
@vGazza @mikeonsing #EMC announced solutions that will span the VMWare, OpenStack and Microsoft cloud solutions! Hybrid cloud is evolving.
Rodrigo Gazzaneo
@seanmwinn @mikeonsing after all #Cloud should be about choice!
Randy Bias
@epowell101 You're off base. OpenStack has no value for the true hyper scale folks. Just smaller web/tech outfits.
Randy Bias
@epowell101 OpenStack and devops are only indirectly related. Mostly orthogonal.
Randy Bias
@noggin143 What about the significant changes you made in the networking stack?
Kenneth Hui @rubrikInc HQ
On the topic of skill gaps, what do u look 4 when u want 2 hire someone that u think can learn OpenStack ops?
Cheyenne Bryant
The ability to be agile and learn. Python and networking are big plusses.
Kenneth Hui @rubrikInc HQ
How important are DevOps experience?
Tim Bell
At CERN, we're generally looking for Linux/Windows admins with an open source community approach. We find people learn very quickly once they get involved in the community.
Scott Carlson
high quality troubleshooting skill, the ability to think, the ability to read/interpret other people's code.
Cheyenne Bryant
DevOps experience is important for the troubleshooting aspect, but in general it's more important to find someone with a willingness and ability to learn without falling behind.
Kenneth Hui @rubrikInc HQ
@noggin143 Can u elaborate on OSS community approach?
Sean Winn
I look for people with problem solving skills and critical thinking skills who can admit to not knowing. Not having the answer and admitting to it is hard.
Tim Bell
The willingness to share your knowledge and learn from the experiences of others
cloud foreign
all of our code is open source. We require that our engineers contribute code with that in mind. We accept pull requests from outside the org and curate our releases.
Danny Abukalam
There's still a massive gap with people who just aren't used to working in the open and capitalizing on the open source community resources available because they come from a closed source background.
Kenneth Hui @rubrikInc HQ
@craig_tracey Does this mean OpenStack operators have 2 be able 2 write code?
David Pollack
@Dannyabukalam What's best way to bridge gap?
Tim Bell
we've found the OpenStack summits help people to understand community. Sitting in an ops design summit session is a great way to start to understand the benefits of sharing.
John Furrier
DevOps is an engineering position not just coder; top exec & geeks I speak with say ability to engineer is key and coding is requirement in some cases or at least some basic coding capability
Scott Carlson
Yes, but not necessarily python code. scripts/html/bash/perl/python all counts because automation is key
Tim Bell
Lots of ways to help other than coding... help on the documentation is an easy one
Tim Bell
Helping out people on http:://ask.openstack.org
Kenneth Hui @rubrikInc HQ
@noggin143 Yes but I wonder if @craig_tracey is implying that 2 be a proficient OpenStack operator u have 2 be able 2 code?
Danny Abukalam
@DavidMPollack It's a different way of thinking. I don't think it's something that will happen overnight. It's not just individuals but also entire organisations that have this way of thinking.
Sean Winn
To become a better operator, I've been learning to code. I've operated Infra for 20+ years thinking I could avoid it. I can't.
cloud foreign
absolutely not. We have a spectrum of "coders" and "operators"...we do expect that our operators can work with configuration management.
Tim Bell
From our experience, python experience is not needed to run a cloud. Understanding logs and googling tracebacks is needed.
David Pollack
@dannyabukalam Vendor marketing and product management has its work cut out for them. No time to waste.
Sean Winn
@colinmcnamara has a great talk on contributing as an operator - https://www.youtube....
Contributing Back As an Operator
Contributing Back as an Operator features Colin McNamara of Nexus IS, Inc. OpenStack needs more operators contributing back. Learn about the challenges, and ...
Ashok Bhojwani
This should be a 3 fold approach. Prepare for the Cloud admins, Get the right Use Cases for the Business, Get the right set of developers who can code for 3rd Platform apps.