Nate Baechtold, Enterprise Architect at EBSCO Information Services, says it was going to be too hard to automate the companys VMware environment so the firm shifted to OpenStack, which natively abstracts underlying components much like AWS. But the next sticking point was how to enable developers to build in load balancing? A self-service model using the existing hardware-based system was too complex, Baechtold tells Network World Editor in Chief John Dix, but a new software-defined tool fit the bill.
Nate Baechtold, Enterprise Architect at EBSCO Information Services
Lets start with a thumbnail description of your organization.
EBSCO Information Services is a discovery service provider for many things, including private journals, research databases, historical archives, medical reference databases, ebooks and corporate learning tools. Many of these are things you couldnt find on the public Internet. So, universities and other organizations subscribe to our services and we are able to federate searches over all these databases to provide the information they are looking for. This past year we peaked at somewhere close to 400 million searches per day.
Does it appeal to certain vertical markets, say legal or healthcare, or is it any and all of them?
Any and all of them. A large amount of traffic comes from libraries and universities providing research services to students.
What does the technical environment look like?
We have a public cloud based in AWS and three private data centers, two that support our live application and one that primarily supports development resources. The majority of our live runtime apps are supported by a private cloud we built on top of OpenStack.
The main data centers are in Boston and Ipswich Mass. for redundancy sake and to create failure domains, and we have a large fiber link between them, but the idea is each data center is autonomous and can run without the other one. We have roughly 400 physical servers in each data center, and the majority of our workloads are virtualized, so we have 5,000-6,000 VMs. From a virtualization perspective, were using a combination of VMware and OpenStack, but were actually migrating everything over to OpenStack which is built on top of KVM.
How long have you been building the OpenStack environment?
We opened it up for development two years ago, and about a year ago we started using it for our live resources. Ever since then weve had a large percentage of developers using it for self-service provisioning, and that adapted into a model where we started automating provisioning, automating deployments, really trying to automate all of our infrastructure.
Why the shift to OpenStack?
Because it was going to be too hard to automate our VMware platform. When you look at a cloud platform like AWS, you go in and get a VM and it is automatically assigned an IP address and receives everything it needs to run from the cloud platform. You are insulated from a lot of the other underlying hardware implementation. VMware abstracts some elements of that, but ultimately you still need to know what data store to put on it, you need to name the network, maybe a VLAN identifier or something else that ties it to your infrastructure. Theres very little abstraction, and trying to build a fully automated model on top of that was going to be really difficult.
Thats why there are so many management platforms on top of VMware -- to insulate you from that API -- whereas OpenStack natively abstracts the underlying implementation. You create a consistent platform the same way you do in AWS, so you have an instance very analogous to Amazons EC2 (Elastic Compute Cloud), you have a volume in OpenStack thats just like an EBS (Elastic Block Store) volume in AWS, youve got load balancing as a service, youve got images and many other things. Theyre not API compatible, but they operate in a very similar way so it is easy to build infrastructure automation for your continuous integration/continuous deployment (CI/CD) pipeline.
We viewed the adoption of the OpenStack API as an easy onramp for getting full infrastructure automation and also getting integration with our CI/CD processes. Additionally, since its built to be a public cloud product, we didnt have to fight with permissions. With vSphere you have to deal with permissions to folders, resource groups, and many other things. Instead of having to fight with individual permissions, we give developers a project. That project is logically separated from all the other infrastructure, like theyre operating their own private data center.
It makes it easy for them to write automation because they dont need to worry about breaking things, bringing down the whole environment or affecting people on shared resources. It lowers the barrier to entry to write automation, to experiment and test. Those are really the core capabilities that OpenStack gave us, which is why we went with it. It was mostly focused around the API and accelerating our development efforts and accelerating our infrastructure automation efforts.
What percentage of your workloads are on OpenStack at this point?
Of our virtualized infrastructure, I would say around half. The goal is to migrate everything.
You mentioned you have some AWS cloud resources. Is part of the reason to go with OpenStack because it will make it easier to use AWS in a spillover capacity?
Due to data locality and a whole bunch of other problems, it isnt easy to realize a hybrid cloud where you transparently migrate workloads back and forth. We, like probably most companies, are actively working to get into AWS and to get to the public cloud, but we realize we still need a private cloud to be able to serve our own internal data centers in the meantime.
Do you think long term youll be all-in with a public IaaS service, getting away from managing your own stuff?
Yeah. I would say that is our long-term goal. How long it takes to get there is another question, but that would be our long-term goal. Today we use AWS for BI processing and hosting some of our runtime services.
As I understand it, another thing you virtualized was your Application Delivery Controllers. What lead you down that path?
We created this private cloud where users could provision and tear down VMs to their hearts content, and they did it very, very frequently. The level of change velocity in this environment is incredible. Weve had over 420,000 VMs created and destroyed in the past two years.
But really a cloud isnt useful until youve given your development and operations teams the ability to self-service all the capabilities they need to build their live applications. Out of the box they can build VMs. Thats great. However, they couldnt hook them up to load balancing or many of the other things they needed. Load balancing was the number one pain point because you couldnt build a highly available application without some semblance of load balancing.
So first we tried to create a self-service model on top of our existing hardware-based load balancing system, where we could enable teams to provision new content rules, new virtual IPs, everything they need to build and manage their applications. But it was surprisingly hard to do. To create a system that could be fully automated was almost impossible on our existing solution.
Did your hardware ADC provider offer a software version of their appliance?
Yes, they did. They offered a VM version but all it did was shift the problem. It didnt solve the problem. The only way it helped us was to say, Okay teams, now you configure and manage your own virtual load balancers. They werent too happy with that because it added complexity.
It wouldnt have been very efficient to take this problem that was solved before by a dedicated load balancing team and shift it so that now everyone had to become subject matter experts on a specific load balancing technology. So we looked into tapping into load balancer as a service on OpenStack and pointing it to our existing vendor, and that didnt work out very well. The driver wasnt very mature at that point in time and it wound up causing all sorts of problems. Thats what caused us to start looking for alternatives.
Can you give us some perspective in terms of what the load balancers were being asked to do?
We had a very SOA-heavy architecture. We probably had around 80 or so services in our mid- and back-tiers communicating with each other, so the edge, the front tier, was a small portion of what the load balancers were doing in this environment.
And what solved the problem for you?
We wound up seeing a company called Avi Networks at the OpenStack Summit and they had some really interesting demos. The attraction was multifold:
* First, from an access perspective and API perspective, they aligned perfectly with OpenStacks multitenancy system. What they do is view a load balancer as a project, a tenant, just like OpenStack creates a project and a tenant, and that represents your view of the world. You can only see things in your tenant, you can only affect things in your tenant. If I give you a logical slice of Avi through a tenant, just like through OpenStack, you can only break things in your own world. It makes it easy to hand load balancing responsibilities off to different teams. We give you access to your view of the load balancer and you can perform all of the functions you need to build and manage your applications from the ground up automatically. That was really cool.
* The second thing, which wound up appealing to us even more, was the insight and analytics engine that came with it. We used to get some very raw metrics from a load balancer, but the analytics we get out of Avi are extremely valuable; things like better end-to-end performance results and automatic anomaly detection and tracking. And something that wound up being very useful was significant event detection. It logs what it sees as significant events and weve used that to find network issues that werent detected before.
Our development operations teams wound up liking that element probably the most out of all because now theyve got all this visibility, all this insight into application performance they didnt have before. It created a strong desire to migrate over to the product.
How did Avi address the need for simplicity, the problem you were having with the other product?
The setup and usage of Avi was straightforward. It literally took us 20 minutes to get a highly available instance deployed, configured and integrated into our OpenStack cloud, which was awesome.
From a user perspective, the interface is very intuitive and easy to use. There arent any superfluous options, and if there are they are cordoned off into their own little bounded context area; network settings, for example, are in a network profile section and, unless you care about that, you dont need to deal with it or know it exists. You just take whatever the standard is. We were able to point dev teams at it and people with no load balancing experience were able to quickly create highly available load balanced environments.
Where we used to have a centralized network team do all of our load balancing functions, writing custom rules trying to distill them down for other people to use, now were able to distribute these functions to all the operations team because they are so much simpler.
How is it deployed?
We point it at our OpenStack cloud and it integrates with it. It integrates with the projects, aligns with its multitenancy model, and provisions load balancers on the OpenStack cloud to use. Theyre called the service engines. It automatically scales up and scales down the service engines based on demand. From our perspective, pretty much we carved out an OpenStack project, we told Avi to put load balancer VMs here and it autoscales them in and out as it sees fit.
Were you concerned at all about a potential performance hit, shifting from a hardware to a software-based product?
Initially we were concerned, but so far every single performance test weve done, and every single live application we converted, hasnt shown any performance hit. In fact, in some cases we wound up getting better performance due to the insight and analytics engine pointing out inefficiencies that we had not noticed before.
Did you justify the migration on the promised ease of use, or was there a cost factor as well?
I would say the ease of use. The integration with our strategy, with our private cloud, were the real drivers, but there was a cost-saving element to it as well. It wound up being considerably cheaper than our existing solution because it didnt rely on proprietary hardware, we are just paying for the software, and it is scaling on the same x86 virtualization platform all of our systems are running on.
Any hiccups along the way in terms of implementation or lessons learned?
There are always hiccups. In converting one of our applications over we found one of the performance settings we had set wound up being inefficient for the type of application, and it was sending very large quantities of HTTP post data to this service and we didnt know it. It wound up being an application where we saw performance increase once wetuned the TCP Windows scaling settings.
It sounds like the product has worked out well for you.
It has. Weve gotten to the point where now were using it to do blue-green deployments of our applications to achieve full infrastructure automation. As part of a software release well spin up an entire new farm of servers, hook it up to our load balancer, validate it independently, and just switch the load balancer to feed traffic to the new software in one atomic action. Were automatically standing up new environments, virtual services and load balancer rules through complete automation, and we still get the visibility required. Its been one of the more successful things at our company.
View original post here:
- Even With Industry 4.0, Sometimes The Best Level Of Automation Is None - Forbes - January 5th, 2020
- What we can do to make sure automation doesn't negatively affect the work force - TNW - January 5th, 2020
- Automation and Public Policy - State of the Planet - January 5th, 2020
- In 2020, AI to enable acceleration from automation to autonomy, say experts - Robot Report - January 5th, 2020
- Improving Your Manufacturing Productivity and Quality with CMM Networking and Automation - Quality Magazine - January 5th, 2020
- Listen to top VCs discuss the next generation of automation startups at TC Sessions: Robotics+AI - TechCrunch - January 5th, 2020
- How the most vulnerable workers to job automation can adapt - Yahoo Money - January 5th, 2020
- DevOps The Troubles Of Automating All The Things - JAXenter - January 5th, 2020
- The unsettling grip of the automated gods | News, Sports, Jobs - Williamsport Sun-Gazette - January 5th, 2020
- Automation and AI will launch a golden age of marketing - The Drum - January 5th, 2020
- Hashtag Trending Automation predictions for 2020 - ITBusiness.ca - January 5th, 2020
- Stories that will define the next decade: Automation will likely cause changes to the ports of LA, Long Beach - The Daily Breeze - January 5th, 2020
- True automation, a bigger streaming revolution: Tech that will take over our lives this year - Economic Times - January 5th, 2020
- Robotic Process Automation Market Size, Outlook on Key Growth Trends, Factors and Forecast to 2026 - ReportsPioneer - January 5th, 2020
- Home Automation Is Taking Control On The Upper Cape - CapeNews.net - January 5th, 2020
- Despite Chaotic Year, Automation, AI Offer Benefits to Indian IT Industry - Analytics Insight - January 5th, 2020
- How AI may be the key to future-proofing jobs at risk of being automated - Employee Benefit News - January 5th, 2020
- The End of the Road for Spreadsheets? - Automation World - January 5th, 2020
- What is Automation | IBM - December 31st, 2019
- Automation benefits and costs - Economics Help - December 31st, 2019
- Save 15% on Automation - The Car Company Tycoon Game on Steam - December 31st, 2019
- Pricing - Automation | Microsoft Azure - December 31st, 2019
- Automation | Definition of Automation at Dictionary.com - December 31st, 2019
- What is Automation?- ISA - December 31st, 2019
- Using robotic process automation to manage revenue cycles - Healthcare IT News - December 31st, 2019
- Guest Post: Why 2020 Will be Better Than 2019 in Automation - Robotics Business Review - December 31st, 2019
- 5 Robotic Process Automation Trends To Look For In 2020 - Inc42 Media - December 31st, 2019
- Vanguard: automation is great until it doesn't work - FX Week - December 31st, 2019
- Crestview Weighed IPO of JR Automation Before Clinching $1.4 Billion Sale - Barron's - December 31st, 2019
- What Jobs Will be Lost to Automation? - San Diego Entertainer Magazine - December 31st, 2019
- Energy Asset Performance Management to Take on Automation - IoT World Today - December 31st, 2019
- How to get started with HomeKit home automation - Cult of Mac - December 31st, 2019
- Part of the trucking industry is already becoming fully automated - Inverse - December 31st, 2019
- Embedded Automation Computers Market: Comprehensive Evaluation Of The Market Via In-Depth Qualitative Insights - AnalyticSP - December 31st, 2019
- The global automated blood tube labeler and specimen transport box market at a CAGR of over 7% during the forecast period - PRNewswire - December 31st, 2019
- 'If we can't automate it, we don't build it': Wealthfront's Andy Rachleff on 'self-driving money' - bankinnovation.net - December 31st, 2019
- Field Force Automation Market Expected to Grow with a CAGR of 18.2% During the Forecast Period, 2019-2024 - Yahoo Finance - December 31st, 2019
- The global modular laboratory automation market at a CAGR of over 6% during the forecast period - P&T Community - December 31st, 2019
- Research Analysts Recent Ratings Updates for Hollysys Automation Technologies (HOLI) - Riverton Roll - December 31st, 2019
- Automation | Britannica - December 26th, 2019
- Automation - Advantages and disadvantages of automation ... - December 26th, 2019
- How Personal Branding Can Make You Stand Out In The Age Of Automation - Forbes - December 26th, 2019
- Predictions 2020: Is Security Automation the Answer? - Security Boulevard - December 26th, 2019
- Top Article of 2019 - Warehouse and Supply Chain Automation - Robotics Tomorrow - December 26th, 2019
- The future is autonomous: 5 reasons why automation will be tech's major story in 2020 - SiliconANGLE - December 26th, 2019
- Building Trust In A Retail Workforce Threatened By Automation - Retail TouchPoints - Retail TouchPoints - December 26th, 2019
- Self-Checkout in France Sets Off Battle Over a Day of Rest - The New York Times - December 26th, 2019
- Survey: 75% of U.S. Workers Think Their Jobs are Safe from Automation - Robotics Business Review - December 26th, 2019
- Uniqlo heads towards full warehouse automation with groundbreaking robot that can fold and box clothes - The Telegraph - December 26th, 2019
- Warehouse Automation: A New Age of Workplace Safety and Efficiency - Supply and Demand Chain Executive - December 26th, 2019
- How Immigrant Workers Are Preparing For Automation In Agriculture - 90.3 KAZU - December 26th, 2019
- 2020 Priorities: Sanitation, Automation and Brand Transparency in Supply Chain - FoodSafetyTech - December 26th, 2019
- What the HiQ vs. LinkedIn Case Means for Automated Web Scraping - CPO Magazine - December 26th, 2019
- Who is afraid of automation displacing jobs? - Livemint - December 26th, 2019
- The roadmap to implementing automation and AI must include 'people' - Tech Wire Asia - December 26th, 2019
- Capgemini makes the case for intelligent process automation - Gigabit Magazine - Technology News, Magazine and Website - December 26th, 2019
- PayClip taps TreasuryXpress for treasury automation - IBS Intelligence - December 26th, 2019
- Mindtree Recognized as an Innovator by Avasant in Intelligent Automation Services - PRNewswire - December 26th, 2019
- 25 Benefits of Robotic Process Automation in Today's Time - TechFunnel - December 26th, 2019
- Process Automation Systems Market 2019, Trend, CAGR Status, Growth, Analysis and Forecast to 2025 - AnalyticSP - December 26th, 2019
- Global Automation Testing Market Quantitative Information of Size, Leading Players, Shares, Threats and Trends - Neptune Pine - December 26th, 2019
- Intelligent Process Automation Market Generate Massive Revenue In Upcoming Future 20192027 - News Cast Report - December 26th, 2019
- ChatBook Raises $1M to Strengthen Its Social Media Automation Platform - MarTech Advisor - December 26th, 2019
- Global Process Automation Software Market Size, Growth, Industry Analysis and Forecast 2019 To 2026 - Testifyandrecap - December 26th, 2019
- What Employees Tell Us About Automation and Re-skilling - MIT Sloan - December 18th, 2019
- New study says the next wave of automation is coming for Orlando's workforce - Orlando Weekly - December 18th, 2019
- Convoys latest digital trucking breakthrough is 100% automation of the load pricing process - GeekWire - December 18th, 2019
- The Twin Trends of Aging and Automation - GC Capital Ideas - December 18th, 2019
- Aragon Research Positions HelloSign as a Leader in the Tech Spectrum for Workflow and Content Automation, 2020 - Business Wire - December 18th, 2019
- RPA (Robotic Process Automation): Whats In Store For 2020? - Forbes - December 18th, 2019
- Edge computing key industrial automation trend in 2020 - DesignNews - December 18th, 2019
- This Was A Big Year For Fintech, Real Estate, Insurance, And Automation - Crunchbase News - December 18th, 2019
- Automation And Machine Learning: Transforming The Office Of The CFO - Forbes - December 18th, 2019
- Picnic Announces Its Automated Pizza Assembly Robot Will Serve Attendees of the Consumer Electronics Show, January 7-10, 2020 - Yahoo Finance - December 18th, 2019
- Mining automation: is Mali leading us into the future of work? - Raconteur - December 18th, 2019
- Equinor ties up offshore Norway automation, safety needs - Offshore Oil and Gas Magazine - December 18th, 2019
- Customers Rank Verint Highest in Overall Vendor Satisfaction in New Report on Robotic Process Automation - Business Wire - December 18th, 2019
- Older workers most anxious about automation - The Actuary - December 18th, 2019
- Albertsons, Takeoff Technologies expand automation partnership - Supermarket News - December 18th, 2019
- Keysight Technologies and Nozomi Networks collaborate to deliver industrial cyberdefense solution - Automation.com - December 18th, 2019