Nate Baechtold, Enterprise Architect at EBSCO Information Services, says it was going to be too hard to automate the companys VMware environment so the firm shifted to OpenStack, which natively abstracts underlying components much like AWS. But the next sticking point was how to enable developers to build in load balancing? A self-service model using the existing hardware-based system was too complex, Baechtold tells Network World Editor in Chief John Dix, but a new software-defined tool fit the bill.
Nate Baechtold, Enterprise Architect at EBSCO Information Services
Lets start with a thumbnail description of your organization.
EBSCO Information Services is a discovery service provider for many things, including private journals, research databases, historical archives, medical reference databases, ebooks and corporate learning tools. Many of these are things you couldnt find on the public Internet. So, universities and other organizations subscribe to our services and we are able to federate searches over all these databases to provide the information they are looking for. This past year we peaked at somewhere close to 400 million searches per day.
Does it appeal to certain vertical markets, say legal or healthcare, or is it any and all of them?
Any and all of them. A large amount of traffic comes from libraries and universities providing research services to students.
What does the technical environment look like?
We have a public cloud based in AWS and three private data centers, two that support our live application and one that primarily supports development resources. The majority of our live runtime apps are supported by a private cloud we built on top of OpenStack.
The main data centers are in Boston and Ipswich Mass. for redundancy sake and to create failure domains, and we have a large fiber link between them, but the idea is each data center is autonomous and can run without the other one. We have roughly 400 physical servers in each data center, and the majority of our workloads are virtualized, so we have 5,000-6,000 VMs. From a virtualization perspective, were using a combination of VMware and OpenStack, but were actually migrating everything over to OpenStack which is built on top of KVM.
How long have you been building the OpenStack environment?
We opened it up for development two years ago, and about a year ago we started using it for our live resources. Ever since then weve had a large percentage of developers using it for self-service provisioning, and that adapted into a model where we started automating provisioning, automating deployments, really trying to automate all of our infrastructure.
Why the shift to OpenStack?
Because it was going to be too hard to automate our VMware platform. When you look at a cloud platform like AWS, you go in and get a VM and it is automatically assigned an IP address and receives everything it needs to run from the cloud platform. You are insulated from a lot of the other underlying hardware implementation. VMware abstracts some elements of that, but ultimately you still need to know what data store to put on it, you need to name the network, maybe a VLAN identifier or something else that ties it to your infrastructure. Theres very little abstraction, and trying to build a fully automated model on top of that was going to be really difficult.
Thats why there are so many management platforms on top of VMware -- to insulate you from that API -- whereas OpenStack natively abstracts the underlying implementation. You create a consistent platform the same way you do in AWS, so you have an instance very analogous to Amazons EC2 (Elastic Compute Cloud), you have a volume in OpenStack thats just like an EBS (Elastic Block Store) volume in AWS, youve got load balancing as a service, youve got images and many other things. Theyre not API compatible, but they operate in a very similar way so it is easy to build infrastructure automation for your continuous integration/continuous deployment (CI/CD) pipeline.
We viewed the adoption of the OpenStack API as an easy onramp for getting full infrastructure automation and also getting integration with our CI/CD processes. Additionally, since its built to be a public cloud product, we didnt have to fight with permissions. With vSphere you have to deal with permissions to folders, resource groups, and many other things. Instead of having to fight with individual permissions, we give developers a project. That project is logically separated from all the other infrastructure, like theyre operating their own private data center.
It makes it easy for them to write automation because they dont need to worry about breaking things, bringing down the whole environment or affecting people on shared resources. It lowers the barrier to entry to write automation, to experiment and test. Those are really the core capabilities that OpenStack gave us, which is why we went with it. It was mostly focused around the API and accelerating our development efforts and accelerating our infrastructure automation efforts.
What percentage of your workloads are on OpenStack at this point?
Of our virtualized infrastructure, I would say around half. The goal is to migrate everything.
You mentioned you have some AWS cloud resources. Is part of the reason to go with OpenStack because it will make it easier to use AWS in a spillover capacity?
Due to data locality and a whole bunch of other problems, it isnt easy to realize a hybrid cloud where you transparently migrate workloads back and forth. We, like probably most companies, are actively working to get into AWS and to get to the public cloud, but we realize we still need a private cloud to be able to serve our own internal data centers in the meantime.
Do you think long term youll be all-in with a public IaaS service, getting away from managing your own stuff?
Yeah. I would say that is our long-term goal. How long it takes to get there is another question, but that would be our long-term goal. Today we use AWS for BI processing and hosting some of our runtime services.
As I understand it, another thing you virtualized was your Application Delivery Controllers. What lead you down that path?
We created this private cloud where users could provision and tear down VMs to their hearts content, and they did it very, very frequently. The level of change velocity in this environment is incredible. Weve had over 420,000 VMs created and destroyed in the past two years.
But really a cloud isnt useful until youve given your development and operations teams the ability to self-service all the capabilities they need to build their live applications. Out of the box they can build VMs. Thats great. However, they couldnt hook them up to load balancing or many of the other things they needed. Load balancing was the number one pain point because you couldnt build a highly available application without some semblance of load balancing.
So first we tried to create a self-service model on top of our existing hardware-based load balancing system, where we could enable teams to provision new content rules, new virtual IPs, everything they need to build and manage their applications. But it was surprisingly hard to do. To create a system that could be fully automated was almost impossible on our existing solution.
Did your hardware ADC provider offer a software version of their appliance?
Yes, they did. They offered a VM version but all it did was shift the problem. It didnt solve the problem. The only way it helped us was to say, Okay teams, now you configure and manage your own virtual load balancers. They werent too happy with that because it added complexity.
It wouldnt have been very efficient to take this problem that was solved before by a dedicated load balancing team and shift it so that now everyone had to become subject matter experts on a specific load balancing technology. So we looked into tapping into load balancer as a service on OpenStack and pointing it to our existing vendor, and that didnt work out very well. The driver wasnt very mature at that point in time and it wound up causing all sorts of problems. Thats what caused us to start looking for alternatives.
Can you give us some perspective in terms of what the load balancers were being asked to do?
We had a very SOA-heavy architecture. We probably had around 80 or so services in our mid- and back-tiers communicating with each other, so the edge, the front tier, was a small portion of what the load balancers were doing in this environment.
And what solved the problem for you?
We wound up seeing a company called Avi Networks at the OpenStack Summit and they had some really interesting demos. The attraction was multifold:
* First, from an access perspective and API perspective, they aligned perfectly with OpenStacks multitenancy system. What they do is view a load balancer as a project, a tenant, just like OpenStack creates a project and a tenant, and that represents your view of the world. You can only see things in your tenant, you can only affect things in your tenant. If I give you a logical slice of Avi through a tenant, just like through OpenStack, you can only break things in your own world. It makes it easy to hand load balancing responsibilities off to different teams. We give you access to your view of the load balancer and you can perform all of the functions you need to build and manage your applications from the ground up automatically. That was really cool.
* The second thing, which wound up appealing to us even more, was the insight and analytics engine that came with it. We used to get some very raw metrics from a load balancer, but the analytics we get out of Avi are extremely valuable; things like better end-to-end performance results and automatic anomaly detection and tracking. And something that wound up being very useful was significant event detection. It logs what it sees as significant events and weve used that to find network issues that werent detected before.
Our development operations teams wound up liking that element probably the most out of all because now theyve got all this visibility, all this insight into application performance they didnt have before. It created a strong desire to migrate over to the product.
How did Avi address the need for simplicity, the problem you were having with the other product?
The setup and usage of Avi was straightforward. It literally took us 20 minutes to get a highly available instance deployed, configured and integrated into our OpenStack cloud, which was awesome.
From a user perspective, the interface is very intuitive and easy to use. There arent any superfluous options, and if there are they are cordoned off into their own little bounded context area; network settings, for example, are in a network profile section and, unless you care about that, you dont need to deal with it or know it exists. You just take whatever the standard is. We were able to point dev teams at it and people with no load balancing experience were able to quickly create highly available load balanced environments.
Where we used to have a centralized network team do all of our load balancing functions, writing custom rules trying to distill them down for other people to use, now were able to distribute these functions to all the operations team because they are so much simpler.
How is it deployed?
We point it at our OpenStack cloud and it integrates with it. It integrates with the projects, aligns with its multitenancy model, and provisions load balancers on the OpenStack cloud to use. Theyre called the service engines. It automatically scales up and scales down the service engines based on demand. From our perspective, pretty much we carved out an OpenStack project, we told Avi to put load balancer VMs here and it autoscales them in and out as it sees fit.
Were you concerned at all about a potential performance hit, shifting from a hardware to a software-based product?
Initially we were concerned, but so far every single performance test weve done, and every single live application we converted, hasnt shown any performance hit. In fact, in some cases we wound up getting better performance due to the insight and analytics engine pointing out inefficiencies that we had not noticed before.
Did you justify the migration on the promised ease of use, or was there a cost factor as well?
I would say the ease of use. The integration with our strategy, with our private cloud, were the real drivers, but there was a cost-saving element to it as well. It wound up being considerably cheaper than our existing solution because it didnt rely on proprietary hardware, we are just paying for the software, and it is scaling on the same x86 virtualization platform all of our systems are running on.
Any hiccups along the way in terms of implementation or lessons learned?
There are always hiccups. In converting one of our applications over we found one of the performance settings we had set wound up being inefficient for the type of application, and it was sending very large quantities of HTTP post data to this service and we didnt know it. It wound up being an application where we saw performance increase once wetuned the TCP Windows scaling settings.
It sounds like the product has worked out well for you.
It has. Weve gotten to the point where now were using it to do blue-green deployments of our applications to achieve full infrastructure automation. As part of a software release well spin up an entire new farm of servers, hook it up to our load balancer, validate it independently, and just switch the load balancer to feed traffic to the new software in one atomic action. Were automatically standing up new environments, virtual services and load balancer rules through complete automation, and we still get the visibility required. Its been one of the more successful things at our company.
View original post here:
- Automation, COVID, And The Future Of Work - Forbes - October 19th, 2020
- Most cybersecurity pros believe automation will make their jobs easier - Help Net Security - October 19th, 2020
- ancora Software Partners with HelpSystems for Intelligent Process Automation - Benzinga - October 19th, 2020
- Customer Service: How to Balance AI and Automation with Human Touch - Finextra - October 19th, 2020
- Circular Edge Customer Success Stories Illustrate the Importance of Automation with Oracle JD Edwards - Benzinga - October 19th, 2020
- ANZ New Zealand turns to Red Hat for automation & collaboration - IT Brief Australia - October 19th, 2020
- Where CFOs might spend more time: How about strategy, automation and data analytics? - CFO Dive - October 19th, 2020
- Robotic Process Automation: Transforming the world of finance - CNBCTV18 - October 19th, 2020
- Laying the Groundwork for a Self-Optimizing Plant - Automation World - October 19th, 2020
- Automated ATOs and cybersecurity - FCW.com - October 19th, 2020
- Strategies for realizing the full benefits of automation - Pet Food Processing - October 19th, 2020
- Midwest Precision Adds Automated Turning Center to Increase Unattended Lights Out Manufacturing, Improve Process CPK, Shorten Lead Times, and Reduce... - October 19th, 2020
- Faster innovation with automated ATOs - GCN.com - October 19th, 2020
- Intuit Automated Our Personal Finances. Now Its UX Team Is Bringing Human Helpers Back. - Built In - October 19th, 2020
- Coinrule Launches Its Automated Trading Platform To The Wider Market - Exchange News Direct - October 19th, 2020
- Logistics Manager Analysis: Automating conveyors and sortation systems - Logistics Manager - October 19th, 2020
- Solve Unique Accounts Payable Problems and Learn More About the Importance of AP Automation in Today's Economy With IntelliChief - GlobeNewswire - October 19th, 2020
- Volkswagen invests in automation, thousands of robots ordered for its EV plants - Hindustan Times Auto News - October 19th, 2020
- Bruker Introduces Routine Gradient Spectroscopy and Robust, Industry-Standard PAL Automation on High-Performance Fourier 80 Benchtop FT-NMR System -... - October 19th, 2020
- Automated aerocomposites production: Liquid molding or welded thermoplastic? - CompositesWorld - October 19th, 2020
- Nursery automation focus of new effort led by UTIA - williamsonherald.com - October 19th, 2020
- Automation Realities in the Context of SOAR - Security Intelligence - August 21st, 2020
- Using AI, automation to bolster network capacity planning - Federal News Network - August 21st, 2020
- How robotics and automation could create new jobs in the new normal - VentureBeat - August 21st, 2020
- Is Automation the Future of the Supply Chain? | Technology - Supply Chain Digital - The Procurement & Supply Chain Platform - August 21st, 2020
- Automation Testing Market to Reap Excessive Revenues by 2025 - Scientect - August 21st, 2020
- How Brands Meet Evolving Customer Expectations with Creative Automation - Street Fight - August 21st, 2020
- Is Automation of Data Science Tasks the Future? - Analytics Insight - August 21st, 2020
- HashiCorp Partners With Carahsoft to Bring Cloud Infrastructure Automation to the Public Sector - GlobeNewswire - August 21st, 2020
- Building The Ultimate Raspberry Pi Automation Controller - Hackaday - August 21st, 2020
- Robotic Process Automation Market 2020 Trending Innovation, New Technology, Growing Opportunities, Major Players, Industry Outlook And Regional... - August 21st, 2020
- COVID-19 Update: Global Workload Scheduling and Automation Software Market is Expected to Grow at a Healthy CAGR with top players IBM, CA... - August 21st, 2020
- SPOC Automation Named to the Inc. 5000 List for the Third Time - PRNewswire - August 21st, 2020
- Automated fact-checking can catch claims that slip past human checkers. Here are the two ways they work. - Poynter - August 21st, 2020
- Quantzig: Intelligent Automation Can Prove Resourceful for the Healthcare and Life Sciences Sector | Contact Us for Detailed Insights - Business Wire - August 21st, 2020
- Robotic Process Automation Market Size, Trends, Analysis, Demand, Outlook And Forecast 2026 Sutherland Bulgaria, Automation Anywhere Inc., Blue Prism... - August 21st, 2020
- Enterprise Workflow Automation Software Market Forecasts 2020-2026 : Growth Analysis By Key Drivers, Regions, Sorts and Applications - Scientect - August 21st, 2020
- #1 Meeting Automation Platform Jifflenow Integrates with ON24 - Martechcube - August 21st, 2020
- Automated Sortation System Market Surges on the Back of Enhanced Efficiency in Production Units, Future Market Insights - Scientect - August 21st, 2020
- BioCatch reveals a tool that helps fraud teams provide security automation - The Paypers - August 21st, 2020
- Don't spread fears over automation, union tells banks - Free Malaysia Today - August 21st, 2020
- Global Irrigation Automation Market Outlook to 2027 - Water Conservation and Increased Mechanization in Agriculture are Driving Market Growth -... - August 10th, 2020
- The Global Industrial Automation Device Manager Software Market is expected to grow by $ 1 bn during 2020-2024 progressing at a CAGR of 6% during the... - August 10th, 2020
- NATS - The challenges of fully automating air traffic management - sUAS News - August 10th, 2020
- How does automation affect our lives and should it be reduced? - Electropages - August 10th, 2020
- Robot Process Automation (RPA) Market Overview with Detailed Analysis, Competitive landscape, Forecast to 2025 - AlgosOnline - August 10th, 2020
- Preserve Innovation And Empathy As You Automate - Forbes - August 10th, 2020
- Fortescue to bring automation expertise to Curtin University WASM curriculum - International Mining - August 10th, 2020
- Automation Council Announces a New Initiative for Automation as a Service - GlobeNewswire - August 10th, 2020
- IoT automation trend rides the next wave of machine learning, Big Data - Urgent Communications - August 10th, 2020
- Intelligent Process Automation Market 2020 | In-Depth Study On The Current State Of The Industry And Key Insights Of The Business Scenario By 2026 -... - August 10th, 2020
- Parrot + Dronisos: Imagining the future of Drone Automation - sUAS News - August 10th, 2020
- COVID-19 Impact & Recovery Analysis - Cable Tray Market (2020-2024) | Increasing Adoption of Automation and Communication Technologies to Boost... - August 10th, 2020
- Orthopedic Surgical Robots Market: Increasing demand for automation in medical industry is driving the market - BioSpace - August 10th, 2020
- Automation: The future of the combat vehicle? - Defence Connect - August 10th, 2020
- Using Automated Security Protocols Reduce the Cost of Data Breaches, Report Says - Nextgov - August 10th, 2020
- Quantzig: Unleash the Power of AI and Intelligent Automation to Make-headway in the New Normal - Business Wire - August 10th, 2020
- Balancing Employee Health and Safety With Business Continuity During COVID-19 - Automation World - August 10th, 2020
- The 3 Telltale Signs That It's Time for You to Automate - mySanAntonio.com - August 10th, 2020
- Frost & Sullivan Reveals Innovative Technologies to Revolutionize the Global Building Automation Systems Market - PRNewswire - August 10th, 2020
- Automation Control Components and Devices Market Competitive Insights, Business Growth and Opportunities 2020-2026 - eRealty Express - August 10th, 2020
- State of the Art in Automated Machine Learning - InfoQ.com - August 10th, 2020
- Francis Carden of Pega: RPA Doesn't Automatically Mean You're Adding Intelligence to Your Automation Efforts - Small Business Trends - August 10th, 2020
- Software Will Determine the Future of Industrial Automation - Electronic Design - August 10th, 2020
- Measuring Automation Light Grids Market Report, History and Forecast 2015-2025, Breakdown Data by Manufacturers, Key Regions, Types and Application -... - August 10th, 2020
- Parrot and Dronisos join forces to explore drone automation - DroneDJ - August 10th, 2020
- Stay Tuned with the Epic Battle in the COVID19 Outbreak IT Robotic Automation Market - Levee Report - August 10th, 2020
- COVID-19 Impacts: Industrial Automation Market in Life Sciences Industry will Accelerate at a CAGR of Over 6% through 2020-2024 | Demand for... - August 10th, 2020
- The Global Industrial Automation Control Market is expected to grow by $ 25.18 bn during 2020-2024 progressing at a CAGR of 5% during the forecast... - August 10th, 2020
- Food Automation Consumption Market Size, Global Future Trend, Segmentation, Business Growth, Top Key Players, Opportunities and Forecast to 2027 -... - August 10th, 2020
- Pax8 Gives MSPs Access to Liongard Automation Platform - Channelnomics - August 10th, 2020
- Is fully contactless automation the future of supply chain technology? - TechHQ - August 9th, 2020
- Pegasystems Named a Visionary in Gartner's Magic Quadrant for Robotic Process Automation - PRNewswire - August 9th, 2020
- COVID-19 Impacts: Global Industrial Automation Control Market will Accelerate at a CAGR of almost 5% through 2020-2024 | Need For Simplification of... - August 9th, 2020
- Global Industrial Automation Control Industry Outlook, 2024 - Increasing Focus on Smart Factories and Changing Market Dynamics - GlobeNewswire - August 9th, 2020
- Automation in Automotive Market Report 2020 Industry Capacity, Manufacture, - News by aeresearch - August 9th, 2020
- Automation Testing Tools Market - Growth, Trends, and Forecast (2020 - 2025) - News by aeresearch - August 9th, 2020
- Switching Automation Light Grids Market: Opportunities, Demand and Forecasts, 2 - News by aeresearch - August 9th, 2020
- Automation in Biopharmaceutical Market Structure, Industry Inspection, and Fore - News by aeresearch - August 9th, 2020
- Clinical Diagnostics Automation Market Globally Expected to Drive Growth Through 2019-2026 - My Amazon Echo - August 9th, 2020