To realize the benefits of test automation,organizations have to take full advantage of smartertools, according to theThe World Quality Report 20202021.
Smart tools are those thatinclude more features based onartificial intelligence (AI)and machine learning (ML). These, along witha proliferation of JavaScript-based testing tools, more API testing, andmore emphasis on skills, are the trends to watch this year, experts say.
Here's what your organization needs to know about the state of test automation tools.
One of last year's predictionsthat'shappening now is the increased use of AIand MLin testing tools to make test automation easier, said Diego Lo Giudice, vice president and principal analyst at Forrester Research.
"The trend that everybody was expecting was that developers would take over testing. But developers don't really like testing. We can give them some testing to do, but the rest of the testing is done by other personas, such as the business testing persona."Diego Lo Giudice
However, while expectations of the benefits that AI and ML in testingcan bring to quality assurance remain high, and adoption is on the increase, there are few signs of significant general progress, as the World Quality Report noted:
"Partly, this is because relevant skill sets still aren't in place; and partly, the arrival of the COVID-19 pandemic has disrupted schedules, budgets, and plans.Nonetheless, enthusiasm hasn't diminished [and] organizations are putting AI high among their selection criteria for new QA solutions and tools."
The reason: Smart technologies will increase cost-efficiency, reduce the need for manual testing, shorten time to market, and help create and sustain continuous quality improvements, the report found.
Otherbenefits of AI-basedtest automationincludereducing test creation time, boosting test coverage, increasing resiliency of testing assets, and cutting down on test maintenance efforts, said Nick Mears, product marketing manager for functional testing at Micro Focus.
Additionally, new ML techniques are being applied to determine the scope of optimal automation tests; the goal is"to reduce the exponential growth in test scripts," according to the report.
Another new automation technique is the use of AI-based, self-healing scripts to automatically modify scripts during runtime, in case of object and page element changes, the report noted.
Although more tools are sporting AI capabilities, adoption has been limited to this point, said Malcolm Isaacs, a testing evangelist at Micro Focus. But that's about to change.
"We're at the point where I think we're going to take off. The tool set that we've had up until now has enabled a certain amount of AI-based automation. [But now] is kind of the inflection point where we can take it to the mainstreamit's now production-ready."Malcolm Isaacs
One of the most prominent trends in 2021 will be the increaseof JavaScript-based testing tools, such as Jest, Cypress, Puppeteer, and Playwright, said Nikolay Advolodkin, CEO and senior test automation engineer at Ultimate QA.
This is happeningbecause a lot of front-end web development is done with JavaScript. And when writing code in JavaScript, it is just mucheasier to alsotest that code in JavaScript, according to Advolodkin.
"All of this tooling that easily integrates with your software development practices just makes a very low barrier of entry, whether for developers or even testing individuals, who just enter and start testing the code."Nikolay Advolodkin
Another factor is the tight integration between application code and testing code, he said."You can do things like writing unit tests or component tests in JavaScript,Advolodkin said. "But then whenever you find testing gaps that you can't fulfill with either one of those strategies, you can start using stuff like system tests with Cypress, for example, which is just another extra tool inside of your JavaScript repository."
The use of Cypress, an end-to-end testing tool for browser-based apps,is growing in popularity because JavaScript has gained users, Advolodkin said.Another plus is Cypress' feature set. Among other features, the tooloffers browser automation,application programming interface (API) automation, and component testing for React web applications, he said.
"So it covers multiple layers of testing applications, as opposed to many other tools that kind of just focus on a single aspect."Nikolay Advolodkin
Tools like Selenium and Puppeteer areonly for browser-based front-end automation, so if you want to start doing API testing or component testing, now you have to pick up all their tools."Cypress has all of that," he said.
Since the majority of information sharing that occurs within Internet of Things (IoT) devices is via APIs, it's critical to test the APIs of IoT-enabled devices to ensure they're secure, saidAdvolodkin.
"As more of the world brings us devices onlineand we have smart thermostats, we have Alexa, we have smart light bulbs, TVs, and all of thatit becomes increasingly more important to test those things. And the way that we test them is using APInot browser-based tools, but API testing. So I think that's going to be huge."Nikolay Advolodkin
The QA community appears willing to consider using natural-language processing (NLP)-based automation tools. These provide benefits includingscriptless automation, model-based testing, the use of plain English statements to generate scripts, and a shallower learning curvethat allowsdifferent project stakeholders to contribute to automation efforts, as the The World Quality Report noted:
"Options such as self-healing capabilities are going to increase gradually, but there is no doubt that these are the future of automation. While the promises are big, we understand these automation tools aren't yet sufficiently mature."
Forrester'sLo Giudice said everybody talks about self-healing, but the reality is that it's not there yet.
"It's improving. There are some tools that do it better than others, but it's at a superficial level. It's nothing huge yet."Diego Lo Giudice
Although there are plenty of tools on the market, the trend is going to be less on tools and more on people just skilling themselves up because they want to be marketable, said Michael Fritzius, president of Arch DevOps.
"You're going to see more manual testers that want to get into automation. You're going to see more automation engineers that want to get into the architecture of automated testing solutions."Michael Fritzius
Rather than being the people developing the actual tests, they'll be overseeing and guiding teams about how to do it properly. "So they're going to try to do what they can to make it on their own," Fritzius said. "It's skilling yourself up to write software, mainly."
Adoption of commercial tools won't pick up until next year at the earliest, as a result of the investment involved, saidFritzius."It takes a lot of time and money."
Tools, on average, run at least$250,000. And then youhave to learn it and change the processes to integrate the tool into their system, he noted.
It's going takea while for companies to be willing to really risk that much moneyto improve theirprocesses,"knowing that it might take a while for us to see a result on that."
There will continue to be fragmentation in the test automation landscape throughout 2021 and likely into 2022, said Paul Grizzaffi, principal automation architect at Magenic.
Although there are different technologies,frameworks and stacks coming out, they are generallyattached to one browser or API.
"They need to be glued together by users. Or you have to go and get an additional framework or stack piece that would help bring all of that stuff together so that you can work with one technology, if you will, to do different types of automation."Paul Grizzaffi
Forrester's Lo Giudice said that companies prefer integrated platforms over best-of-breed testing tools.
Testing has many aspectsunit testing, functional testing, performance, load, security, integration testing, test data management, API testing,he said.
"Clients don't wantone tool for each, and they don't care about having a best of breed for each. They want an integrated platform because they're looking for a uniform, consistent experience going from one type of testing to another."Diego Lo Giudice
As with life in general, the COVID-19 pandemic has thrown a monkey wrench into the test automation landscape. As such, it's important for you to take these trends into consideration as you review your test automation tools and capabilities this year before investing time and money in anything new.
Continued here:
Test automation tools: 8 trends and techniques to watch - TechBeacon
- The Automation Conference - December 9th, 2016 [December 9th, 2016]
- The Best Home Automation Systems of 2016 | Top Ten Reviews - December 24th, 2016 [December 24th, 2016]
- Compact Automation - Actuators, Hydraulic Cylinders, Linear ... - December 24th, 2016 [December 24th, 2016]
- What is Home Automation? | Home Automation Systems - December 24th, 2016 [December 24th, 2016]
- Job Seekers - Automation Personnel Services - December 24th, 2016 [December 24th, 2016]
- iAutomation - December 25th, 2016 [December 25th, 2016]
- Beyond Automation - hbr.org - December 25th, 2016 [December 25th, 2016]
- Automation The Car Company Tycoon Game on Steam - December 25th, 2016 [December 25th, 2016]
- Automation - Wikipedia - December 25th, 2016 [December 25th, 2016]
- Build automation - Wikipedia - December 26th, 2016 [December 26th, 2016]
- Home - Enerwave Home Automation - December 27th, 2016 [December 27th, 2016]
- Automation | Technologies | Systems | Integrator ... - December 27th, 2016 [December 27th, 2016]
- Automation - DESHAZO - December 27th, 2016 [December 27th, 2016]
- Custom Automation & Machine Design | Automation GT - December 27th, 2016 [December 27th, 2016]
- IT Automation - BMC - December 27th, 2016 [December 27th, 2016]
- Werner Electric | Automation - January 28th, 2017 [January 28th, 2017]
- Automationtechies | Automation Engineering Recruiting - January 28th, 2017 [January 28th, 2017]
- Automation - Mazak Corporation - January 28th, 2017 [January 28th, 2017]
- Automation | Food Engineering - January 28th, 2017 [January 28th, 2017]
- Test Automation Services for Development of Regression ... - January 28th, 2017 [January 28th, 2017]
- UI Automation Overview - msdn.microsoft.com - February 5th, 2017 [February 5th, 2017]
- The Evolution of Automation and What It Means for the Integration Industry - Commercial Integrator - February 7th, 2017 [February 7th, 2017]
- Automation, robots could replace 250000 public sector workers in the next 15 years - Computer Business Review - February 7th, 2017 [February 7th, 2017]
- New telecom transformation goals require service automation - TechTarget - February 7th, 2017 [February 7th, 2017]
- Automation expected to displace insurance underwriters, real estate brokers - CIO Dive - February 7th, 2017 [February 7th, 2017]
- The Perks Of Automation And The Risks: Why To Think Twice About Getting Into That Driverless Uber - Forbes - February 7th, 2017 [February 7th, 2017]
- Voices Reinventing enterprise finance by overhauling AP automation - Accounting Today - February 7th, 2017 [February 7th, 2017]
- DFLabs Launches the First Security Automation and Orchestration Platform based Upon Supervised Active Intelligence - Business Wire (press release) - February 7th, 2017 [February 7th, 2017]
- VIDEO: Going Big on Automation in a Small Footprint Facility - ENGINEERING.com - February 7th, 2017 [February 7th, 2017]
- Building a better model of human-automation interaction - Phys.org - Phys.Org - February 7th, 2017 [February 7th, 2017]
- Cruise Automation Is Testing an App For Hailing Self-Driving Cars - Fortune - February 8th, 2017 [February 8th, 2017]
- AlixPartners examines automation in manufacturing and logistics management - Logistics Management - February 8th, 2017 [February 8th, 2017]
- Women need to look out for each other in automated workplaces - The Guardian - February 8th, 2017 [February 8th, 2017]
- Automation vs. the H-1B visa program: Which matters to employees? - TechTarget - February 8th, 2017 [February 8th, 2017]
- Automation is the unavoidable future of the economy - The Daily Cougar - February 8th, 2017 [February 8th, 2017]
- Speeders beware: Legislation would allow automation crackdown ... - SFGate - February 9th, 2017 [February 9th, 2017]
- Robots versus bureaucrats: Why public sector work is ripe for automation - Financial Post - February 9th, 2017 [February 9th, 2017]
- Rockwell Automation Surged 10% in January as Growth Picked Up Steam - Motley Fool - February 9th, 2017 [February 9th, 2017]
- Global Medical Automation Market to Reach Approximately $75.6 Billion by 2025 - By End User, Application ... - PR Newswire (press release) - February 10th, 2017 [February 10th, 2017]
- Automation 'key' to advancing Thai production - The Nation - February 10th, 2017 [February 10th, 2017]
- WorkWave Releases New Lead Management And Marketing ... - PR Newswire (press release) - February 10th, 2017 [February 10th, 2017]
- 'We employ insane levels of automation' Kris Canekeratne - Times of India - February 10th, 2017 [February 10th, 2017]
- Most people are optimistic about workplace automation, social data suggests - ZDNet - February 10th, 2017 [February 10th, 2017]
- Yes, there's a job creation argument for automation and technology ... - The Hill (blog) - February 10th, 2017 [February 10th, 2017]
- Technobabble: Automation and the modern worker - CIO Dive - February 10th, 2017 [February 10th, 2017]
- Improving Behavior Through Automation of Vehicle Systems - School Transportation News (blog) - February 11th, 2017 [February 11th, 2017]
- Automation Nightmare: Philosopher Warns We Are Creating a World Without Consciousness - Big Think - February 11th, 2017 [February 11th, 2017]
- Why Don't We See More Automation in Federal Networks? - Nextgov - February 11th, 2017 [February 11th, 2017]
- Automation can revitalize the US workforce - Fox News - February 11th, 2017 [February 11th, 2017]
- Readers Write (Feb. 12): The moose population; jobs, start-ups and automation; diversity in the funny pages - Minneapolis Star Tribune - February 12th, 2017 [February 12th, 2017]
- Automation can replace bureaucrats and save taxpayers money - Hot Air - February 12th, 2017 [February 12th, 2017]
- TigerStop hopes to ride automation to new heights - The Columbian - February 12th, 2017 [February 12th, 2017]
- Your Most Valuable Resource is Time Get More of it through Automation - CMS Critic (press release) (blog) - February 13th, 2017 [February 13th, 2017]
- What Does Device Automation Mean for Users? - Medical Device and Diagnostics Industry (blog) - February 13th, 2017 [February 13th, 2017]
- How To Beat Automation And Not Lose Your Job - Forbes - February 13th, 2017 [February 13th, 2017]
- Logistics firm gets automation boost - The Straits Times - February 14th, 2017 [February 14th, 2017]
- PP Control & Automation launch new video to kick-start exciting plans for 2017 - Manufacturer.com - February 14th, 2017 [February 14th, 2017]
- Automation's Impace on Data Center Monitoring Alerts - The Data Center Journal - February 14th, 2017 [February 14th, 2017]
- Hollysys Automation Technologies Reports Unaudited Financial Results for the First Half Year and the Second Quarter ... - PR Newswire (press release) - February 15th, 2017 [February 15th, 2017]
- 4 Automation Hacks to Save You Money and Manpower - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Istuary Innovation Group and Bluewrist Partner to Bring Robotics and Automation into China's Manufacturing Sector - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Redwood Software Named a Strong Performer in Independent Robotic Process Automation (RPA) Report - Yahoo Finance - February 15th, 2017 [February 15th, 2017]
- Boeing ramps up automation, innovation as it readies 737MAX | The ... - The Seattle Times - February 15th, 2017 [February 15th, 2017]
- Robots and AI are coming for our jobs, but can augmentation save us from automation? - Digital Trends - February 15th, 2017 [February 15th, 2017]
- The Impact of Bad Data in Automation: Why Quality Management is Critical - R & D Magazine - February 16th, 2017 [February 16th, 2017]
- Automation: Are We Empowering Human Interaction Or Displacing It? - Business 2 Community - February 16th, 2017 [February 16th, 2017]
- Life in the Fast LaneAutomation with Software-Defined Intelligence - InfoWorld - February 16th, 2017 [February 16th, 2017]
- Luddite Lefty Journalists Apparently Think Workplace Automation is Conservatives' Fault [VIDEO] - Daily Caller - February 16th, 2017 [February 16th, 2017]
- Will automation define the future of network technology? - TechTarget - February 16th, 2017 [February 16th, 2017]
- Editorial: Improving automation - The Motorship - February 17th, 2017 [February 17th, 2017]
- TigerText Unveils Role-based Scheduling Automation, Amazon Alexa integration - HIT Consultant - February 17th, 2017 [February 17th, 2017]
- 89% people want automation at workplace: Adobe - Economic Times - February 18th, 2017 [February 18th, 2017]
- Delta veers to EV parts, automation - Bangkok Post - February 18th, 2017 [February 18th, 2017]
- Robotic process automation makes nearshore outsourcing more ... - CIO - February 18th, 2017 [February 18th, 2017]
- The working-class job that Trump could save from automation - Washington Post - February 18th, 2017 [February 18th, 2017]
- China must be ready for automation - Basic Income News - February 18th, 2017 [February 18th, 2017]
- Bill Gates Says Robots Should Be Taxed Like Workers - Fortune - February 18th, 2017 [February 18th, 2017]
- Trump and automation challenge India's IT industry - VentureBeat - February 18th, 2017 [February 18th, 2017]
- Both Trump and Automation Are Challenging India's IT Industry - Fortune - February 20th, 2017 [February 20th, 2017]
- 89% people want automation at workplace: Adobe - ETCIO.com - February 20th, 2017 [February 20th, 2017]