From 2016-2019, a team from the Australian Centre for Field Robotics at the University of Sydney undertook projects focusing on advancing the application of robotics, intelligent sensing systems, precision agriculture automation and more in Australias vegetable industry.
In November 2019, Vegetables Australia spoke to Project Lead Professor Salah Sukkarieh about the research, and the potential impact it has for the future of on-farm robotic automation.Over the past three years, many vegetable industry members would have seen the LadyBird and RIPPA (Robot for Intelligent Perception and Precision Application) robots in both trial-farm and commercial-farm settings.
A strategic levy investment under the Hort Innovation Vegetable Fund, Using autonomous systems to guide vegetable decision making on-farm (VG15003) was undertaken to research and develop novel sensors, algorithms and robotic technologies that would help reduce production cost and increase on-farm productivity in the vegetable industry, in particular brassica, lettuce and baby leaf.
The project was awarded to the Australian Centre for Field Robotics at the University of Sydney and, led by Professor Salah Sukkarieh, started in January 2016. It was divided into four themes: Sensing, Automated Decision Support (ADS), Crop Interaction and Farm Automation Standards.
The project used the LadyBird robotic platform, designed and developed by the Australian Centre for Field Robotics under a previous investment entitled An Intelligent Farm Robot for the Vegetable Industry (VG12104). The robot was fitted with a number of different sensors including Thermal, Hyperspectral, Vision and Laser, and experiments were conducted on the University of Sydney farm.
Evaluating and testing autonomous systems developed in VG15003 in Australian vegetable production systems (VG15059) started in June 2016 and focused on Evaluation, Market Analyses, Economic Viability and Industry Engagement of the four themes in VG15003. The project used the RIPPA robotic platform, also designed and developed under project VG12104. It was customised for testing and evaluation of these technologies on commercial operational farms.
The two projects worked together: VG15003 focused on the research and demonstration of novel sensing and algorithms, and VG15059 operationalised that research and it demonstrated to growers on-farm, Professor Sukkarieh explained.
Both investments drew to a close in February 2019, having supported and progressed the development of new technologies for the vegetable industry.
Key findingsThe experiments undertaken during project VG15003 collected large amounts of data and analysed for evaluation of plant health and estimation of water index.
Initially experiments were done for lettuce and the scope was expanded to cauliflower and broccoli. Machine learning algorithms were developed that could observe plant structure, distinguish weeds from crops, detect water stress or damage, and map soil properties such as conductivity and moisture, Professor Sukkarieh said.
The data collection exercise demonstrated the capacity to rapidly collect high spatial and spectral resolution data on a routine basis (weekly), as well as the software pipeline that could extract this data and make meaningful representations of the plants and environment in general.
A number of important characteristics were determined from these results, including the ability to get close to 100 per cent confidence in the machine learning systems extracting plant information (shape and size), as well as greater than 90 per cent accuracy in detecting weeds green-on-green when in uncluttered environments (using spatial and shape differences), and greater than 75 per cent in cases where weeds were similar to early established plants.
During VG15059, Professor Sukkarieh and his team ventured on-farm to demonstrate RIPPAs capability for detecting weeds in real-time among crops and real-time weeding using mechanical prongs as well as directed spraying technologies that minimised chemicals.
The software pipeline developed was also used to detect foreign objects and we retrofitted an industrial vacuum cleaner that could suck up those foreign objects. We demonstrated the capability of actively sampling water conductivity near plant roots. A user interface was developed that not only allowed growers to control the robot, but also to see results of plant statistics, history, weed pressure and water availability, Professor Sukkarieh said.
Both projects went through continuous cycles of experimentation and design improvements; especially for operational envelope enhancements.
Most of prototype tests were conducted at the University of Sydneys Lansdowne farm, and operational trials were conducted in Gatton, Cowra, Griffith, Werribee, Gippsland and Launceston. More than 660 growers attended, and feedback was collected through end-to-end demonstrations.
Addressing issuesThis was the first time extensive full production, autonomous data collection of individual plants in the field had been conducted which posed challenges to Professor Sukkarieh and his team.
There were are a number of technical challenges that we overcame, including registration of changing plant data over multiple weeks and the effect of lighting and weather on autonomous data gathering, Professor Sukkarieh said.
Plant biology means that the algorithms that were developed had to deal with changing plant architecture over time which hadnt been dealt with before in the research community.
This was also the first time that the robotics and automation work extended beyond just automating a platform for operation on-farm and moved into crop intelligence. Grower input also contributed to the program, as Professor Sukkarieh explained.
We received very positive feedback in our trials as well as a number of suggestions on operational improvements that were incorporated into the program. As the project moved through its various stages of development, the growers became very interested in the capability that the system could also provide in the future for pest/disease detection.
According to Professor Sukkarieh, VG15003 and VG15059 both demonstrated that a continuous cycle of research and development through to operational demonstration with the growers was key.
This is to ensure that the research aligned with the grower interests, and that continuous feedback was provided to the research. The next steps in robotics would include better crop intelligence algorithms for detecting pests/diseases and novel tools for precision action on plants and ultimately harvesting and these should follow the same approach, he said.
There are technologies that are ready for commercialisation, including automated platforms for weeding and crop intelligence (plant size and distribution). These should now transition into the hands of the growers for end-user feedback.
The bottom lineProfessor Sukkarieh said that the three projects VG12104, VG15003, VG15059 have placed the Australian vegetable industry at the leading edge of on-farm robotic automation.
We are now in position to commercialise many of the technologies developed in these programs. The industry now should look further forward to understand what future vegetable farm operations would look like with the belief that on-farm robotic solutions are coming, he said.
This will help provide a vision on how best to use these technologies (beyond weeding and crop intelligence), how intelligent on-farm systems should work with each other, and how these intelligent assets will support supply chain optimisation.
For more information:Professor Salah Sukkarieh Email: salah.sukkarieh@sydney.edu.au http://www.sydney.edu.au
Read more:
Advancing robotics in the Australian vegetable industry - hortidaily.com
- Brief: NVIDIA's venture arm invests in autonomous weeding startup Carbon Robotics - AgFunderNews - May 11th, 2024 [May 11th, 2024]
- 7 Robotics Stocks to Bet On for Reliable AI-Powered Returns - InvestorPlace - May 11th, 2024 [May 11th, 2024]
- NSF and USDA join forces to boost innovation in agricultural robotics - Future Farming - May 11th, 2024 [May 11th, 2024]
- Meet The Swiss Start-Up Taking On The Tech Giants In Robotics And AI - Forbes - May 11th, 2024 [May 11th, 2024]
- LimX Dynamics' W1 robot can stand, walk and roll on its hind 'legs' - Interesting Engineering - May 11th, 2024 [May 11th, 2024]
- Lear Corporation's acquisition showcases the industry's use of robotics and AI for efficiency and innovation - CBT Automotive News - May 11th, 2024 [May 11th, 2024]
- OMRON and NEURA Robotics Partner to Unveil New Cognitive Robot at Automate 2024 - Automation.com - May 11th, 2024 [May 11th, 2024]
- Community briefs: Ravenswood robotics at world championship, Bike to the Library Day - The Almanac Online - May 11th, 2024 [May 11th, 2024]
- JCHS Robotics shimes at VEX World Competition | Community News - The Tomahawk - May 11th, 2024 [May 11th, 2024]
- Carbon Robotics to Help Revolutionize Farming with AI, Using Investment from NVentures - Business Wire - May 11th, 2024 [May 11th, 2024]
- Nvidia's DrEureka outperforms humans in training robotics systems - VentureBeat - May 11th, 2024 [May 11th, 2024]
- Humanoid Robots: The Next-Generation Robotic Workforce - Tech Briefs - May 11th, 2024 [May 11th, 2024]
- PHOTOS Motiva helping fund Port Arthur ISD robotics and engineering - Port Arthur News - The Port Arthur News - May 11th, 2024 [May 11th, 2024]
- Kiwanis Club of Miami helps fund McMillan MS robotics team trip - Miami's Community Newspapers - May 11th, 2024 [May 11th, 2024]
- The Interplay Between Robotics and Artificial Intelligence in Manufacturing | RoboticsTomorrow - Robotics Tomorrow - May 11th, 2024 [May 11th, 2024]
- Doosan Robotics releases its longest reach cobots with PRIME SERIES - Robot Report - May 11th, 2024 [May 11th, 2024]
- KION North America and Fox Robotics Announce Non-Exclusive Strategic Partnership - Automation.com - May 11th, 2024 [May 11th, 2024]
- Ag tech startup Carbon Robotics lands Nvidia investment - The Business Journals - May 11th, 2024 [May 11th, 2024]
- Mars Robotics offers chance to drive Mars rover on Saturday - Butler Eagle - May 11th, 2024 [May 11th, 2024]
- Comparative analysis of robot-assisted language learning systems and human tutors in English conversation lessons - EurekAlert - May 11th, 2024 [May 11th, 2024]
- Valencia College to more than double students training in semiconductors, robotics and optics - The Business Journals - May 11th, 2024 [May 11th, 2024]
- DeepMind is experimenting with a nearly indestructible robot hand - New Scientist - May 11th, 2024 [May 11th, 2024]
- Five Things to Consider Before Adopting Robotics for Warehouse Automation - Automation.com - May 11th, 2024 [May 11th, 2024]
- Nvidia and Alphabet's Intrinsic aim to revolutionize next-gen robotics - VentureBeat - May 11th, 2024 [May 11th, 2024]
- NVIDIA and Alphabet's Intrinsic Put Next-Gen Robotics Within Grasp - Automation.com - May 11th, 2024 [May 11th, 2024]
- STEM robotics team celebrates 10 years and remembers hero who saved lives - Denver 7 Colorado News - May 11th, 2024 [May 11th, 2024]
- Zero-shot learning helps Intrinsic pave the future for robotics - FierceElectronics - May 11th, 2024 [May 11th, 2024]
- EN robotics team demonstrates real-world learning | News Sun | kpcnews.com - KPCnews.com - May 11th, 2024 [May 11th, 2024]
- Future Innovators Challenged to Design Nuclear Fission and Fusion Decommissioning Robots - Automation.com - May 11th, 2024 [May 11th, 2024]
- Meet Pepper and Bernard: The robots shaping AI research at SDSU - Daily Aztec - May 11th, 2024 [May 11th, 2024]
- Gene Haas Foundation Partner Hosts FIRST Robotics District Competitions - Kettering University - May 5th, 2024 [May 5th, 2024]
- NASA Showcases Innovations at the 2024 FIRST Robotics World Championships - NASA - May 5th, 2024 [May 5th, 2024]
- Robots are invading the San Carlos Branch Library - San Diego Community Newspaper Group - May 5th, 2024 [May 5th, 2024]
- Wyoming-Based Company Makes High-Tech Robots To Go Where Humans Don't Want To - Cowboy State Daily - May 5th, 2024 [May 5th, 2024]
- Anzu Robotics launches U.S.-based clone of DJI Mavic 3 - Robot Report - May 5th, 2024 [May 5th, 2024]
- Carnegie Mellon University's Robotics Institute begins developing drones to fight wildfires - CBS Pittsburgh - May 5th, 2024 [May 5th, 2024]
- 3 Robotics Stocks That Could Be Multibaggers in the Making: Spring Edition - MSN - May 5th, 2024 [May 5th, 2024]
- Hopkinton teams advance to Robotics World Championships - Hopkinton Independent - May 5th, 2024 [May 5th, 2024]
- "Big Cat Robotics" team from Wellsville returns from VRC World Championship - THE WELLSVILLE SUN - THE WELLSVILLE SUN - May 5th, 2024 [May 5th, 2024]
- PropStream-Sponsored Robotics Team Places in Competition - RisMedia.com - May 5th, 2024 [May 5th, 2024]
- Bellefontaine Robotics Team Travels to World Championship Peak of Ohio - peakofohio.com - May 5th, 2024 [May 5th, 2024]
- ASL Aviation Holdings Inks Deal with Reliable Robotics for 30 Aircraft Autonomy Systems - Business Wire - May 5th, 2024 [May 5th, 2024]
- Global Nano Robotics Market Projected to Surge to US$ 19.86 Billion by 2032: Healthcare Trends Catalyzing Nano ... - GlobeNewswire - May 5th, 2024 [May 5th, 2024]
- 'Afghan Dreamers' | Film about Afghan girls robotics team to be screened on May 15 - Piedmont Exedra - May 5th, 2024 [May 5th, 2024]
- 3 Robotics Stocks That Could Be Multibaggers in the Making: Spring Edition - InvestorPlace - May 5th, 2024 [May 5th, 2024]
- The Rise of the Navy Robots - Signal Magazine - May 5th, 2024 [May 5th, 2024]
- Elon Musk Keeps Talking About the Future of Robotics With Optimus, but This Phenomenal Growth Stock Has Already ... - The Motley Fool - May 5th, 2024 [May 5th, 2024]
- Robosen Robotics Teams Up with Hasbro to Debut the Worlds First Auto-Converting Decepticon Megatron! - aNb Media - May 5th, 2024 [May 5th, 2024]
- John P. Stevens Robotics Team Wins Excellence in Technology at Innovators Awards - TAPinto.net - May 5th, 2024 [May 5th, 2024]
- Nala Robotics and Re-Up partner to develop AI-powered robotic chef - Robotics and Automation News - May 5th, 2024 [May 5th, 2024]
- LCSD1 to Host Final Robotics Competition of the School Year Tomorrow - The Cheyenne Post - May 5th, 2024 [May 5th, 2024]
- GMV showcases its robotic inspection capabilities Robotics & Automation News - Robotics and Automation News - May 5th, 2024 [May 5th, 2024]
- Trine's armored robot finishes 4th in national combat - Trine University - May 5th, 2024 [May 5th, 2024]
- Female robotics founders discuss their journeys in the industry - Robot Report - May 5th, 2024 [May 5th, 2024]
- Hanwha Robotics, B-Robotics join hands on restaurant automation project - Aju Press - May 5th, 2024 [May 5th, 2024]
- Dishchii'bikoh Community School Robotics Team Heads to VEX World Championship - White Mountain Independent - May 5th, 2024 [May 5th, 2024]
- ETH unveils space-hopping robot for asteroid exploration - Robotics and Automation News - May 5th, 2024 [May 5th, 2024]
- Nickelytics and Starship release robots at UCLA and Utah universities - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Next-Level Robotics: Enhancing Accuracy with Advanced Multisensory Interfaces - AZoRobotics - May 1st, 2024 [May 1st, 2024]
- Death of Lake Orion teen on robotics trip determined to be suicide, Houston police say - Detroit News - May 1st, 2024 [May 1st, 2024]
- Niqo Robotics Raises $9 Million In Funding Round Led By Brida Innovation Ventures: Report - Outlook India - May 1st, 2024 [May 1st, 2024]
- Mission to 'Holy Grail of Shipwrecks' Will Employ Robotics - USNI News - May 1st, 2024 [May 1st, 2024]
- Kiwibot acquires Auto Mobility Solutions Robotics & Automation News - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Untethered soft actuators for soft standalone robotics - Nature.com - May 1st, 2024 [May 1st, 2024]
- Robotics in the restaurant industry are here to stay: Carlos Gazitua - Fox Business - May 1st, 2024 [May 1st, 2024]
- It's time for UK business to embrace robotics - Design Products & Applications - May 1st, 2024 [May 1st, 2024]
- Meet the `One Percenters' - The Top Ranked Robotics Group from Franklin - Franklin Observer - May 1st, 2024 [May 1st, 2024]
- Atlas, forefather of humanoid robots, gives way to next generation - Marketplace - May 1st, 2024 [May 1st, 2024]
- BlueBotics releases new version of its server fleet management software - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- U.S. manufacturers invested heavily in robotics in 2023, finds IFR - Robot Report - May 1st, 2024 [May 1st, 2024]
- This is a unique time: ARK Invests chief futurist tackles tech innovation from AI to robotics - CNBC - May 1st, 2024 [May 1st, 2024]
- U.S. Companies Invest Heavily in Robots - IFR Preliminary Results EMSNow - EMSNow - May 1st, 2024 [May 1st, 2024]
- MiR launches new autonomous mobile forklift-type robot - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Rutland Area Robotics' IBOTS compete in FIRST World Championships finals for first time - Rutland Herald - May 1st, 2024 [May 1st, 2024]
- Micropsi Industries introduces new AI-vision software Robotics & Automation News - Robotics and Automation News - May 1st, 2024 [May 1st, 2024]
- Robots on a Roll: The Future of Farming Is Here Now - Growing Produce - May 1st, 2024 [May 1st, 2024]
- Grand Force, Grand Forks' only FIRST Robotics team, returns from world championship with good memories - Grand Forks Herald - May 1st, 2024 [May 1st, 2024]
- Reston Robotics Team Wins National Competition At Tech Conference - Patch - May 1st, 2024 [May 1st, 2024]
- CapSen Robotics Introduces CapSen PiC 2.0 Bin-Picking Software - Supply and Demand Chain Executive - May 1st, 2024 [May 1st, 2024]
- Gecko Robotics and Al Masaood Energy Partner to Help ADNOC Gas Revolutionize Asset Operations and ... - Business Wire - May 1st, 2024 [May 1st, 2024]