Researchers in Germany are developing and testing a dual-arm robot for the automated harvesting of cucumbers. The Fraunhofer Institute for Production Systems and Design Technology IPK’s lightweight solution has the potential to keep crop cultivation in Germany commercially viable.

Automation-intensive sectors such as the automotive industry are not the only ones to rely on robots. In more and more agricultural settings, automation systems are superseding strenuous manual labour.

In Germany, cucumbers destined for pickle jars are harvested using “cucumber flyers” – farm vehicles with wing-like attachments. Seasonal workers lie on their stomachs on the wings and pluck the ripe cucumbers. This labour-intensive, energy-sapping type of manual harvesting is becoming increasingly uneconomical, especially since Germany introduced a minimum wage. Many of the country’s agricultural regions consequently face an uncertain future; cucumber farming has already begun relocating to Eastern Europe and India.

There is thus an urgent need for improved harvesting technologies to maintain the economic viability of cucumber farming in Germany. Experts from Fraunhofer IPK in Berlin are studying the potential for automating cucumber harvests in the scope of the EU’s CATCH (Cucumber Gathering – Green Field Experiments) project. Project partners are the Leibniz Institute for Agricultural Engineering and Bioeconomy in Germany, and the CSIC-UPM Centre for Automation and Robotics (CAR) in Spain.

CATCH researchers want to develop and test a dual-arm robot system consisting of inexpensive lightweight modules. The ultimate aim is a system suitable for automated cucumber farming and other agricultural applications. The robotic picker would have to be cost-effective, high-performance and dependable. Even in adverse weather, it would need to be capable of first identifying ripe cucumbers, and then using its two gripper arms to gently pick and store them.

To this end, cutting-edge control methods equip the robot with tactile perception and enable it to adapt to ambient conditions. These methods also make it possible for the dual-arm robot system to imitate human movements, so that the robot does not damage crops, pulling them and their roots out of the soil. Moreover, the automated harvester must be as efficient as its experienced human counterpart, who can pick as many as 13 cucumbers per minute.

High success rate

Designing autonomous systems capable of optical and tactile sensing, assessing and evaluating is a considerable challenge, only compounded by cucumber harvesting: a robot must identify green objects camouflaged by green surroundings. In addition, cucumbers are randomly distributed throughout a field, with some concealed by vegetation. Varying light conditions make the mission all the more difficult. It should be possible to use multispectral cameras and intelligent image processing to locate cucumbers and guide the robot’s gripper arms to pluck them.

This part of the CATCH project is overseen by CSIC-UPM. A special camera system helps ensure the robot detects and locates approximately 95% of cucumbers – an impressive success rate. The goal, of course, is to advance the technology so the robot picks all the ripe cucumbers, to foster growth of new ones. Fraunhofer IPK has developed robot arms with five degrees of freedom on the basis of hardware modules developed by igus GmbH in Cologne.

In search of human inspiration

The IPK project experts are tasked with developing three gripper prototypes: a gripper based on vacuum technology; a set of bionic gripper jaws (Fin Ray); and a customised “cucumber hand” based on OpenBionics robot hands. They are relying on insights acquired during a previous European research project, in which they developed a dual-arm robot control system with efficient task-oriented programming for Workerbot I – a humanoid robot capable of industrial assembly.

Project experts from IPK are enhancing this system so it can plan, program and control the behaviour of robots harvesting cucumbers. These preprogrammed behavioural patterns make bimanual searching possible, meaning the robot can look for cucumbers as a human would.

Dr Dragoljub Surdilovic, a scientist at Fraunhofer IPK, explains: “The robot can, for example, push leaves to the side using symmetrical or asymmetrical movements, or congruent and incongruent movements. As a result, it can automatically change directions on the fly to approach and then grasp a cucumber.”

The researchers’ goal is to create an intelligent control system capable of making judgment calls: assigning a certain task to a certain gripper arm, monitoring cucumber picking and dealing with exceptions.

In July 2017, the Leibniz Institute used various types of cucumbers to conduct initial field testing of the system. The Institute also tested harvesting new types of cucumbers with distinguishing features that make them easier to pick. The first round of testing validated basic functionality. Since late 2017, project partners have been conducting additional tests in a Leibniz Institute greenhouse. Researchers are keen to see the extent to which interference or malfunctions affect the system’s efficiency and robustness.

Once testing of the robot has been completed, the aim is to make it commercially viable. Companies, cucumber farmers and agricultural associations have expressed considerable interest in the system. In November 2017, the CATCH project was unveiled to the general public at Agritechnica, the world’s leading trade fair for agricultural technology, and drew enthusiastic feedback from agricultural specialists and companies.

www.fraunhofer.de