Willy Pell from Blue River Technology brings AI to the farm

The Robot Report Podcast · 15 Apr 2022 · 57m

AI in practice: 3 real uses of AI described

What this episode covers

Willy Pell, VP of Autonomy at Blue River Technology (acquired by John Deere), explains how the company applied machine learning and computer vision to automate farming, starting with the See & Spray weed management system and expanding to the autonomous John Deere AR tractor. Pell details the strategic decision to use stereo cameras instead of LIDAR due to dust and speed constraints, and describes how the system uses deep learning to detect crops versus weeds, achieving significant herbicide savings. The episode also covers the broader roadmap for autonomous tillage, planting, and grain cart coordination, drawing inspiration from Tesla's data-driven approach to achieve full autonomy in a semi-structured agricultural environment.

AI in practice

Where this conversation describes AI being used to build or deliver a product. Part of the AI in practice tracker.

Engineering & simulationBlue River See & Sprayroughly 70% savings in herbicides

The system uses computer vision and deep learning to detect weeds versus crops in real-time, enabling the sprayer to target only weeds and reduce herbicide usage by roughly 70%.

“by putting cameras across the spray boom, um, we can take pictures of the ground, detect the crop, detect the weeds and spray herbicides and only the weeds. The result is like roughly 70% savings in herbicides for farmers…”

Willy Pell · Hear it at 36:18

Engineering & simulationJohn Deere Autonomous Tractor (AR)

The team used stereo cameras and deep learning image segmentation to identify objects like rocks or cows, designing the network to heavily penalize missing unexpected objects to ensure safety in dusty, low-speed farm environments.

“we ended up with stereo cameras. Okay. And the other thing, you know, because we were such a deep learning, heavy company, you know, image segmentation just really isn't a huge problem anymore. With enough well labeled data. You can kind of figure out what you're looking at in any given scene.”

Willy Pell · Hear it at 40:13

Engineering & simulationBlue River Machine Learning Models

The company developed a system where models identify their own weaknesses, automatically capturing and labeling that specific data to retrain the system, allowing the technology to self-heal and improve performance over time without manual intervention.

“what we're starting to do now is actually make models to discover where the model's weak. And capture that data. So pick it off, you know, while it's running on the system and and say, hey, this is this is getting cute for upload. That data gets labeled, that data ends up in a train set and the performance improves.”

Willy Pell · Hear it at 50:12

Mentioned

Companies
Blue River Technology, John Deere, Cruise, SoftBank Robotics, United Robotics Group, Tesla
Products
Pepper, See & Spray, John Deere AR Tractor

Other shows on the same ground, closest first.

  • Moore's Lobby · 55m

    Getting Out of the Weeds with John Deere's Revolutionary AI Technology

    Chris Padwick, Director of Computer Vision and Machine Learning at Blue River Technology (a John Deere subsidiary), explains the engineering behind the See & Spray system, which uses computer vision to spot-spray herbicide on weeds. He details the massive compute requirements, noting the system uses NVIDIA Xavier and Orin GPUs to achieve 0.3 petaflops of processing power for real-time image classification at 12 mph. Padwick also discusses the critical role of data collection, the acquisition by John Deere for scaling, and the future of autonomous agricultural machinery.

  • IoT For All Podcast · 20m

    Smart Farming: The Role of IoT and AI | John Deere's Gaurav Bansal | Internet of Things Podcast

    Gaurav Bansal, VP of Engineering at Blue River Technology (a subsidiary of John Deere), discusses the integration of IoT, AI, and computer vision in smart farming to address labor shortages and climate challenges. He details the John Deere autonomous tractor, which uses stereo cameras and NVIDIA Jetson GPUs for obstacle detection, and the See & Spray system, which uses real-time computer vision to reduce herbicide usage by up to two-thirds. Bansal also highlights the critical role of connectivity, noting a partnership with Starlink to solve rural coverage gaps, and outlines John Deere's goal of achieving fully autonomous production systems for corn and soybeans by 2030.

  • Over the Air · 18m

    Digital Transformation: From Tractors to Autonomous Agriculture

    Jorge Heraud, VP of Automation and Autonomy at John Deere, explains how the company is leveraging IoT and computer vision to transform agriculture through products like See & Spray and fully autonomous tractors. He details the decision to refine existing herbicide application rather than pursuing unproven technologies like lasers, achieving a 3-5x reduction in chemical usage. Heraud also outlines John Deere's roadmap to a fully autonomous farm by 2030, highlighting the operational advantages of private land environments compared to public roads.

  • The Next Byte Podcast · 26m

    44. How Computer Vision Is Changing Your World

    Hosts Daniel and Farbod discuss how computer vision AI is applied in manufacturing and agriculture, featuring insights from Plain Sight AI and a project by the Technical University of Denmark. They explain Plain Sight AI's three levels of vision systems for detecting hazardous objects on production lines, emphasizing that Level 3 instance segmentation offers superior sorting and counting capabilities. The hosts also detail a robot developed by PhD student Ronja Goldring to autonomously remove weeds from organic dairy farms using laser or electrocution, highlighting the importance of large, diverse training datasets and collaboration with end-users.

  • IoT For All Podcast · 27m

    How IoT and Smart Farming Technology is Revolutionizing Agriculture

    Lane Arthur, Vice President of Data Applications and Analytics at John Deere, explains how the company leverages IoT, machine learning, and computer vision to revolutionize agricultural operations. He details specific applications such as automated grain quality adjustment in combines and weed-differentiating sprayers, which improve efficiency and sustainability. Arthur also discusses the critical role of connectivity, including rural broadband and 5G, in enabling real-time data exchange and remote machine management during the pandemic.

The summary, chapters and topics are generated from the episode’s audio by this directory, not written by The Robot Report Podcast. The episode itself belongs to its publisher.