Iowa AI, ML and Computer Vision Meetup

Location
Virtual. Register for the Zoom.

Paved2Paradise: Scalable LiDAR Simulation for Real-World Perception

Training robust perception models for robotics and autonomy often requires massive, diverse 3D datasets. But collecting and annotating real-world LiDAR point clouds at scale is both expensive and time-consuming, especially when high-quality labels are needed. Paved2Paradise introduces a cost-effective alternative: a scalable LiDAR simulation pipeline that generates realistic, fully annotated datasets with minimal human labeling effort.

The key idea is to “factor the real world” by separately capturing background scans (e.g., fields, roads, construction sites) and object scans (e.g., vehicles, people, machinery). By intelligently combining these two sources, Paved2Paradise can synthesize a combinatorially large set of diverse training scenes. The pipeline involves four steps: (1) collecting extensive background LiDAR scans, (2) recording high-resolution scans of target objects under controlled conditions, (3) inserting objects into backgrounds with physically consistent placement and occlusion, and (4) simulating LiDAR geometry to ensure realism.

Experiments show that models trained on Paved2Paradise-generated data transfer effectively to the real world, achieving strong detection performance with far less manual annotation compared to conventional dataset collection. The approach is not only cost-efficient, but also flexible—allowing practitioners to easily expand to new object classes or domains by swapping in new background or object scans.
For ML practitioners working in robotics, autonomous vehicles, or safety-critical perception, Paved2Paradise highlights a practical path toward scaling training data without scaling costs. It bridges the gap between simulation and real-world performance, enabling faster iteration and more reliable deployment of perception models.

About the Speaker

Michael A. Alcorn is a Senior Machine Learning Engineer at John Deere, where he develops deep learning models for LiDAR and RGB perception in safety-critical, real-time systems. He earned his Ph.D. in Computer Science from Auburn University, with a dissertation on improving computer vision and spatiotemporal deep neural networks, and also holds a Graduate Minor in Mathematics. Michael’s research has been cited by researchers at DeepMind, Google, Meta, Microsoft, and OpenAI, among others, and his (batter|pitcher)2vec paper was a prize-winner at the 2018 MIT Sloan Sports Analytics Conference. He has also contributed machine learning code to scikit-learn and Apache Solr, and his GitHub repositories—which have collectively received over 2,100 stars—have served as starting points for research and production code at many different organizations.

MothBox: inexpensive, open-source, automated insect monitor

Dr. Andy Quitmeyer will talk about the design of an exciting new open source science tool, The Mothbox. The Mothbox is an award winning project for broad scale monitoring of insects for biodiversity. It's a low cost device developed in harsh Panamanian jungles which takes super high resolution photos to then automatically ID the levels of biodiversity in forests and agriculture. After thousands of insect observations and hundreds of deployments in Panama, Peru, Mexico, Ecuador, and the US, we are now developing a new, manufacturable version to share this important tool worldwide. We will discuss the development of this device in the jungles of Panama and its importance to studying biodiversity worldwide.

About the Speaker

Dr. Andy Quitmeyer designs new ways to interact with the natural world. He has worked with large organizations like Cartoon Network, IDEO, and the Smithsonian, taught as a tenure-track professor at the National University of Singapore, and even had his research turned into a (silly) television series called “Hacking the Wild,” distributed by Discovery Networks.

Now, he spends most of his time volunteering with smaller organizations, and recently founded the field-station makerspace, Digital Naturalism Laboratories. In the rainforest of Gamboa, Panama, Dinalab blends biological fieldwork and technological crafting with a community of local and international scientists, artists, engineers, and animal rehabilitators. He currently also advises students as an affiliate professor at the University of Washington.

Foundation Models for Visual AI in Agriculture

Foundation models have enabled a new way to address tasks, by benefitting from emerging capabilities in a zero-shot manner. In this talk I will discuss recent research on enabling visual AI in a zero-shot manner and via fine-tuning. Specifically, I will discuss joint work on RELOCATE, a simple training-free baseline designed to perform the challenging task of visual query localization in long videos.

To eliminate the need for task-specific training and efficiently handle long videos, RELOCATE leverages a region-based representation derived from pretrained vision models. I will also discuss joint work on enabling multi-modal large language models (MLLMs) to correctly answer prompts that require a holistic spatio-temporal understanding: MLLMs struggle to answer prompts that refer to 1) the entirety of an environment that an agent equipped with an MLLM can operate in; and simultaneously also refer to 2) recent actions that just happened and are encoded in a video clip.

However, such a holistic spatio-temporal understanding is important for agents operating in the real world. Our solution involves development of a dedicated data collection pipeline and fine-tuning of an MLLM equipped with projectors to improve both spatial understanding of an environment and temporal understanding of recent observations.

About the Speaker

Alex Schwing is an Associate Professor at the University of Illinois at Urbana-Champaign working with talented students on artificial intelligence, generative AI, and computer vision topics. He received his B.S. and diploma in Electrical Engineering and Information Technology from the Technical University of Munich in 2006 and 2008 respectively, and obtained a PhD in Computer Science from ETH Zurich in 2014. Afterwards he joined University of Toronto as a postdoctoral fellow until 2016.

His research interests are in the area of artificial intelligence, generative AI, and computer vision, where he has co-authored numerous papers on topics in scene understanding, inference and learning algorithms, deep learning, image and language processing, and generative modeling. His PhD thesis was awarded an ETH medal and his team’s research was awarded an NSF CAREER award.

Beyond the Lab: Real-World Anomaly Detection for Agricultural Computer Vision

Anomaly detection is transforming manufacturing and surveillance, but what about agriculture? Can AI actually detect plant diseases and pest damage early enough to make a difference? This talk demonstrates how anomaly detection identifies and localizes crop problems using coffee leaf health as our primary example. We'll start with the foundational theory, then examine how these models detect rust and miner damage in leaf imagery.

The session includes a comprehensive hands-on workflow using the open-source FiftyOne computer vision toolkit, covering dataset curation, patch extraction, model training, and result visualization. You'll gain both theoretical understanding of anomaly detection in computer vision and practical experience applying these techniques to agricultural challenges and other domains.

About the Speaker

Paula Ramos has a PhD in Computer Vision and Machine Learning, with more than 20 years of experience in the technological field. She has been developing novel integrated engineering technologies, mainly in Computer Vision, robotics, and Machine Learning applied to agriculture, since the early 2000s in Colombia.

Location
Virtual. Register for the Zoom.

Field-Ready Vision: Building the Agricultural Image Repository (AgIR) for Sustainable Farming

Data—not models—is the bottleneck in agricultural computer vision. This talk shares how Precision Sustainable Agriculture (PSA) is tackling that gap with the Agricultural Image Repository (AgIR): a cloud bank of high-resolution, labeled images spanning weeds (40+ species), cover crops, and cash crops across regions, seasons, and sensors.

We’ll show how AgIR blends two complementary streams:

(1) semi-field, high-throughput data captured by BenchBot, our open-source, modular gantry that autonomously images plants and feeds a semi-automated annotation pipeline;
(2) true field images that capture real environmental variability. Together, they cut labeling cost, accelerate pretraining, and improve robustness in production.

On top of AgIR, we’ve built a data-centric training stack: hierarchical augmentation groups, batch mixers, a stand-alone visualizer for rapid iteration, and a reproducible PyTorch Lightning pipeline. We’ll cover practical lessons from segmentation (crop/weed/residue/water/soil), handling domain shift between semi-field and field scenes, and designing metadata schemas that actually pay off at model time.

About the Speaker

Sina Baghbanijam is a Ph.D. candidate in Electrical and Computer Engineering at North Carolina State University, where his research centers on generative AI, computer vision, and machine learning. His work bridges advanced AI methods with real-world applications across agriculture, medicine, and the social sciences, with a focus on large-scale image segmentation, bias-aware modeling, and data-driven analysis. In addition to his academic research, Sina is currently serving as an Agricultural Image Repository Software Engineering Intern with Precision Sustainable Agriculture, where he develops scalable pipelines and metadata systems to support AI-driven analysis of crop, soil, and field imagery.

Beyond Manual Measurements: How AI is Accelerating Plant Breeding

Traditional plant breeding relies on manual phenotypic measurements that are time-intensive, subjective, and create bottlenecks in variety development. This presentation demonstrates how computer vision and artificial intelligence are revolutionizing plant selection processes by automating trait extraction from simple photographs. Our cloud-based platform transforms images captured with smartphones, drones, or laboratory cameras into instant, quantitative phenotypic data including fruit count, size measurements, and weight estimations.

The system integrates phenotypic data with genotypic, pedigree, and environmental information in a unified database, enabling real-time analytics and decision support through intuitive dashboards. Unlike expensive hardware-dependent solutions, our software-focused approach works with existing camera equipment and standard breeding workflows, making advanced phenotyping accessible to organizations of all sizes.

About the Speaker

Dr. Sharon Inch is a botanist with a PhD in Plant Pathology and over 20 years of experience in horticulture and agricultural research. Throughout her career, she has witnessed firsthand the inefficiencies of traditional breeding methods, inspiring her to found AgriVision Analytics. As CEO, she leads the development of cloud-based computer vision platforms that transform plant breeding workflows through AI-powered phenotyping. Her work focuses on accelerating variety development and improving breeding decision-making through automated trait extraction and data integration. Dr. Sharon Inch is passionate about bridging the gap between advanced technology and practical agricultural applications to address global food security challenges.

AI-assisted sweetpotato yield estimation pipelines using optical sensor data

In this presentation, we will introduce the sensor systems and AI-powered analysis algorithms used in high-throughput sweetpotato post-harvest packing pipelines (developed by the Optical Sensing Lab at NC State University). By collecting image data from sweetpotato fields and packing lines respectively, we aim to quantitatively optimize the grading and yield estimation process, and the planning on storage and inventory-order matching.

We built two customized sensor devices to collect data respectively from the top bins when receiving sweetpotatoes from farmers, and eliminator table before grading and packing process. We also developed a compact instance segmentation pipeline that can run on smart phones for rapid yield estimation in-field with resource limitations. To minimize data privacy concerns and Internet connectivity issues, we try to keep all the analysis pipelines on the edge, which results in a design tradeoff between resource availability and environmental constraints. We will also introduce sensor building with these considerations. The analysis results and real time production information are then integrated into an interactive online dashboard, where stakeholders can leverage to help with inventory-order management and making operational decisions.

About the Speaker

Yifan Wu is a current Ph.D candidate at NC State University working in the Optical Sensing Lab (OSL) supervised by Dr. Michael Kudenov. Research focuses on developing sensor systems and machine learning platforms for business intelligence applications.

An End-to-End AgTech Use Case in FiftyOne

The agricultural sector is increasingly turning to computer vision to tackle challenges in crop monitoring, pest detection, and yield optimization. Yet, developing robust models in this space often requires careful data exploration, curation, and evaluation—steps that are just as critical as model training itself.

In this talk, we will walk through an end-to-end AgTech use case using FiftyOne, an open-source tool for dataset visualization, curation, and model evaluation. Starting with a pest detection dataset, we will explore the samples and annotations to understand dataset quality and potential pitfalls. From there, we will curate the dataset by filtering, tagging, and identifying edge cases that could impact downstream performance. Next, we’ll train a computer vision model to detect different pest species and demonstrate how FiftyOne can be used to rigorously evaluate the results. Along the way, we’ll highlight how dataset-centric workflows can accelerate experimentation, improve model reliability, and surface actionable insights specific to agricultural applications.

By the end of the session, attendees will gain a practical understanding of how to:

- Explore and diagnose real-world agricultural datasets
- Curate training data for improved performance
- Train and evaluate pest detection models
- Use FiftyOne to close the loop between data and models

This talk will be valuable for anyone working at the intersection of agriculture and computer vision, whether you’re building production models or just beginning to explore AgTech use cases.

About the Speaker

Prerna Dhareshwar is a Machine Learning Engineer at Voxel51, where she helps customers leverage FiftyOne to accelerate dataset curation, model development, and evaluation in real-world AI workflows. She brings extensive experience building and deploying computer vision and machine learning systems across industries. Prior to Voxel51, Prerna was a Senior Machine Learning Engineer at Instrumental Inc., where she developed models for defect detection in manufacturing, and a Machine Learning Software Engineer at Pure Storage, focusing on predictive analytics and automation.

* Oct 28, 2025
* 9:00-10:30 AM Pacific
* Online. Register for the Zoom!

Want greater visibility into the quality of your computer vision datasets and models? Then join us for this free 90-minute, hands-on workshop to learn how to leverage the open source FiftyOne computer vision toolset.
At the end of the workshop, you’ll be able to:

• Load and visualize agricultural datasets with complex labels
• Explore data insights interactively using embeddings and statistics
• Work with geolocation and map-based visualizations
• Generate high-quality annotations with the Segment Anything Model (SAM2)
• Evaluate model performance and debug predictions using real AgTec scenarios

Prerequisites: working knowledge of Python and basic computer vision concepts.

Resources: All attendees will get access to the tutorials, videos, and code examples used in the workshop.

Learn how to:

• Visualize complex datasets
• Explore embeddings
• Analyze and improve models
• Perform advanced data curation
• Build integrations with popular ML tools, models, and datasets

Digital Ag Innovation Lab
3800 University Blvd
Suite 1220
Ames, Iowa 50010

AI in Use Across Corteva R&D

Corteva Agriscience is a leading global agricultural solutions company based on deep integration of technology and science. Corteva’s core innovation drivers are proprietary seed products and differentiated crop protection, and has sights set on the next horizon of value from gene editing, biologicals, and advanced decision science.

A central theme of innovation at Corteva is the transformative role of artificial intelligence across the entire R&D pipeline. AI has already delivered an increase in the speed of time to discovery and significantly improved development timelines, and manufacturing productivity. Corteva is expanding its capabilities, from leveraging GenAI for creating regulatory documents to an AI-powered agronomy tool for its sales team.

This focus on innovation underpins a robust pipeline of new seed and crop protection products. The overarching goal is to leverage the latest technological capabilities to accelerate AI-guided discovery and fully embed data-driven solutions from the laboratory to the farm.

About the Speaker

Matt Smalley serves as the Data Science & Data Engineering Leader for R&D at Corteva Agriscience, where he spearheads the integration of advanced analytics, digital technologies, and scientific research to deliver innovative solutions for farmers worldwide. Matt was raised on a crop and livestock farm in northeast Iowa, an experience that instilled in him a deep appreciation for the challenges and opportunities faced by farmers.

Machine Learning Advances for 3D Phenotyping

Artificial intelligence and machine learning are reshaping agricultural research by enabling new approaches to plant phenotyping and precision agriculture. This talk presents recent advances in 3D plant reconstruction using Neural Radiance Fields (NeRFs) and related learning-based methods for generating high-fidelity visualizations of plant growth. These techniques support scalable, real-time analysis of complex plant structures, offering efficient alternatives to traditional, equipment-intensive approaches.

The session will also highlight how immersive Virtual Reality (VR) environments, combined with AI-driven reconstructions, create new opportunities for collaborative research, allowing distributed teams to virtually analyze, monitor, and interact with crops. By integrating machine learning with visualization and interaction technologies, this work advances precision agriculture and lowers barriers to access, providing both researchers and practitioners with flexible, data-driven tools for breeding, monitoring, and decision-making.

About the Speaker

Adarsh Krishnamurthy is a professor in the mechanical engineering department at Iowa State University, where he currently leads the Integrated Design and Engineering Analysis (IDEA) lab. His research interests include computer-aided design (CAD), GPU and parallel algorithms, cyber-enabled manufacturing, biomechanics, patient-specific heart modeling, solid mechanics, computational geometry, and ultrasonic non-destructive testing. He is a fellow of the Plant Science Institute at Iowa State University. He was elected as a fellow of the American Society of Mechanical Engineers (ASME) in 2024.

Beyond the Lab: Real-World Anomaly Detection for Agricultural Computer Vision

Anomaly detection is transforming manufacturing and surveillance, but what about agriculture? Can AI actually detect plant diseases and pest damage early enough to make a difference?

This talk demonstrates how anomaly detection identifies and localizes crop problems using coffee leaf health as our primary example. We'll start with the foundational theory, then examine how these models detect rust and miner damage in leaf imagery.

The session includes a comprehensive hands-on workflow using the open-source FiftyOne computer vision toolkit, covering dataset curation, patch extraction, model training, and result visualization. You'll gain both theoretical understanding of anomaly detection in computer vision and practical experience applying these techniques to agricultural challenges and other domains.

About the Speaker

Paula Ramos has a PhD in Computer Vision and Machine Learning, with more than 20 years of experience in the technological field. She has been developing novel integrated engineering technologies, mainly in Computer Vision, robotics, and Machine Learning applied to agriculture, since the early 2000s in Colombia.

Role of AI Foundation Models in Cyber-Agricultural Systems

The emergence of multi-modal AI foundation models presents a paradigm shift opportunity for cyber-agricultural systems by enabling the integration of diverse data types such as imagery, text, and time-series signals. This talk will explore the core concepts, recent advancements, and domain-specific challenges in building and applying multi-modal models to agricultural problems. I will focus on a few of our recent success stories, driving progress in this space, with applications ranging from crop monitoring and yield prediction to sustainable crop management. I will also discuss some practical considerations such as data curation, computational requirements, and model evaluation in the context of Ag foundation models.

About the Speaker

Soumik Sarkar is the Director of the Translational AI Center at Iowa State University and the Associate Director of the NSF/USDA-NIFA AI Institute for Resilient Agriculture (AIIRA). He is a Professor of Mechanical Engineering and Computer Science, and his research focuses on developing AI and machine learning algorithms for cyber-physical systems with applications to manufacturing, transportation, and agriculture. He co‐authored more than 310 peer-reviewed publications and is a recipient of several prestigious honors, including the NSF CAREER Award, the AFOSR Young Investigator Program (YIP) Award, and the Presidential Early Career Award for Scientists and Engineers (PECASE).