TY - JOUR
T1 - Persistent monitoring of insect-pests on sticky traps through hierarchical transfer learning and slicing-aided hyper inference
AU - Fotouhi, Fateme
AU - Menke, Kevin
AU - Prestholt, Aaron
AU - Gupta, Ashish
AU - Carroll, Matthew E.
AU - Yang, Hsin Jung
AU - Skidmore, Edwin J.
AU - O’Neal, Matthew
AU - Merchant, Nirav
AU - Das, Sajal K.
AU - Kyveryga, Peter
AU - Ganapathysubramanian, Baskar
AU - Singh, Asheesh K.
AU - Singh, Arti
AU - Sarkar, Soumik
N1 - Publisher Copyright:
Copyright © 2024 Fotouhi, Menke, Prestholt, Gupta, Carroll, Yang, Skidmore, O’Neal, Merchant, Das, Kyveryga, Ganapathysubramanian, Singh, Singh and Sarkar.
PY - 2024
Y1 - 2024
N2 - Introduction: Effective monitoring of insect-pests is vital for safeguarding agricultural yields and ensuring food security. Recent advances in computer vision and machine learning have opened up significant possibilities of automated persistent monitoring of insect-pests through reliable detection and counting of insects in setups such as yellow sticky traps. However, this task is fraught with complexities, encompassing challenges such as, laborious dataset annotation, recognizing small insect-pests in low-resolution or distant images, and the intricate variations across insect-pests life stages and species classes. Methods: To tackle these obstacles, this work investigates combining two solutions, Hierarchical Transfer Learning (HTL) and Slicing-Aided Hyper Inference (SAHI), along with applying a detection model. HTL pioneers a multi-step knowledge transfer paradigm, harnessing intermediary in-domain datasets to facilitate model adaptation. Moreover, slicing-aided hyper inference subdivides images into overlapping patches, conducting independent object detection on each patch before merging outcomes for precise, comprehensive results. Results: The outcomes underscore the substantial improvement achievable in detection results by integrating a diverse and expansive in-domain dataset within the HTL method, complemented by the utilization of SAHI. Discussion: We also present a hardware and software infrastructure for deploying such models for real-life applications. Our results can assist researchers and practitioners looking for solutions for insect-pest detection and quantification on yellow sticky traps.
AB - Introduction: Effective monitoring of insect-pests is vital for safeguarding agricultural yields and ensuring food security. Recent advances in computer vision and machine learning have opened up significant possibilities of automated persistent monitoring of insect-pests through reliable detection and counting of insects in setups such as yellow sticky traps. However, this task is fraught with complexities, encompassing challenges such as, laborious dataset annotation, recognizing small insect-pests in low-resolution or distant images, and the intricate variations across insect-pests life stages and species classes. Methods: To tackle these obstacles, this work investigates combining two solutions, Hierarchical Transfer Learning (HTL) and Slicing-Aided Hyper Inference (SAHI), along with applying a detection model. HTL pioneers a multi-step knowledge transfer paradigm, harnessing intermediary in-domain datasets to facilitate model adaptation. Moreover, slicing-aided hyper inference subdivides images into overlapping patches, conducting independent object detection on each patch before merging outcomes for precise, comprehensive results. Results: The outcomes underscore the substantial improvement achievable in detection results by integrating a diverse and expansive in-domain dataset within the HTL method, complemented by the utilization of SAHI. Discussion: We also present a hardware and software infrastructure for deploying such models for real-life applications. Our results can assist researchers and practitioners looking for solutions for insect-pest detection and quantification on yellow sticky traps.
KW - Edge-IoT cyberinfrastructure
KW - deep learning
KW - insect-pest monitoring
KW - transfer learning
KW - yellow sticky traps
UR - http://www.scopus.com/inward/record.url?scp=85210975825&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85210975825&partnerID=8YFLogxK
U2 - 10.3389/fpls.2024.1484587
DO - 10.3389/fpls.2024.1484587
M3 - Article
AN - SCOPUS:85210975825
SN - 1664-462X
VL - 15
JO - Frontiers in Plant Science
JF - Frontiers in Plant Science
M1 - 1484587
ER -