Oral Presentation Society for Freshwater Science 2025 Annual Meeting

AI-enhanced remote sensing for aquaculture monitoring in the Amazon (117557)

Felipe S Pacheco 1 , Anmol Kabra 2 , Brendan H Rappazzo 2 , Aaron M Ferber 2 , Joshua Y Fan 2 , Laura E Greenstreet 2 , Marta E Ummus 3 , Alecsander G Brito 3 , Sebastian Heilpern 4 , Imanol Miqueleiz 5 , Rafael M Almeida 6 , Suresh A Sethi 7 , Marcela Miranda 1 , Carla P Gomes 2 , Alexander S Flecker 1
  1. Ecology & Evolutionary Biology, Cornell University, Ithaca, New York, United States
  2. Department of Computer Science, Cornell University, Ithaca, New York, United States
  3. Embrapa Fishery and Aquaculture, Palmas, Tocantins, Brazil
  4. Department of Public & Ecosystem Health, Cornell University, Ithaca, New York, United States
  5. Department of Natural Resources and the Environment, Cornell University, Ithaca, New York, United States
  6. O’Neill School of Public and Environmental Affairs, Indiana University, Bloomington, Indiana, United States
  7. Aquatic Research and Environmental Assessment Center, Brooklyn College, University of New York, New York, United States

Aquaculture is a critical component of sustainable food systems, particularly in the Amazon Basin, where its expansion must balance production goals with ecological preservation. Monitoring aquaculture systems is essential for ensuring sustainable development, yet traditional satellite-based approaches face significant challenges in identifying aquaculture ponds amidst the region’s complex tropical landscapes. These challenges are exacerbated by the variability in pond sizes, shapes, and land-use contexts, requiring innovative solutions. Here, we present AISciVision-Aqua, a novel framework that integrates Visual Retrieval-Augmented Generation (VisRAG) and domain-specific interactive tools to enhance aquaculture pond detection using high-resolution satellite imagery. Leveraging Large Multimodal Models (LMMs), AISciVision-Aqua incorporates domain-specific interactive tools, such as panning and zooming, that emulate human workflows for image classification and enable dynamic exploration of spatial contexts. The framework was trained and validated on a robust dataset combining PlanetScope imagery and a validated database of aquaculture pond locations in Rondônia state, Brazil. Our results show that AISciVision-Aqua achieves significantly higher precision and recall compared to baseline methods, including random forest classifiers and supervised deep-learning models. Additionally, the framework provides interpretable transcripts of its decision-making process, fostering transparency and facilitating expert validation. By integrating spatial analysis tools and iterative reasoning, AISciVision-Aqua enables real-time refinement of predictions, offers a scalable, accessible solution for aquaculture monitoring in complex landscapes like the Amazon, and supports effective decision-making to balance food security with environmental conservation in tropical ecosystems. Our approach highlights the transformative potential of artificial intelligence in addressing sustainability challenges in freshwater science.