ViT-LASNet: Enhancing Plankton Classification for Real-Time Ecological Monitoring

ViT-LASNet Framework

Figure 1: Sample diversity captured by the Plankton Imager and location of the research vessel: a comparative display of copepods, non-copepods, and detritus.

Abstract

The complexity of marine plankton monitoring has highlighted the limitations of conventional machine learning models, particularly when faced with long-tailed data distributions commonly found in natural environments. This paper introduces a comprehensive framework that leverages a novel dataset from the Plankton imager (Pi-10) instrument designed to enhance plankton image monitoring accuracy in a real-time application. We employ cutting-edge image classification architectures, including pre-trained Vision Transformers (ViT) and BERT Pre-training of Image Transformers (BEiT). We integrate Label-Aware Smoothing (LAS) into our training process to address the challenges of long-tailed data distributions. Further, we innovate with dynamic label-aware smoothing, which adjusts smoothing factors based on attention scores from ViTs to tailor model confidence to the significance of different image regions. The results demonstrate improvements in classification performance on the Pi-10 dataset, effectively handling long-tail distribution challenges and setting new benchmarks for real-time image classification in ecological research and biodiversity monitoring. This approach advances biodiversity monitoring and provides a scalable solution adaptable to other domains encountering similar distributional challenges.

Contact

For inquiries or collaboration, please reach out via:

Email: Neftekhari@turing.ac.uk