Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data
© International Council for the Exploration of the Sea 2017. All rights reserved. There is a need for automatic systems that can reliably detect, track and classify fish and other marine species in underwater videos without human intervention. Conventional computer vision techniques do not perform w...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Journal Article |
| Published: |
Oxford University Press 2009
2018
|
| Online Access: | http://hdl.handle.net/20.500.11937/65753 |
| _version_ | 1848761196115656704 |
|---|---|
| author | Siddiqui, S. Salman, A. Malik, M. Shafait, F. Mian, A. Shortis, M. Harvey, Euan |
| author_facet | Siddiqui, S. Salman, A. Malik, M. Shafait, F. Mian, A. Shortis, M. Harvey, Euan |
| author_sort | Siddiqui, S. |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | © International Council for the Exploration of the Sea 2017. All rights reserved. There is a need for automatic systems that can reliably detect, track and classify fish and other marine species in underwater videos without human intervention. Conventional computer vision techniques do not perform well in underwater conditions where the background is complex and the shape and textural features of fish are subtle. Data-driven classification models like neural networks require a huge amount of labelled data, otherwise they tend to over-fit to the training data and fail on unseen test data which is not involved in training. We present a state-of-the-art computer vision method for fine-grained fish species classification based on deep learning techniques. A cross-layer pooling algorithm using a pre-trained Convolutional Neural Network as a generalized feature detector is proposed, thus avoiding the need for a large amount of training data. Classification on test data is performed by a SVM on the features computed through the proposed method, resulting in classification accuracy of 94.3% for fish species from typical underwater video imagery captured off the coast of Western Australia. This research advocates that the development of automated classification systems which can identify fish from underwater video imagery is feasible and a cost-effective alternative to manual identification by humans. |
| first_indexed | 2025-11-14T10:27:49Z |
| format | Journal Article |
| id | curtin-20.500.11937-65753 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T10:27:49Z |
| publishDate | 2018 |
| publisher | Oxford University Press 2009 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-657532018-02-19T08:06:17Z Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data Siddiqui, S. Salman, A. Malik, M. Shafait, F. Mian, A. Shortis, M. Harvey, Euan © International Council for the Exploration of the Sea 2017. All rights reserved. There is a need for automatic systems that can reliably detect, track and classify fish and other marine species in underwater videos without human intervention. Conventional computer vision techniques do not perform well in underwater conditions where the background is complex and the shape and textural features of fish are subtle. Data-driven classification models like neural networks require a huge amount of labelled data, otherwise they tend to over-fit to the training data and fail on unseen test data which is not involved in training. We present a state-of-the-art computer vision method for fine-grained fish species classification based on deep learning techniques. A cross-layer pooling algorithm using a pre-trained Convolutional Neural Network as a generalized feature detector is proposed, thus avoiding the need for a large amount of training data. Classification on test data is performed by a SVM on the features computed through the proposed method, resulting in classification accuracy of 94.3% for fish species from typical underwater video imagery captured off the coast of Western Australia. This research advocates that the development of automated classification systems which can identify fish from underwater video imagery is feasible and a cost-effective alternative to manual identification by humans. 2018 Journal Article http://hdl.handle.net/20.500.11937/65753 10.1093/icesjms/fsx109 Oxford University Press 2009 restricted |
| spellingShingle | Siddiqui, S. Salman, A. Malik, M. Shafait, F. Mian, A. Shortis, M. Harvey, Euan Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data |
| title | Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data |
| title_full | Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data |
| title_fullStr | Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data |
| title_full_unstemmed | Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data |
| title_short | Automatic fish species classification in underwater videos: Exploiting pre-trained deep neural network models to compensate for limited labelled data |
| title_sort | automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data |
| url | http://hdl.handle.net/20.500.11937/65753 |