This paper presents a semantic scene modeling technique for constructing a cloud-based aquaculture surveillance system using an autonomous drone. The emergence of low-cost drones has created opportunities to find new solutions for a number of problems of computer vision and artificial intelligence based internet-of-things (AIoT). However, vision based activity detection using a mobile RGB camera still remains as a challenging task since the activities in different regions of the scene to be monitored are quite different. Moreover, the sizes of detected objects using a drone are often very small. In this work, the 3D model of an aquaculture environment is first constructed using the calibrated intrinsic camera parameters, the depth maps and the pose parameters of frames in the captured video using a drone. Next, our semantic scene modeling algorithm represents the visual and geometrical information of the semantic objects which defines the checkpoints for routine data gathering and environmental inspection. To associate each checkpoint with the GPS signal and the altitude value of the drone, our approach combines the automatic drone navigation, computer vision and machine learning algorithms to detect the checkpoint specific activities. The scene modeling algorithm transfers the essential knowledge to the mobile drone through the aquaculture cloud for monitoring the fish, persons, nets and feeding systems in an aquaculture site on a daily basis. Thus, the drone becomes a flyable intelligent robot that helps the manager of an aquaculture site to automatically collect valuable data that are important in optimization fish production using further decision making algorithms. Experiments show that our approach attains very high performance yielding significant semantics-based activity recognition accuracy without sacrificing the operation speed.
Semantic scene modeling for aquaculture management using an autonomous drone
International Workshop on Advanced Imaging Technology (IWAIT) 2020 ; 2020 ; Yogyakarta,Indonesia
Proc. SPIE ; 11515
2020-06-01
Conference paper
Electronic Resource
English
Semantic scene modeling for aquaculture management using an autonomous drone
British Library Conference Proceedings | 2020
|Factory type aquaculture management system using drone and method thereof
European Patent Office | 2021
|