A research team led by Prof. LU Xiaoqiang from the Xi'an Institute of Optics and Precision Mechanics (XIOPM) of the Chinese Academy of Sciences proposed a novel mutual attention inception network (MAIN) and a dataset named RSIVQA for remote sensing visual question answering. The results were published in IEEE Transactions on Geoscience and Remote Sensing.
Remote sensing visual question answering (VQA) mainly aims at making semantic understanding of remote sensing images (RSIs) objective and interactive. Specifically, given an RSI, an intelligent agent will answer a question about the remote sensing scene.
Most of the existing methods ignore the spatial information of RSIs and word-level semantic information of questions, which restricts their applications in many complex scenes.
Accordingly, in this study, the proposed MAIN was made up of two parts, including the representation module and the fusion module. The representation module was devised to obtain the features of image and question which can provide better representations.
As for the fusion module, it enhanced the discriminative ability of representations which can acquire correct answers by reinforcing the representations of image and question.
According to the experiments results, the proposed method can capture the alignments between images and questions under different evaluation metrics. This study provides a new perspective for the remote sensing visual question answering.
Overview of the proposed method. (Image by XIOPM)
It has been proved that the proposed analytical approximation method is useful in the radiation scheme of GCM, while it is not sufficient in the satellite remote sensing. Therefore the team improved a vector radiative transfer model by coupling marine biology-optic module...
A memorandum of understanding, signed by the Institute of Remote Sensing and Digital Earth (RADI) of China, Chinese Academy of Sciences (CAS), HIST and Cambodia' s Authority for the Protection and Management of Angkor and the Region of Siem Reap (APSARA) in 2014, enables ...
86-10-68597521 (day)
86-10-68597289 (night)
86-10-68511095 (day)
86-10-68512458 (night)
cas_en@cas.cn
52 Sanlihe Rd., Xicheng District,
Beijing, China (100864)
Copyright © 2002 - Chinese Academy of Sciences
