Learning-based saliency model with depth information

Most previous studies on visual saliency focused on two-dimensional (2D) scenes. Due to the rapidly growing three-dimensional (3D) video applications, it is very desirable to know how depth information affects human visual attention. In this study, we first conducted eye-fixation experiments on 3D i...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of vision (Charlottesville, Va.) Ročník 15; číslo 6; s. 19
Hlavní autoři: Ma, Chih-Yao, Hang, Hsueh-Ming
Médium: Journal Article
Jazyk:angličtina
Vydáno: United States 01.01.2015
Témata:
Adolescent
Databases, Factual
Depth Perception - physiology
Eye Movements - physiology
Female
Fixation, Ocular - physiology
Humans
Image Processing, Computer-Assisted - methods
Imaging, Three-Dimensional
Male
Models, Biological
Young Adult
ISSN:1534-7362, 1534-7362
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Most previous studies on visual saliency focused on two-dimensional (2D) scenes. Due to the rapidly growing three-dimensional (3D) video applications, it is very desirable to know how depth information affects human visual attention. In this study, we first conducted eye-fixation experiments on 3D images. Our fixation data set comprises 475 3D images and 16 subjects. We used a Tobii TX300 eye tracker (Tobii, Stockholm, Sweden) to track the eye movement of each subject. In addition, this database contains 475 computed depth maps. Due to the scarcity of public-domain 3D fixation data, this data set should be useful to the 3D visual attention research community. Then, a learning-based visual attention model was designed to predict human attention. In addition to the popular 2D features, we included the depth map and its derived features. The results indicate that the extra depth information can enhance the saliency estimation accuracy specifically for close-up objects hidden in a complex-texture background. In addition, we examined the effectiveness of various low-, mid-, and high-level features on saliency prediction. Compared with both 2D and 3D state-of-the-art saliency estimation models, our methods show better performance on the 3D test images. The eye-tracking database and the MATLAB source codes for the proposed saliency model and evaluation methods are available on our website.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1534-7362
1534-7362
DOI:10.1167/15.6.19