TOUCHDOWN: Natural Language Navigation and Spatial Reasoning in Visual Street Environments

We study the problem of jointly reasoning about language and vision through a navigation and spatial reasoning task. We introduce the Touchdown task and dataset, where an agent must first follow navigation instructions in a Street View environment to a goal position, and then guess a location in its...

Full description

Bibliographic Details

Published in:	Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 12530 - 12539
Main Authors:	Chen, Howard, Suhr, Alane, Misra, Dipendra, Snavely, Noah, Artzi, Yoav
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01.06.2019
Subjects:	Cognition Data collection Datasets and Evaluation Linguistics Navigation Spatial databases Urban areas Vision + Language Visual Reasoning Visualization
ISSN:	1063-6919
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!