Parallel Learning: Overview and Perspective for Computational Learning Across Syn2Real and Sim2Real

The virtual-to-real paradigm, i.e., training models on virtual data and then applying them to solve real-world problems, has attracted more and more attention from various domains by successfully alleviating the data shortage problem in machine learning. To summarize the advances in recent years, th...

Full description

Saved in:
Bibliographic Details
Published in:IEEE/CAA journal of automatica sinica Vol. 10; no. 3; pp. 603 - 631
Main Authors: Miao, Qinghai, Lv, Yisheng, Huang, Min, Wang, Xiao, Wang, Fei-Yue
Format: Journal Article
Language:English
Published: Piscataway Chinese Association of Automation (CAA) 01.03.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
School of Artificial Intelligence,University of Chinese Academy of Sciences,Beijing 100049,China%School of Artificial Intelligence,University of Chinese Academy of Sciences,Beijing 100049,China
State Key Laboratory for Manage-ment and Control of Complex Systems,Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China%School of Artificial Intelligence,Anhui University,Hefei 266114,China,Qingdao Academy of Intelligent Industries,Qingdao 230031,China%State Key Laboratory for Manage-ment and Control of Complex Systems,Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China
Subjects:
ISSN:2329-9266, 2329-9274
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The virtual-to-real paradigm, i.e., training models on virtual data and then applying them to solve real-world problems, has attracted more and more attention from various domains by successfully alleviating the data shortage problem in machine learning. To summarize the advances in recent years, this survey comprehensively reviews the literature, from the viewport of parallel intelligence. First, an extended parallel learning framework is proposed to cover main domains including computer vision, natural language processing, robotics, and autonomous driving. Second, a multi-dimensional taxonomy is designed to organize the literature in a hierarchical structure. Third, the related virtual-to-real works are analyzed and compared according to the three principles of parallel learning known as description, prediction, and prescription, which cover the methods for constructing virtual worlds, generating labeled data, domain transferring, model training and testing, as well as optimizing the strategies to guide the task-oriented data generator for better learning performance. Key issues remained in virtual-to-real are discussed. Furthermore, the future research directions from the viewpoint of parallel learning are suggested.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2329-9266
2329-9274
DOI:10.1109/JAS.2023.123375