Single-shot extrinsic calibration of a generically configured RGB-D camera rig from scene constraints

With the increasing use of commodity RGB-D cameras for computer vision, robotics, mixed and augmented reality and other areas, it is of significant practical interest to calibrate the relative pose between a depth (D) camera and an RGB camera in these types of setups. In this paper, we propose a new...

Full description

Saved in:
Bibliographic Details
Published in:2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) pp. 181 - 188
Main Authors: Jiaolong Yang, Yuchao Dai, Hongdong Li, Gardner, Henry, Yunde Jia
Format: Conference Proceeding
Language:English
Published: IEEE 01.10.2013
Subjects:
and virtual realities
augmented
Calibration
Cameras
Color
Educational institutions
H.5.1 [INFORMATION INTERFACES AND PRESENTATION]: Multimedia Information Systems-Artificial
I.4.1 [IMAGE PROCESSING AND COMPUTER VISION ]: Digitization and Image Capture-Camera calibration
I.4.3 [IMAGE PROCESSING AND COMPUTER VISION ]: Enhancement-Registration
I.4.8 [IMAGE PROCESSING AND COMPUTER VISION]: Scene Analysis-Range data
Image color analysis
Robot vision systems
Three-dimensional displays
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract With the increasing use of commodity RGB-D cameras for computer vision, robotics, mixed and augmented reality and other areas, it is of significant practical interest to calibrate the relative pose between a depth (D) camera and an RGB camera in these types of setups. In this paper, we propose a new single-shot, correspondence-free method to extrinsically calibrate a generically configured RGB-D camera rig. We formulate the extrinsic calibration problem as one of geometric 2D-3D registration which exploits scene constraints to achieve single-shot extrinsic calibration. Our method first reconstructs sparse point clouds from a single-view 2D image. These sparse point clouds are then registered with dense point clouds from the depth camera. Finally, we directly optimize the warping quality by evaluating scene constraints in 3D point clouds. Our single-shot extrinsic calibration method does not require correspondences across multiple color images or across different modalities and it is more flexible than existing methods. The scene constraints can be very simple and we demonstrate that a scene containing three sheets of paper is sufficient to obtain reliable calibration and with a lower geometric error than existing methods.
AbstractList With the increasing use of commodity RGB-D cameras for computer vision, robotics, mixed and augmented reality and other areas, it is of significant practical interest to calibrate the relative pose between a depth (D) camera and an RGB camera in these types of setups. In this paper, we propose a new single-shot, correspondence-free method to extrinsically calibrate a generically configured RGB-D camera rig. We formulate the extrinsic calibration problem as one of geometric 2D-3D registration which exploits scene constraints to achieve single-shot extrinsic calibration. Our method first reconstructs sparse point clouds from a single-view 2D image. These sparse point clouds are then registered with dense point clouds from the depth camera. Finally, we directly optimize the warping quality by evaluating scene constraints in 3D point clouds. Our single-shot extrinsic calibration method does not require correspondences across multiple color images or across different modalities and it is more flexible than existing methods. The scene constraints can be very simple and we demonstrate that a scene containing three sheets of paper is sufficient to obtain reliable calibration and with a lower geometric error than existing methods.
Author Yunde Jia
Hongdong Li
Jiaolong Yang
Gardner, Henry
Yuchao Dai
Author_xml – sequence: 1
  surname: Jiaolong Yang
  fullname: Jiaolong Yang
  email: yangjiaolong@bit.edu.cn
  organization: Sch. of Comput. Sci., Beijing Inst. of Technol., Beijing, China
– sequence: 2
  surname: Yuchao Dai
  fullname: Yuchao Dai
  email: yuchao.dai@anu.edu.au
  organization: Res. Sch. of Comput. Sci., Australian Nat. Univ., Canberra, ACT, Australia
– sequence: 3
  surname: Hongdong Li
  fullname: Hongdong Li
  email: hongdong.li@anu.edu.au
  organization: Res. Sch. of Eng., Australian Nat. Univ., Canberra, ACT, Australia
– sequence: 4
  givenname: Henry
  surname: Gardner
  fullname: Gardner, Henry
  email: henry.gardner@anu.edu.au
  organization: Res. Sch. of Comput. Sci., Australian Nat. Univ., Canberra, ACT, Australia
– sequence: 5
  surname: Yunde Jia
  fullname: Yunde Jia
  email: jiayunde@bit.edu.cn
  organization: Sch. of Comput. Sci., Beijing Inst. of Technol., Beijing, China
BookMark eNotkF1LwzAYRiMoqLN_QG_yBzqTtkuayzl1DibCptcjH2_qC20qSQT37624qwcOh3PxXJPzMAYg5JazOedM3W_2r8vdvGK8ngshuZTtGSmUbHkjlapaodQlKVJCwyohRcOaxRWBPYauhzJ9jpnCT44YElpqdY8m6oxjoKOnmnYQIOKE-yO1Y_DYfUdwdLd-KB8ne4CoacSO-jgONNnJ_tNSjhpDTjfkwus-QXHaGfl4fnpfvZTbt_VmtdyWWHGVy8ow0N5Jx2xt3aL1rFEgFGjVOOOU1cJ5Do0wEzXWVVxIw1wtLOOuVq2sZ-Tuv4sAcPiKOOh4PJzOqH8BBdVZgA
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ISMAR.2013.6671778
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE/IET Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781479928699
1479928690
EndPage 188
ExternalDocumentID 6671778
Genre orig-research
GroupedDBID 6IE
6IL
ALMA_UNASSIGNED_HOLDINGS
CBEJK
RIB
RIC
RIE
RIL
ID FETCH-LOGICAL-i219t-2b0eafd7d0c3cd58f049e69ea94dbd9ca6df1e46b9e6bcd2167b0d36c01d39873
IEDL.DBID RIE
ISICitedReferencesCount 8
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000331439800048&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Dec 20 05:18:52 EST 2023
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i219t-2b0eafd7d0c3cd58f049e69ea94dbd9ca6df1e46b9e6bcd2167b0d36c01d39873
OpenAccessLink https://openresearch-repository.anu.edu.au/bitstreams/baa5a560-964f-4a39-90be-3c30238cae42/download
PageCount 8
ParticipantIDs ieee_primary_6671778
PublicationCentury 2000
PublicationDate 2013-Oct.
PublicationDateYYYYMMDD 2013-10-01
PublicationDate_xml – month: 10
  year: 2013
  text: 2013-Oct.
PublicationDecade 2010
PublicationTitle 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
PublicationTitleAbbrev ISMAR
PublicationYear 2013
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib026764045
Score 1.9310876
Snippet With the increasing use of commodity RGB-D cameras for computer vision, robotics, mixed and augmented reality and other areas, it is of significant practical...
SourceID ieee
SourceType Publisher
StartPage 181
SubjectTerms and virtual realities
augmented
Calibration
Cameras
Color
Educational institutions
H.5.1 [INFORMATION INTERFACES AND PRESENTATION]: Multimedia Information Systems-Artificial
I.4.1 [IMAGE PROCESSING AND COMPUTER VISION ]: Digitization and Image Capture-Camera calibration
I.4.3 [IMAGE PROCESSING AND COMPUTER VISION ]: Enhancement-Registration
I.4.8 [IMAGE PROCESSING AND COMPUTER VISION]: Scene Analysis-Range data
Image color analysis
Robot vision systems
Three-dimensional displays
Title Single-shot extrinsic calibration of a generically configured RGB-D camera rig from scene constraints
URI https://ieeexplore.ieee.org/document/6671778
WOSCitedRecordID wos000331439800048&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEA5t8eBJpRXf5ODR1H2kye7RV1XQUlqF3kqSmdSFspXdreC_N9nWiuDFWwgJgW-GJJPM9w0h5_5nyLqIjSXcKMatCVnaM5pp4xwKNTcSahHXJzkYJJNJOmyQiw0XBhHr5DPs-mb9lw8Ls_RPZb5yXyhl0iRNKcWKq_XtO5GQgrvryTcvJkgvH8fPVyOfvBV31xN_VVCpD5D-zv-W3iWdHyYeHW7OmD3SwLxNcOzac2Tl26KibnMtstxhTR3aPvb1SNOFpYrOvKS0N8L8k7qw12azZYFAR_fX7NaN9s9R1AXn1FNMqFd1Qj-srKtGVGWHvPbvXm4e2LpcAsvctlOxSAeoLEgITGygl1h3-UeRoko5aEiNEmBD5EK7Xm0gCoXUAcTCBCHEaSLjfdLKFzkeEKrBWBHxBCAyXAdSBUp4sTA3ByBUcEjaHqLp-0oRY7pG5-jv7mOy7a2wSoE7Ia2qWOIp2TIfVVYWZ7UZvwCXWKJH
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEA61CnpSacW3OXg0dR9psnv0VVtsS2kreCtJJqkLZSu7W8F_b7J9iODFWwgJgZkhyZfM9w1C1-5nyFjERiKqBKFG-SRuKkmksgGlJVUcShHXLu_3o7e3eFBBNxsujNa6TD7TDdcs__JhrhbuqcxV7vM5j7bQdpNa3LNka62jJ2CcUXtBWTNjvPi2M-rdDV36VthYTf1VQ6U8Qlr7_1v8ANV_uHh4sDllDlFFpzWkR7Y90yR_nxfYbq9ZklprY2tvh36drfHcYIGnTlTauWH2hS3wNcl0kWnAw-d78mhHuwcpbOE5diQT7HSdtBuWl3UjiryOXltP44c2WRVMIIndeAoSSE8LAxw8FSpoRsZe_zWLtYgpSIiVYGB8TZm0vVJB4DMuPQiZ8nwI44iHR6iazlN9jLAEZVhAI4BAUelx4Qnm5MLsHABfwAmqORNNPpaaGJOVdU7_7r5Cu-1xrzvpdvovZ2jPeWSZEHeOqkW20BdoR30WSZ5dli79BjQipY4
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2013+IEEE+International+Symposium+on+Mixed+and+Augmented+Reality+%28ISMAR%29&rft.atitle=Single-shot+extrinsic+calibration+of+a+generically+configured+RGB-D+camera+rig+from+scene+constraints&rft.au=Jiaolong+Yang&rft.au=Yuchao+Dai&rft.au=Hongdong+Li&rft.au=Gardner%2C+Henry&rft.date=2013-10-01&rft.pub=IEEE&rft.spage=181&rft.epage=188&rft_id=info:doi/10.1109%2FISMAR.2013.6671778&rft.externalDocID=6671778