Reconstructing Three-Dimensional Models of Interacting Humans

Gespeichert in:
Bibliographische Detailangaben
Titel: Reconstructing Three-Dimensional Models of Interacting Humans
Autoren: Fieraru, Mihai, Zanfir, Mihai, Oneata, Elisabeta, Popa, Alin Ionut, Olaru, Vlad, Sminchisescu, Cristian
Weitere Verfasser: Lund University, Faculty of Science, Centre for Mathematical Sciences, Research groups at the Centre for Mathematical Sciences, Mathematical Imaging Group, Lunds universitet, Naturvetenskapliga fakulteten, Matematikcentrum, Forskargrupper vid Matematikcentrum, Mathematical Imaging Group, Originator, Lund University, Profile areas and other strong research environments, Strategic research areas (SRA), ELLIIT: the Linköping-Lund initiative on IT and mobile communication, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Strategiska forskningsområden (SFO), ELLIIT: the Linköping-Lund initiative on IT and mobile communication, Originator, Lund University, Profile areas and other strong research environments, Strategic research areas (SRA), eSSENCE: The e-Science Collaboration, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Strategiska forskningsområden (SFO), eSSENCE: The e-Science Collaboration, Originator, Lund University, Faculty of Engineering, LTH, LTH Profile areas, LTH Profile Area: AI and Digitalization, Lunds universitet, Lunds Tekniska Högskola, LTH profilområden, LTH profilområde: AI och digitalisering, Originator, Lund University, Profile areas and other strong research environments, Lund University Profile areas, LU Profile Area: Natural and Artificial Cognition, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Lunds universitets profilområden, LU profilområde: Naturlig och artificiell kognition, Originator, Lund University, Faculty of Science, Centre for Mathematical Sciences, Mathematics (Faculty of Engineering), Computer Vision and Machine Learning, Lunds universitet, Naturvetenskapliga fakulteten, Matematikcentrum, Matematik LTH, Datorseende och maskininlärning, Originator
Quelle: IEEE Transactions on Pattern Analysis and Machine Intelligence. 47(12):10870-10881
Schlagwörter: Natural Sciences, Computer and Information Sciences, Computer graphics and computer vision, Naturvetenskap, Data- och informationsvetenskap (Datateknik), Datorgrafik och datorseende
Beschreibung: Understanding 3D human interactions is fundamental for fine-grained scene analysis and behavioural modeling. However, most of the existing models predict incorrect, lifeless 3D estimates, that miss the subtle human contact aspects–the essence of the event–and are of little use for detailed behavioral understanding. This paper addresses such issues with several contributions: (1) we introduce models for interaction signature estimation (ISP) encompassing contact detection, segmentation, and 3D contact signature prediction; (2) we show how such components can be leveraged to ensure contact consistency during 3D reconstruction; (3) we construct several large datasets for learning and evaluating 3D contact prediction and reconstruction methods; specifically, we introduce CHI3D, a lab-based accurate 3D motion capture dataset with 631 sequences containing 2,525 contact events, 728,664 ground truth 3D poses, as well as FlickrCI3D, a dataset of 11,216 images, with 14,081 processed pairs of people, and 81,233 facet-level surface correspondences. Finally, (4) we propose methodology for recovering the ground-truth pose and shape of interacting people in a controlled setup and (5) annotate all 3D interaction motions in CHI3D with textual descriptions.
Datenbank: SwePub
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsswe&genre=article&issn=01628828&ISBN=&volume=47&issue=12&date=20250101&spage=10870&pages=10870-10881&title=IEEE Transactions on Pattern Analysis and Machine Intelligence&atitle=Reconstructing%20Three-Dimensional%20Models%20of%20Interacting%20Humans&aulast=Fieraru%2C%20Mihai&id=DOI:10.1109/TPAMI.2025.3601974
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Fieraru%20M
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsswe
DbLabel: SwePub
An: edsswe.oai.portal.research.lu.se.publications.de378946.5287.40b7.9674.f6d9c9e4d7dc
RelevancyScore: 1015
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 1014.736328125
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Reconstructing Three-Dimensional Models of Interacting Humans
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Fieraru%2C+Mihai%22">Fieraru, Mihai</searchLink><br /><searchLink fieldCode="AR" term="%22Zanfir%2C+Mihai%22">Zanfir, Mihai</searchLink><br /><searchLink fieldCode="AR" term="%22Oneata%2C+Elisabeta%22">Oneata, Elisabeta</searchLink><br /><searchLink fieldCode="AR" term="%22Popa%2C+Alin+Ionut%22">Popa, Alin Ionut</searchLink><br /><searchLink fieldCode="AR" term="%22Olaru%2C+Vlad%22">Olaru, Vlad</searchLink><br /><searchLink fieldCode="AR" term="%22Sminchisescu%2C+Cristian%22">Sminchisescu, Cristian</searchLink>
– Name: Author
  Label: Contributors
  Group: Au
  Data: Lund University, Faculty of Science, Centre for Mathematical Sciences, Research groups at the Centre for Mathematical Sciences, Mathematical Imaging Group, Lunds universitet, Naturvetenskapliga fakulteten, Matematikcentrum, Forskargrupper vid Matematikcentrum, Mathematical Imaging Group, Originator<br />Lund University, Profile areas and other strong research environments, Strategic research areas (SRA), ELLIIT: the Linköping-Lund initiative on IT and mobile communication, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Strategiska forskningsområden (SFO), ELLIIT: the Linköping-Lund initiative on IT and mobile communication, Originator<br />Lund University, Profile areas and other strong research environments, Strategic research areas (SRA), eSSENCE: The e-Science Collaboration, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Strategiska forskningsområden (SFO), eSSENCE: The e-Science Collaboration, Originator<br />Lund University, Faculty of Engineering, LTH, LTH Profile areas, LTH Profile Area: AI and Digitalization, Lunds universitet, Lunds Tekniska Högskola, LTH profilområden, LTH profilområde: AI och digitalisering, Originator<br />Lund University, Profile areas and other strong research environments, Lund University Profile areas, LU Profile Area: Natural and Artificial Cognition, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Lunds universitets profilområden, LU profilområde: Naturlig och artificiell kognition, Originator<br />Lund University, Faculty of Science, Centre for Mathematical Sciences, Mathematics (Faculty of Engineering), Computer Vision and Machine Learning, Lunds universitet, Naturvetenskapliga fakulteten, Matematikcentrum, Matematik LTH, Datorseende och maskininlärning, Originator
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <i>IEEE Transactions on Pattern Analysis and Machine Intelligence</i>. 47(12):10870-10881
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Natural+Sciences%22">Natural Sciences</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+and+Information+Sciences%22">Computer and Information Sciences</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+graphics+and+computer+vision%22">Computer graphics and computer vision</searchLink><br /><searchLink fieldCode="DE" term="%22Naturvetenskap%22">Naturvetenskap</searchLink><br /><searchLink fieldCode="DE" term="%22Data-+och+informationsvetenskap+%28Datateknik%29%22">Data- och informationsvetenskap (Datateknik)</searchLink><br /><searchLink fieldCode="DE" term="%22Datorgrafik+och+datorseende%22">Datorgrafik och datorseende</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Understanding 3D human interactions is fundamental for fine-grained scene analysis and behavioural modeling. However, most of the existing models predict incorrect, lifeless 3D estimates, that miss the subtle human contact aspects–the essence of the event–and are of little use for detailed behavioral understanding. This paper addresses such issues with several contributions: (1) we introduce models for interaction signature estimation (ISP) encompassing contact detection, segmentation, and 3D contact signature prediction; (2) we show how such components can be leveraged to ensure contact consistency during 3D reconstruction; (3) we construct several large datasets for learning and evaluating 3D contact prediction and reconstruction methods; specifically, we introduce CHI3D, a lab-based accurate 3D motion capture dataset with 631 sequences containing 2,525 contact events, 728,664 ground truth 3D poses, as well as FlickrCI3D, a dataset of 11,216 images, with 14,081 processed pairs of people, and 81,233 facet-level surface correspondences. Finally, (4) we propose methodology for recovering the ground-truth pose and shape of interacting people in a controlled setup and (5) annotate all 3D interaction motions in CHI3D with textual descriptions.
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsswe&AN=edsswe.oai.portal.research.lu.se.publications.de378946.5287.40b7.9674.f6d9c9e4d7dc
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TPAMI.2025.3601974
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 12
        StartPage: 10870
    Subjects:
      – SubjectFull: Natural Sciences
        Type: general
      – SubjectFull: Computer and Information Sciences
        Type: general
      – SubjectFull: Computer graphics and computer vision
        Type: general
      – SubjectFull: Naturvetenskap
        Type: general
      – SubjectFull: Data- och informationsvetenskap (Datateknik)
        Type: general
      – SubjectFull: Datorgrafik och datorseende
        Type: general
    Titles:
      – TitleFull: Reconstructing Three-Dimensional Models of Interacting Humans
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Fieraru, Mihai
      – PersonEntity:
          Name:
            NameFull: Zanfir, Mihai
      – PersonEntity:
          Name:
            NameFull: Oneata, Elisabeta
      – PersonEntity:
          Name:
            NameFull: Popa, Alin Ionut
      – PersonEntity:
          Name:
            NameFull: Olaru, Vlad
      – PersonEntity:
          Name:
            NameFull: Sminchisescu, Cristian
      – PersonEntity:
          Name:
            NameFull: Lund University, Faculty of Science, Centre for Mathematical Sciences, Research groups at the Centre for Mathematical Sciences, Mathematical Imaging Group, Lunds universitet, Naturvetenskapliga fakulteten, Matematikcentrum, Forskargrupper vid Matematikcentrum, Mathematical Imaging Group, Originator
      – PersonEntity:
          Name:
            NameFull: Lund University, Profile areas and other strong research environments, Strategic research areas (SRA), ELLIIT: the Linköping-Lund initiative on IT and mobile communication, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Strategiska forskningsområden (SFO), ELLIIT: the Linköping-Lund initiative on IT and mobile communication, Originator
      – PersonEntity:
          Name:
            NameFull: Lund University, Profile areas and other strong research environments, Strategic research areas (SRA), eSSENCE: The e-Science Collaboration, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Strategiska forskningsområden (SFO), eSSENCE: The e-Science Collaboration, Originator
      – PersonEntity:
          Name:
            NameFull: Lund University, Faculty of Engineering, LTH, LTH Profile areas, LTH Profile Area: AI and Digitalization, Lunds universitet, Lunds Tekniska Högskola, LTH profilområden, LTH profilområde: AI och digitalisering, Originator
      – PersonEntity:
          Name:
            NameFull: Lund University, Profile areas and other strong research environments, Lund University Profile areas, LU Profile Area: Natural and Artificial Cognition, Lunds universitet, Profilområden och andra starka forskningsmiljöer, Lunds universitets profilområden, LU profilområde: Naturlig och artificiell kognition, Originator
      – PersonEntity:
          Name:
            NameFull: Lund University, Faculty of Science, Centre for Mathematical Sciences, Mathematics (Faculty of Engineering), Computer Vision and Machine Learning, Lunds universitet, Naturvetenskapliga fakulteten, Matematikcentrum, Matematik LTH, Datorseende och maskininlärning, Originator
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 01628828
            – Type: issn-locals
              Value: LU_SWEPUB
          Numbering:
            – Type: volume
              Value: 47
            – Type: issue
              Value: 12
          Titles:
            – TitleFull: IEEE Transactions on Pattern Analysis and Machine Intelligence
              Type: main
ResultId 1