An Implicit Physical Face Model Driven by Expression and Style
3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a particular expression is performed. Although it is common t...
Gespeichert in:
| Veröffentlicht in: | arXiv.org |
|---|---|
| Hauptverfasser: | , , , , , , , |
| Format: | Paper |
| Sprache: | Englisch |
| Veröffentlicht: |
Ithaca
Cornell University Library, arXiv.org
27.01.2024
|
| Schlagworte: | |
| ISSN: | 2331-8422 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | 3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a particular expression is performed. Although it is common to define a semantic basis of expressions that characters can perform, most characters perform each expression in their own style. To date, style is usually entangled with the expression, and it is not possible to transfer the style of one character to another when considering facial animation. We present a new face model, based on a data-driven implicit neural physics model, that can be driven by both expression and style separately. At the core, we present a framework for learning implicit physics-based actuations for multiple subjects simultaneously, trained on a few arbitrary performance capture sequences from a small set of identities. Once trained, our method allows generalized physics-based facial animation for any of the trained identities, extending to unseen performances. Furthermore, it grants control over the animation style, enabling style transfer from one character to another or blending styles of different characters. Lastly, as a physics-based model, it is capable of synthesizing physical effects, such as collision handling, setting our method apart from conventional approaches. |
|---|---|
| AbstractList | 3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a particular expression is performed. Although it is common to define a semantic basis of expressions that characters can perform, most characters perform each expression in their own style. To date, style is usually entangled with the expression, and it is not possible to transfer the style of one character to another when considering facial animation. We present a new face model, based on a data-driven implicit neural physics model, that can be driven by both expression and style separately. At the core, we present a framework for learning implicit physics-based actuations for multiple subjects simultaneously, trained on a few arbitrary performance capture sequences from a small set of identities. Once trained, our method allows generalized physics-based facial animation for any of the trained identities, extending to unseen performances. Furthermore, it grants control over the animation style, enabling style transfer from one character to another or blending styles of different characters. Lastly, as a physics-based model, it is capable of synthesizing physical effects, such as collision handling, setting our method apart from conventional approaches. |
| Author | Zoss, Gaspard Yang, Lingchen Chandran, Prashanth Gotardo, Paulo Gross, Markus Bradley, Derek Solenthaler, Barbara Sifakis, Eftychios |
| Author_xml | – sequence: 1 givenname: Lingchen surname: Yang fullname: Yang, Lingchen – sequence: 2 givenname: Gaspard surname: Zoss fullname: Zoss, Gaspard – sequence: 3 givenname: Prashanth surname: Chandran fullname: Chandran, Prashanth – sequence: 4 givenname: Paulo surname: Gotardo fullname: Gotardo, Paulo – sequence: 5 givenname: Markus surname: Gross fullname: Gross, Markus – sequence: 6 givenname: Barbara surname: Solenthaler fullname: Solenthaler, Barbara – sequence: 7 givenname: Eftychios surname: Sifakis fullname: Sifakis, Eftychios – sequence: 8 givenname: Derek surname: Bradley fullname: Bradley, Derek |
| BookMark | eNotzctKAzEYQOEgCtbaB3AXcD1j7peNUGqrhYqC3ZdM8hdTxmScTEvn7RV0dXbfuUGXKSdA6I6SWhgpyYPrz_FUM0FoTaWg4gJNGOe0MoKxazQr5UAIYUozKfkEPc4TXn91bfRxwO-fY4netXjlPODXHKDFT308QcLNiJfnrodSYk7YpYA_hrGFW3S1d22B2X-naLtabhcv1ebteb2YbyonGauUdEZqYzV46jgn1lMDyhutgSnuiKJuz4MJUhMJhnsvgm60lQFcowNRfIru_9iuz99HKMPukI99-j3umKXWcqUs4z-4ckqe |
| ContentType | Paper |
| Copyright | 2024. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| Copyright_xml | – notice: 2024. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
| DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS |
| DOI | 10.48550/arxiv.2401.15414 |
| DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central UK/Ireland ProQuest Central Essentials - QC ProQuest Central Technology collection ProQuest One Community College ProQuest Central SciTech Premium Collection ProQuest Engineering Collection Engineering Database Proquest Central Premium ProQuest One Academic ProQuest Publicly Available Content Database ProQuest One Academic Middle East (New) ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Applied & Life Sciences ProQuest One Academic (retired) ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection |
| DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest One Applied & Life Sciences ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest Central (New) ProQuest One Academic ProQuest One Academic (New) Engineering Collection |
| DatabaseTitleList | Publicly Available Content Database |
| Database_xml | – sequence: 1 dbid: PIMPY name: Publicly Available Content Database url: http://search.proquest.com/publiccontent sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Physics |
| EISSN | 2331-8422 |
| Genre | Working Paper/Pre-Print |
| GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PHGZM PHGZT PIMPY PKEHL PQEST PQGLB PQQKQ PQUKI PRINS PTHSS |
| ID | FETCH-LOGICAL-a522-65a857897ec1a3309c18e6c877e263a061af3d8d5705e83cc4d7b795deab7d063 |
| IEDL.DBID | BENPR |
| IngestDate | Mon Jun 30 09:16:24 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a522-65a857897ec1a3309c18e6c877e263a061af3d8d5705e83cc4d7b795deab7d063 |
| Notes | SourceType-Working Papers-1 ObjectType-Working Paper/Pre-Print-1 content type line 50 |
| OpenAccessLink | https://www.proquest.com/docview/2919936692?pq-origsite=%requestingapplication% |
| PQID | 2919936692 |
| PQPubID | 2050157 |
| ParticipantIDs | proquest_journals_2919936692 |
| PublicationCentury | 2000 |
| PublicationDate | 20240127 |
| PublicationDateYYYYMMDD | 2024-01-27 |
| PublicationDate_xml | – month: 01 year: 2024 text: 20240127 day: 27 |
| PublicationDecade | 2020 |
| PublicationPlace | Ithaca |
| PublicationPlace_xml | – name: Ithaca |
| PublicationTitle | arXiv.org |
| PublicationYear | 2024 |
| Publisher | Cornell University Library, arXiv.org |
| Publisher_xml | – name: Cornell University Library, arXiv.org |
| SSID | ssj0002672553 |
| Score | 1.858733 |
| SecondaryResourceType | preprint |
| Snippet | 3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key... |
| SourceID | proquest |
| SourceType | Aggregation Database |
| SubjectTerms | Animation Physics |
| Title | An Implicit Physical Face Model Driven by Expression and Style |
| URI | https://www.proquest.com/docview/2919936692 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV27TsMwFL2CFiQm3uJRKg-soYmd2MkC4tGKDlQR7VCmyvFDqlSlJQlV-_fYwQWJgYXR8mL5ce_Ruef6AFxbmzdum2O0xsILM5V5mc6YZ8FyRHWEk1DXZhNsMIjH4yR1hFvpZJWbmFgHajkXliPv4MRKzShN8N3i3bOuUba66iw0tqFpfyoLG9B86A7S12-WBVNmMDP5KmfWn3d1eLGaLm9MIgssq2K7d34F4Tqz9Pb_u6YDaKZ8oYpD2FL5EezWik5RHsPtfY76tVx8WqHUnQbqcaGQ9T-boafCBjqUrVF35dSwOeK5RMNqPVMnMOp1R4_PnjNL8LiBUB6NeGweX8KUCDghfiKCWFERM6YwJdxkba6JjGXE_EjFRIhQsowlkVQ8Y9LglFNo5PNcnQGivpQyZByHhIRS-5zGXGqDZALhUyWDc2htdmPiLnw5-dmKi7-nL2EPG1xgWQzMWtCoig91BTtiWU3Lou3Or20lmEMzSvsv6dsndF6nmw |
| linkProvider | ProQuest |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1NT8JAEJ0gaPTkd_xA3YMeK-223W0PaoxAICAhgQO3Zru7TUhIwbYi_Cj_o7uFauLBGwfPTZpmdvrm7eybfQC32uaN6eGYKMLccEIZGmEUUkOTZZdELvadKDeboL2eNxr5_RJ8FrMwWlZZYGIO1GLKdY-8hn0tNSPEx0-zN0O7RunT1cJCY5UWHbn8UFu29KFdV-t7h3GzMXxpGWtXAYMprmEQl3kqS30qucXUZt7nlicJ9yiVmNhMlTcW2cITLjVd6dmcO4KG1HeFZCEVqqCr125BxdHgnysFB98tHUyoIuj26uw0vymsxpLFeH6vqqalWzh6VOgX4udlrLn_zwJwAJU-m8nkEEoyPoKdXK3K02N4fI5RO5fCjzPUX2caajIukfZ2m6B6okEchUvUWKyVvjFisUCDbDmRJzDcxBefQjmexvIMEDGFEA5l2LFtR0QmIx4TkWJpFjeJFNY5VIvgB-ufOQ1-In_x9-Mb2G0NX7tBt93rXMIeVvxHd2swrUI5S97lFWzzeTZOk-s8cRAEG16nLx83_os |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+Implicit+Physical+Face+Model+Driven+by+Expression+and+Style&rft.jtitle=arXiv.org&rft.au=Yang%2C+Lingchen&rft.au=Zoss%2C+Gaspard&rft.au=Chandran%2C+Prashanth&rft.au=Gotardo%2C+Paulo&rft.date=2024-01-27&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.2401.15414 |