Makeup Lamps: Live Augmentation of Human Faces via Projection
We propose the first system for live dynamic augmentation of human faces. Using projector‐based illumination, we alter the appearance of human performers during novel performances. The key challenge of live augmentation is latency — an image is generated according to a specific pose, but is displaye...
Saved in:
| Published in: | Computer graphics forum Vol. 36; no. 2; pp. 311 - 323 |
|---|---|
| Main Authors: | , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Oxford
Blackwell Publishing Ltd
01.05.2017
|
| Subjects: | |
| ISSN: | 0167-7055, 1467-8659, 1467-8659 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | We propose the first system for live dynamic augmentation of human faces. Using projector‐based illumination, we alter the appearance of human performers during novel performances. The key challenge of live augmentation is latency — an image is generated according to a specific pose, but is displayed on a different facial configuration by the time it is projected. Therefore, our system aims at reducing latency during every step of the process, from capture, through processing, to projection. Using infrared illumination, an optically and computationally aligned high‐speed camera detects facial orientation as well as expression. The estimated expression blendshapes are mapped onto a lower dimensional space, and the facial motion and non‐rigid deformation are estimated, smoothed and predicted through adaptive Kalman filtering. Finally, the desired appearance is generated interpolating precomputed offset textures according to time, global position, and expression. We have evaluated our system through an optimized CPU and GPU prototype, and demonstrated successful low latency augmentation for different performers and performances with varying facial play and motion speed. In contrast to existing methods, the presented system is the first method which fully supports dynamic facial projection mapping without the requirement of any physical tracking markers and incorporates facial expressions. |
|---|---|
| AbstractList | We propose the first system for live dynamic augmentation of human faces. Using projector‐based illumination, we alter the appearance of human performers during novel performances. The key challenge of live augmentation is latency — an image is generated according to a specific pose, but is displayed on a different facial configuration by the time it is projected. Therefore, our system aims at reducing latency during every step of the process, from capture, through processing, to projection. Using infrared illumination, an optically and computationally aligned high‐speed camera detects facial orientation as well as expression. The estimated expression blendshapes are mapped onto a lower dimensional space, and the facial motion and non‐rigid deformation are estimated, smoothed and predicted through adaptive Kalman filtering. Finally, the desired appearance is generated interpolating precomputed offset textures according to time, global position, and expression. We have evaluated our system through an optimized CPU and GPU prototype, and demonstrated successful low latency augmentation for different performers and performances with varying facial play and motion speed. In contrast to existing methods, the presented system is the first method which fully supports dynamic facial projection mapping without the requirement of any physical tracking markers and incorporates facial expressions. |
| Author | Iwai, Daisuke Grundhöfer, Anselm Billeter, Markus Bermano, Amit H. |
| Author_xml | – sequence: 1 givenname: Amit H. surname: Bermano fullname: Bermano, Amit H. email: bermano@princeton.edu organization: Princeton University – sequence: 2 givenname: Markus surname: Billeter fullname: Billeter, Markus email: billeter@chalmers.se organization: Chalmers University – sequence: 3 givenname: Daisuke surname: Iwai fullname: Iwai, Daisuke email: daisuke.iwai@sys.es.osaka-u.ac.jp organization: Osaka University – sequence: 4 givenname: Anselm surname: Grundhöfer fullname: Grundhöfer, Anselm email: anselm@disneyresearch.com |
| BackLink | https://research.chalmers.se/publication/251135$$DView record from Swedish Publication Index (Chalmers tekniska högskola) |
| BookMark | eNp9kE9LAzEQxYNUsFYPfoMFTx62TbpJdiN4KMW2QkVBPYfZdNJu7f4x6bb027t1xYOgc5mBefMe8zsnnaIskJArRvusqYFZ2j6L2DA5IV3GZRwmUqgO6VLWzDEV4oyce7-mlPJYii65e4R3rKtgDnnlb4N5tsNgVC9zLLawzcoiKG0wq3MoggkY9MEug-DZlWs0x-0FObWw8Xj53XvkbXL_Op6F86fpw3g0D42gKgmVpTYFi3xoErkYCiEjpphcUGsgjoaRpIolxsZcMW4lSuBpRDFNUiliNClEPfLS-vo9VnWqK5fl4A66hEw79AjOrLRZwSZH57VHzQUshBSR5sip5gqEToEJHTFhrEibZMUa1-vWtXLlR41-q9dl7YrmEc0UZZxKKlWjumlVxpXeO7Q_6YzqI3PdMNdfzBvt4JfWZC3HrYNs89_FPtvg4W9rPZ5O2otP15CS2Q |
| CitedBy_id | crossref_primary_10_1016_j_cag_2020_07_008 crossref_primary_10_1109_TVCG_2025_3549859 crossref_primary_10_1109_TVCG_2017_2734478 crossref_primary_10_1111_cgf_13382 crossref_primary_10_1109_ACCESS_2018_2858268 crossref_primary_10_2183_pjab_100_012 crossref_primary_10_1109_TVCG_2019_2932248 crossref_primary_10_1111_cgf_13387 crossref_primary_10_1016_j_cag_2022_01_004 crossref_primary_10_1109_TVCG_2025_3527203 crossref_primary_10_1109_TVCG_2019_2932223 crossref_primary_10_1109_TVCG_2019_2940453 crossref_primary_10_1145_3450626_3459940 crossref_primary_10_1145_3476576_3476583 crossref_primary_10_1145_3676491 crossref_primary_10_1109_TVCG_2021_3106511 crossref_primary_10_1109_TVCG_2023_3247104 crossref_primary_10_1109_TVCG_2024_3372031 crossref_primary_10_1109_ACCESS_2018_2875905 crossref_primary_10_3169_itej_76_322 crossref_primary_10_1109_TVCG_2021_3099290 crossref_primary_10_3390_app11093753 crossref_primary_10_1109_TVCG_2024_3456170 crossref_primary_10_1109_TVCG_2022_3150488 crossref_primary_10_3389_frobt_2020_580835 crossref_primary_10_1016_j_ifacol_2023_10_1418 crossref_primary_10_1109_TVCG_2022_3150465 crossref_primary_10_1109_TVCG_2023_3320256 crossref_primary_10_1109_TVCG_2023_3281681 crossref_primary_10_1007_s10055_020_00490_2 crossref_primary_10_1145_3453477 crossref_primary_10_1109_TVCG_2022_3217266 crossref_primary_10_1109_TVCG_2017_2734428 crossref_primary_10_1109_TVCG_2020_2973444 crossref_primary_10_1109_TVCG_2024_3372132 |
| Cites_doi | 10.1007/s11554-012-0255-8 10.1109/ISMAR.2014.6948421 10.1145/2508363.2508380 10.1145/1276377.1276419 10.1109/ISMAR.2009.5336503 10.1007/s003710100140 10.2312/conf/EG2012/stars/183204 10.1145/2818466.2818477 10.1145/2380116.2380174 10.1145/2821592.2821618 10.1145/2816795.2818056 10.1109/WACV.2012.6163031 10.1145/2816795.2818111 10.1109/CVPR.2014.218 10.1145/2601097.2601204 10.4108/icst.intetain.2015.259444 10.1017/S0263574714001787 10.1109/VR.2015.7223330 10.1145/2010324.1964972 10.1145/2766943 10.1109/ISMAR.2015.51 10.1145/2601097.2601165 10.1145/2461912.2462019 10.1109/ISMAR.2014.6948427 10.1007/978-3-0348-5737-6 10.1007/s100550140256y 10.1109/CVPRW.2014.72 10.2312/SCA03/193-206 10.1145/1599470.1599472 10.2312/egst.20051044 10.1109/ROBOT.2006.1641757 10.1145/2461912.2462012 10.1145/2858036.2858282 10.1145/2010324.1964970 10.1109/ISAR.2001.970539 10.1145/2815585.2815735 10.1145/1457515.1409074 10.2312/EGWR/EGSR07/183-194 10.1145/253284.253292 10.1007/978-3-662-44785-7_11 10.1145/2159516.2159519 10.1016/j.imavis.2005.08.006 10.1007/978-0-8176-8212-5_12 10.1109/TVCG.2013.249 10.1145/2858036.2858329 10.1007/978-1-84628-907-1_13 10.1145/1450579.1450605 10.1109/ICCV.2013.449 10.1109/ISMAR-Adjunct.2016.0072 10.1145/2508363.2508416 10.1007/978-3-319-10593-2_52 10.1145/2461912.2461976 10.1109/TVCG.2016.2518038 10.1145/20/0781.2024198 |
| ContentType | Journal Article |
| Copyright | 2017 The Author(s) Computer Graphics Forum © 2017 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd. 2017 The Eurographics Association and John Wiley & Sons Ltd. |
| Copyright_xml | – notice: 2017 The Author(s) Computer Graphics Forum © 2017 The Eurographics Association and John Wiley & Sons Ltd. Published by John Wiley & Sons Ltd. – notice: 2017 The Eurographics Association and John Wiley & Sons Ltd. |
| DBID | AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D ADTPV AOWAS F1S |
| DOI | 10.1111/cgf.13128 |
| DatabaseName | CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional SwePub SwePub Articles SWEPUB Chalmers tekniska högskola |
| DatabaseTitle | CrossRef Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Computer and Information Systems Abstracts |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 1467-8659 |
| EndPage | 323 |
| ExternalDocumentID | oai_research_chalmers_se_45ad5653_4e40_49a5_ba15_315cf5bd0f91 10_1111_cgf_13128 CGF13128 |
| Genre | article |
| GroupedDBID | .3N .4S .DC .GA .Y3 05W 0R~ 10A 15B 1OB 1OC 29F 31~ 33P 3SF 4.4 50Y 50Z 51W 51X 52M 52N 52O 52P 52S 52T 52U 52W 52X 5GY 5HH 5LA 5VS 66C 6J9 702 7PT 8-0 8-1 8-3 8-4 8-5 8UM 8VB 930 A03 AAESR AAEVG AAHHS AAHQN AAMNL AANHP AANLZ AAONW AASGY AAXRX AAYCA AAZKR ABCQN ABCUV ABDBF ABDPE ABEML ABPVW ACAHQ ACBWZ ACCFJ ACCZN ACFBH ACGFS ACPOU ACRPL ACSCC ACUHS ACXBN ACXQS ACYXJ ADBBV ADEOM ADIZJ ADKYN ADMGS ADNMO ADOZA ADXAS ADZMN ADZOD AEEZP AEGXH AEIGN AEIMD AEMOZ AENEX AEQDE AEUQT AEUYR AFBPY AFEBI AFFNX AFFPM AFGKR AFPWT AFWVQ AFZJQ AHBTC AHEFC AHQJS AITYG AIURR AIWBW AJBDE AJXKR AKVCP ALAGY ALMA_UNASSIGNED_HOLDINGS ALUQN ALVPJ AMBMR AMYDB ARCSS ASPBG ATUGU AUFTA AVWKF AZBYB AZFZN AZVAB BAFTC BDRZF BFHJK BHBCM BMNLL BMXJE BNHUX BROTX BRXPI BY8 CAG COF CS3 CWDTD D-E D-F DCZOG DPXWK DR2 DRFUL DRSTM DU5 EAD EAP EBA EBO EBR EBS EBU EDO EJD EMK EST ESX F00 F01 F04 F5P FEDTE FZ0 G-S G.N GODZA H.T H.X HF~ HGLYW HVGLF HZI HZ~ I-F IHE IX1 J0M K1G K48 LATKE LC2 LC3 LEEKS LH4 LITHE LOXES LP6 LP7 LUTES LW6 LYRES MEWTI MK4 MRFUL MRSTM MSFUL MSSTM MXFUL MXSTM N04 N05 N9A NF~ O66 O9- OIG P2W P2X P4D PALCI PQQKQ Q.N Q11 QB0 QWB R.K RDJ RIWAO RJQFR ROL RX1 SAMSI SUPJJ TH9 TN5 TUS UB1 V8K W8V W99 WBKPD WIH WIK WOHZO WQJ WRC WXSBR WYISQ WZISG XG1 ZL0 ZZTAW ~IA ~IF ~WT AAMMB AAYXX ADMLS AEFGJ AEYWJ AGHNM AGQPQ AGXDD AGYGG AIDQK AIDYY AIQQE CITATION O8X 7SC 8FD JQ2 L7M L~C L~D ADTPV AOWAS F1S |
| ID | FETCH-LOGICAL-c5098-9f0fbafe42c86d255631916d0fca732360918cf74914f6e6a4b30eb8b657ecba3 |
| IEDL.DBID | DRFUL |
| ISICitedReferencesCount | 67 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000404474000029&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0167-7055 1467-8659 |
| IngestDate | Wed Nov 05 04:16:06 EST 2025 Fri Jul 25 06:52:19 EDT 2025 Tue Nov 18 22:04:15 EST 2025 Sat Nov 29 07:50:09 EST 2025 Wed Jan 22 16:30:01 EST 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Language | English |
| License | http://onlinelibrary.wiley.com/termsAndConditions http://doi.wiley.com/10.1002/tdm_license_1 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c5098-9f0fbafe42c86d255631916d0fca732360918cf74914f6e6a4b30eb8b657ecba3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| PQID | 1901406069 |
| PQPubID | 30877 |
| PageCount | 13 |
| ParticipantIDs | swepub_primary_oai_research_chalmers_se_45ad5653_4e40_49a5_ba15_315cf5bd0f91 proquest_journals_1901406069 crossref_primary_10_1111_cgf_13128 crossref_citationtrail_10_1111_cgf_13128 wiley_primary_10_1111_cgf_13128_CGF13128 |
| PublicationCentury | 2000 |
| PublicationDate | May 2017 |
| PublicationDateYYYYMMDD | 2017-05-01 |
| PublicationDate_xml | – month: 05 year: 2017 text: May 2017 |
| PublicationDecade | 2010 |
| PublicationPlace | Oxford |
| PublicationPlace_xml | – name: Oxford |
| PublicationTitle | Computer graphics forum |
| PublicationYear | 2017 |
| Publisher | Blackwell Publishing Ltd |
| Publisher_xml | – name: Blackwell Publishing Ltd |
| References | 2015; 34 2015; 19 2002; 18 2012 1977; 47 2009 2011; 30 2008 1997 1974 2007 2006 2005 2004 2003 2012; 32 2012; 31 2016; 34 2014; 20 1999 2001 2013; 32 2006; 24 2016 2015 2014 2013 2014; 33 2007; 26 2012; 8 Chang (10.1111/cgf.13128-BIB0013|cgf13128-cit-0013) 2006; 24 Saakes (10.1111/cgf.13128-BIB0056|cgf13128-cit-0056) 2016 10.1111/cgf.13128-BIB0029|cgf13128-cit-0029 Bickel (10.1111/cgf.13128-BIB0003|cgf13128-cit-0003) 2007; 26 10.1111/cgf.13128-BIB0035|cgf13128-cit-0035 10.1111/cgf.13128-BIB0058|cgf13128-cit-0058 Bouaziz (10.1111/cgf.13128-BIB0009|cgf13128-cit-0009) 2013; 32 10.1111/cgf.13128-BIB0047|cgf13128-cit-0047 10.1111/cgf.13128-BIB0012|cgf13128-cit-0012 Zhou (10.1111/cgf.13128-BIB0067|cgf13128-cit-0067) 2016 Raskar (10.1111/cgf.13128-BIB0048|cgf13128-cit-0048) 1999 Berman (10.1111/cgf.13128-BIB0005|cgf13128-cit-0005) 2015 10.1111/cgf.13128-BIB0065|cgf13128-cit-0065 Ishii (10.1111/cgf.13128-BIB0025|cgf13128-cit-0025) 2012; 8 Suwajanakorn (10.1111/cgf.13128-BIB0051|cgf13128-cit-0051) 2014 10.1111/cgf.13128-BIB0024|cgf13128-cit-0024 Lincoln (10.1111/cgf.13128-BIB0033|cgf13128-cit-0033) 2016 10.1111/cgf.13128-BIB0041|cgf13128-cit-0041 10.1111/cgf.13128-BIB0053|cgf13128-cit-0053 Thies (10.1111/cgf.13128-BIB0057|cgf13128-cit-0057) 2015; 34 Jenkins (10.1111/cgf.13128-BIB0027|cgf13128-cit-0027) 2007 10.1111/cgf.13128-BIB0031|cgf13128-cit-0031 Yotsukura (10.1111/cgf.13128-BIB0062|cgf13128-cit-0062) 2002; 18 10.1111/cgf.13128-BIB0039|cgf13128-cit-0039 10.1111/cgf.13128-BIB0060|cgf13128-cit-0060 Cao (10.1111/cgf.13128-BIB0014|cgf13128-cit-0014) 2014; 33 Seo (10.1111/cgf.13128-BIB0050|cgf13128-cit-0050) 2011; 30 Asayama (10.1111/cgf.13128-BIB0001|cgf13128-cit-0001) 2015 10.1111/cgf.13128-BIB0042|cgf13128-cit-0042 10.1111/cgf.13128-BIB0002|cgf13128-cit-0002 Weise (10.1111/cgf.13128-BIB0059|cgf13128-cit-0059) 2011; 30 10.1111/cgf.13128-BIB0020|cgf13128-cit-0020 10.1111/cgf.13128-BIB0026|cgf13128-cit-0026 10.1111/cgf.13128-BIB0043|cgf13128-cit-0043 Chai (10.1111/cgf.13128-BIB0018|cgf13128-cit-0018) 2003 Seol (10.1111/cgf.13128-BIB0052|cgf13128-cit-0052) 2012; 31 10.1111/cgf.13128-BIB0066|cgf13128-cit-0066 Cao (10.1111/cgf.13128-BIB0015|cgf13128-cit-0015) 2013; 32 Orvalho (10.1111/cgf.13128-BIB0044|cgf13128-cit-0044) 2012; 32 Ma (10.1111/cgf.13128-BIB0038|cgf13128-cit-0038) 2007 Knibbe (10.1111/cgf.13128-BIB0030|cgf13128-cit-0030) 2015 10.1111/cgf.13128-BIB0055|cgf13128-cit-0055 10.1111/cgf.13128-BIB0032|cgf13128-cit-0032 Lincoln (10.1111/cgf.13128-BIB0036|cgf13128-cit-0036) 2009 10.1111/cgf.13128-BIB0008|cgf13128-cit-0008 Lin (10.1111/cgf.13128-BIB0034|cgf13128-cit-0034) 2016; 34 Zollhöfer (10.1111/cgf.13128-BIB0063|cgf13128-cit-0063) 2014; 33 10.1111/cgf.13128-BIB0010|cgf13128-cit-0010 Cao (10.1111/cgf.13128-BIB0017|cgf13128-cit-0017) 2014; 20 Beeler (10.1111/cgf.13128-BIB0006|cgf13128-cit-0006) 2011; 30 Wilson (10.1111/cgf.13128-BIB0061|cgf13128-cit-0061) 2004 Bermano (10.1111/cgf.13128-BIB0004|cgf13128-cit-0004) 2013; 32 10.1111/cgf.13128-BIB0016|cgf13128-cit-0016 Punpongsanon (10.1111/cgf.13128-BIB0045|cgf13128-cit-0045) 2015; 19 Zhang (10.1111/cgf.13128-BIB0064|cgf13128-cit-0064) 2008 Gelb (10.1111/cgf.13128-BIB0021|cgf13128-cit-0021) 1974 Siegl (10.1111/cgf.13128-BIB0049|cgf13128-cit-0049) 2015; 34 10.1111/cgf.13128-BIB0019|cgf13128-cit-0019 10.1111/cgf.13128-BIB0040|cgf13128-cit-0040 10.1111/cgf.13128-BIB0007|cgf13128-cit-0007 10.1111/cgf.13128-BIB0046|cgf13128-cit-0046 10.1111/cgf.13128-BIB0023|cgf13128-cit-0023 Sorkine (10.1111/cgf.13128-BIB0054|cgf13128-cit-0054) 2005 Li (10.1111/cgf.13128-BIB0037|cgf13128-cit-0037) 2013; 32 Kanade (10.1111/cgf.13128-BIB0028|cgf13128-cit-0028) 1977; 47 Cao (10.1111/cgf.13128-BIB0011|cgf13128-cit-0011) 2015; 34 Garrido (10.1111/cgf.13128-BIB0022|cgf13128-cit-0022) 2013; 32 |
| References_xml | – start-page: 449 year: 2014 end-page: 454 – start-page: 3615 year: 2013 end-page: 3622 – year: 2009 – year: 2005 – volume: 19 start-page: 45 issue: 1 year: 2015 end-page: 56 article-title: Projection‐based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture publication-title: Virtual Reality – volume: 31 start-page: 14 issue: 2 year: 2012 article-title: Spacetime expression cloning for blendshapes publication-title: ACM Transactions on Graphics (TOG) – start-page: 311 year: 2004 end-page: 340 – volume: 30 start-page: 77 issue: 4 year: 2011 article-title: Realtime performance‐based facial animation publication-title: ACM Transactions on Graphics (TOG) – volume: 32 start-page: 41 issue: 4 year: 2013 article-title: 3d shape regression for real‐time facial animation publication-title: ACM Transactions on Graphics (TOG) – volume: 34 start-page: 237:1 issue: 6 year: 2015 end-page: 237:11 article-title: Real‐time pixel luminance optimization for dynamic multi‐projection mapping publication-title: ACM Transactions on Graphics (TOG) – volume: 47 year: 1977 – volume: 34 start-page: 46 issue: 4 year: 2015 article-title: Real‐time high‐fidelity facial performance capture publication-title: ACM Transactions on Graphics (TOG) – start-page: 195 year: 2014 end-page: 200 – start-page: 149 year: 2015 end-page: 152 – volume: 26 start-page: 33 issue: 3 year: 2007 article-title: Multi‐scale capture of facial geometry and motion publication-title: ACM Transactions on Graphics (TOG) – start-page: 207 year: 2001 end-page: 216 – year: 2014 – volume: 30 start-page: 164 issue: 6 year: 2011 article-title: Compression and direct manipulation of complex blendshape models publication-title: ACM Transactions on Graphics (TOG) – start-page: 453 year: 2012 end-page: 464 – start-page: 9 year: 2015 end-page: 16 – volume: 32 start-page: 189:1 issue: 6 year: 2013 end-page: 189:10 article-title: Augmenting physical avatars using projector‐based illumination publication-title: ACM Transactions on Graphics (TOG) – start-page: 193 year: 2003 end-page: 206 – start-page: 33 year: 2012 end-page: 40 – start-page: 7:1 year: 2015 end-page: 7:2 – volume: 24 start-page: 605 issue: 6 year: 2006 end-page: 614 article-title: Manifold based analysis of facial expression publication-title: Image and Vision Computing – start-page: 27 year: 2009 end-page: 33 – start-page: 121:1 year: 2008 end-page: 121:10 – volume: 33 start-page: 43:1 issue: 4 year: 2014 end-page: 43:10 article-title: Displaced dynamic expression regression for real‐time facial tracking and animation publication-title: ACM Trans. Graph. – start-page: 97 year: 2015 end-page: 104 – start-page: 6058 year: 2016 end-page: 6063 – start-page: 93 year: 2015 end-page: 94 – start-page: 183 year: 2007 end-page: 194 – start-page: 63 year: 1999 end-page: 72 – volume: 8 start-page: 379 issue: 4 year: 2012 end-page: 388 article-title: 500‐fps face tracking system publication-title: Journal of Real‐Time Image Processing – start-page: 1685 year: 2014 end-page: 1692 – volume: 32 start-page: 42 issue: 4 year: 2013 end-page: 1 article-title: Realtime facial animation with on‐the‐fly correctives publication-title: ACM Transactions on Graphics (TOG) – start-page: 481 year: 2006 end-page: 486 – volume: 34 start-page: 652 year: 2016 end-page: 670 article-title: An expressional simplified mechanism in anthropomorphic face robot design publication-title: Robotica – volume: 18 start-page: 111 issue: 2 year: 2002 end-page: 120 article-title: Hypermask: Talking Head Projected onto Real Object publication-title: The Visual Computer – start-page: 796 year: 2014 end-page: 812 – year: 2007 – start-page: 174 year: 2015 end-page: 175 – start-page: 151 year: 2014 end-page: 156 – volume: 32 start-page: 158 issue: 6 year: 2013 end-page: 1 article-title: Reconstructing detailed dynamic face geometry from monocular video publication-title: ACM Transactions on Graphics (TOG) – start-page: 191 year: 2015 end-page: 208 – volume: 20 start-page: 413 issue: 3 year: 2014 end-page: 425 article-title: Face‐warehouse: A 3d facial expression database for visual computing publication-title: IEEE Transactions on Visualization and Computer Graphics – start-page: 47 year: 2013 end-page: 50 – year: 2016 – start-page: 199 year: 2014 end-page: 218 – start-page: 184 year: 2016 end-page: 188 – volume: 32 start-page: 10 year: 2012 end-page: 32 article-title: A facial rigging survey publication-title: Eurographics – volume: 34 start-page: 183 issue: 6 year: 2015 article-title: Real‐time expression transfer for facial reenactment publication-title: ACM Transactions on Graphics (TOG) – start-page: 7 year: 1997 end-page: 16 – start-page: 248 year: 2008 end-page: 276 – volume: 30 start-page: 75 issue: 4 year: 2011 article-title: High‐quality passive facial performance capture using anchor frames publication-title: ACM Transactions on Graphics (TOG) – year: 1974 – volume: 33 start-page: 156 issue: 4 year: 2014 article-title: Real‐time non‐rigid reconstruction using an RGB‐D camera publication-title: ACM Transactions on Graphics (TOG) – start-page: 115 year: 2008 end-page: 122 – volume: 32 start-page: 40 issue: 4 year: 2013 article-title: Online modeling for realtime facial animation publication-title: ACM Transactions on Graphics (TOG) – year: 2013 – start-page: 781 year: 2016 end-page: 790 – volume: 8 start-page: 379 issue: 4 year: 2012 ident: 10.1111/cgf.13128-BIB0025|cgf13128-cit-0025 article-title: 500-fps face tracking system publication-title: Journal of Real-Time Image Processing doi: 10.1007/s11554-012-0255-8 – ident: 10.1111/cgf.13128-BIB0058|cgf13128-cit-0058 – ident: 10.1111/cgf.13128-BIB0047|cgf13128-cit-0047 doi: 10.1109/ISMAR.2014.6948421 – volume: 32 start-page: 158 issue: 6 year: 2013 ident: 10.1111/cgf.13128-BIB0022|cgf13128-cit-0022 article-title: Reconstructing detailed dynamic face geometry from monocular video publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2508363.2508380 – volume: 26 start-page: 33 issue: 3 year: 2007 ident: 10.1111/cgf.13128-BIB0003|cgf13128-cit-0003 article-title: Multi-scale capture of facial geometry and motion publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/1276377.1276419 – start-page: 27 volume-title: Proceedings of the 8th IEEE International Symposium on Mixed and Augmented Reality year: 2009 ident: 10.1111/cgf.13128-BIB0036|cgf13128-cit-0036 doi: 10.1109/ISMAR.2009.5336503 – volume: 18 start-page: 111 issue: 2 year: 2002 ident: 10.1111/cgf.13128-BIB0062|cgf13128-cit-0062 article-title: Hypermask: Talking Head Projected onto Real Object publication-title: The Visual Computer doi: 10.1007/s003710100140 – volume: 32 start-page: 10 year: 2012 ident: 10.1111/cgf.13128-BIB0044|cgf13128-cit-0044 article-title: A facial rigging survey publication-title: Eurographics doi: 10.2312/conf/EG2012/stars/183204 – start-page: 7:1 volume-title: SIGGRAPH Asia 2015 Emerging Technologies year: 2015 ident: 10.1111/cgf.13128-BIB0001|cgf13128-cit-0001 doi: 10.1145/2818466.2818477 – ident: 10.1111/cgf.13128-BIB0041|cgf13128-cit-0041 doi: 10.1145/2380116.2380174 – ident: 10.1111/cgf.13128-BIB0042|cgf13128-cit-0042 doi: 10.1145/2821592.2821618 – volume: 34 start-page: 183 issue: 6 year: 2015 ident: 10.1111/cgf.13128-BIB0057|cgf13128-cit-0057 article-title: Real-time expression transfer for facial reenactment publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2816795.2818056 – ident: 10.1111/cgf.13128-BIB0012|cgf13128-cit-0012 doi: 10.1109/WACV.2012.6163031 – volume: 34 start-page: 237:1 issue: 6 year: 2015 ident: 10.1111/cgf.13128-BIB0049|cgf13128-cit-0049 article-title: Real-time pixel luminance optimization for dynamic multi-projection mapping publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2816795.2818111 – ident: 10.1111/cgf.13128-BIB0026|cgf13128-cit-0026 – ident: 10.1111/cgf.13128-BIB0046|cgf13128-cit-0046 doi: 10.1109/CVPR.2014.218 – ident: 10.1111/cgf.13128-BIB0035|cgf13128-cit-0035 – volume: 33 start-page: 43:1 issue: 4 year: 2014 ident: 10.1111/cgf.13128-BIB0014|cgf13128-cit-0014 article-title: Displaced dynamic expression regression for real-time facial tracking and animation publication-title: ACM Trans. Graph. doi: 10.1145/2601097.2601204 – ident: 10.1111/cgf.13128-BIB0023|cgf13128-cit-0023 doi: 10.4108/icst.intetain.2015.259444 – volume: 34 start-page: 652 year: 2016 ident: 10.1111/cgf.13128-BIB0034|cgf13128-cit-0034 article-title: An expressional simplified mechanism in anthropomorphic face robot design publication-title: Robotica doi: 10.1017/S0263574714001787 – ident: 10.1111/cgf.13128-BIB0053|cgf13128-cit-0053 doi: 10.1109/VR.2015.7223330 – volume: 30 start-page: 77 issue: 4 year: 2011 ident: 10.1111/cgf.13128-BIB0059|cgf13128-cit-0059 article-title: Realtime performance-based facial animation publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2010324.1964972 – volume: 34 start-page: 46 issue: 4 year: 2015 ident: 10.1111/cgf.13128-BIB0011|cgf13128-cit-0011 article-title: Real-time high-fidelity facial performance capture publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2766943 – ident: 10.1111/cgf.13128-BIB0020|cgf13128-cit-0020 doi: 10.1109/ISMAR.2015.51 – volume: 33 start-page: 156 issue: 4 year: 2014 ident: 10.1111/cgf.13128-BIB0063|cgf13128-cit-0063 article-title: Real-time non-rigid reconstruction using an RGB-D camera publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2601097.2601165 – volume: 32 start-page: 42 issue: 4 year: 2013 ident: 10.1111/cgf.13128-BIB0037|cgf13128-cit-0037 article-title: Realtime facial animation with on-the-fly correctives publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2461912.2462019 – ident: 10.1111/cgf.13128-BIB0066|cgf13128-cit-0066 doi: 10.1109/ISMAR.2014.6948427 – volume: 47 volume-title: Computer recognition of human faces year: 1977 ident: 10.1111/cgf.13128-BIB0028|cgf13128-cit-0028 doi: 10.1007/978-3-0348-5737-6 – volume: 19 start-page: 45 issue: 1 year: 2015 ident: 10.1111/cgf.13128-BIB0045|cgf13128-cit-0045 article-title: Projection-based visualization of tangential deformation of nonrigid surface by deformation estimation using infrared texture publication-title: Virtual Reality doi: 10.1007/s100550140256y – ident: 10.1111/cgf.13128-BIB0002|cgf13128-cit-0002 doi: 10.1109/CVPRW.2014.72 – start-page: 193 volume-title: Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation year: 2003 ident: 10.1111/cgf.13128-BIB0018|cgf13128-cit-0018 doi: 10.2312/SCA03/193-206 – ident: 10.1111/cgf.13128-BIB0060|cgf13128-cit-0060 doi: 10.1145/1599470.1599472 – volume-title: Eurographics 2005 - State of the Art Reports year: 2005 ident: 10.1111/cgf.13128-BIB0054|cgf13128-cit-0054 doi: 10.2312/egst.20051044 – ident: 10.1111/cgf.13128-BIB0024|cgf13128-cit-0024 doi: 10.1109/ROBOT.2006.1641757 – volume: 32 start-page: 41 issue: 4 year: 2013 ident: 10.1111/cgf.13128-BIB0015|cgf13128-cit-0015 article-title: 3d shape regression for real-time facial animation publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2461912.2462012 – start-page: 6058 volume-title: Proceedings of the CHI Conference on Human Factors in Computing Systems year: 2016 ident: 10.1111/cgf.13128-BIB0056|cgf13128-cit-0056 doi: 10.1145/2858036.2858282 – volume: 30 start-page: 75 issue: 4 year: 2011 ident: 10.1111/cgf.13128-BIB0006|cgf13128-cit-0006 article-title: High-quality passive facial performance capture using anchor frames publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2010324.1964970 – ident: 10.1111/cgf.13128-BIB0007|cgf13128-cit-0007 doi: 10.1109/ISAR.2001.970539 – start-page: 93 volume-title: Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology year: 2015 ident: 10.1111/cgf.13128-BIB0030|cgf13128-cit-0030 doi: 10.1145/2815585.2815735 – ident: 10.1111/cgf.13128-BIB0010|cgf13128-cit-0010 – ident: 10.1111/cgf.13128-BIB0031|cgf13128-cit-0031 – ident: 10.1111/cgf.13128-BIB0039|cgf13128-cit-0039 doi: 10.1145/1457515.1409074 – start-page: 183 volume-title: Proceedings of the 18th Eurographics conference on Rendering Techniques year: 2007 ident: 10.1111/cgf.13128-BIB0038|cgf13128-cit-0038 doi: 10.2312/EGWR/EGSR07/183-194 – ident: 10.1111/cgf.13128-BIB0040|cgf13128-cit-0040 doi: 10.1145/253284.253292 – start-page: 191 volume-title: Advances in Estimation, Navigation, and Spacecraft Control: Selected Papers of the Itzhack Y. Bar-Itzhack Memorial Symposium on Estimation, Navigation, and Spacecraft Control year: 2015 ident: 10.1111/cgf.13128-BIB0005|cgf13128-cit-0005 doi: 10.1007/978-3-662-44785-7_11 – ident: 10.1111/cgf.13128-BIB0032|cgf13128-cit-0032 – volume: 31 start-page: 14 issue: 2 year: 2012 ident: 10.1111/cgf.13128-BIB0052|cgf13128-cit-0052 article-title: Spacetime expression cloning for blendshapes publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2159516.2159519 – ident: 10.1111/cgf.13128-BIB0043|cgf13128-cit-0043 – volume: 24 start-page: 605 issue: 6 year: 2006 ident: 10.1111/cgf.13128-BIB0013|cgf13128-cit-0013 article-title: Manifold based analysis of facial expression publication-title: Image and Vision Computing doi: 10.1016/j.imavis.2005.08.006 – start-page: 311 volume-title: Sampling, Wavelets, and Tomography year: 2004 ident: 10.1111/cgf.13128-BIB0061|cgf13128-cit-0061 doi: 10.1007/978-0-8176-8212-5_12 – volume: 20 start-page: 413 issue: 3 year: 2014 ident: 10.1111/cgf.13128-BIB0017|cgf13128-cit-0017 article-title: Face-warehouse: A 3d facial expression database for visual computing publication-title: IEEE Transactions on Visualization and Computer Graphics doi: 10.1109/TVCG.2013.249 – start-page: 781 volume-title: Proceedings of the CHI Conference on Human Factors in Computing Systems year: 2016 ident: 10.1111/cgf.13128-BIB0067|cgf13128-cit-0067 doi: 10.1145/2858036.2858329 – volume-title: Applied Optimal Estimation year: 1974 ident: 10.1111/cgf.13128-BIB0021|cgf13128-cit-0021 – start-page: 248 volume-title: Data-Driven 3D Facial Animation year: 2008 ident: 10.1111/cgf.13128-BIB0064|cgf13128-cit-0064 doi: 10.1007/978-1-84628-907-1_13 – ident: 10.1111/cgf.13128-BIB0055|cgf13128-cit-0055 doi: 10.1145/1450579.1450605 – ident: 10.1111/cgf.13128-BIB0065|cgf13128-cit-0065 – ident: 10.1111/cgf.13128-BIB0016|cgf13128-cit-0016 doi: 10.1109/ICCV.2013.449 – volume-title: Anatomy and physiology: from science to life year: 2007 ident: 10.1111/cgf.13128-BIB0027|cgf13128-cit-0027 – ident: 10.1111/cgf.13128-BIB0008|cgf13128-cit-0008 doi: 10.1109/ISMAR-Adjunct.2016.0072 – ident: 10.1111/cgf.13128-BIB0019|cgf13128-cit-0019 – ident: 10.1111/cgf.13128-BIB0029|cgf13128-cit-0029 – volume: 32 start-page: 189:1 issue: 6 year: 2013 ident: 10.1111/cgf.13128-BIB0004|cgf13128-cit-0004 article-title: Augmenting physical avatars using projector-based illumination publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2508363.2508416 – start-page: 796 volume-title: Computer Vision-ECCV year: 2014 ident: 10.1111/cgf.13128-BIB0051|cgf13128-cit-0051 doi: 10.1007/978-3-319-10593-2_52 – volume: 32 start-page: 40 issue: 4 year: 2013 ident: 10.1111/cgf.13128-BIB0009|cgf13128-cit-0009 article-title: Online modeling for realtime facial animation publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/2461912.2461976 – volume-title: IEEE Virtual Reality (VR) year: 2016 ident: 10.1111/cgf.13128-BIB0033|cgf13128-cit-0033 doi: 10.1109/TVCG.2016.2518038 – start-page: 63 volume-title: Proceedings of the International Workshop on Augmented Reality : Placing Artificial Objects in Real Scenes: Placing Artificial Objects in Real Scenes year: 1999 ident: 10.1111/cgf.13128-BIB0048|cgf13128-cit-0048 – volume: 30 start-page: 164 issue: 6 year: 2011 ident: 10.1111/cgf.13128-BIB0050|cgf13128-cit-0050 article-title: Compression and direct manipulation of complex blendshape models publication-title: ACM Transactions on Graphics (TOG) doi: 10.1145/20/0781.2024198 |
| SSID | ssj0004765 |
| Score | 2.4760728 |
| Snippet | We propose the first system for live dynamic augmentation of human faces. Using projector‐based illumination, we alter the appearance of human performers... We propose the first system for live dynamic augmentation of human faces. Using projector-based illumination, we alter the appearance of human performers... |
| SourceID | swepub proquest crossref wiley |
| SourceType | Open Access Repository Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 311 |
| SubjectTerms | Adaptive filters Augmentation CAPTURE Categories and Subject Descriptors (according to ACM CCS) Computer graphics Deformation Face FACIAL EXPRESSION Forecasting FRAMES H.5.1 [HCI]: Multimedia Information Systems—Artificial, augmented, and virtual realities Human performance I.3.7 [Computer Graphics]: Three‐Dimensional Graphics and Realism—Animation Illumination Kalman filters Real time |
| Title | Makeup Lamps: Live Augmentation of Human Faces via Projection |
| URI | https://onlinelibrary.wiley.com/doi/abs/10.1111%2Fcgf.13128 https://www.proquest.com/docview/1901406069 https://research.chalmers.se/publication/251135 |
| Volume | 36 |
| WOSCitedRecordID | wos000404474000029&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVWIB databaseName: Wiley Online Library Full Collection 2020 customDbUrl: eissn: 1467-8659 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0004765 issn: 0167-7055 databaseCode: DRFUL dateStart: 19970101 isFulltext: true titleUrlDefault: https://onlinelibrary.wiley.com providerName: Wiley-Blackwell |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpZ1NS8QwEIYHXT3owW9xdZUgHrxUmibph-JB1OphFREFbyFJE13UdbHu_n6TtF1XUBC8FZqGIclM3obMMwB7mSBWxTLnaakOKE10IAsZBVYsp6SwW4qihS82kVxfpw8P2c0UHDW5MBUfYnzg5jzDx2vn4EKWE06uHs0BJja8TsNMZNctbcHM2W1-3_1Ki0xi1qC9HTSmBgu5izzjj79vRxMas-KGfpesfs_JF_9l7RIs1FITnVRrYxmmdH8F5icAhKtwfCWe9XCAHHaxPERdG_rQyfDxtU5I6qM3g_wxP8rd1S006gl0U53d2LdrcJ-f351eBnVBhUAxxw3NTGikMJpGKo0LBx-zDojjIjRKJCQisRUPqTIJzTA1sY4FlSTUMpUxS7SSgqxDq__W1xuAMDZESKl1qFIqFBZFwpjExNjOsApVG_abceWqpo27ohcvvPnrsCPC_Yi0YXfcdFAhNn5q1Gkmh9deVnInZqwgCeOsDd1qwsY9OGx2zUt64urJF6Mpeak5ZaKwKpZwqmnIaSaYFQyYcYKZMkxa-zNsrfeT-bs9_PQi9w-bf2-6BXOREwX-umQHWh_vQ70Ns2r00Svfd-rV-wlQzvDX |
| linkProvider | Wiley-Blackwell |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpZ3NS_QwEIcHXQX14Mer4voZxMN7qTSbpB-iB1GrYl1EFLyFJE1U1FWs699vkrbrCgqCt0LTMGQyya9D8gzAViqIVbHMRVqiA0pjHchCdgIrlhNS2C1F0cIXm4i73eTmJr0Ygd3mLkzFhxgk3Fxk-PXaBbhLSA9Fubo125jY9XUUxqidRqwFY4eX2XX-eS8yjljD9nbUmJos5E7yDD7-uh8NicwKHPpVs_pNJ5v5m7mzMF2LTbRfzY45GNG9fzA1hCCch71z8aD7L8iBF8sdlNvFD-33b5_qK0k99GyQT_SjzB3eQu_3Al1U2Rv7dgGus6Org5OgLqkQKObIoakJjRRG045KosLhx2wI4qgIjRIx6ZDIyodEmZimmJpIR4JKEmqZyIjFWklBFqHVe-7pJUAYGyKk1DpUCRUKiyJmTGJibGdYhaoN_5uB5armjbuyF4-8-e-wI8L9iLRhc9D0pYJsfNdotfEOr-Os5E7OWEkSRmkb8spjgx4cOLsmJt1xdefL0ZS81JwyUVgdSzjVNOQ0FcxKBsw4wUwZJq39KbbWe2_-bA8_OM78w_Lvm27AxMnVec7z0-7ZCkx2nETwhydXofX22tdrMK7e3-7L1_V6Kn8AwIX0xw |
| linkToPdf | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpZ3Nb9MwGMZfjW6a4ABsDK0wwJp22CUojj-SIDhMGwFEqSrEpN0s27HbCtZWTdu_H9v5oJNAmsQtUhzrle3HfmLZvxfgLJfEuVjmlZaZiNLURKpUSeTMckZKt6RoWoZkE-lwmN3c5KMdeN_ehan5EN2Gm1dGmK-9wM2itFsq12P7FhM3vz6AXcpy7mS5e_W9uB78uReZctayvT01piEL-ZM83cd316Mtk1mDQ-961rDoFE_-L9yn8Lgxm-iiHh0HsGNmh_BoC0H4DD58kz_NeoE8eLF6hwZu8kMX6_FtcyVphuYWhY1-VPjDW2gzlWhU7964t0dwXXz8cfk5alIqRJp5cmhuY6ukNTTRGS89fsxJEPMytlqmJCHc2YdM25TmmFpuuKSKxEZlirPUaCXJc-jN5jNzDAhjS6RSxsQ6o1JjWaaMKUysqwzrWPfhvG1YoRveuE978Uu0_x2uRURokT6cdkUXNWTjb4VO2t4Rjc4q4e2MsyQxz_swqHusq8GDsxti0kToSUhHU4nKCMpk6XwsEdTQWNBcMmcZMBMEM22ZcvHn2EUfevPf8YjLT0V4eHH_om9gf3RViMGX4deX8DDxDiGcnTyB3mq5Nq9gT29W02r5uhnJvwFbvPRC |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Makeup+Lamps%3A+Live+Augmentation+of+Human+Faces+via+Projection&rft.jtitle=Computer+graphics+forum&rft.au=Bermano%2C+Amit+H.&rft.au=Billeter%2C+Markus&rft.au=Iwai%2C+Daisuke&rft.au=Grundh%C3%B6fer%2C+Anselm&rft.date=2017-05-01&rft.issn=0167-7055&rft.eissn=1467-8659&rft.volume=36&rft.issue=2&rft.spage=311&rft.epage=323&rft_id=info:doi/10.1111%2Fcgf.13128&rft.externalDBID=10.1111%252Fcgf.13128&rft.externalDocID=CGF13128 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0167-7055&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0167-7055&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0167-7055&client=summon |