A modular and scalable computational framework for interactive immersion into imaging data with a holographic augmented reality interface
•Framework for interactive immersion into imaging data.•3D/4D holographic visualization and interaction with a head mounted display.•Modular, expandable, scalable, and customizable framework.•Real-time segmentation of 4D MRI CINE with machine learning. Modern imaging scanners produce an ever-growing...
Saved in:
| Published in: | Computer methods and programs in biomedicine Vol. 198; p. 105779 |
|---|---|
| Main Authors: | , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Ireland
Elsevier B.V
01.01.2021
|
| Subjects: | |
| ISSN: | 0169-2607, 1872-7565, 1872-7565 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | •Framework for interactive immersion into imaging data.•3D/4D holographic visualization and interaction with a head mounted display.•Modular, expandable, scalable, and customizable framework.•Real-time segmentation of 4D MRI CINE with machine learning.
Modern imaging scanners produce an ever-growing body of 3D/4D multimodal data requiring image analytics and visualization of fused images, segmentations, and information. For the latter, augmented reality (AR) with head-mounted displays (HMDs) has shown potential. This work describes a framework (FI3D) for interactive immersion with data, integration of image processing and analytics, and rendering and fusion with an AR interface.
The FI3D was designed and endowed with modules to communicate with peripherals, including imaging scanners and HMDs, and to provide computational power for data acquisition and processing. The core of FI3D is deployed to a dedicated computational unit that performs the computationally demanding processes in real-time, and the HMD is used as a display output peripheral and an input peripheral through gestures and voice commands. FI3D offers user-made processing and analysis dedicated modules. Users can customize and optimize these for a particular workflow while incorporating current or future libraries.
The FI3D framework was used to develop a workflow for processing, rendering, and visualization of CINE MRI cardiac sets. In this version, the data were loaded from a remote database, and the endocardium and epicardium of the left ventricle (LV) were segmented using a machine learning model and transmitted to a HoloLens HMD to be visualized in 4D. Performance results show that the system is capable of maintaining an image stream of one image per second with a resolution of 512 × 512. Also, it can modify visual properties of the holograms at 1 update per 16 milliseconds (62.5 Hz) while providing enough resources for the segmentation and surface reconstruction tasks without hindering the HMD.
We provide a system design and framework to be used as a foundation for medical applications that benefit from AR visualization, removing several technical challenges from the developmental pipeline. |
|---|---|
| AbstractList | Modern imaging scanners produce an ever-growing body of 3D/4D multimodal data requiring image analytics and visualization of fused images, segmentations, and information. For the latter, augmented reality (AR) with head-mounted displays (HMDs) has shown potential. This work describes a framework (FI3D) for interactive immersion with data, integration of image processing and analytics, and rendering and fusion with an AR interface.
The FI3D was designed and endowed with modules to communicate with peripherals, including imaging scanners and HMDs, and to provide computational power for data acquisition and processing. The core of FI3D is deployed to a dedicated computational unit that performs the computationally demanding processes in real-time, and the HMD is used as a display output peripheral and an input peripheral through gestures and voice commands. FI3D offers user-made processing and analysis dedicated modules. Users can customize and optimize these for a particular workflow while incorporating current or future libraries.
The FI3D framework was used to develop a workflow for processing, rendering, and visualization of CINE MRI cardiac sets. In this version, the data were loaded from a remote database, and the endocardium and epicardium of the left ventricle (LV) were segmented using a machine learning model and transmitted to a HoloLens HMD to be visualized in 4D. Performance results show that the system is capable of maintaining an image stream of one image per second with a resolution of 512 × 512. Also, it can modify visual properties of the holograms at 1 update per 16 milliseconds (62.5 Hz) while providing enough resources for the segmentation and surface reconstruction tasks without hindering the HMD.
We provide a system design and framework to be used as a foundation for medical applications that benefit from AR visualization, removing several technical challenges from the developmental pipeline. •Framework for interactive immersion into imaging data.•3D/4D holographic visualization and interaction with a head mounted display.•Modular, expandable, scalable, and customizable framework.•Real-time segmentation of 4D MRI CINE with machine learning. Modern imaging scanners produce an ever-growing body of 3D/4D multimodal data requiring image analytics and visualization of fused images, segmentations, and information. For the latter, augmented reality (AR) with head-mounted displays (HMDs) has shown potential. This work describes a framework (FI3D) for interactive immersion with data, integration of image processing and analytics, and rendering and fusion with an AR interface. The FI3D was designed and endowed with modules to communicate with peripherals, including imaging scanners and HMDs, and to provide computational power for data acquisition and processing. The core of FI3D is deployed to a dedicated computational unit that performs the computationally demanding processes in real-time, and the HMD is used as a display output peripheral and an input peripheral through gestures and voice commands. FI3D offers user-made processing and analysis dedicated modules. Users can customize and optimize these for a particular workflow while incorporating current or future libraries. The FI3D framework was used to develop a workflow for processing, rendering, and visualization of CINE MRI cardiac sets. In this version, the data were loaded from a remote database, and the endocardium and epicardium of the left ventricle (LV) were segmented using a machine learning model and transmitted to a HoloLens HMD to be visualized in 4D. Performance results show that the system is capable of maintaining an image stream of one image per second with a resolution of 512 × 512. Also, it can modify visual properties of the holograms at 1 update per 16 milliseconds (62.5 Hz) while providing enough resources for the segmentation and surface reconstruction tasks without hindering the HMD. We provide a system design and framework to be used as a foundation for medical applications that benefit from AR visualization, removing several technical challenges from the developmental pipeline. Modern imaging scanners produce an ever-growing body of 3D/4D multimodal data requiring image analytics and visualization of fused images, segmentations, and information. For the latter, augmented reality (AR) with head-mounted displays (HMDs) has shown potential. This work describes a framework (FI3D) for interactive immersion with data, integration of image processing and analytics, and rendering and fusion with an AR interface.BACKGROUND AND OBJECTIVEModern imaging scanners produce an ever-growing body of 3D/4D multimodal data requiring image analytics and visualization of fused images, segmentations, and information. For the latter, augmented reality (AR) with head-mounted displays (HMDs) has shown potential. This work describes a framework (FI3D) for interactive immersion with data, integration of image processing and analytics, and rendering and fusion with an AR interface.The FI3D was designed and endowed with modules to communicate with peripherals, including imaging scanners and HMDs, and to provide computational power for data acquisition and processing. The core of FI3D is deployed to a dedicated computational unit that performs the computationally demanding processes in real-time, and the HMD is used as a display output peripheral and an input peripheral through gestures and voice commands. FI3D offers user-made processing and analysis dedicated modules. Users can customize and optimize these for a particular workflow while incorporating current or future libraries.METHODSThe FI3D was designed and endowed with modules to communicate with peripherals, including imaging scanners and HMDs, and to provide computational power for data acquisition and processing. The core of FI3D is deployed to a dedicated computational unit that performs the computationally demanding processes in real-time, and the HMD is used as a display output peripheral and an input peripheral through gestures and voice commands. FI3D offers user-made processing and analysis dedicated modules. Users can customize and optimize these for a particular workflow while incorporating current or future libraries.The FI3D framework was used to develop a workflow for processing, rendering, and visualization of CINE MRI cardiac sets. In this version, the data were loaded from a remote database, and the endocardium and epicardium of the left ventricle (LV) were segmented using a machine learning model and transmitted to a HoloLens HMD to be visualized in 4D. Performance results show that the system is capable of maintaining an image stream of one image per second with a resolution of 512 × 512. Also, it can modify visual properties of the holograms at 1 update per 16 milliseconds (62.5 Hz) while providing enough resources for the segmentation and surface reconstruction tasks without hindering the HMD.RESULTSThe FI3D framework was used to develop a workflow for processing, rendering, and visualization of CINE MRI cardiac sets. In this version, the data were loaded from a remote database, and the endocardium and epicardium of the left ventricle (LV) were segmented using a machine learning model and transmitted to a HoloLens HMD to be visualized in 4D. Performance results show that the system is capable of maintaining an image stream of one image per second with a resolution of 512 × 512. Also, it can modify visual properties of the holograms at 1 update per 16 milliseconds (62.5 Hz) while providing enough resources for the segmentation and surface reconstruction tasks without hindering the HMD.We provide a system design and framework to be used as a foundation for medical applications that benefit from AR visualization, removing several technical challenges from the developmental pipeline.CONCLUSIONSWe provide a system design and framework to be used as a foundation for medical applications that benefit from AR visualization, removing several technical challenges from the developmental pipeline. |
| ArticleNumber | 105779 |
| Author | Velazco-Garcia, Jose D. Shah, Dipan J. Leiss, Ernst L. Tsekos, Nikolaos V. |
| Author_xml | – sequence: 1 givenname: Jose D. surname: Velazco-Garcia fullname: Velazco-Garcia, Jose D. email: jdvelazcogarcia@uh.edu organization: MRI Lab, Dept. of CS, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA – sequence: 2 givenname: Dipan J. surname: Shah fullname: Shah, Dipan J. email: DJShah@houstonmethodist.org organization: Cardiovascular MRI Lab, Houston Methodist DeBakey Heart and Vascular Center, 6550 Fannin St., Smith Tower – Suite 1801, Houston, USA – sequence: 3 givenname: Ernst L. surname: Leiss fullname: Leiss, Ernst L. email: coscel@handy.cs.uh.edu organization: MRI Lab, Dept. of CS, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA – sequence: 4 givenname: Nikolaos V. surname: Tsekos fullname: Tsekos, Nikolaos V. email: nvtsekos@central.uh.edu organization: MRI Lab, Dept. of CS, University of Houston, 4800 Calhoun Road PGH 501, Houston, TX, USA |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/33045556$$D View this record in MEDLINE/PubMed |
| BookMark | eNqFkUFv1DAQhS1URLeFP8AB-cgli-PESYq4VBXQSpW4wNka25Ndb5042E6r_Qn91zhKe-mhnMYeve9J894ZORn9iIR8LNm2ZGXz5bDVw6S2nPFlIdr24g3ZlF3Li1Y04oRssuii4A1rT8lZjAfGGBeieUdOq4rVIj835PGSDt7MDgKF0dCowYFySLUfpjlBsn4ER_sAAz74cEd7H6gdEwbQyd4jtcOAIWbVsvX5Czs77qiBBPTBpj0FuvfO7wJMe6spzLsBM25oQHA2HVezHjS-J297cBE_PM1z8ufH999X18Xtr583V5e3ha5ZmwqhsKx101bGqL4WAEJAVWvdlm3FDVMdV60yHSjOTY15qE7xHuuqrErUnanOyefVdwr-74wxycFGjc7BiH6OkteCNXXXCZaln56ksxrQyCnk-8JRPseXBd0q0MHHGLCX2q6hpQDWyZLJpSl5kEtTcmlKrk1llL9An91fhb6tEOaA7i0GGbXFUaOxAXWSxtvX8a8vcO3saHPnd3j8H_wPQPvDgA |
| CitedBy_id | crossref_primary_10_1016_j_media_2023_102757 crossref_primary_10_1002_rcs_2290 crossref_primary_10_3389_fdgth_2025_1571521 crossref_primary_10_3390_app14052070 crossref_primary_10_3390_app11062656 crossref_primary_10_1007_s10278_020_00412_3 crossref_primary_10_3390_jimaging7120274 |
| Cites_doi | 10.1002/mrm.24389 10.1097/PRS.0000000000003817 10.1049/htl.2017.0061 10.1109/TBME.2012.2230398 10.1007/s00701-013-1668-2 10.1177/1553350618799552 10.2214/ajr.183.2.1830391 10.1007/s11548-017-1564-y 10.5213/inj.1620edi005 10.1007/s10278-018-0152-1 10.1016/j.mri.2006.08.016 10.1371/journal.pone.0205188 10.1016/j.jvir.2019.09.020 10.1097/PRS.0000000000003802 10.1016/j.cmpb.2019.105277 10.1177/1553350619871787 |
| ContentType | Journal Article |
| Copyright | 2020 Copyright © 2020. Published by Elsevier B.V. |
| Copyright_xml | – notice: 2020 – notice: Copyright © 2020. Published by Elsevier B.V. |
| DBID | AAYXX CITATION CGR CUY CVF ECM EIF NPM 7X8 |
| DOI | 10.1016/j.cmpb.2020.105779 |
| DatabaseName | CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic |
| DatabaseTitle | CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: NPM name: PubMed url: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Medicine |
| EISSN | 1872-7565 |
| ExternalDocumentID | 33045556 10_1016_j_cmpb_2020_105779 S0169260720316126 |
| Genre | Journal Article |
| GroupedDBID | --- --K --M -~X .1- .DC .FO .GJ .~1 0R~ 1B1 1P~ 1RT 1~. 1~5 29F 4.4 457 4G. 53G 5GY 5RE 5VS 7-5 71M 8P~ 9JN AAEDT AAEDW AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AATTM AAXKI AAXUO AAYFN AAYWO ABBOA ABFNM ABJNI ABMAC ABMZM ABWVN ABXDB ACDAQ ACGFS ACIEU ACIUM ACLOT ACNNM ACRLP ACRPL ACVFH ACZNC ADBBV ADCNI ADEZE ADJOM ADMUD ADNMO AEBSH AEIPS AEKER AENEX AEUPX AEVXI AFJKZ AFPUW AFRHN AFTJW AFXIZ AGHFR AGQPQ AGUBO AGYEJ AHHHB AHZHX AIALX AIEXJ AIGII AIIUN AIKHN AITUG AJRQY AJUYK AKBMS AKRWK AKYEP ALMA_UNASSIGNED_HOLDINGS AMRAJ ANKPU ANZVX AOUOD APXCP ASPBG AVWKF AXJTR AZFZN BKOJK BLXMC BNPGV CS3 DU5 EBS EFJIC EFKBS EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q GBLVA GBOLZ HLZ HMK HMO HVGLF HZ~ IHE J1W KOM LG9 M29 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. Q38 R2- ROL RPZ SAE SBC SDF SDG SEL SES SEW SPC SPCBC SSH SSV SSZ T5K UHS WUQ XPP Z5R ZGI ZY4 ~G- ~HD AACTN AAIAV ABLVK ABTAH ABYKQ AFKWA AJBFU AJOXV AMFUW LCYCR RIG 9DU AAYXX CITATION AFCTW CGR CUY CVF ECM EIF NPM 7X8 |
| ID | FETCH-LOGICAL-c407t-5be14c673ddbf45aa55a34cc71732d0b82b7bd8ab22d4eab2b8b2fe43131ec8d3 |
| ISICitedReferencesCount | 7 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000598417800007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0169-2607 1872-7565 |
| IngestDate | Sat Sep 27 23:21:58 EDT 2025 Thu Apr 03 07:05:47 EDT 2025 Sat Nov 29 07:23:43 EST 2025 Tue Nov 18 22:36:43 EST 2025 Fri Feb 23 02:48:17 EST 2024 Tue Oct 14 19:31:46 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Human-cyber Interface Computational framework Interactive Immersion Medical imaging Augmented reality Rendering and visualization |
| Language | English |
| License | Copyright © 2020. Published by Elsevier B.V. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c407t-5be14c673ddbf45aa55a34cc71732d0b82b7bd8ab22d4eab2b8b2fe43131ec8d3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| PMID | 33045556 |
| PQID | 2450648850 |
| PQPubID | 23479 |
| ParticipantIDs | proquest_miscellaneous_2450648850 pubmed_primary_33045556 crossref_citationtrail_10_1016_j_cmpb_2020_105779 crossref_primary_10_1016_j_cmpb_2020_105779 elsevier_sciencedirect_doi_10_1016_j_cmpb_2020_105779 elsevier_clinicalkey_doi_10_1016_j_cmpb_2020_105779 |
| PublicationCentury | 2000 |
| PublicationDate | January 2021 2021-01-00 2021-Jan 20210101 |
| PublicationDateYYYYMMDD | 2021-01-01 |
| PublicationDate_xml | – month: 01 year: 2021 text: January 2021 |
| PublicationDecade | 2020 |
| PublicationPlace | Ireland |
| PublicationPlace_xml | – name: Ireland |
| PublicationTitle | Computer methods and programs in biomedicine |
| PublicationTitleAlternate | Comput Methods Programs Biomed |
| PublicationYear | 2021 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Morales Mojica, Navkar, Tsekos, Webb, Birbilis, Seimenis, Tsagkaris, Webb, Birbilis, Seimenis (bib0020) 2017 Velazco-Garcia, Navkar, Balakrishnan, Abinahed, Al-Ansari, Younes, Darweesh, Al-Rumaihi, Christoforous, Leiss, Karkoub, Tsiamyrtzis, Tsekos (bib0028) 2019 Cutolo, Freschi, Mascioli, Parchi, Ferrari, Ferrari (bib0002) 2016; 5 Tepper, Rudy, Lefkowitz, Weimer, Marks, Stern, Garfein, Chen, Lin (bib0007) 2017; 140 D. Gobbi, DICOM for VTK, (2019). Hansen, Sørensen (bib0011) 2013; 69 (bib0027) 2017 Brown, Cheng, Haacke, Thompson, Venkatesan (bib0008) 2014 Mahvash, Tabrizi (bib0017) 2013; 155 Rahman, Wood, Qian, Price, Johnson, Osgood (bib0019) 2019; 27 Morales Mojica, Velazco-Garcia, Zhao, Seimenis, Leiss, Shah, Webb, Becker, Tsekos (bib0021) 2019 Meulstee, Nijsink, Schreurs, Verhamme, Xi, Delye, Borstlap, Maal (bib0023) 2019; 26 JSON, (2019). Navkar, Deng, Shah, Tsekos (bib0025) 2013; 60 Christoforou, Akbudak, Ozcan, Karanikolas, Tsekos (bib0010) 2007; 25 Velazco Garcia, Navkar, Gui, Morales, Christoforou, Ozcan, Abinahed, Al-Ansari, Webb, Seimenis, Tsekos (bib0012) 2019; 32 Chen, Lin (bib0001) 2017; 140 Kersten-Oertel, Gerard, Drouin, Petrecca, Hall, Louis Collins (bib0003) 2016 (accessed July 23, 2019). Unity Technologies, Unity real-time development platform | 3D, 2D VR and AR visualizations, (2019). Navkar, Deng, Shah, Bekris, Tsekos (bib0026) 2012 Huellebrand, Messroghli, Tautz, Kuehne, Hennemuth (bib0013) 2020; 184 Kuhlemann, Kleemann, Jauer, Schweikard, Ernst (bib0005) 2017; 4 (accessed November 16, 2019). Liu, Al’Aref, Singh, Caprio, Moghadam, Jang, Wong, Min, Dunham, Mosadegh (bib0016) 2019; 14 Kitware, VTK - the visualization toolkit, (2019). Gobbetti, Pili, Zorcolo, Tuveri (bib0014) 1998 Velazco-Garcia, Navkar, Balakrishnan, Abinahed, Al-Ansari, Darweesh, Al-Rumaihi, Christoforous, Leiss, Karkoub, Tsiamyrtzis, Tsekos (bib0029) 2020 Molina, Velazco-Garcia, Shah, Becker, Tsekos (bib0030) 2019 (accessed September 24, 2019). Wacker, Elgort, Hillenbrand, Duerk, Lewin (bib0009) 2004; 183 Microsoft, Mixed reality toolkit, (2019). (accessed October 17, 2019). Morales Mojica, Velazco-Garcia, Navkar, Balakrishnan, Abinahed, El Ansari, Al-Rumaihi, Darweesh, Al-Ansari, Gharib, Karkoub, Leiss, Seimenis, Tsekos (bib0022) 2018 Kim (bib0004) 2016; 20 Jang, Tschabrunn, Barkagan, Anter, Menze, Nezafat (bib0024) 2018; 13 Qian, Barthel, Johnson, Osgood, Kazanzides, Navab, Fuerst (bib0006) 2017; 12 Park, Hunt, Martin, Nadolski, Wood, Gade (bib0018) 2020 Silva, Southworth, Dalal, Hare, Silva (bib0015) 2017; 136 (bib0031) 2019 Chen (10.1016/j.cmpb.2020.105779_bib0001) 2017; 140 Morales Mojica (10.1016/j.cmpb.2020.105779_bib0020) 2017 Morales Mojica (10.1016/j.cmpb.2020.105779_bib0022) 2018 Liu (10.1016/j.cmpb.2020.105779_bib0016) 2019; 14 Jang (10.1016/j.cmpb.2020.105779_bib0024) 2018; 13 Brown (10.1016/j.cmpb.2020.105779_bib0008) 2014 10.1016/j.cmpb.2020.105779_bib0036 10.1016/j.cmpb.2020.105779_bib0035 10.1016/j.cmpb.2020.105779_bib0034 Wacker (10.1016/j.cmpb.2020.105779_bib0009) 2004; 183 (10.1016/j.cmpb.2020.105779_bib0031) 2019 Kuhlemann (10.1016/j.cmpb.2020.105779_bib0005) 2017; 4 Christoforou (10.1016/j.cmpb.2020.105779_bib0010) 2007; 25 Meulstee (10.1016/j.cmpb.2020.105779_bib0023) 2019; 26 Huellebrand (10.1016/j.cmpb.2020.105779_bib0013) 2020; 184 Qian (10.1016/j.cmpb.2020.105779_bib0006) 2017; 12 Hansen (10.1016/j.cmpb.2020.105779_bib0011) 2013; 69 Gobbetti (10.1016/j.cmpb.2020.105779_bib0014) 1998 Velazco-Garcia (10.1016/j.cmpb.2020.105779_bib0029) 2020 Navkar (10.1016/j.cmpb.2020.105779_bib0026) 2012 Tepper (10.1016/j.cmpb.2020.105779_bib0007) 2017; 140 Cutolo (10.1016/j.cmpb.2020.105779_bib0002) 2016; 5 Silva (10.1016/j.cmpb.2020.105779_bib0015) 2017; 136 Molina (10.1016/j.cmpb.2020.105779_bib0030) 2019 Park (10.1016/j.cmpb.2020.105779_bib0018) 2020 Morales Mojica (10.1016/j.cmpb.2020.105779_bib0021) 2019 Velazco-Garcia (10.1016/j.cmpb.2020.105779_bib0028) 2019 10.1016/j.cmpb.2020.105779_bib0033 10.1016/j.cmpb.2020.105779_bib0032 (10.1016/j.cmpb.2020.105779_bib0027) 2017 Rahman (10.1016/j.cmpb.2020.105779_bib0019) 2019; 27 Kersten-Oertel (10.1016/j.cmpb.2020.105779_bib0003) 2016 Kim (10.1016/j.cmpb.2020.105779_bib0004) 2016; 20 Velazco Garcia (10.1016/j.cmpb.2020.105779_bib0012) 2019; 32 Navkar (10.1016/j.cmpb.2020.105779_bib0025) 2013; 60 Mahvash (10.1016/j.cmpb.2020.105779_bib0017) 2013; 155 |
| References_xml | – start-page: 21 year: 2017 end-page: 27 ident: bib0020 article-title: Holographic interface for three-dimensional visualization of MRI on HoloLens: a prototype platform for MRI guided neurosurgeries publication-title: Proc. - 2017 IEEE 17th Int. Conf. Bioinforma. Bioeng. BIBE 2017 – year: 2019 ident: bib0030 article-title: Automated segmentation and 4D reconstruction of the heart left ventricle from CINE MRI publication-title: Proc. - 2019 IEEE 19th Int. Conf. Bioinforma. Bioeng. BIBE 2019 – reference: (accessed November 16, 2019). – volume: 69 start-page: 1768 year: 2013 end-page: 1776 ident: bib0011 article-title: Gadgetron: an open source framework for medical image reconstruction publication-title: Magn. Reson. Med. – reference: (accessed July 23, 2019). – volume: 183 start-page: 391 year: 2004 end-page: 395 ident: bib0009 article-title: The catheter-driven MRI scanner: a new approach to intravascular catheter tracking and imaging-parameter adjustment for interventional MRI publication-title: Am. J. Roentgenol. – start-page: 17 year: 2018 end-page: 21 ident: bib0022 article-title: A prototype holographic augmented reality interface for image-guided prostate cancer interventions publication-title: Proc. Eurographics Work. Vis. Comput. Biol. Med – volume: 25 start-page: 69 year: 2007 end-page: 77 ident: bib0010 article-title: Performance of interventions with manipulator-driven real-time MR guidance: implementation and initial in vitro tests publication-title: Magn. Reson. Imaging – year: 2019 ident: bib0021 article-title: Interactive and immersive image-guided control of interventional manipulators with a prototype holographic interface publication-title: Proc. - 2019 IEEE 19th Int. Conf. Bioinforma. Bioeng. BIBE 2019 – volume: 60 start-page: 1023 year: 2013 end-page: 1033 ident: bib0025 article-title: A framework for integrating real-time MRI with robot control: application to simulated transapical cardiac interventions publication-title: IEEE Trans. Biomed. Eng. – year: 2020 ident: bib0029 article-title: Evaluation of interventional planning software features for MR-guided transrectal prostate biopsies publication-title: Proc. - 2020 IEEE 20th Int. Conf. Bioinforma. Bioeng. BIBE 2020 – volume: 184 year: 2020 ident: bib0013 article-title: An extensible software platform for interdisciplinary cardiovascular imaging research publication-title: Comput. Methods Programs Biomed. – reference: Unity Technologies, Unity real-time development platform | 3D, 2D VR and AR visualizations, (2019). – reference: D. Gobbi, DICOM for VTK, (2019). – year: 2019 ident: bib0031 article-title: Qt | Cross-Platform Software Development for Embedded and Desktop – reference: (accessed October 17, 2019). – volume: 140 start-page: 1066 year: 2017 end-page: 1070 ident: bib0007 article-title: Mixed reality with HoloLens: where virtual reality meets augmented reality in the operating room publication-title: Plast. Reconstr. Surg. – volume: 26 start-page: 86 year: 2019 end-page: 94 ident: bib0023 article-title: Toward holographic-guided surgery publication-title: Surg. Innov – start-page: 163 year: 2016 end-page: 174 ident: bib0003 article-title: Towards Augmented Reality Guided Craniotomy Planning in Tumour Resections – reference: Microsoft, Mixed reality toolkit, (2019). – start-page: 689 year: 2012 end-page: 694 ident: bib0026 article-title: Visual and force-feedback guidance for robot-assisted interventions in the beating heart with real-time MRI publication-title: Proc. - IEEE Int. Conf. Robot. Autom. – volume: 32 start-page: 1 year: 2019 end-page: 13 ident: bib0012 article-title: A platform integrating acquisition, reconstruction, visualization, and manipulator control modules for MRI-guided interventions publication-title: J. Digit. Imaging – volume: 140 start-page: 1071 year: 2017 end-page: 1072 ident: bib0001 article-title: Discussion: mixed reality with HoloLens: where virtual reality meets augmented reality in the operating room. publication-title: Plast. Reconstr. Surg. – volume: 155 start-page: 943 year: 2013 end-page: 947 ident: bib0017 article-title: A novel augmented reality system of image projection for image-guided neurosurgery publication-title: Acta Neurochir. (Wien) – volume: 14 year: 2019 ident: bib0016 article-title: An augmented reality system for image guidance of transcatheter procedures for structural heart disease publication-title: PLoS ONE – reference: Kitware, VTK - the visualization toolkit, (2019). – volume: 20 start-page: 169 year: 2016 end-page: 170 ident: bib0004 article-title: The potential application of virtual, augmented, and mixed reality in neurourology publication-title: Int. Neurourol. J. – volume: 27 start-page: 88 year: 2019 end-page: 100 ident: bib0019 article-title: Head-mounted display use in surgery: a systematic review publication-title: Surg. Innov. – reference: JSON, (2019). – year: 2020 ident: bib0018 article-title: Augmented and mixed reality: technologies for enhancing the future of IR publication-title: J. Vasc. Interv. Radiol. – volume: 5 start-page: 59 year: 2016 ident: bib0002 article-title: Robust and accurate algorithm for wearable stereoscopic augmented reality with three indistinguishable markers publication-title: Electronics (Basel) – year: 2017 ident: bib0027 article-title: The Leader in Mixed Reality Technology | Hololens – volume: 12 start-page: 901 year: 2017 end-page: 910 ident: bib0006 article-title: Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display publication-title: Int. J. Comput. Assist. Radiol. Surg. – year: 2014 ident: bib0008 article-title: Magnetic Resonance Imaging: Physical Principles and Sequence Design – volume: 13 year: 2018 ident: bib0024 article-title: Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens publication-title: PLoS ONE – year: 2019 ident: bib0028 article-title: Preliminary evaluation of robotic transrectal biopsy system on an interventional planning software publication-title: Proc. - 2019 IEEE 19th Int. Conf. Bioinforma. Bioeng. BIBE 2019 – volume: 136 start-page: A15358 year: 2017 ident: bib0015 article-title: Improving visualization and interaction during transcatheter ablation using an augmented reality system: first-in-human experience publication-title: Electrophysiol. Arrhythm. Nov. Tools Tech. Arrhythmia Ablation – volume: 4 start-page: 184 year: 2017 end-page: 187 ident: bib0005 article-title: Towards X-ray free endovascular interventions – using HoloLens for on-line holographic visualisation publication-title: Healthc. Technol. Lett. – start-page: 435 year: 1998 end-page: 438 ident: bib0014 article-title: Interactive virtual angioscopy publication-title: Proc. Vis. ’98 (Cat. No.98CB36276) – reference: (accessed September 24, 2019). – volume: 136 start-page: A15358 year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0015 article-title: Improving visualization and interaction during transcatheter ablation using an augmented reality system: first-in-human experience publication-title: Electrophysiol. Arrhythm. Nov. Tools Tech. Arrhythmia Ablation – volume: 14 year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0016 article-title: An augmented reality system for image guidance of transcatheter procedures for structural heart disease publication-title: PLoS ONE – year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0028 article-title: Preliminary evaluation of robotic transrectal biopsy system on an interventional planning software – volume: 69 start-page: 1768 year: 2013 ident: 10.1016/j.cmpb.2020.105779_bib0011 article-title: Gadgetron: an open source framework for medical image reconstruction publication-title: Magn. Reson. Med. doi: 10.1002/mrm.24389 – ident: 10.1016/j.cmpb.2020.105779_bib0032 – ident: 10.1016/j.cmpb.2020.105779_bib0034 – ident: 10.1016/j.cmpb.2020.105779_bib0036 – volume: 140 start-page: 1071 year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0001 article-title: Discussion: mixed reality with HoloLens: where virtual reality meets augmented reality in the operating room. publication-title: Plast. Reconstr. Surg. doi: 10.1097/PRS.0000000000003817 – start-page: 21 year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0020 article-title: Holographic interface for three-dimensional visualization of MRI on HoloLens: a prototype platform for MRI guided neurosurgeries – year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0021 article-title: Interactive and immersive image-guided control of interventional manipulators with a prototype holographic interface – year: 2020 ident: 10.1016/j.cmpb.2020.105779_bib0029 article-title: Evaluation of interventional planning software features for MR-guided transrectal prostate biopsies – volume: 4 start-page: 184 year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0005 article-title: Towards X-ray free endovascular interventions – using HoloLens for on-line holographic visualisation publication-title: Healthc. Technol. Lett. doi: 10.1049/htl.2017.0061 – volume: 60 start-page: 1023 year: 2013 ident: 10.1016/j.cmpb.2020.105779_bib0025 article-title: A framework for integrating real-time MRI with robot control: application to simulated transapical cardiac interventions publication-title: IEEE Trans. Biomed. Eng. doi: 10.1109/TBME.2012.2230398 – volume: 155 start-page: 943 year: 2013 ident: 10.1016/j.cmpb.2020.105779_bib0017 article-title: A novel augmented reality system of image projection for image-guided neurosurgery publication-title: Acta Neurochir. (Wien) doi: 10.1007/s00701-013-1668-2 – volume: 26 start-page: 86 year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0023 article-title: Toward holographic-guided surgery publication-title: Surg. Innov doi: 10.1177/1553350618799552 – start-page: 689 year: 2012 ident: 10.1016/j.cmpb.2020.105779_bib0026 article-title: Visual and force-feedback guidance for robot-assisted interventions in the beating heart with real-time MRI – ident: 10.1016/j.cmpb.2020.105779_bib0033 – start-page: 17 year: 2018 ident: 10.1016/j.cmpb.2020.105779_bib0022 article-title: A prototype holographic augmented reality interface for image-guided prostate cancer interventions publication-title: Proc. Eurographics Work. Vis. Comput. Biol. Med – volume: 5 start-page: 59 year: 2016 ident: 10.1016/j.cmpb.2020.105779_bib0002 article-title: Robust and accurate algorithm for wearable stereoscopic augmented reality with three indistinguishable markers publication-title: Electronics (Basel) – ident: 10.1016/j.cmpb.2020.105779_bib0035 – year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0030 article-title: Automated segmentation and 4D reconstruction of the heart left ventricle from CINE MRI – volume: 183 start-page: 391 year: 2004 ident: 10.1016/j.cmpb.2020.105779_bib0009 article-title: The catheter-driven MRI scanner: a new approach to intravascular catheter tracking and imaging-parameter adjustment for interventional MRI publication-title: Am. J. Roentgenol. doi: 10.2214/ajr.183.2.1830391 – volume: 12 start-page: 901 year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0006 article-title: Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display publication-title: Int. J. Comput. Assist. Radiol. Surg. doi: 10.1007/s11548-017-1564-y – year: 2014 ident: 10.1016/j.cmpb.2020.105779_bib0008 – volume: 20 start-page: 169 year: 2016 ident: 10.1016/j.cmpb.2020.105779_bib0004 article-title: The potential application of virtual, augmented, and mixed reality in neurourology publication-title: Int. Neurourol. J. doi: 10.5213/inj.1620edi005 – volume: 32 start-page: 1 year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0012 article-title: A platform integrating acquisition, reconstruction, visualization, and manipulator control modules for MRI-guided interventions publication-title: J. Digit. Imaging doi: 10.1007/s10278-018-0152-1 – volume: 25 start-page: 69 year: 2007 ident: 10.1016/j.cmpb.2020.105779_bib0010 article-title: Performance of interventions with manipulator-driven real-time MR guidance: implementation and initial in vitro tests publication-title: Magn. Reson. Imaging doi: 10.1016/j.mri.2006.08.016 – volume: 13 year: 2018 ident: 10.1016/j.cmpb.2020.105779_bib0024 article-title: Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens publication-title: PLoS ONE doi: 10.1371/journal.pone.0205188 – year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0027 – year: 2020 ident: 10.1016/j.cmpb.2020.105779_bib0018 article-title: Augmented and mixed reality: technologies for enhancing the future of IR publication-title: J. Vasc. Interv. Radiol. doi: 10.1016/j.jvir.2019.09.020 – start-page: 163 year: 2016 ident: 10.1016/j.cmpb.2020.105779_bib0003 – year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0031 – start-page: 435 year: 1998 ident: 10.1016/j.cmpb.2020.105779_bib0014 article-title: Interactive virtual angioscopy – volume: 140 start-page: 1066 year: 2017 ident: 10.1016/j.cmpb.2020.105779_bib0007 article-title: Mixed reality with HoloLens: where virtual reality meets augmented reality in the operating room publication-title: Plast. Reconstr. Surg. doi: 10.1097/PRS.0000000000003802 – volume: 184 year: 2020 ident: 10.1016/j.cmpb.2020.105779_bib0013 article-title: An extensible software platform for interdisciplinary cardiovascular imaging research publication-title: Comput. Methods Programs Biomed. doi: 10.1016/j.cmpb.2019.105277 – volume: 27 start-page: 88 year: 2019 ident: 10.1016/j.cmpb.2020.105779_bib0019 article-title: Head-mounted display use in surgery: a systematic review publication-title: Surg. Innov. doi: 10.1177/1553350619871787 |
| SSID | ssj0002556 |
| Score | 2.3601112 |
| Snippet | •Framework for interactive immersion into imaging data.•3D/4D holographic visualization and interaction with a head mounted display.•Modular, expandable,... Modern imaging scanners produce an ever-growing body of 3D/4D multimodal data requiring image analytics and visualization of fused images, segmentations, and... |
| SourceID | proquest pubmed crossref elsevier |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 105779 |
| SubjectTerms | Augmented Reality Computational framework Human-cyber Interface Image Processing, Computer-Assisted Imaging, Three-Dimensional Immersion Interactive Immersion Medical imaging Rendering and visualization User-Computer Interface |
| Title | A modular and scalable computational framework for interactive immersion into imaging data with a holographic augmented reality interface |
| URI | https://www.clinicalkey.com/#!/content/1-s2.0-S0169260720316126 https://dx.doi.org/10.1016/j.cmpb.2020.105779 https://www.ncbi.nlm.nih.gov/pubmed/33045556 https://www.proquest.com/docview/2450648850 |
| Volume | 198 |
| WOSCitedRecordID | wos000598417800007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1872-7565 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0002556 issn: 0169-2607 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3JbtswECWcpCh6KbrXXQIW6E2QYW0WdTQad4Nr9OAavgnclChxJMMbgv5B_60f1eEi1k7htDn0Ihu0SFCeJ3E4mnkPobchzwRJZOTzbo_5cCdKn-pIXATLmRQJE5pSaDJMRyMynWZfW62fTS3MZpZWFbm6yub_1dTQBsZWpbO3MLcbFBrgOxgdjmB2OP6T4ftK3UYnl-qYONhAV0dxLd_QhP6KJidLpxkqzghdLbWRXqkj2SYDEvzS8tLIGKlMUlsI5501RNeK63V9qmk9VRGMcen1YAXluyQIVjzCKlYvLT-Bzg3TGbmGBmDnNf9Ezuh3XvsflNwRbV5XeCcdFxU6ozoodFLOVRGWax_K0kjBDxbg_HpD98N4KS9MWuGovIA9fb30Jp3tuEcYbMU9bCi0l_mwG0t3nuVG0to-jZWGsZGq-WOhMDGL8w6_nLMODG8Ej83Ju6zc11ZLl8PYpMed52qMXI2RmzEO0FGYJhk8Y4_6nwbTz84zUHRvhmvezNwWcZl8w-sz2eco7dsIaYdo_ADdtzsZ3DcIfIhasnqE7n6xRnyMfvSxBSIGY-MGiHgHiNgBEQMQ8RYQsQOiaq2xBSJWQMQKiJjiLSBiB0RsgYgdEJ-gb-8H43cffSv84fO4m678hMkg5r00EoIVcUJpktAo5lxljISiy0jIUiYIZWEoYgkfjLCwkOALR4HkRERP0WFVV_I5wgEpIhHTQmRxGPOAsaDgIiGSRhkrUpG2UdD8yzm3rPhKnGWW77dvG3muz9xwwtx4dtQYL2-qnWF9zgGJN_ZKXC_rCxsf96_93jT4yGGhUG__aCXr9TIPY8VNSUjSbaNnBjhu9iqomQA4X9zqyl6ie79vzFfocLVYy9foDt-syuXiGB2kU3Jsb4Ff2mrxmQ |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+modular+and+scalable+computational+framework+for+interactive+immersion+into+imaging+data+with+a+holographic+augmented+reality+interface&rft.jtitle=Computer+methods+and+programs+in+biomedicine&rft.au=Velazco-Garcia%2C+Jose+D.&rft.au=Shah%2C+Dipan+J.&rft.au=Leiss%2C+Ernst+L.&rft.au=Tsekos%2C+Nikolaos+V.&rft.date=2021-01-01&rft.issn=0169-2607&rft.volume=198&rft.spage=105779&rft_id=info:doi/10.1016%2Fj.cmpb.2020.105779&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_cmpb_2020_105779 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0169-2607&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0169-2607&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0169-2607&client=summon |