Dynamic context capture and distributed video arrays for intelligent spaces
Intelligent environments can be viewed as systems where humans and machines (rooms) collaborate. Intelligent (or smart) environments need to extract and maintain an awareness of a wide range of events and human activities occurring in these spaces. This requirement is crucial for supporting efficien...
Uloženo v:
| Vydáno v: | IEEE transactions on systems, man and cybernetics. Part A, Systems and humans Ročník 35; číslo 1; s. 145 - 163 |
|---|---|
| Hlavní autoři: | , , |
| Médium: | Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
01.01.2005
|
| Témata: | |
| ISSN: | 1083-4427 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Intelligent environments can be viewed as systems where humans and machines (rooms) collaborate. Intelligent (or smart) environments need to extract and maintain an awareness of a wide range of events and human activities occurring in these spaces. This requirement is crucial for supporting efficient and effective interactions among humans as well as humans and intelligent spaces. Visual information plays an important role for developing accurate and useful representation of the static and dynamic states of an intelligent environment. Accurate and efficient capture, analysis, and summarization of the dynamic context requires the vision system to work at multiple levels of semantic abstractions in a robust manner. In this paper, we present details of a long-term and ongoing research project, where indoor intelligent spaces endowed with a range of useful functionalities are designed, built, and systematically evaluated. Some of the key functionalities include: intruder detection; multiple person tracking; body pose and posture analysis; person identification; human body modeling and movement analysis; and for integrated systems for intelligent meeting rooms, teleconferencing, or performance spaces. The paper includes an overall system architecture to support design and development of intelligent environments. Details of panoramic (omnidirectional) video camera arrays, calibration, video stream synchronization, and real-time capture/processing are discussed. Modules for multicamera-based multiperson tracking, event detection and event based servoing for selective attention, voxelization, streaming face recognition, are also discussed. The paper includes experimental studies to systematically evaluate performance of individual video analysis modules as well as to evaluate basic feasibility of an integrated system for dynamic context capture and event based servoing, and semantic information summarization. |
|---|---|
| AbstractList | Intelligent environments can be viewed as systems where humans and machines (rooms) collaborate. Intelligent (or smart) environments need to extract and maintain an awareness of a wide range of events and human activities occurring in these spaces. This requirement is crucial for supporting efficient and effective interactions among humans as well as humans and intelligent spaces. Visual information plays an important role for developing accurate and useful representation of the static and dynamic states of an intelligent environment. Accurate and efficient capture, analysis, and summarization of the dynamic context requires the vision system to work at multiple levels of semantic abstractions in a robust manner. In this paper, we present details of a long-term and ongoing research project, where indoor intelligent spaces endowed with a range of useful functionalities are designed, built, and systematically evaluated. Some of the key functionalities include: intruder detection; multiple person tracking; body pose and posture analysis; person identification; human body modeling and movement analysis; and for integrated systems for intelligent meeting rooms, teleconferencing, or performance spaces. The paper includes an overall system architecture to support design and development of intelligent environments. Details of panoramic (omnidirectional) video camera arrays, calibration, video stream synchronization, and real-time capture/processing are discussed. Modules for multicamera-based multiperson tracking, event detection and event based servoing for selective attention, voxelization, streaming face recognition, are also discussed. The paper includes experimental studies to systematically evaluate performance of individual video analysis modules as well as to evaluate basic feasibility of an integrated system for dynamic context capture and event based servoing, and semantic information summarization. |
| Author | Huang, K.S. Trivedi, M.M. Mikic, I. |
| Author_xml | – sequence: 1 givenname: M.M. surname: Trivedi fullname: Trivedi, M.M. organization: Comput. Vision & Robotics Res. Lab., Univ. of California, San Diego, CA, USA – sequence: 2 givenname: K.S. surname: Huang fullname: Huang, K.S. organization: Comput. Vision & Robotics Res. Lab., Univ. of California, San Diego, CA, USA – sequence: 3 givenname: I. surname: Mikic fullname: Mikic, I. |
| BookMark | eNqNkD1PwzAQQD0UiRb4AYjFE0wt_kpij1X5FEUMlDm6OGdk1CbFdhD996QUCYmhYrrlvbvTG5FB0zZIyClnE86ZuVw8P86mE8GYmmiplWYDMuRMy7FSojgkoxjfGONKGTUkD1ebBlbeUts2CT8TtbBOXUAKTU1rH1PwVZewph--xpZCCLCJ1LWB-p5fLv0rNonGNViMx-TAwTLiyc88Ii8314vZ3Xj-dHs_m87HVmUijVG4THDucqcZ5FmuQFtmWV3LzDmWSwUq51AIU1eQOVEVlQRTSO0qRMlqI4_IxW7vOrTvHcZUrny0_TPQYNvFUptcCGG46MnzvaTQPaVk8Q-Q8UIb2YN8B9rQxhjQlevgVxA2JWfltn75Xb_c1i939Xun-ONYnyD5vngAv9xrnu1Mj4i_l2RuZCbkFyvdlwI |
| CODEN | ITSHFX |
| CitedBy_id | crossref_primary_10_1155_2022_9032400 crossref_primary_10_1109_TIE_2008_2004388 crossref_primary_10_1109_TII_2013_2255616 crossref_primary_10_1155_2008_478396 crossref_primary_10_1186_s13638_021_02079_y crossref_primary_10_1109_TPAMI_2008_106 crossref_primary_10_1007_s00138_006_0055_x crossref_primary_10_1109_JSTSP_2010_2057890 crossref_primary_10_1155_2008_374528 crossref_primary_10_1109_JPROC_2010_2057231 crossref_primary_10_1109_TII_2011_2173945 crossref_primary_10_1109_JSTSP_2012_2196975 crossref_primary_10_1016_j_cviu_2008_08_007 crossref_primary_10_3390_jimaging6040025 crossref_primary_10_3390_s111009136 crossref_primary_10_1016_j_optcom_2013_01_023 crossref_primary_10_1109_TSMCA_2008_918589 crossref_primary_10_1088_1742_6596_2187_1_012023 crossref_primary_10_1109_TMM_2014_2377515 crossref_primary_10_1007_s13042_018_0801_1 crossref_primary_10_1109_TII_2011_2172450 crossref_primary_10_1016_j_cviu_2007_10_005 crossref_primary_10_1109_TASE_2009_2022976 crossref_primary_10_1007_s00138_006_0063_x crossref_primary_10_1145_1671962_1671964 crossref_primary_10_1109_JSYST_2009_2035734 crossref_primary_10_1145_2423636_2423647 crossref_primary_10_1109_MIS_2005_86 crossref_primary_10_1109_TMM_2010_2058095 |
| Cites_doi | 10.1109/5.664275 10.1109/34.868684 10.1109/CVPR.1997.609369 10.1109/JRA.1987.1087109 10.1006/cviu.1998.0716 10.1109/icip.1997.647399 10.1007/3-540-39959-3_2 10.1007/978-1-4757-3482-9_18 10.1109/ICPR.2002.1047435 10.1109/RATFG.1999.799218 10.1109/CVPR.1998.698614 10.1109/ITSC.2002.1041348 10.1109/CVPR.2000.854944 10.1007/978-1-4757-3502-4 10.1109/2.820039 10.1023/A:1023012723347 10.1109/34.598227 10.1109/ICPR.2004.1334689 10.1006/cviu.2001.0921 10.1109/ICIP.2002.1037957 10.1007/s00138-003-0106-5 10.1109/34.868683 10.1109/TSA.2003.818027 10.1109/CVPR.2000.855833 10.1080/03772063.2002.11416289 10.1109/CVPR.1999.786988 10.1006/cviu.2000.0897 10.1109/5.381842 10.1109/ICSMC.2000.885948 10.1109/34.598226 10.1109/93.556457 |
| ContentType | Journal Article |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 7TB 8FD FR3 JQ2 L7M L~C L~D H8D F28 |
| DOI | 10.1109/TSMCA.2004.838480 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Xplore CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Mechanical & Transportation Engineering Abstracts Technology Research Database Engineering Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Aerospace Database ANTE: Abstracts in New Technology & Engineering |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Mechanical & Transportation Engineering Abstracts Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Engineering Research Database Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional Aerospace Database ANTE: Abstracts in New Technology & Engineering |
| DatabaseTitleList | Technology Research Database Technology Research Database Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Sciences (General) |
| EndPage | 163 |
| ExternalDocumentID | 10_1109_TSMCA_2004_838480 1369352 |
| Genre | orig-research |
| GroupedDBID | -~X 0R~ 29I 4.4 5VS 6IK 85S 97E AAJGR AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFS AETIX AGQYO AGSQL AHBIQ AI. AIBXA ALLEH ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS EJD F5P HZ~ IFIPE IFJZH IPLJI JAVBF LAI M43 O9- OCL PZZ RIA RIE RNS VH1 VJK AAYXX CITATION 7SC 7SP 7TB 8FD FR3 JQ2 L7M L~C L~D H8D F28 |
| ID | FETCH-LOGICAL-c452t-e2f5211f6f80a6564a8c0c0dd35ff0634a461a729dba5f2b7b3a9738fbee30d93 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 54 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000225807200013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1083-4427 |
| IngestDate | Fri Jul 11 08:52:04 EDT 2025 Fri Jul 11 09:50:55 EDT 2025 Fri Jul 11 05:35:52 EDT 2025 Sat Nov 29 08:01:47 EST 2025 Tue Nov 18 22:18:27 EST 2025 Tue Aug 26 16:40:08 EDT 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c452t-e2f5211f6f80a6564a8c0c0dd35ff0634a461a729dba5f2b7b3a9738fbee30d93 |
| Notes | ObjectType-Article-2 SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 23 |
| PQID | 28017893 |
| PQPubID | 23500 |
| PageCount | 19 |
| ParticipantIDs | crossref_primary_10_1109_TSMCA_2004_838480 proquest_miscellaneous_28912437 proquest_miscellaneous_896222912 ieee_primary_1369352 proquest_miscellaneous_28017893 crossref_citationtrail_10_1109_TSMCA_2004_838480 |
| PublicationCentury | 2000 |
| PublicationDate | 2005-Jan. 2005-01-00 20050101 |
| PublicationDateYYYYMMDD | 2005-01-01 |
| PublicationDate_xml | – month: 01 year: 2005 text: 2005-Jan. |
| PublicationDecade | 2000 |
| PublicationTitle | IEEE transactions on systems, man and cybernetics. Part A, Systems and humans |
| PublicationTitleAbbrev | TSMCA |
| PublicationYear | 2005 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| References | ref13 ref35 ref12 ref34 ref15 ref37 ref14 ref36 ref31 ref30 ref33 ref32 Davis (ref21) ref2 ref17 ref18 ref24 ref23 ref26 Cipolla (ref1) 1998 ref25 Basu (ref16) ref20 ref22 Rabiner (ref10) 1993 ref28 ref27 ref29 ref8 ref7 ref9 Bolt (ref19); 86 ref4 Brandstein (ref11) 1995 ref3 ref6 ref5 |
| References_xml | – ident: ref13 doi: 10.1109/5.664275 – ident: ref25 doi: 10.1109/34.868684 – ident: ref26 doi: 10.1109/CVPR.1997.609369 – ident: ref27 doi: 10.1109/JRA.1987.1087109 – volume-title: Cambridge Univ. Press year: 1998 ident: ref1 – ident: ref7 doi: 10.1006/cviu.1998.0716 – ident: ref14 doi: 10.1109/icip.1997.647399 – ident: ref17 doi: 10.1007/3-540-39959-3_2 – ident: ref28 doi: 10.1007/978-1-4757-3482-9_18 – ident: ref34 doi: 10.1109/ICPR.2002.1047435 – ident: ref32 doi: 10.1109/RATFG.1999.799218 – volume: 86 start-page: 853 issue: 5 volume-title: Proc. IEEE ident: ref19 article-title: Put that there: Voice and gesture at the graphic interface – volume-title: 3rd Int. Workshop Cooperative Distributed Vision ident: ref21 article-title: Multi-perspective analysis of human action – volume-title: Fundamentals of Speech Recognition year: 1993 ident: ref10 – volume-title: A framework for speech source localization using sensor arrays year: 1995 ident: ref11 – ident: ref29 doi: 10.1109/CVPR.1998.698614 – ident: ref20 doi: 10.1109/ITSC.2002.1041348 – ident: ref22 doi: 10.1109/CVPR.2000.854944 – ident: ref23 doi: 10.1007/978-1-4757-3502-4 – ident: ref3 doi: 10.1109/2.820039 – ident: ref24 doi: 10.1023/A:1023012723347 – ident: ref31 doi: 10.1109/34.598227 – ident: ref33 doi: 10.1109/ICPR.2004.1334689 – ident: ref2 doi: 10.1006/cviu.2001.0921 – ident: ref5 doi: 10.1109/ICIP.2002.1037957 – ident: ref6 doi: 10.1007/s00138-003-0106-5 – ident: ref18 doi: 10.1109/34.868683 – ident: ref12 doi: 10.1109/TSA.2003.818027 – ident: ref30 doi: 10.1109/CVPR.2000.855833 – ident: ref35 doi: 10.1080/03772063.2002.11416289 – ident: ref37 doi: 10.1109/CVPR.1999.786988 – ident: ref9 doi: 10.1006/cviu.2000.0897 – volume-title: IEEE Int. Workshop Cues Commun. ident: ref16 article-title: Toward measuring human interactions in conversational settings – ident: ref4 doi: 10.1109/5.381842 – ident: ref36 doi: 10.1109/ICSMC.2000.885948 – ident: ref8 doi: 10.1109/34.598226 – ident: ref15 doi: 10.1109/93.556457 |
| SSID | ssj0014494 |
| Score | 2.041876 |
| Snippet | Intelligent environments can be viewed as systems where humans and machines (rooms) collaborate. Intelligent (or smart) environments need to extract and... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 145 |
| SubjectTerms | Active vision activity summarization ambient intelligence Arrays Biological system modeling body modeling Collaboration Data mining Dynamic tests Dynamical systems Dynamics event analysis face detection/recognition Human human-machine interfaces Humans Machine intelligence Machine vision Modules multicamera systems Performance analysis person tracking real-time vision Robustness Semantics smart rooms/spaces Streaming media Tracking |
| Title | Dynamic context capture and distributed video arrays for intelligent spaces |
| URI | https://ieeexplore.ieee.org/document/1369352 https://www.proquest.com/docview/28017893 https://www.proquest.com/docview/28912437 https://www.proquest.com/docview/896222912 |
| Volume | 35 |
| WOSCitedRecordID | wos000225807200013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) issn: 1083-4427 databaseCode: RIE dateStart: 19960101 customDbUrl: isFulltext: true dateEnd: 20121231 titleUrlDefault: https://ieeexplore.ieee.org/ omitProxy: false ssIdentifier: ssj0014494 providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1Li9swEB6yoYftoW2SlqZPHXrYLvWuZI0t6bhsGwqlS6FZ2JuR9YCFxQmOU-i_ryQ7aaDtQm8-jB94pJlPGs33AbwrmM95gTqjRvAMBfpMSsMyEdCw90ZQhzaJTYirK3lzo76N4MO-F8Y5lw6fubN4mWr5dmW2cavsnPFSBcBwBEdClH2v1r5igJhED1mAFBliLoYKJqPqfPn96-VFWgqeSS4xMkAe5KAkqvJHJE7pZfH4_z7sCTwaYCS56P0-gZFrpvDwgFxwCpNh2m7IycAt_X4GXz72CvQkHlEPcZkYvY41BKIbS2wk0Y36V86S2J63Irpt9c8NCcCW3O65OzsSolB47lO4XnxaXn7OBj2FzGCRd5nLfUjWzJdeUh1wHGppqKHW8sL7AFVQY8l0QNu21oXPa1FzrQSXvnaOU6v4Mxg3q8Y9B-Jqy2NNsVbKoEXURhrLZW5QF6q09Rzo7g9XZiAbj5oXd1VadFBVJadEEUyseqfM4XR_y7pn2rjPeBa98Nuwd8Ac3u7cWIVpEmsfunGr7abKQyYWAZvdZ6FYZGecA_mHhVRlVD9n-Yu_v_0lHCdi17RB8wrGXbt1r-GB-dHdbto3abj-Aqfo6KM |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSyQxEC7UFXQPu74Wx32YgwcVW5NOdSc5iruiqIPgCN6adB4gLD0yD8F_v0m6HYV1hb31ofpBV1L1JZX6PoCdgvmcF6gzagTPUKDPpDQsEwENe28EdWiT2ITo9-Xdnbqeg4NZL4xzLh0-c4fxMtXy7dBM41bZEeOlCoBhHj5E5ayuW2tWM0BMsocsgIoMMRddDZNRdTS4uTo5TovBQ8klRg7IV1koyar8FYtTgjn9_H-ftgKfOiBJjlvPr8Kca9bg4yt6wTVY7SbumOx27NJ763Dxs9WgJ_GQeojMxOiHWEUgurHERhrdqIDlLIkNekOiRyP9NCYB2pL7GXvnhIQ4FJ67AbenvwYnZ1mnqJAZLPJJ5nIf0jXzpZdUBySHWhpqqLW88D6AFdRYMh3wtq114fNa1FwrwaWvnePUKv4FFpph4zaBuNryWFWslTJoEbWRxnKZG9SFKm3dA_r8hyvT0Y1H1YvfVVp2UFUlp0QZTKxap_Rgf3bLQ8u18Z7xevTCi2HrgB5sP7uxChMlVj9044bTcZWHXCwCOnvPQrHIz9gD8g8Lqcqof87yrbffvg1LZ4Ory-ryvH_xFZYTzWvarvkGC5PR1H2HRfM4uR-PfqSh-wfpCOvs |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Dynamic+context+capture+and+distributed+video+arrays+for+intelligent+spaces&rft.jtitle=IEEE+transactions+on+systems%2C+man+and+cybernetics.+Part+A%2C+Systems+and+humans&rft.au=Trivedi%2C+M.M.&rft.au=Huang%2C+K.S.&rft.au=Mikic%2C+I.&rft.date=2005-01-01&rft.pub=IEEE&rft.issn=1083-4427&rft.volume=35&rft.issue=1&rft.spage=145&rft.epage=163&rft_id=info:doi/10.1109%2FTSMCA.2004.838480&rft.externalDocID=1369352 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1083-4427&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1083-4427&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1083-4427&client=summon |