Hierarchical Two-Stream Growing Self-Organizing Maps With Transience for Human Activity Recognition

The rapid growth in autonomous industrial environments has increased the need for intelligent video surveillance. As a predominant element of video surveillance, recognition of complex human movements is important in a wide range of surveillance applications. However, the current state-of-the-art vi...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:IEEE transactions on industrial informatics Ročník 16; číslo 12; s. 7756 - 7764
Hlavní autoři: Nawaratne, Rashmika, Alahakoon, Damminda, De Silva, Daswin, Kumara, Harsha, Yu, Xinghuo
Médium: Journal Article
Jazyk:angličtina
Vydáno: Piscataway IEEE 01.12.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Témata:
Activity recognition
Algorithms
Architecture
Decision making
Deep learning
Feature extraction
Forgetting
hierarchical learning
Histograms
Human activity recognition
human activity recognition (HAR)
Machine learning
Moving object recognition
neural networks
Neurons
Optical flow
Self organizing maps
Self-organizing feature maps
Surveillance
Video data
Video surveillance
ISSN:1551-3203, 1941-0050
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:The rapid growth in autonomous industrial environments has increased the need for intelligent video surveillance. As a predominant element of video surveillance, recognition of complex human movements is important in a wide range of surveillance applications. However, the current state-of-the-art video surveillance techniques use supervised deep learning pipelines for human activity recognition (HAR). A key shortcoming of such techniques is the inability to learn from unlabeled video streams. To operate effectively in natural environments, video surveillance techniques have to be able to handle huge volumes of unlabeled video data, monitor and generate alerts and insights derived from multiple characteristics such as spatial structure, motion flow, color distribution, etc. Furthermore, most conventional learning systems lack memory persistence capability which can reduce the influence of outdated information in memory-guided decision-making resulting in limiting plasticity and overfitting based on specific past events. In this article, we propose a new adaptation of the Growing Self-Organizing Map (GSOM) to address these shortcomings by 1) adopting two proven concepts of traditional deep learning, hierarchical, and multistream learning, applied into GSOM self-structuring architecture to accommodate learning from unlabeled video data and their diverse characteristics, 2) address overfitting and the influence of outdated information on neural architecture by implementing a transience property in the algorithm. We demonstrate the proposed model using three benchmark video datasets and the results confirm its validity and usability for HAR.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1551-3203
1941-0050
DOI:10.1109/TII.2019.2957454