Search Results - Multimodal Interactive Pattern Recognition

Multimodal interactive transcription of text images by Toselli, Alejandro H., Romero, Verónica, Pastor, Moisés, Vidal, Enrique

“… As an alternative to fully manual transcription and post-editing, a multimodal interactive approach is proposed here where user feedback is provided by means of touchscreen pen strokes and/or more…”
Get full text

Pattern Recognition Letters Learning Off-line vs. On-line Models of Interactive Multimodal Behaviors with Recurrent Neural Networks by Nguyen, Duc-Canh, Bailly, Gérard, Elisei, Frédéric

“…), Dynamic Bayesian Network (DBN), etc. In this paper, we present the multimodal interactive data and our behavioral model based on recurrent neural networks, namely Long-Short Term Memory (LSTM…”
Get full text

HIAN: A hybrid interactive attention network for multimodal sarcasm detection by Bao, Yongtang, Zhao, Xin, Zhang, Peng, Qi, Yue, Li, Haojie

“… To this end, we introduce a novel sarcasm detection fusion model based on multimodal hybrid interactive attention (HIAN…”
Get full text

Learning off-line vs. on-line models of interactive multimodal behaviors with recurrent neural networks by Nguyen, Duc-Canh, Bailly, Gérard, Elisei, Frédéric

“…), Dynamic Bayesian Network (DBN), etc. In this paper, we present the multimodal interactive data and our behavioral model based on recurrent neural networks, namely Long-Short Term Memory (LSTM…”
Get full text

MultiHeart: Secure and Robust Heartbeat Pattern Recognition in Multimodal Cardiac Monitoring System by Ahmadi, Hossein, Zhang, Yan, Tran, Nghi H.

“…, which may compromise both performance and data security. To address these challenges, we propose MultiHeart, which is a robust and secure multimodal interactive cardiac monitoring system designed to provide reliable heartbeat pattern recognition…”
Get full text

Control Color: Multimodal Diffusion-Based Interactive Image Colorization: Control Color: Multimodal Diffusion-Based Interactive by Liang, Zhexin, Li, Zhaochen, Zhou, Shangchen, Li, Chongyi, Loy, Chen Change

“…), a multi-modal colorization method that leverages the pre-trained Stable Diffusion (SD) model, offering promising capabilities in highly controllable interactive image colorization (Fig.  1…”
Get full text

Efficient Multimodal Fusion via Interactive Prompting by Li, Yaowei, Quan, Ruijie, Zhu, Linchao, Yang, Yi

“… Following this trend, the size of multimodal learning models constantly increases, leading to an urgent need to reduce the massive computational cost of finetuning these models for downstream tasks…”
Get full text

IMPLEMENTATION OF MULTIMODAL INTERFACE FOR HUMAN-COMPUTER INTERACTION SYSTEM TO CONTROL A ROBOTIC WHEELCHAIR by Petrunina, Elena, Bayramovv, Elmin, Pecherskij, Denis

“…The research on the development of new robot control systems is currently underway. The interest in this area stems from the need for practical, user-friendly…”
Get full text

iPoet: interactive painting poetry creation with visual multimodal analysis by Feng, Yingchaojie, Chen, Jiazhou, Huang, Keyu, Wong, Jason K., Ye, Hui, Zhang, Wei, Zhu, Rongchen, Luo, Xiaonan, Chen, Wei

“… In this paper, we present an interactive visual system to enable ordinary users to compose customized painting poetry for ancient Chinese paintings, which contain three properties: (1…”
Get full text

Cross-dialogue scene interactive knowledge enhancement for multimodal conversation emotion analysis by Liao, Jian, Wang, Xiaoyu, Feng, Yu, Wang, Suge, Zheng, Jianxing

“…Current research on multimodal conversation emotion analysis primarily focuses on modeling the context within a dialogue and employing attention-based multimodal fusion…”
Get full text

MNEMOSINE: A Modular Framework to Monitor Interaction in Multimodal Interactive Spaces by Barros, Fabio, Marques, Bernardo, Teixeira, Antonio, Silva, Samuel

“…The evolution of human-machine interfaces has resulted in the proposal of increasingly complex multimodal solutions, encompassing a diverse set of input and output modalities, towards more natural…”
Get full text

Contextual Object Detection with Multimodal Large Language Models by Zang, Yuhang, Li, Wei, Han, Jun, Zhou, Kaiyang, Loy, Chen Change

“…Recent Multimodal Large Language Models (MLLMs) are remarkable in vision-language tasks, such as image captioning and question answering, but lack the essential perception ability, i.e. , object detection…”
Get full text

SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation by Cheng, Yen-Chi, Lee, Hsin-Ying, Tulyakov, Sergey, Schwing, Alexander, Gui, Liangyan

“… To enable a variety of multimodal inputs, we employ task-specific encoders with dropout followed by a cross-attention mechanism…”
Get full text

Multimodal human–computer interaction in interventional radiology and surgery: a systematic literature review by Schreiter, Josefine, Heinrich, Florian, Hatscher, Benjamin, Schott, Danny, Hansen, Christian

“…Purpose As technology advances, more research dedicated to medical interactive systems emphasizes the integration of touchless and multimodal interaction (MMI…”
Get full text

Multimodal embodied attribute learning by robots for object-centric action policies by Zhang, Xiaohan, Amiri, Saeid, Sinapov, Jivko, Thomason, Jesse, Stone, Peter, Zhang, Shiqi

“…Robots frequently need to perceive object attributes, such as red , heavy , and empty , using multimodal exploratory behaviors, such as look , lift , and shake…”
Get full text

DER-GCN: Dialog and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialog Emotion Recognition by Ai, Wei, Shou, Yuntao, Meng, Tao, Li, Keqin

“…With the continuous development of deep learning (DL), the task of multimodal dialog emotion recognition (MDER…”
Get full text

Interactive Multimodal Visual Search on Mobile Device by Li, Houqiang, Wang, Yang, Mei, Tao, Wang, Jingdong, Li, Shipeng

“…This paper describes a novel multimodal interactive image search system on mobile devices…”
Get full text

Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience by Taewan Kim, Jiwoo Kang, Sanghoon Lee, Bovik, Alan C.

“… We propose a new methodology that we call multimodal interactive continuous scoring of quality (MICSQ…”
Get full text

TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses by Kui, Xiaoyan, Zhang, Mingkun, liu, Qiang, Wang, Zixiao, Huang, Guiping, Zheng, Zhihao, Xia, Jiazhi, Zhang, Chao

“…Massive open online courses (MOOCs) have become a popular platform owing to their open nature. However, the shortage of emotional interaction in MOOCs can…”
Get full text

Development of an integrated multimodal optical imaging system with real-time image analysis for the evaluation of oral premalignant lesions by Yang, Eric C., Vohra, Imran S., Badaoui, Hawraa, Schwarz, Richard A., Cherry, Katelin D., Quang, Timothy, Jacob, Justin, Lang, Alex, Bass, Nancy, Rodriguez, Jessica, Williams, Michelle D., Vigneswaran, Nadarajah, Gillenwater, Ann M., Richards-Kortum, Rebecca R.

“… We developed a multimodal optical imaging system (MMIS) that fully integrates the acquisition, display, and analysis of macroscopic white-light (WL), autofluorescence (AF…”
Get full text