Search Results - Transformer-based factorized encoder

Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images by Huang, Yingying, Si, Yang, Hu, Bingliang, Zhang, Yan, Wu, Shuang, Wu, Dongsheng, Wang, Quan

“…) typically provides more details of the lesions in the lung. Thus, a transformer-based factorized encoder (TBFE…”
Get full text

DMFC-UFormer: Depthwise multi-scale factorized convolution transformer-based UNet for medical image segmentation by Garbaz, Anass, Oukdach, Yassine, Charfi, Said, Ansari, Mohamed El, Koutti, Lahcen, Salihoun, Mouna

“… In this paper, we combine the benefits of both methodologies. We propose DMFC-UFormer, an advanced fusion of Depthwise Multi-Scale Factorized Convolution-based transformers (DMFC-Transformer) with UNet…”
Get full text

Two-stream vision transformer based multi-label recognition for TCM prescriptions construction by Zhao, Zijuan, Qiang, Yan, Yang, Fenghao, Hou, Xiao, Zhao, Juanjuan, Song, Kai

“… and multi-label classification. The framework comprises three key components: image encoder, label embedding module, and cross-modal…”
Get full text

FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-Pose, and Facial Expression Features by Rochow, Andre, Schwarz, Max, Behnke, Sven

“… We propose a transformer-based encoder for computing a set-latent representation of the source image…”
Get full text

See, hear, read: Leveraging multimodality with guided attention for abstractive text summarization by Atri, Yash Kumar, Pramanick, Shraman, Goyal, Vikram, Chakraborty, Tanmoy

“…In recent years, abstractive text summarization with multimodal inputs has started drawing attention due to its ability to accumulate information from…”
Get full text

Multimodal Abstractive Summarization using bidirectional encoder representations from transformers with attention mechanism by Argade, Dakshata, Khairnar, Vaishali, Vora, Deepali, Patil, Shruti, Kotecha, Ketan, Alfarhood, Sultan

“… To address the aforementioned issues, this research presented the Multimodal Abstractive Summarization using Bidirectional Encoder Representations from Transformers (MAS-BERT…”
Get full text

DeHi: A Decoupled Hierarchical Architecture for Unaligned Ground-to-Aerial Geo-Localization by Wang, Teng, Li, Jiawen, Sun, Changyin

“… Specifically, DeHi first leverages CNN to extract high-level semantic features, and then introduces a novel orthogonally factorized transformer model consisting of part-level and global transformer…”
Get full text

FSRT: Facial Scene Representation Transformer for Face Reenactment from Factorized Appearance, Head-pose, and Facial Expression Features by Rochow, Andre, Schwarz, Max, Behnke, Sven

“… We propose a transformer-based encoder for computing a set-latent representation of the source image…”
Get full text

Co-Scale Conv-Attentional Image Transformers by Xu, Weijian, Xu, Yifan, Chang, Tyler, Tu, Zhuowen

“…In this paper, we present Co-scale conv-attentional image Transformers (CoaT), a Transformer-based image classifier equipped with co-scale and conv-attentional mechanisms…”
Get full text

ESRNet: an exploring sample relationships network for arbitrary-shaped scene text detection by Fan, Huageng, Lu, Tongwei

“…Recently transformer-based scene text detection methods have been gradually investigated…”
Get full text

PredFormer: Transformers Are Effective Spatial-Temporal Predictive Learners by Tang, Yujin, Lu, Qi, Xie, Fei, Li, Xiangtai, Ma, Chao, Ming-Hsuan Yang

“… mechanisms, including full-, factorized-, and interleaved-spatial-temporal attention. With its recurrent-free, transformer-based design, PredFormer is both simple and efficient, significantly outperforming previous…”
Get full text

CAMS: Convolution and Attention-Free Mamba-based Cardiac Image Segmentation by Khan, Abbas, Asad, Muhammad, Benning, Martin, Roney, Caroline, Slabaugh, Gregory

“…Convolutional Neural Networks (CNNs) and Transformer-based self-attention models have become the standard for medical image segmentation…”
Get full text

CAMS: Convolution and Attention-Free Mamba-Based Cardiac Image Segmentation by Khan, Abbas, Asad, Muhammad, Benning, Martin, Roney, Caroline, Slabaugh, Gregory

“…Convolutional Neural Networks (CNNs) and Transformer-based self-attention models have become the standard for medical image segmentation…”
Get full text

See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization by Atri, Yash Kumar, Pramanick, Shraman, Goyal, Vikram, Chakraborty, Tanmoy

“…In recent years, abstractive text summarization with multimodal inputs has started drawing attention due to its ability to accumulate information from…”
Get full text

Efficient Deep Learning Models for Physics Simulation by Li, Zijie

“…Many natural and engineered systems are governed by partial differential equations (PDEs), spanning atomic interactions in molecular systems to large-scale…”
Get full text

Co-Scale Conv-Attentional Image Transformers by Xu, Weijian, Xu, Yifan, Chang, Tyler, Tu, Zhuowen

“…In this paper, we present Co-scale conv-attentional image Transformers (CoaT), a Transformer-based image classifier equipped with co-scale and conv-attentional mechanisms…”
Get full text