Výsledky vyhledávání - Encoder-Decoder Transformer Model

TrEnD: A transformer‐based encoder‐decoder model with adaptive patch embedding for mass segmentation in mammograms Autor Liu, Dongdong, Wu, Bo, Li, Changbo, Sun, Zheng, Zhang, Nan

“… Methods We propose an effective transformer‐based encoder‐decoder model (TrEnD). Firstly…”
Získat plný text

TransformEHR: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records Autor Yang, Zhichao, Mitra, Avijit, Liu, Weisong, Berlowitz, Dan, Yu, Hong

“… In this study, we present TransformEHR, a generative encoder-decoder model with transformer that is pretrained using a new pretraining objective…”
Získat plný text

Road Extraction from Remote Sensing Images Using a Skip-Connected Parallel CNN-Transformer Encoder-Decoder Model Autor Gui, Linger, Gu, Xingjian, Huang, Fen, Ren, Shougang, Qin, Huanhuan, Fan, Chengcheng

“…) with a Transformer Encoder Module (TEM). The integration combines the CEM’s strength in local feature extraction…”
Získat plný text

Artificial Intelligence-Based Fault Diagnosis for Steam Traps Using Statistical Time Series Features and a Transformer Encoder-Decoder Model Autor Kim, Chul, Cho, Kwangjae, Joe, Inwhee

“… This paper proposes a novel predictive maintenance system for steam traps that integrates statistical time series features and transformer encoder…”
Získat plný text

Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers Autor Chefer, Hila, Gur, Shir, Wolf, Lior

“… to the prediction in the model's input. In this work, we propose the first method to explain prediction by any Transformer-based architecture, including bi-modal Transformers and Transformers with co-attentions…”
Získat plný text

Stacked encoder–decoder transformer with boundary smoothing for action segmentation Autor Kim, Gyeong‐hyeon, Kim, Eunwoo

“…In this work, a new stacked encoder–decoder transformer (SEDT) model is proposed for action segmentation…”
Získat plný text

EDSOD: An Encoder-Decoder, Diffusion-model, and Swin-Transformer-based Small Object Detector Autor Li, Junnian, Zhou, MengChu, Cao, Zhengcai

“… To tackle such issues, this work proposes a new encoder-decoder-based SOD framework with a Diffusion Model and Swin Transformer given aerial images…”
Získat plný text

Temporal convolutional and fusional transformer model with Bi-LSTM encoder-decoder for multi-time-window remaining useful life prediction Autor Pour, Mohamadreza Akbari, Karimi, Mohamad Sadeq, Mazloumi, Amir Hossein

“…) for localized temporal feature extraction with a modified Temporal Fusion Transformer (TFT) enhanced by Bi-LSTM encoder-decoders…”
Získat plný text

A Comparison of Transformer and LSTM Encoder Decoder Models for ASR Autor Zeyer, Albert, Bahar, Parnia, Irie, Kazuki, Schluter, Ralf, Ney, Hermann

“…We present competitive results using a Transformer encoder-decoder-attention model for end-to-end speech recognition needing less training time compared to a similarly performing LSTM model…”
Získat plný text

Finetuning Encoder-Decoder Transformer Models for Text Summarization Using Pause Tokens Autor Odeyemi, Glory

“…In natural language processing, text summarization is widely explored using transformer-based models due to their strong ability to capture and generate meaningful representations of input text…”
Získat plný text

A Comparative Evaluation of Transformer-Based Vision Encoder-Decoder Models for Brazilian Portuguese Image Captioning Autor Bromonschenkel, Gabriel, Oliveira, Hilario, Paixao, Thiago M.

“… This work seeks to contribute to this context by fine-tuning and investigating the performance of vision language models based on the Transformer architecture in Brazilian Portuguese…”
Získat plný text

Image Captioning Using Vision Transformer Encoder Decoder Model Autor Kareemunissa, Ramachandran, Prakash

“…The automated generation of a NLP of an image has been in the spotlight because it is important in real-world applications and because it involves two of the…”
Získat plný text

Pre-Trained Encoder Decoder Transformer Model for Language Processing Autor K, Farhan Akthar, K, Deepaksakthi V, A, Tamizhselvi

“… In this project, a novel approach to address these limitations is to build an encoder-decoder transformer model specifically for the Tamil language…”
Získat plný text

Enhanced brain tumour segmentation using a hybrid dual encoder–decoder model in federated learning Autor Narmadha, K., Varalakshmi, P.

“… To address these drawbacks, we propose a Hybrid Dual Encoder–Decoder Segmentation Model in Federated Learning, that integrates EfficientNet with Swin Transformer as encoders and BASNet…”
Získat plný text

A Novel Length Controllable Encoder-Decoder Transformer Model for Abstractive Summarization of Scientific Documents Autor Sharma, Grishma, Sharma, Deepak

“… of it. To perform abstractive summarization of scientific publications, a unique lengthcontrollable encoder-decoder transformer approach is proposed in this study…”
Získat plný text

Reframing Software Log Summarisation as Multi-Label Classification with Encoder-Decoder Transformer Model Autor Turkzeybek, Furkan Zeki, Inan, Emrah

“… Recent improvements in natural language processing, brought about by transformers that evolved into large language models, offer substantial capabilities that can be implemented for log summarisation tasks…”
Získat plný text

Road Extraction from Remote Sensing Images Using a Skip-Connected Parallel CNN-Transformer Encoder-Decoder Model Autor Dharani Sri, Vuyyuru

“…) with a Transformer Encoder Module (TEM). The integration combines the CEM’s strength in local feature extraction…”
Získat plný text

CT-γ-Net: A Hybrid Model Based on Convolutional Encoder–Decoder and Transformer Encoder for Brain Tumor Localization Autor Bedi, Punam, Ningshen, Ningyao, Rani, Surbhi, Gole, Pushkar, Bhasin, Veenu

“… The proposed CT-γ-Net model follows an encoder-decoder structure in which the convolutional encoder…”
Získat plný text

Single Block Encoder-Decoder Transformer Model for Multi-Step Traffic Flow Forecasting Autor Omar, Mas, Yakub, Fitri, Abu Talip, Mohamad Sofian, Nazmin Maslan, Mohd, Sinha, Vijay Kumar, Muljono, Muljono

“… This is particularly true for the simplest form of a single block encoder-decoder Transformer model, which can be finely tuned through optimised hyperparameters…”
Získat plný text

Attention-Guided Facial Emotion Recognition with Swin Transformer Encoder Decoder Model Autor Jeen Retna Kumar, R, Anushlin Leena, M B, Saumiya, S, Gnanaprakash, V, Febin, U, Stanley, Berakhah F

“… A novel technique of FER that integrates an attention-guided Swin Transformer-based encoder-decoder model is furnished here…”
Získat plný text