Suchergebnisse - Encoder-Decoder Transformer Model*

TrEnD: A transformer‐based encoder‐decoder model with adaptive patch embedding for mass segmentation in mammograms von Liu, Dongdong, Wu, Bo, Li, Changbo, Sun, Zheng, Zhang, Nan

“… Methods We propose an effective transformer‐based encoder‐decoder model (TrEnD). Firstly …”
Volltext

TransformEHR: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic health records von Yang, Zhichao, Mitra, Avijit, Liu, Weisong, Berlowitz, Dan, Yu, Hong

“… In this study, we present TransformEHR, a generative encoder-decoder model with transformer that is pretrained using a new pretraining objective …”
Volltext

Road Extraction from Remote Sensing Images Using a Skip-Connected Parallel CNN-Transformer Encoder-Decoder Model von Gui, Linger, Gu, Xingjian, Huang, Fen, Ren, Shougang, Qin, Huanhuan, Fan, Chengcheng

“… ) with a Transformer Encoder Module (TEM). The integration combines the CEM’s strength in local feature extraction …”
Volltext

Artificial Intelligence-Based Fault Diagnosis for Steam Traps Using Statistical Time Series Features and a Transformer Encoder-Decoder Model von Kim, Chul, Cho, Kwangjae, Joe, Inwhee

“… This paper proposes a novel predictive maintenance system for steam traps that integrates statistical time series features and transformer encoder …”
Volltext

Finetuning Encoder-Decoder Transformer Models for Text Summarization Using Pause Tokens von Odeyemi, Glory

“… In natural language processing, text summarization is widely explored using transformer-based models due to their strong ability to capture and generate meaningful representations of input text …”
Volltext

Image Captioning Using Vision Transformer Encoder Decoder Model von Kareemunissa, Ramachandran, Prakash

“… The automated generation of a NLP of an image has been in the spotlight because it is important in real-world applications and because it involves two of the …”
Volltext

Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers von Chefer, Hila, Gur, Shir, Wolf, Lior

“… to the prediction in the model's input. In this work, we propose the first method to explain prediction by any Transformer-based architecture, including bi-modal Transformers and Transformers with co-attentions …”
Volltext

Pre-Trained Encoder Decoder Transformer Model for Language Processing von K, Farhan Akthar, K, Deepaksakthi V, A, Tamizhselvi

“… In this project, a novel approach to address these limitations is to build an encoder-decoder transformer model specifically for the Tamil language …”
Volltext

EDSOD: An Encoder-Decoder, Diffusion-model, and Swin-Transformer-based Small Object Detector von Li, Junnian, Zhou, MengChu, Cao, Zhengcai

“… To tackle such issues, this work proposes a new encoder-decoder-based SOD framework with a Diffusion Model and Swin Transformer given aerial images …”
Volltext

A Comparison of Transformer and LSTM Encoder Decoder Models for ASR von Zeyer, Albert, Bahar, Parnia, Irie, Kazuki, Schluter, Ralf, Ney, Hermann

“… We present competitive results using a Transformer encoder-decoder-attention model for end-to-end speech recognition needing less training time compared to a similarly performing LSTM model …”
Volltext

Temporal convolutional and fusional transformer model with Bi-LSTM encoder-decoder for multi-time-window remaining useful life prediction von Pour, Mohamadreza Akbari, Karimi, Mohamad Sadeq, Mazloumi, Amir Hossein

“… ) for localized temporal feature extraction with a modified Temporal Fusion Transformer (TFT) enhanced by Bi-LSTM encoder-decoders …”
Volltext

A Comparative Evaluation of Transformer-Based Vision Encoder-Decoder Models for Brazilian Portuguese Image Captioning von Bromonschenkel, Gabriel, Oliveira, Hilario, Paixao, Thiago M.

“… This work seeks to contribute to this context by fine-tuning and investigating the performance of vision language models based on the Transformer architecture in Brazilian Portuguese …”
Volltext

Reframing Software Log Summarisation as Multi-Label Classification with Encoder-Decoder Transformer Model von Turkzeybek, Furkan Zeki, Inan, Emrah

“… Recent improvements in natural language processing, brought about by transformers that evolved into large language models, offer substantial capabilities that can be implemented for log summarisation tasks …”
Volltext

Road Extraction from Remote Sensing Images Using a Skip-Connected Parallel CNN-Transformer Encoder-Decoder Model von Dharani Sri, Vuyyuru

“… ) with a Transformer Encoder Module (TEM). The integration combines the CEM’s strength in local feature extraction …”
Volltext

DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models von Tang, Peng, Zhu, Pengkai, Li, Tian, Appalaraju, Srikar, Mahadevan, Vijay, Manmatha, R

“… Encoder-decoder transformer models have achieved great success on various vision-language (VL …”
Volltext

A Novel Length Controllable Encoder-Decoder Transformer Model for Abstractive Summarization of Scientific Documents von Sharma, Grishma, Sharma, Deepak

“… of it. To perform abstractive summarization of scientific publications, a unique lengthcontrollable encoder-decoder transformer approach is proposed in this study …”
Volltext

Single Block Encoder-Decoder Transformer Model for Multi-Step Traffic Flow Forecasting von Omar, Mas, Yakub, Fitri, Abu Talip, Mohamad Sofian, Nazmin Maslan, Mohd, Sinha, Vijay Kumar, Muljono, Muljono

“… This is particularly true for the simplest form of a single block encoder-decoder Transformer model, which can be finely tuned through optimised hyperparameters …”
Volltext

Attention-Guided Facial Emotion Recognition with Swin Transformer Encoder Decoder Model von Jeen Retna Kumar, R, Anushlin Leena, M B, Saumiya, S, Gnanaprakash, V, Febin, U, Stanley, Berakhah F

“… A novel technique of FER that integrates an attention-guided Swin Transformer-based encoder-decoder model is furnished here …”
Volltext

Arabic News Classification and Generation Based on an Encoder-Decoder Transformer Model (ArabicT5) von Gawbah, Hezam, Al-Majmar, Nashwan, Alsubari, Akram, Alsurori, Muneer, Ahmed Al-Shaebi, Rashed Ali

“… Recent developments in the natural language processing for Arabic, particularly the emergence of transformers, paved the way for computers to comprehend Arabic more effectively and solve complex related tasks …”
Volltext

CT-γ-Net: A Hybrid Model Based on Convolutional Encoder–Decoder and Transformer Encoder for Brain Tumor Localization von Bedi, Punam, Ningshen, Ningyao, Rani, Surbhi, Gole, Pushkar, Bhasin, Veenu

“… The proposed CT-γ-Net model follows an encoder-decoder structure in which the convolutional encoder …”
Volltext