Search Results - "knowledge distillation"

Confounding factors-aware hierarchical deep learning for sustainable edge wildfire detection

Authors: El Madafri, Ismail

Contributors: University/Department: Universitat Politècnica de Catalunya. Institut Universitari de Recerca en Ciència i Tecnologies de la Sostenibilitat

Thesis Advisors: Peña Carrera, Marta, Olmedo Torre, Noelia

Source: TDX (Tesis Doctorals en Xarxa)

Subject Terms: wildfire detection, deep learning, confounding elements, multi-task learning, knowledge distillation, hierarchical learning, domain adaptation, edge devices, sustainable AI, environmental monitoring., detecció d'incendis forestals, aprenentatge profund, elements confusos, aprenentatge multitarea, destil·lació de coneixement, aprenentatge jeràrquic, adaptació al domini, dispositius edge, IA sostenible, monitoratge ambiental, detección de incendios forestales, aprendizaje profundo, elementos confusos, aprendizaje multitarea, destilación de conocimiento, aprendizaje jerárquico, adaptación al dominio, dispositivos edge, monitoreo ambiental., Àrees temàtiques de la UPC::Desenvolupament humà i sostenible, 502 - Natura. Estudi, conservació i protecció de la natura, 630 - Silvicultura. Arboricultura

File Description: application/pdf

Access URL: http://hdl.handle.net/10803/695130
https://dx.doi.org/10.5821/dissertation-2117-440594

Enhancing Global Model Performance in Federated Learning With Non-IID Data Using a Data-Free Generative Diffusion Model

Authors: Najafi, Mohammadreza Daneshtalab, Masoud Lee, Jeong-A et al.

Source: IEEE Access. 12:148230-148239

Subject Terms: Federated learning, non-identical and independent distributions (Non-IID), diffusion model, knowledge distillation

File Description: print

Access URL: https://urn.kb.se/resolve?urn=urn:nbn:se:mdh:diva-68763
https://doi.org/10.1109/ACCESS.2024.3474056

Efficient anomaly detection for edge clouds: mitigating data and resource constraints

Authors: Forough, Javad Haddadi, Hamed Bhuyan, Monowar et al.

Source: IEEE Access. 12:171897-171910

Subject Terms: Anomaly detection, data constraints, edge clouds, knowledge distillation, resource constraints, transfer learning

File Description: electronic

Access URL: https://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-231909
https://doi.org/10.1109/ACCESS.2024.3492815

Improve Real-Time Flood Segmentation by Encoding and Distilling Foreground Information

Authors: Mentesidis, Pantelis Mygdalis, Vasileios Pitas, Ioannis

Source: 2025 IEEE International Conference on Image Processing (ICIP). :1840-1845

Subject Terms: knowledge distillation, flood segmentation, real-time flood monitoring

LLM-Enhanced Multi-Teacher Knowledge Distillation for Modality-Incomplete Emotion Recognition in Daily Healthcare

Authors: Yuzhe Zhang Huan Liu Yang Xiao et al.

Source: Zhang, Y, Liu, H, Xiao, Y, Amoon, M, Zhang, D, Wang, D, Yang, S & Quek, C 2024, 'LLM-Enhanced Multi-Teacher Knowledge Distillation for Modality-Incomplete Emotion Recognition in Daily Healthcare', IEEE Journal of Biomedical and Health Informatics. https://doi.org/10.1109/JBHI.2024.3470338

Subject Terms: Large Language Model, Emotion Recognition, Healthcare, Multi-teacher Knowledge Distillation

Access URL: https://pubmed.ncbi.nlm.nih.gov/39348250

Lightweight Audio-Visual Wake Word Spotting With Diverse Acoustic Knowledge Distillation

Authors: Ke-Wei Li Hang Chen Jun Du et al.

Source: IEEE Transactions on Circuits and Systems for Video Technology. 35:7308-7320

Subject Terms: Audio-visual wake word spotting, cross-modality, knowledge distillation, small-footprint, teacher-student learning, deep. learning

File Description: application/pdf

Image small target detection in complex traffic scenes based on Yolov8 multiscale feature fusion

Authors: Xuguang Chai Meizhi Zhao Jing Li et al.

Source: Alexandria Engineering Journal, Vol 126, Iss, Pp 578-590 (2025)

Subject Terms: Multi-scale feature fusion, YOLOv8, Small target detection, Attention mechanism, Knowledge distillation, TA1-2040, Complex traffic scenes, Engineering (General). Civil engineering (General)

Access URL: https://doaj.org/article/b9db6aa97ae949db890f5ccedb98b88f

Distilling Clinical Scores with Symbolic Machine Learning: Frailty Index, an HIV Cohort Case Study

Authors: Guidetti V. Motta F. Milic J. et al.

Source: 2025 IEEE 13th International Conference on Healthcare Informatics (ICHI). :164-173

Subject Terms: Clinical Decision Support, Frailty Index, HIV, Knowledge Distillation, Symbolic Machine Learning, Symbolic Regression

Multi-Stage Multimodal Distillation for Audio-Visual Speaker Tracking

Authors: Li, Yidi Zhao, Wenkai Wang, Zeyu et al.

Source: ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). :1-5

Subject Terms: Knowledge Distillation, Multi-Stage Distillation, Multimodal Fusion, Speaker Tracking

File Description: application/pdf

Access URL: https://ieeexplore.ieee.org/document/10888838
https://doi.org/10.1109/ICASSP49660.2025.10888838
https://hdl.handle.net/11572/453810

Object detection with dynamic high-/low-frequency knowledge distillation for real-world degradation

Authors: Junyi Zhao Jinbao Li Xiandong Chen et al.

Source: Alexandria Engineering Journal, Vol 124, Iss, Pp 110-120 (2025)

Subject Terms: Object detection, Real-world degradation, Knowledge distillation, TA1-2040, Engineering (General). Civil engineering (General), Blind super-resolution

Access URL: https://doaj.org/article/1a1418b60e444a27ba79d8a091f6c3a4

MFD-KD: Multi-Scale Frequency-Driven Knowledge Distillation

Authors: Tao Dai Rongliang Huang Hang Guo et al.

Source: Big Data Mining and Analytics, Vol 8, Iss 3, Pp 563-574 (2025)

Subject Terms: knowledge distillation (kd), image recognition, Electronic computers. Computer science, transformer, object detection, QA75.5-76.95, frequency domain

Access URL: https://doaj.org/article/6a880c8c63bc4309940030a16383e74f

Joint optimization of AI large and small models for surface temperature and emissivity retrieval using knowledge distillation

Authors: Wang Dai Kebiao Mao Zhonghua Guo et al.

Source: Artificial Intelligence in Agriculture, Vol 15, Iss 3, Pp 407-425 (2025)

Subject Terms: Artificial intelligence, Automated machine learning, Large models, Remote sensing parameter retrieval, Agriculture, Knowledge distillation

Access URL: https://doaj.org/article/d6a26045798c4b23a348cef239f2ca87

HPCNet: Hybrid Pixel and Contour Network for Audio-Visual Speech Enhancement With Low-Quality Video

Authors: Hang Chen Chen-Yue Zhang Qing Wang et al.

Source: IEEE Journal of Selected Topics in Signal Processing. 19:671-684

Subject Terms: audio-visual, graph convolutional network, knowledge distillation, Speech enhancement, talking face generation

File Description: application/pdf

Access URL: https://hdl.handle.net/10447/678903
https://doi.org/10.1109/JSTSP.2025.3559763

Fine-tuning AI Models for code generation: Advances and applications

Authors: Sonkar, Siddhant

Source: World Journal of Advanced Research and Reviews. 26:1353-1359

Subject Terms: Security-Aware Programming, Parameter Efficiency, Adaptive Learning, Code Generation, Fine-Tuning, Knowledge Distillation

Semi-PKD: Semi-supervised Pseudoknowledge Distillation for saliency prediction

Authors: Chakkrit Termritthikun Ayaz Umer Suwichaya Suwanwimolkul et al.

Source: ICT Express, Vol 11, Iss 2, Pp 364-370 (2025)

Subject Terms: Saliency prediction, Self-training, Knowledge distillation, Information technology, T58.5-58.64, Unlabeled data

Access URL: https://doaj.org/article/0f04dbeb38f349ccb61d5684a95312e3

Joint Class and Domain Continual Learning for Decentralized Federated Processes

Authors: Chiara Lanza Tinne Tuytelaars Marco Miozzo et al.

Source: UPCommons. Portal del coneixement obert de la UPC
Universitat Politècnica de Catalunya (UPC)
IEEE Access, Vol 13, Pp 56982-56993 (2025)
IEEE Access

Subject Terms: domain incremental, Technology, STRATEGIES, Decentralized learning, Federated learning, Knowledge distillation, 46 Information and computing sciences, 09 Engineering, Engineering, Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors, 10 Technology, Àrees temàtiques de la UPC::Ensenyament i aprenentatge::TIC's aplicades a l'educació, decentralized learning, Class incremental, continual learning, 40 Engineering, Distributed learning, Science & Technology, Computer Science, Information Systems, federated learning, Engineering, Electrical & Electronic, Domain incremental, domainincremental, TK1-9971, knowledge distillation, Computer Science, Telecommunications, 08 Information and Computing Sciences, Electrical engineering. Electronics. Nuclear engineering, Continual learning, distributed learning

File Description: application/pdf

Access URL: https://doaj.org/article/5d2697745f6446569e812ec3ca5842ad

Fed-HKD: Federated Heterogeneous Model Aggregation Using Modified Knowledge Distillation

Authors: Gupta, Harshit Panda, Subham Gautam, Shubhendra et al.

Source: Procedia Computer Science. 262:831-838

Subject Terms: Federated Learning, Heterogeneous Model Aggregation, Knowledge Distillation, Privacy Preserving Image Processing

Access URL: https://hdl.handle.net/11570/3339670
https://doi.org/10.1016/j.procs.2025.03.264

Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs

Authors: Galiano Jiménez, Aarón Pérez-Ortiz, Juan Antonio Sánchez-Martínez, Felipe et al.

Contributors: Galiano Jiménez, Aarón Pérez-Ortiz, Juan Antonio Sánchez-Martínez, Felipe et al.

Source: RUA. Repositorio Institucional de la Universidad de Alicante
Universidad de Alicante (UA)

Subject Terms: Low-resource language pairs, Sequence-level knowledge distillation, Multilingual translation models

Access URL: http://hdl.handle.net/10045/153693

OneN: Guided attention for natively-explainable anomaly detection

Authors: P. Coscia A. Genovese V. Piuri et al.

Subject Terms: anomaly detection, attention mechanism, knowledge distillation, generative model, vision transformer

File Description: application/pdf

Access URL: https://hdl.handle.net/2434/1185775

E-3T: A Heterogeneous Ensemble Method with Temporal Transformers for Financial Time Series Forecasting

Authors: Graça , Tácito Henrique da Silva Santos , Alex Álisson Bandeira Pinheiro , Oberdan Rocha

Source: Revista de Gestão e Secretariado (Management and Administrative Professional Review); Vol. 16 No. 10 (2025): Revista de Gestão e Secretariado v.16, n.10, 2025; e5361
Revista de Gestão e Secretariado; Vol. 16 Núm. 10 (2025): Revista de Gestão e Secretariado v.16, n.10, 2025; e5361
Revista de Gestão e Secretariado; v. 16 n. 10 (2025): Revista de Gestão e Secretariado v.16, n.10, 2025; e5361

Subject Terms: Deep Learning, Meta-Knowledge, Temporal Transformers, Financial Series, Knowledge Distillation

File Description: application/pdf

Access URL: https://ojs.revistagesec.org.br/secretariado/article/view/5361