Suchergebnisse - "Multimodal Large Language Models"

GSVA: Generalized Segmentation via Multimodal Large Language Models von Xia, Zhuofan, Han, Dongchen, Han, Yizeng, Pan, Xuran, Song, Shiji, Huang, Gao

“… Multimodal Large Language Models (MLLMs) have recently shown tremendous progress in these complicated vision-language tasks …”
Volltext

Will multimodal large language models ever achieve deep understanding of the world? von Farkaš, Igor, Vavrečka, Michal, Wermter, Stefan

“… Despite impressive performance in various tasks, large language models (LLMs) are subject to the symbol grounding problem, so from the cognitive science …”
Volltext

Can Multimodal Large Language Models Diagnose Diabetic Retinopathy from Fundus Photos? A Quantitative Evaluation von Most, Jesse A., Walker, Evan H., Mehta, Nehal N., Nagel, Ines D., Chen, Jimmy S., Russell, Jonathan F., Scott, Nathan L., Borooah, Shyamanga

“… To evaluate the diagnostic accuracy of 4 multimodal large language models (MLLMs) in detecting and grading diabetic retinopathy …”
Volltext

Analyzing the performance of multimodal large language models on visually-based questions in the Japanese National Examination for Dental Technicians von Mine, Yuichi, Taji, Tsuyoshi, Okazaki, Shota, Takeda, Saori, Peng, Tzu-Yu, Shimoe, Saiji, Kaku, Masato, Nikawa, Hiroki, Kakimoto, Naoya, Murayama, Takeshi

“… Correct response rates were calculated overall, as well as by question type (text-only vs. visually-based) and subject …”
Volltext

MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI von Yue, Xiang, Ni, Yuansheng, Zheng, Tianyu, Zhang, Kai, Liu, Ruoqi, Zhang, Ge, Stevens, Samuel, Jiang, Dongfu, Ren, Weiming, Sun, Yuxuan, Wei, Cong, Yu, Botao, Yuan, Ruibin, Sun, Renliang, Yin, Ming, Zheng, Boyuan, Yang, Zhenzhu, Liu, Yibo, Huang, Wenhao, Sun, Huan, Su, Yu, Chen, Wenhu

“… We introduce MMMU: a new benchmark designed to evaluate multimodal models on massive multi-discipline tasks demanding college-level subject knowledge and deliberate reasoning. MMMU includes …”
Volltext

Towards Zero-Shot Differential Morphing Attack Detection with Multimodal Large Language Models von Shekhawat, Ria, Li, Hailin, Ramachandra, Raghavendra, Venkatesh, Sushma

“… Leveraging the power of multimodal large language models (LLMs) offers a promising approach to enhancing the accuracy and interpretability of morphing attack detection (MAD …”
Volltext

GSVA: Generalized Segmentation via Multimodal Large Language Models von Xia, Zhuofan, Han, Dongchen, Han, Yizeng, Pan, Xuran, Song, Shiji, Huang, Gao

“… Multimodal Large Language Models (MLLMs) have recently shown tremendous progress in these complicated vision-language tasks …”
Volltext

Kosmos-G: Generating Images in Context with Multimodal Large Language Models von Pan, Xichen, Li, Dong, Huang, Shaohan, Peng, Zhiliang, Chen, Wenhu, Furu Wei

“… " This paper presents Kosmos-G, a model that leverages the advanced multimodal perception capabilities of Multimodal Large Language Models (MLLMs …”
Volltext

Gemini Goes to Med School: Exploring the Capabilities of Multimodal Large Language Models on Medical Challenge Problems & Hallucinations von Pal, Ankit, Sankarasubbu, Malaikannan

“… Large language models have the potential to be valuable in the healthcare industry, but it's crucial to verify their safety and effectiveness through rigorous …”
Volltext

An fMRI visual neural encoding method with multimodal large language model von Ma, Shuxiao, Wang, Linyuan, Hou, Libin, Hou, Senbao, Yan, Bin

“… •In summary, our contributions are primarily threefold:.•To our knowledge, we establish the first multimodal framework combining MLLM with fMRI visual neural …”
Volltext

Coherent Interpretation of Entire Visual Field Test Reports Using a Multimodal Large Language Model (ChatGPT) von Tan, Jeremy C. K.

“… Single-page anonymised VF test reports from 60 eyes of 60 subjects were analysed by an LLM (ChatGPT 4o …”
Volltext

Art appreciation based on graph retrieval augmented generation and few-shot learning von LIU Tianyang, KOU Sijia, JIN Xu, WANG Wenjing, LU Xuesong

“… In this case, using multimodal large language models to tutor students in art appreciation has become a potential alternative …”
Volltext

Glaucoma Detection and Structured OCT Report Generation via a Fine-tuned Multimodal Large Language Model von Jalili, Jalil, Gavhane, Yashraj, Walker, Evan, Heinke, Anna, Bowd, Christopher, Belghith, Akram, Fazio, Massimo A, Girkin, Christopher A, De Moraes, C Gustavo, Liebmann, Jeffrey M, Baxter, Sally L, Weinreb, Robert N, Zangwill, Linda M, Christopher, Mark

“… To develop an explainable multimodal large language model (MM-LLM) that (1) screens optic nerve head (ONH …”
Volltext

Art appreciation based on graph retrieval augmented generation and few-shot learning von LIU Tianyang, KOU Sijia, JIN Xu, WANG Wenjing, LU Xuesong

“… In this case, using multimodal large language models to tutor students in art appreciation has become a potential alternative …”
Volltext

Visual Commonsense Causal Reasoning From a Still Image von Wu, Xiaojing, Guo, Rui, Li, Qin, Zhu, Ning

“… Even from a still image, humans exhibit the ability to ratiocinate diverse visual cause-and-effect relationships of events preceding, succeeding, and extending …”
Volltext

Glaucoma Detection and Feature Identification via GPT-4V Fundus Image Analysis von Jalili, Jalil, Jiravarnsirikul, Anuwat, Bowd, Christopher, Chuter, Benton, Belghith, Akram, Goldbaum, Michael H., Baxter, Sally L., Weinreb, Robert N., Zangwill, Linda M., Christopher, Mark

“… Evaluation of multimodal large language models for reviewing fundus images in glaucoma. A total of 300 fundus images from 3 public datasets …”
Volltext

Deep Composer: Improving the String Quartet Music Generation Task von Galajda, Jacob Edward, Bach, Van Hoang Bao, Hua, Kien

“… Large Language Models (LLMs) have the capacity to create new pieces of music, however, generating high quality samples in specific genres and instrumentation …”
Volltext

Mv-Math: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts von Wang, Peijie, Li, Zhong-Zhi, Yin, Fei, Ran, Dekang, Liu, Cheng-Lin

“… Multimodal Large Language Models (MLLMs) have shown promising capabilities in mathematical reasoning within visual contexts across various datasets …”
Volltext

An autonomous AI agent for universal behavior analysis von Aljović, Almir, Lin, Zuwan, Wang, Wenbo, Zhang, Xinhe, Marin-Llobet, Arnau, Liang, Ningyue, Canales, Bradley, Lee, Jaeyong, Baek, Jongmin, Liu, Ren, Li, Catherine, Li, Na, Liu, Jia

“… Unlike conventional methods that require manual behavior annotation, video segmentation, task-specific model training, BehaveAgent leverages the reasoning capabilities of multimodal large language models (LLM …”
Volltext

Instruction-based Image Manipulation by Watching How Things Move von Cao, Mingdeng, Zhang, Xuaner, Zheng, Yinqiang, Xia, Zhihao

“… This paper introduces a novel dataset construction pipeline that samples pairs of frames from videos and uses multimodal large language models (MLLMs …”
Volltext