Enhanced Realism in Virtual Try-On Tasks Using Diffusion Methods

Virtual try-on technology is revolutionizing online retail by enabling customers to visualize garments on their bodies before purchasing. Traditional methods, often based on Generative Adversarial Networks (GANs), face challenges such as misalignment and visual artifacts, especially in complex poses...

Full description

Saved in:
Bibliographic Details
Published in:2025 11th International Conference on Computing and Artificial Intelligence (ICCAI) pp. 128 - 133
Main Authors: Kiattithapanayong, Saris, Phoomvuthisarn, Suronapee
Format: Conference Proceeding
Language:English
Published: IEEE 28.03.2025
Subjects:
Accuracy
Autoencoders
Benchmark testing
Computer architecture
ControlNet
Diffusion models
Diffusions
Kernel
Training
Vectors
Virtual Tryon
Visualization
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Virtual try-on technology is revolutionizing online retail by enabling customers to visualize garments on their bodies before purchasing. Traditional methods, often based on Generative Adversarial Networks (GANs), face challenges such as misalignment and visual artifacts, especially in complex poses. We present a virtual try-on framework leveraging diffusion models to enhance realism, accuracy, and garment detail preservation. Our approach integrates Vector Quantized Variational Autoencoders (VQ-VAEs) for precise feature matching within a diffusion U-Net architecture. By adopting image-based conditioning with the CLIP image encoder, our system utilizes visual features directly from clothing images for more faithful garment representations. Additionally, an Additional Feature Preserving Block (ControlNet) maintains intricate details like textures and logos, addressing fine-grained garment fidelity challenges. Quantitative evaluation demonstrates our system's superior performance, achieving the best LPIPS of 0.082. We also achieve a Fréchet Inception Distance (FID) of 7.782 and Kernel Inception Distance (KID) of 1.53, indicating enhanced image quality and feature alignment. Although the Structural Similarity Index Measure (SSIM) of \mathbf{0. 8 2 5} is slightly lower, it underscores the trade-off for improved realism and garment detail preservation. Our contributions set a new benchmark for accurate and realistic clothing visualization in virtual try-on systems.
DOI:10.1109/ICCAI66501.2025.00028