Wddm Ukan Cifar10 Lvl1

--- license: cc-by-nc-sa-4.0 library_name: diffusers tags: - pytorch - diffusers - unconditional-image-generation - wavelet-diffusion - U-KAN --- # A Wavelet Diffusion Framework for Accelerated Generative Modeling with Lightweight Denoisers **Authors**: Markos Aivazoglou-Vounatsos, Mostafa Mehdipour Ghazi **Abstract** Denoising diffusion models have emerged as a powerful class of deep generative models, yet they remain computationally demanding due to their iterative nature and high-dimensional input space. In this work, we propose a novel framework that integrates wavelet decomposition into diffusion-based generative models to reduce spatial redundancy and improve training and sampling efficiency. By operating in the wavelet domain, our approach enables a compact multiresolution representation of images, facilitating faster convergence and more efficient inference with minimal architectural modifications. We assess this framework using UNets and UKANs as denoising backbones across multiple diffusion models and benchmark datasets. Our experiments show that a 1-level wavelet decomposition achieves a speedup of up to three times in training, with competitive Fréchet Inception Distance (FID) scores. We further demonstrate that KAN-based architectures offer lightweight alternatives to convolutional backbones, enabling parameter-efficient generation. In-depth analysis of sampling dynamics, including the impact of implicit configurations and wavelet depth, reveals trade-offs between speed, quality, and resolution-specific sensitivity. These findings offer practical insights into the design of efficient generative models and highlight the potential of frequency-domain learning for future generative modeling research. Source code available at https://github.com/markos-aivazoglou/wavelet-diffusion. ## Architecture Overview <img src="wddpm-diffusion-new.png" alt="Architecture Overview" width="100%"> *Figure 1: Overview of the Wavelet Diffusion Model (WDDM) architecture. The model operates in the wavelet domain, leveraging wavelet decomposition to reduce spatial redundancy and improve training efficiency. The denoising backbone can be a UNet or a KAN-based architecture, allowing for flexible and efficient generative modeling.* ## 🚀 Key Features - **Efficient Training**: Up to 3x faster training compared to standard diffusion models - **Wavelet-Based Compres...

Source context: 7 downloads · 0 likes · Pipeline unconditional-image-generation · Library diffusers · Repo markos-aivazoglou/wddm-ukan-cifar10-lvl1