Fusion Lab: Generative Vision Lab of Fudan University and SII ORG

[ECCV 2024] Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation

A research AI tool that takes a still portrait photo and an audio clip and generates a short video of that face speaking or singing in sync with the audio, running on a GPU with pretrained models from HuggingFace.

[ICLR 2025] Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation

[AAAI 2025] Dynamic Protein Data Bank

[CVPR 2025] Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer

[CVPR 2025] A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation

[ICCV2025 Highlight] DicFace: Dirichlet-Constrained Variational Codebook Learning for Temporally Coherent Video Face Restoration

[CVPR 2026] WAM-Flow: Parallel Coarse-to-Fine Motion Planning via Discrete Flow Matching for Autonomous Driving

WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving

Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation

Bridging AutoRegressive and Diffusion Vision-Language Models

Course: Diffusion Generative AI for Computer Vision and Science

[SIGGRAPH Asia 2025] Hallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimization

[CVPR 2026] MixFlow Training: Alleviating Exposure Bias with Slowed Interpolation Mixture

[ICML 2026] Alleviating Prompt Forgetting in Multimodal Diffusion Transformers

[ICLR 2026] Pyramidal Patchification Flow for Visual Generation (PPFlow)

LaPha: Latent Poincaré Shaping for Agentic Reinforcement Learning

Spatiotemporally Coherent Generative Emulation of Protein Dynamics Across Timescales with DyneTrion

No description.