Hi, I am a second year Ph.D. student at Multimedia Laboratory (MMLAB), The Chinese University of Hong Kong, advised by Prof. Dahua Lin. Prior to that, I received my Bachelor’s degree in the EE Department at Nanjing University. My research interests focus on deep generative models for visual content creation.

I am open to research collaboration and internship opportunities. Feel free to drop me an email if you are interested in working with me. :)

News

2024.08 We are organizing the Course on Generative Models for Visual Content Editing and Creation at SIGGRAPH 2024.
2024.07 SparseCtrl is accepted by ECCV 2024.
2023.07 🎉🎉 AnimateDiff is online.
2023-06 We are organizing the Third Workshop on AI for Creative Video Editing and Understanding (CVEU) at ICCV 2023.

Educations

2023.08 - Present Ph.D. in Information Engineering, The Chinese University of Hong Kong
2019.09 - 2023.06 B.Sc. in Electronic Engineering, Nanjing University

*:equal contribution; †: corresponding author

ECCV 2024

SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models

[Paper] [Project] [Code]

ICLR 2024 (spotlight)

AnimateDiff: Animate Your Personalized Text-to-Image Models without Specific Tuning

[Paper] [Project] [Code (10k+ stars)]

SIGGRAPH Poster

Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Production

[Paper] [Project]

Research Intern, Pika Labs, Palo Alto, USA (2024.06 - 2024.08)
with Chenlin Meng, Omer Bar-Tal
Research Intern, Shanghai AI Laboratory, Shanghai, China (2022.10 - 2023.08)
with Ceyuan Yang, Bo Dai, Anyi Rao