Hi, I am a second year Ph.D. student at Multimedia Laboratory (MMLAB), The Chinese University of Hong Kong, advised by Prof. Dahua Lin. Prior to that, I received my Bachelor’s degree in the EE Department at Nanjing University. My research interests focus on deep generative models for visual content creation.

I am always open to research collaboration & internship opportunities. Feel free to drop me an email if you are interested in working with me. :)

News

• 2024.08  We are organizing the Course on Generative Models for Visual Content Editing and Creation at SIGGRAPH 2024.
• 2024.07  SparseCtrl is accepted by ECCV 2024.
• 2023.07  🎉🎉 AnimateDiff is online.
• 2023.06  We are organizing the Third Workshop on AI for Creative Video Editing and Understanding (CVEU) at ICCV 2023.

Educations

• 2023.08 - Present  Ph.D. in Information Engineering, The Chinese University of Hong Kong
• 2019.09 - 2023.06  B.Sc. in Electronic Engineering, Nanjing University

Selected Works

*:equal contribution; †: corresponding author

Preprint

Imagine360: Immersive 360 Video Generation from Perspective Anchor

Jing Tan, Shuai Yang, Tong Wu, Jingwen He, Yuwei Guo, Ziwei Liu, Dahua Lin

[Paper]  [Project]  [Code]

Preprint

CameraCtrl: Enabling Camera Control for Video Diffusion Models

Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai Hongsheng Li, Ceyuan Yang

[Paper]  [Project]  [Code]

Preprint

SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree

Shuangrui Ding, Rui Qian, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Yuhang Cao,
Yuwei Guo, Dahua Lin, Jiaqi Wang

[Paper]  [Project]  [Code]

NeurIPS 2024 D&B Track

HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation

Zhenzhi Wang, Yixuan Li, Yanhong Zeng, Youqing Fang, Yuwei Guo, Wenran Liu, Jing Tan, Kai Chen, Tianfan Xue, Bo Dai, Dahua Lin

[Paper]  [Project]  [Code]

ECCV 2024

SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models

Yuwei Guo, Ceyuan Yang^†, Anyi Rao, Maneesh Agrawala, Dahua Lin, Bo Dai

[Paper]  [Project]  [Code]

ICLR 2024 (spotlight)

AnimateDiff: Animate Your Personalized Text-to-Image Models without Specific Tuning

Yuwei Guo, Ceyuan Yang^†, Anyi Rao, Zhengyang Liang, Yaohui Wang, Yu Qiao, Maneesh Agrawala, Dahua Lin, Bo Dai

[Paper]  [Project]  [Code (10k+ stars)]

SIGGRAPH Poster

Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Production

Anyi Rao^*, Xuekun Jiang^*, Yuwei Guo, Linning Xu, Lei Yang, Libiao Jin, Dahua Lin, Bo Dai

[Paper]  [Project]

Experiences

• Research Intern, Pika Labs, Palo Alto, USA (2024.06 - 2024.08)
  with Chenlin Meng, Omer Bar-Tal

• Research Intern, Shanghai AI Laboratory, Shanghai, China (2022.10 - 2023.08)
  with Ceyuan Yang, Bo Dai, Anyi Rao

Selected Awards

• 2023.04  Hong Kong PhD Fellowship
• 2023.04  CUHK Vice-Chancellor’s Scholarship
• 2020.10  China National Scholarship

Talks

• 2023.11  Invited talk at Kunlun 2050 Research

Reviewer

• 2025  ICML
• 2024  SIGGRAPH, ACM MM, SIGGRAPH Asia, NeurIPS, ICLR, CVPR

Teaching

• IERG4998  Final Year Project, Fall 2023
• IERG4998  Final Year Project, Spring 2024