Photo of Me

Zhaoyang Huang

黄昭阳

I am a Ph.D. student at CUHK, MMLab, advised by Prof. Hongsheng Li and Prof. Xiaogang Wang. Before that, I got my master degree and bachelor degree from Zhejiang University. I had a great research experience working in the ZJU-3DV group of State Key Lab of CAD&CG, Zhejiang University, advised by Prof. Guofeng Zhang and Prof. Xiaowei Zhou. I am interested in correspondence learning and generative models.

Experience

  • Ph.D in Electronic Engineering at MMLab of The Chinese University of Hong Kong.
  • M.Eng in Computer Science at State Key Lab of CAD & CG of Zhejiang University.
  • B.Eng. in Computer Science at Zhejiang University.
  • Research intern at NVIDIA, Hong Kong.
  • Research intern at Sensetime, Hangzhou.
  • Research intern at Siemens, Suzhou/Beijing.
  • Recent News

  • We release BlinkFlow, the first large-scale dataset for event-based optical flow.
  • Our VideoFlow, FlowFormer++, and FlowFormer occupies the TOP 3 places in the Sintel Optical Flow benchmark among published papers.
  • Publication

    Context-TAP: Tracking Any Point Demands Spatial Context Features
    NeurIPS
    Spotlight 2023
    Weikang Bian*, Zhaoyang Huang*, Xiaoyu Shi, Yitong Dong, Yijin Li, Hongsheng Li
    Paper Project Page
    DiffRoom: Diffusion-based High-Quality 3D Room Reconstruction and Generation with Occupancy Prior
    Arxiv 2023
    Xiaoliang Ju*, Zhaoyang Huang*, Yijin Li, Guofeng Zhang, Yu Qiao, Hongsheng Li
    Paper Project Page
    VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation
    ICCV 2023
    Ranks 1st on Sintel Optical Flow benchmark on Mar. 15th, 2023
    VideoFlow reduces the optical flow error of Sintel Clean to the sub-pixel level for the first time
    Xiaoyu Shi, Zhaoyang Huang*, Weikang Bian, Dasong Li, Manyuan Zhang, Kachun Cheung, Simon See, Hongwei Qin, Jifeng Dai, Hongsheng Li*
    Paper
    BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimation
    IROS 2023
    The first large-scale dataset for event-based optical flow.
    Yijin Li*, Zhaoyang Huang*, Shuo Chen, Xiaoyu Shi, Hongsheng Li, Hujun Bao, Zhaopeng Cui, Guofeng Zhang
    Paper
    pats-png
    PATS: Patch Area Transportation with Subdivision for Local Feature Matching
    CVPR 2023
    Junjie Ni, Yijin Li, Zhaoyang Huang, Hongsheng Li, Hujun Bao, Zhaopeng Cui, Guofeng Zhang
    Paper Project Page
    FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation
    CVPR 2023
    Ranks 1st on Sintel Optical Flow benchmark on Mar. 1th, 2023
    Xiaoyu Shi*, Zhaoyang Huang*, Dasong Li, Manyuan Zhang, Kachun Cheung, Simon See, Hongwei Qin, Jifeng Dai, Hongsheng Li
    Paper
    pats-png
    NeuralMarker: A Framework for Learning General Marker Correspondence
    ACM Transactions on Graphics (SIGGRAPH Asia 2022)
    Zhaoyang Huang*, Xiaokun Pan*, Weihong Pan, Weikang Bian, Yan Xu, Ka Chun Cheung, Guofeng Zhang, Hongsheng Li
    Paper Project Page Code
    cgof-png
    Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields
    NIPS 2022
    Keqiang Sun, Shangzhe Wu, Zhaoyang Huang, Ning Zhang, Quan Wang, HongSheng Li
    Paper Project Page Code
    FlowFormer: A Transformer Architecture for Optical Flow
    ECCV 2022
    Ranks 1st on Sintel Optical Flow benchmark on Mar. 17th, 2022
    Zhaoyang Huang*, Xiaoyu Shi*, Chao Zhang, Qiang Wang, Kachun Cheung, Hongwei Qin, Jifeng Dai, Hongsheng Li
    Paper Supp Project Page Code
    life-png
    LIFE: Lighting Invariant Flow Estimation
    A previous version of NeuralMarker
    Zhaoyang Huang*, Xiaokun Pan*, Runsen Xu, Yan Xu, Kachun Cheung, Guofeng Zhang, Hongsheng Li
    Paper Project Page Code
    vs-png
    VS-Net: Voting with Segmentation for Visual Localization
    CVPR 2021
    Zhaoyang Huang*, Han Zhou*, Yijin Li, Bangbang Yang, Yan Xu, Xiaowei Zhou, Hujun Bao, Guofeng Zhang, Hongsheng Li
    Paper Project Page Code
    voxelo-png
    SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networks
    CoRL 2020
    Yan Xu, Zhaoyang Huang, Kwan-Yee Lin, Xinge Zhu, Jianping Shi, Hujun Bao, Guofeng Zhang, Hongsheng Li
    Paper
    pats-png
    NIID-Net: Adapting Surface Normal Knowledge for Intrinsic Image Decomposition in Indoor Scenes
    TVCG 2020
    Jundan Luo*, Zhaoyang Huang*, Yijin Li, Xiaowei Zhou, Guofeng Zhang, Hujun Bao
    Paper Project Page Code
    pgd-png
    Prior Guided Dropout for Robust Visual Localization in Dynamic Environments
    ICCV 2019
    Zhaoyang Huang, Yan Xu, Jianping Shi, Xiaowei Zhou, Hujun Bao, Guofeng Zhang
    Paper Code Poster

    Honors

  • National Scholarship
  • Outstanding Graduate award