Menghan Xia Researcher Tencent AI Lab Shenzhen, Guangdong, China Email: menghanxyz@gmail.com Github    ResearchGate    ResourcePage

About Me

I am a researcher at Visual Computing Center of Tencent AI Lab. My research interest lies in computer vision and deep learning, especially image/video generation & translation. Currently I focus on foundation generative models (AIGC), multimodal learning, and facial motion synthesis.

I obtained my Ph.D. degree in Computer Science and Engineering from The Chinese University of Hong Kong (CUHK) in 2021, supervised by Prof. Tien-Tsin Wong. Before that, I got the B.Eng. degree in Photogrammetry and Remote Sensing in 2014 and M.Eng. degree in Pattern Recognition and Intelligent System in 2017, both from Wuhan University, under the supervision of Prof. Jian Yao. During my Ph.D. period, I had one-year collaboration with Adobe Research since March 2019, and took a research internship at Microsoft Research Asia (MSRA) in 2021 summer.

Publications [check full list]

✦ Conference

• Interactive Story Visualization with Multiple Characters
  Yuan Gong, Youxin Pang, Xiaodong Cun, Menghan Xia, Yingqing He, Haoxin Chen, Longyue Wang, Yong Zhang, Xintao Wang, Ying Shan and Yujiu Yang.
  SIGGRAPH Asia (Conference Track), 2023.
  Project Code
• CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
  Jinbo Xing, Menghan Xia, Yuechen Zhang, Xiaodong Cun, Jue Wang, Tien-Tsin Wong.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  Project Code
• CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Querying
  Weihuang Liu, Xiaodong Cun, Chi-Man Pun, Menghan Xia, Yong Zhang, and Jue Wang.
  AAAI Conference on Artificial Intelligence (AAAI), 2023.
  Code
• Disentangled Image Colorization via Global Anchors
  Menghan Xia, Wenbo Hu, Tien-Tsin Wong, Jue Wang.
  SIGGRAPH Asia (special issue of ACM Transactions on Graphics), 2022.
  Project Presentation Code Demo
• VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
  Kun Cheng, Xiaodong Cun, Yong Zhang, Menghan Xia, Xuan Wang, Fei Yin, Mingrui Zhu, Jue Wang, Nannan Wang.
  SIGGRAPH Asia (Conference Track), 2022.
  Code
• PalGAN: Image Colorization with Palette Generative Adversarial Networks
  Yi Wang, Menghan Xia, Lu Qi, Jing Shao, Yu Qiao.
  European Conference on Computer Vision (ECCV), 2022.
  
• Deep Halftoning with Reversible Binary Pattern
  Menghan Xia, Wenbo Hu, Xueting Liu, Tien-Tsin Wong.
  IEEE International Conference on Computer Vision (ICCV), 2021.
  Project Code Demo
• Exploiting Aliasing for Manga Restoration
  Minshan Xie*, Menghan Xia*, Tien-Tsin Wong.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  Project Code
• Seamless Manga Inpainting with Semantics Awareness
  Minshan Xie, Menghan Xia, Xueting Liu, Chengze Li, Tien-Tsin Wong.
  SIGGRAPH (special issue of ACM Transactions on Graphics), 2021.
  Project Code
• Mononizing Binocular Videos
  Wenbo Hu, Menghan Xia, Chi-Wing Fu, Tien-Tsin Wong.
  SIGGRAPH Asia (special issue of ACM Transactions on Graphics), 2020.
  Project Code
• Colorblind-Shareable Videos by Synthesizing Temporal-Coherent Polynomial Coefficients
  Xinghong Hu, Xueting Liu, Zhuming Zhang, Menghan Xia, Chengze Li, Tien-Tsin Wong.
  SIGGRAPH Asia (special issue of ACM Transactions on Graphics), 2019.
  Project
• Invertible Grayscale
  Menghan Xia, Xueting Liu, Tien-Tsin Wong.
  SIGGRAPH Asia (special issue of ACM Transactions on Graphics), 2018.
  Project Code
• Color Consistency Correction Based on Remapping Optimization for Image Stitching
  Menghan Xia, Jian Yao, Renping Xie, Mi Zhang, Jinsheng Xiao.
  IEEE International Conference on Computer Vision Workshops (ICCVW), 2017.
  Code
• Line-Based Multi-Label Energy Optimization for Fisheye Image Rectification and Calibration
  Mi Zhang, Jian Yao, Menghan Xia, Kai Li, Yi Zhang, Yaping Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  

✦ Journal

• Scale-Arbitrary Invertible Image Downscaling
  Jinbo Xing, Wenbo Hu, Menghan Xia, Tien-Tsin Wong.
  IEEE Transactions on Image Processing (TIP), 2023 Early access.
  
• Taming Reversible Halftoning via Predictive Luminance
  Cheuk-Kit Lau, Menghan Xia, Tien-Tsin Wong.
  IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023 Early access.
  
• LF2MV: Learning An Editable Meta-View Towards Light Field Representation
  Menghan Xia, Jose Echevarria, Minshan Xie, Tien-Tsin Wong.
  IEEE Transactions on Visualization and Computer Graphics (TVCG), 2022 Early access.
  Code Video
• Jointly Optimizing Global and Local Color Consistency for Multiple Image Mosaicking
  Li Li, Menghan Xia, Chi Liu, Liang Li, Hanyun Wang, Jian Yao.
  ISPRS Journal of Photogrammetry and Remote Sensing (ISPRS), 170:45-56, 2020.
• A Closed-Form Solution for Multi-view Color Correction with Gradient Preservation
  Menghan Xia, Jian Yao, Zhi Gao.
  ISPRS Journal of Photogrammetry and Remote Sensing (ISPRS), 157:188-200, 2019.
  Code
• Guided Color Consistency Optimization for Image Mosaicking
  Renping Xie, Menghan Xia, Jian Yao, Li Li.
  ISPRS Journal of Photogrammetry and Remote Sensing (ISPRS), 135:43-59, 2018.
• Globally Consistent Alignment for Planar Mosaicking via Topology Analysis
  Menghan Xia, Jian Yao, Renping Xie, Li Li, Wei Zhang.
  Pattern Recognition (PR), 66:239-252, 2017.
  Project Code

Academic Services

• Conference Review:
  International Joint Conference on Artificial Intelligence (IJCAI) 2020.
  ACM SIGGRAPH 2019,2023.
  ACM SIGGRAPH Asia 2023.
  Pacific Graphic 2019,2023.
  Computer Graphics International 2019~2020.
  International Conference on Computer Vision and Pattern Recognition (CVPR) 2021~2023.
  International Conference on Computer Vision (ICCV) 2021,2023.
  European Conference on Computer Vision (ECCV) 2022.
  
• Journal Review:
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  IEEE Transaction on Image Processing (TIP)
  IEEE Transaction on Multimedia (TMM)
  Computer Graphics Forum (CGF)
  The Visual Computer (TVC)
  

Selected Awards

• Outstanding Graduate Award (Postgraduate), Wuhan University, 2017.
• First-class Scholarship of Wuhan University, 2016.
• Microsoft Aerial Photogrammetry Scholarship, Wuhan University, 2015.
• Postgraduate Freshman Scholarship, Wuhan University, 2014.
• Outstanding Graduate Award (Undergraduate), Wuhan University, 2014.
• Outstanding Students Award, Wuhan University, 2011~2012.

---

©Menghan Xia  •  Updating Constantly