Jia-Bin Huang
More about me: CV | CV of Failures | Awesome Tips | YouTube | Twitter/X | BlueSky
Current teaching
Spring 2026: CSMSC426 Computer Vision
Spring 2026: CSMSC800 How to Conduct Great Research
Past teaching and evaluations
Fall 2025: CMSC848K Multimodal Foundation Models
Spring 2025: CMSC426 Computer Vision | Student evaluation
Spring 2025: CMSC800 How to Conduct Great Research | Student evaluation
Fall 2024: CMSC848K Multimodal Foundation Models | Student evaluation (MS) | Student evaluation (PhD)
Prospective Ph.D. students starting in Fall 2026:
If you are not at UMD: We will be recruiting highly motivated Ph.D. students to join our lab. Please apply through the CS department and include my name as a potential advisor in your application.
If you are already a UMD student, please email me your CV, prior experiences, and how you would like to get involved.
Questions? Check out my answers to the Ph.D. Advisor Guide.
Prospective short-term students:
If you are undergraduate/gradudate students at UMD or at external institute looking to work on research with us, please fill the form. We will contact you if there is a match. (Please submit the form again if you used the old version before. Sorry!)
Prospective Undergraduate Students at UMD: Interested in engaging with computer vision research? Please fill out the form. My email inbox is flooded with various requests that I cannot handle. We will review the form and reach out via email if there is a match.
Prospective Faculty at UMD: The CS department is hiring multiple faculty! Find out more here. Please feel free to reach out if you have any questions.
Research Group
PhD students
 |
 |
 |
 |
| Yao-Chih Lee | Vinayak Gupta | Yue Feng | Yi-Ting Chen |
 |
 |
 |
 |
| Ting-Hsuan Liao | Hadi Alzayer | Seungjae (Jay)Lee | Kevin Zhang |
| (with Furong Huang) | (with Christopher Metzler) | ||
 |
 |
 | |
| Quynh Phung | Haowen Liu | Grace Su | |
Undergraduate students
Alumni
Former PhD Students
Jinwoo Choi, PhD 2020, now an Assistant Professor at Kyung Hee Univeristy
Badour AlBahar, PhD 2022, now an Assistant Professor at Kuwait University
Chen Gao, PhD 2022, now a Research Scientist at Meta
Yuliang Zou, PhD 2022, now a Research Scientist at Waymo
Yiran Xu, PhD 2025, next a Research Scientist at Adobe Research
Songwei Ge, PhD 2025, (with David Jacobs), now Research Scientist at Reve
Former MS/BS Students
At University of Maryland College Park
Sanjali Yadav, next a PhD student at University of Maryland College Park.
Vaibhav Sanjay, next a MSR student at Carnegie Mellon University
At Virginia Tech
Esther Robb (MS 2021), next a PhD student at Stanford University.
Joseph Messou (MS 2020), next a PhD student at University of Maryland College Park.
Shih-Yang Su (MS 2020), next a PhD student at University of British Columbia.
Subhashree Radhakrishnan (MS 2018), next a Deep Learning Software Engineeer at NVIDIA.
Po-Han Huang (MS 2018), next a Deep Learning Software Engineeer at NVIDIA.
Sanket Lokegaonkar (MS 2018), next a Software Engineeer at Amazon AWS.
Adithya Nallabolu (MS 2017), next a Computer Vision R&D Engineer at Qualcomm.
At University of Illinois, Urbana-Champaign
Le Wang (BS 2014), next MS at Stanford, next ASIC/RTL Designer at Google.
Michael Qiu (BS 2014), next Senior Data Engineer at Capital One.
Anarghya Mitra (BS 2014), next Software Engineer at Google.
Zelun Luo (BS 2013), next a PhD student at Stanford University.
JunYoung Gwak (BS 2013), next a PhD student at Stanford University.
Danyang (Mike) Wang (BS 2012), next Analog Design Engineer at Analog Devices.
Linjia Chang (BS 2012), next MS at UIUC, now technical marketing engineer at Intel.
Sakshi Srivastava (BS 2012), next PhD student at UIUC.
Kevin Han (BS 2012), next PhD at UC Berkeley, now Senior Engineer at Pinnacle Photonics.
Former Interns
Yu-Ying Yeh, PhD student at University of California San Diego.
Yu-Lun Liu, PhD student at National Taiwan University, now at Assistant Professor at National Yang Ming Chiao Tung University.
Ishit Mehta, PhD student at University of California San Diego.
Chris Rockwell, PhD student at University of Michigan Ann Arbor.
Benjamin Attal, PhD student at Carnegie Mellon University.
Andreas Meuleman, PhD student at KAIST.
Xiaoming Zhao, PhD student at UIUC.
Badour AlBahar, PhD student at Virginia Tech.
Geng Lin, PhD student at University of Maryland College Park.
Chen Gao, PhD student at Virginia Tech, now Resarch Scientist at Meta.
Wenqi Xian, PhD student at Cornell Tech.
Xuan Luo, PhD student at University of Washington, now Resarch Scientist at Google.
Former Visiting Students
Ting-I Hsieh (Intern 2020)
Yun-Chun Chen (Intern 2019), next PhD student at University of Toronto.
Chieh Hubert Lin (Intern 2019), next PhD student at UC Merced.
Meng-Li Shih (Intern 2018), next PhD student at University of Washington.
Jin-Dong Dong (Intern 2018), next PhD student at Carnegie Mellon University.
Wei-Yu Chen (Intern 2018), next PhD student at Carnegie Mellon University.
Chen Gao (Intern 2018), next PhD student at Virginia Tech.
Yen-Chen Lin (Intern 2017), next PhD student at MIT.
Hao-Wei Yeh (Intern 2017), next PhD student at University of Tokyo.
Publications
Generative Refocusing: Flexible Defocus Control from a Single Image
Chun-Wei Tuan Mu,
Jia-Bin Huang,
Yu-Lun Liu
arXiv 2025
[Paper (PDF)]
[Project page]
[Code]
[Demo]
Generative Video Motion Editing with 3D Point Tracks
Yao-Chih Lee,
Zhoutong Zhang,
Jiahui Huang,
Jui-Hsien Wang,
Joon-Young Lee,
Jia-Bin Huang,
Eli Shechtman,
Zhengqi Li
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
[Paper (PDF)]
[Project page]
|
TraceGen: World Modeling in 3D Trace-Space Enables Learning from Cross-Embodiment Videos |
Generative Omnimatte: Learning to Decompose Video into Layers
Yao-Chih Lee,
Erika Lu,
Sarah Rumbley,
Michal Geyer,
Jia-Bin Huang,
Tali Dekel,
Forrester Cole
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025
[Paper (PDF)]
[Project page]
Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variation
Hadi Alzayer,
Philipp Henzler,
Jonathan T. Barron,
Jia-Bin Huang,
Pratul P. Srinivasan,
Dor Verbin
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025
[Paper (PDF)]
[Project page]
|
Textured Gaussians for Enhanced 3D Scene Appearance Modeling |
 |
IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images |
|
Large Inverse Rendering Model for Reconstruction of Shape, Materials and Realistic Radiance Field |
Expressive Text-to-Image Generation with Rich Text
Songwei Ge,
Taesung Park,
Jun-Yan Zhu,
Jia-Bin Huang
International Journal of Computer Vision (IJCV), 2025
[Paper (PDF)]
[Project page]
[Code]
[Demo]
Illusion3D: 3D Multiview Illusion with 2D Diffusion Priors
Yue Feng,
Vaibhav Sanjay,
Spencer Lutz,
Badour AlBahar,
Songwei Ge,
Jia-Bin Huang
arXiv preprint 2024
[Paper (PDF)]
[Project page]
Fast View Synthesis of Casual Videos with Soup-of-Planes
Yao-Chih Lee,
Zhoutong Zhang,
Kevin Blackburn-Matzen,
Simon Niklaus,
Jianming Zhang,
Jia-Bin Huang,
Feng Liu
European Conference on Computer Vision (ECCV) 2024
[Paper (PDF)]
[Project page]
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion
Yu-Ying Yeh,
Jia-Bin Huang,
Changil Kim,
Lei Xiao,
Thu Nguyen-Phuoc,
Numair Khan,
Cheng Zhang,
Manmohan Chandraker,
Carl S Marshall,
Zhao Dong,
Zhengqin Li
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[Paper (PDF)]
[Project page]
[Code]
[Demo]
Grounded Text-to-Image Synthesis with Attention Refocusing
Quynh Phung,
Songwei Ge,
Jia-Bin Huang
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[Paper (PDF)]
[Project page]
[Code]
[Demo]
 |
FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis |
 |
LTM: Lightweight Textured Mesh Reconstruction of Unbounded Scenes Using Neural Fields |
Single-Image 3D Human Digitization with Shape-Guided Diffusion
Badour AlBahar,
Shunsuke Saito,
Hung-Yu Tseng,
Changil Kim,
Johannes Kopf,
Jia-Bin Huang
ACM SIGGRAPH Asia 2023 (Conference track)
[Paper (PDF)]
[Project page]
[Code]
Visualizing Subtle Motions from Time-Varying Radiance Fields
Brandon Yushan Feng,
Hadi AlZayer,
Michael Rubinstein,
William T. Freeman,
Jia-Bin Huang
Proceedings of International Conference on Computer Vision (ICCV), 2023
[Paper (PDF)]
[Project page]
[Code]
[Demo]
Expressive Text-to-Image Generation with Rich Text
Songwei Ge,
Taesung Park,
Jun-Yan Zhu,
Jia-Bin Huang
Proceedings of International Conference on Computer Vision (ICCV), 2023
[Paper (PDF)]
[Project page]
[Code]
[Demo]
ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field
Yuan Li,
Zhi-Hao Lin,
David Forsyth,
Jia-Bin Huang,
Shenlong Wang
Proceedings of International Conference on Computer Vision (ICCV), 2023
[Paper (PDF)]
[Project page]
[Code]
Dynamic Mesh-Aware Radiance Fields
Yi-Ling Qiao,
Alexander Gao,
Yiran Xu,
Yue Feng,
Jia-Bin Huang,
Ming C. Lin
Proceedings of International Conference on Computer Vision (ICCV), 2023
[Paper (PDF)]
[Project page]
[Code]
 |
Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models |
 |
Neural-PBIR Reconstruction of Shape, Material, and Illumination |
DC2: Dual-Camera Defocus Control by Learning to Refocus
Hadi Alzayer,
Abdullah Abuolaim,
Leung Chun Chan,
Yang Yang,
Ying Chen Lou,
Jia-Bin Huang,
Abhishek Kar
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[Paper (PDF)]
[Project page]
[Video]
[Two Minutes Paper]
HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling
Benjamin Attal,
Jia-Bin Huang,
Christian Richardt,
Michael Zollhoefer,
Johannes Kopf,
Matthew O'Toole,
Changil Kim
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Highlight)
[Paper (PDF)]
[Project page]
[Code]
[Video]
Consistent View Synthesis with Pose-Guided Diffusion Models
Hung-Yu Tseng,
Qinbo Li,
Changil Kim,
Suhib Alsisan,
Jia-Bin Huang,
Johannes Kopf
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[Paper (PDF)]
[Project page]
[Video]
[Code]
Progressively Optimized Local Radiance Fields for Robust View Synthesis
Andreas Meuleman,
Yu-Lun Liu,
Chen Gao,
Jia-Bin Huang,
Changil Kim,
Min H. Kim,
Johannes Kopf
Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[Paper (PDF)]
[Project page]
[Code]
[Video]
 |
A Safety-Performance Metric Enabling Computational Awareness in Autonomous Robots |
Learning to See Through Obstructions with Layered Decomposition
Yu-Lun Liu,
Wei-Sheng Lai,
Ming-Hsuan Yang,
Yung-Yu Chuang,
Jia-Bin Huang
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2021
[Paper (PDF)]
[Project page]
[Code]
[Colab notebook]
News coverage: [New Scientists]
Using meta-learning to enable faster layered decomposition with test-time optimization.
|
Space-time Neural Irradiance Fields for Free-Viewpoint Video Learning spatiotemporal NeRF for dynamic scenes from a single video is ambiguious, but we can constrain the disambiute it using scene depth. |
 |
Visual Analysis and Synthesis with Physically Grounded Constraints |
Open Office Hour
I set aside some time some weeks to meet with anyone (preferrably students from underrepresented groups). Free free to sign up below if you would like to chat with me on any topics.
Recent talks
| 02/25/2026 | Invited talk at UIUC CS |
| 02/24/2026 | Keynote talk at UIUC CSL Student Conference |
| 02/20/2026 | Keynote talk at UVA Symposium on Computer and Autonomous Vision Systems |
| 02/17/2026 | Invited talk at MIT CSAIL |
| 06/18/2024 | Invited talk at CVPR 2024 workshop on Implicit Neural Representation for Vision |
| 06/18/2024 | Invited talk at CVPR workshop on The Future of Generative Visual Art |
| 06/18/2024 | Invited talk at CVPR workshop on SyntaGen: Harnessing Generative Models for Synthetic Visual Datasets |
| 06/17/2024 | Invited talk at CVPR workshop on Computer Vision for Fashion, Art, and Design |
| 12/06/2023 | Adobe GenTech seminar |
| 12/08/2022 | GRAIL Vision Seminar at University of Washington |
| 12/05/2022 | Faculty Job Workshop at University of Maryland College Park [Slides] |
| 11/21/2022 | Computer Science and Engineering AI Seminar at Ohio State University |
| 11/18/2022 | Invited guest lecture in CS197 at Harvard University [Slides] |
| 11/18/2022 | CS Department Seminar at Virginia Tech |
| 10/14/2021 | Invited talk at 2021 華仁全球講座 (Host: Jenq-Neng Hwang) |
| 08/26/2021 | Invited talk at Graphics And Mixed Environment Seminar (Host: Jun-Yan Zhu) |
| 07/20/2021 | Invited talk at School of Computer Science, Tel Aviv University (Host: Daniel Cohen-Or) |
| 07/13/2021 | Invited talk at VGG seminar, University of Oxford |
| 07/07/2021 | Invited talk at IMAGINE lab, Ecole des Ponts ParisTech |
| 05/10/2021 | Invited talk at National Yang Ming Chiao Tung University |
| 04/23/2021 | Invited talk at UT Austin (Host: Zhangyang Wang) |
| 04/20/2021 | School of Interactive Computing Seminar at Georgia Tech (Host: Frank Dellaert) |
| 04/08/2021 | CS Colloquium at Cornell University (Host: Noah Snavely) |
| 04/05/2021 | ECE Seminar at the University of Michigan |
| 03/29/2021 | CS Colloquium at University of Maryland (Host: Abhinav Shrivastava) |
| 03/22/2021 | CS Colloquium at University of North Carolina Chapel Hill (Host: Mohit Bansal) |
| 02/26/2021 | EECS Department Seminar at UC Merced (Host: Ming-Hsuan Yang) |
| 02/05/2021 | 3M Non-Tenured Faculty Award Symposium |
| 02/02/2021 | Visual Information Laboratory Seminar, University of Bristol (Host: Dima Damen) |
| 01/26/2021 | Computer Vision Seminar, University of Illinois, Urbana-Champaign |
| 01/20/2021 | 3D Representations Reading Group at MIT [Video] [Slides] |
Highlights and News
| 04 / 2024 | Thanks Qualcomm for the Research Award! |
| 04 / 2024 | Thanks Google for the Research Scholar Award! |
| 09 / 2022 | Thanks Adobe, Meta, Google for the gift donation. |
| 06 / 2021 | Thanks Virginia’s Commonwealth Cyber Initiative for the grants on Detecting Disinformation and Misinformation (with Ruoxi Jia Adrienne Ivory) |
| 04 / 2021 | Thanks Center for Human-Computer Interaction for the Planning Grants for Large-scale Research Efforts(with Douglas Bowman, Joe Gabbard,Nazila Roofigari-Esfahan, and Hoda Eldardiry) |
| 04 / 2021 | Congrats to Esther and Meng-Li for getting into top PhD programs!Esther will join CS@Stanford University. Meng-Li will join CSE @ University of Washington. |
| 08 / 2020 | Thanks Facebook and Adobe for the gift donation. |
| 08 / 2020 | Thank NSF for the Smart and Connected Health (SCH) grant (1.1M for four years). |
| 03 / 2020 | Thank 3M for supporting our work with the 3M Non-Tenure Faculty Award. |
| 02 / 2020 | Thanks 4-VA for the supporting us with a collaborative research grant (with Vicente Ordonez at University of Virginia). |
| 09 / 2019 | Thanks NSF for supporting us with a medium Cyber-Physical Systems (CPS) grant (with Ryan K. Williams, Haibo Zeng, Changhee Jung). |
| 09 / 2019 | Thanks Rehabilitation Engineering Research Centers (RERC) for supporting us through the Rehabilitation Strategies, Techniques, and Interventions program (with Shirley Ryan Ability Lab, Thanassis Rikakis, Aisling Kelliher). |
| 04 / 2019 | Thanks SAMSUNG for continuing to support our research through the GRO award (with Alexander Schwing). |
| 02 / 2019 | Thanks Google for supporting our research with the Google Faculty Research Award. |
| 04 / 2018 | Thanks NSF for supporting our research with an CRII award. |
Recent Community Services
Computer Vision
-
CVPR: Area Chair 2019, 2023, 2025, 2026
ICCV: Area Chair 2019, 2021, 2023, 2025
ECCV: Area Chair 2022, 2024, 2026
BMVC: Area Chair 2019, 2020, 2021, 2022
WACV: Area Chair 2020, 2022, 2023
IET Computer Vision: Associate Editor 2020-2022
IEEE Transactions on Pattern Analysis and Machine Intelligence: Associate Editor
Computer Graphics
-
SIGGRAPH: Technical Program Committee 2022, 2023
SIGGRAPH Asia: Technical Program Committee 2020, 2021, 2023
Eurographics: International Program Committee 2023
Computer Graphics Forum: Associate Editor 2021-2023
Artificial Intelligence / Machine Learning
-
NeurIPS: Area Chair 2021, 2022, 2023, 2024
ICML: Area Chair 2022, 2024, 2025
ICLR: Area Chair 2023, 2024, 2025
AAAI: Area Chair 2023
TMLR: Action Editor 2022, 2023
Mentoring
-
Student Mentoring: CVPR 2021, 2022; ICCV 2021
Doctoral Consortium: ICCV 2021, CVPR 2023
LatinX in AI Mentoring Program: CVPR 2021, ICCV 2021
“A Conversation With …”: SIGGRAPH Asia 2021
Past Teaching
University of Maryland College Park
CMSC 426 Computer Vision, Spring 2023, 2024
CMSC 733 Computer Processing of Pictorial Information, Fall 2022
CMSC 848K Multimodal Foundation Models, Fall 2024
CMSC 800 How to Conduct Great Research, Spring 2024
Virginia Tech
Advanced Machine Learning: Spring 2021, Spring 2020, Spring 2019
Advanced Computer Vision: Spring 2017
Computer Vision: Fall 2018, Fall 2017, Fall 2016
Deep Learning: Fall 2020, Fall 2019
Introduction to Programming: Spring 2018
