Bio

I am a Senior Research Scientist and Research Lead at NVIDIA Research. I am part of the Learning and Perception group headed by Jan Kautz where I lead the efforts related to human capture and modeling. Prior to that, I completed my PhD in Computer Science (2014-2018) from the University of Bonn, Germany, under the supervision of Juergen Gall. I completed my M.Sc. degree in Information Technology (2011-2013) with majors in Image and Video Signal Processing from Tampere University of Technology (TUT), Finland. Alongside, I also worked at Nokia Research Center as an External Computer Vision Researcher. I completed my B.Sc. degree in Computer Engineering from COMSATS Institute of Information Technology, Pakistan, and later also worked there as a Research Associate at the Computer Vision Research Group during 2010-2011.

News!

21/10/2023:PACE accepted to 3DV'24.

20/07/2023:Three papers accepted to ICCV'23.

24/02/2022:Two papers accepted to CVPR'22.

04/10/2021:One paper accepted to 3DV.

23/07/2021:Two papers accepted to ICCV'21.

10/07/2021:I am serving as an Area Chair for BMVC'21.

Publications

2024

PACE: Human and Camera Motion Estimation from in-the-wild Videos
Muhammed Kocabas, Ye Yuan, Pavlo Molchanov, Yunrong Guo, Michael J. Black, Otmar Hilliges, Jan Kautz, Umar Iqbal
3DV 2024

2023

Generalizable One-shot Neural Head Avatar
Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz
NeurIPs 2023
RANA: Relightable Articulated Neural Avatars
Umar Iqbal, Akin Caliskan, Koki Nagano, Sameh Khamis, Pavlo Molchanov, Jan Kautz
ICCV, 2023
PhysDiff: Physics-Guided Human Motion Diffusion Model
Ye Yuan, Jiaming Song, ​Umar Iqbal, Arash Vahdat, Jan Kautz
ICCV, 2023
Learning Human Dynamics in Autonomous Driving Scenarios
Jingbo Wang, Ye Yuan, Zhengyi Luo, Kevin Xie, Dahua Lin,Umar Iqbal, Sanja Fidler, Sameh Khamis
ICCV, 2023

Coming soon

SSIF: Single-shot Implicit Morphable Faces with Consistent Texture Parameterization
Connor Lin, Koki Nagano, Jan Kautz, Eric R. Chan, Umar Iqbal, Leonidas Guibas, Gordon Wetzstein, Sameh Khamis
SIGGRAPH 2023

2022

DRaCoN – Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars
Amit Raj,Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz
arXiv Preprint 2022
Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objects
Atsuhiro Noguchi, Umar Iqbal, Jonathan Tremblay, Tatsuya Harada, Orazio Gallo
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras
Ye Yuan, Umar Iqbal, Pavlo Molchanov, Kris Kitani, Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

2021

Physics-based Human Motion Estimation and Synthesis from Videos
Kevin Xie, Tingwu Wang, Umar Iqbal, Yunrong Guo, Sanja Fidler, Florian Shkurti
IEEE Conference on Computer Vision (ICCV), 2021
KAMA: 3D Keypoint Aware Body Mesh Articulation
Umar Iqbal, , Kevin Xie, Yunrong Guo, Jan Kautz, Pavlo Molchanov
International Conference on 3D Vision (3DV), 2021
Self-Supervised Object Detection via Generative Image Synthesis
Siva K. Mustikovela, Shalini De Mello, Aayush Prakash, Umar Iqbal, Sifei Liu, Thu Nguyen-Phuoc, Carsten Rother, Jan Kautz
IEEE Conference on Computer Vision (ICCV), 2021
​Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimation
Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Jan Kautz, Otmar Hilliges
arXiv 2021
​Weakly-Supervised Physically Unconstrained Gaze Estimation
Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
​Learning to Track Instances without Video Annotations
Yang Fu, Sifei Liu, Umar Iqbal, Shalini De Mello, Humphrey Shi , Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
DexYCB: A Benchmark for Capturing Hand Grasping of Objects
Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

2020 and earlier...

Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints
Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz
European Conference on Computer Vision (ECCV), 2020.
Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction
Anil Armagan, Guillermo Garcia-Hernando, Seungryul Baek, Shreyas Hampali, Mahdi Rad, Zhaohui Zhang, Shipeng Xie, MingXiu Chen, Boshen Zhang, Fu Xiong, Yang Xiao, Zhiguo Cao, Junsong Yuan, Pengfei Ren, Weiting Huang, Haifeng Sun, Marek Hrúz, Jakub Kanis, Zdeněk Krňoul, Qingfu Wan, Shile Li, Linlin Yang, Dongheui Lee, Angela Yao, Weiguo Zhou, Sijia Mei, Yunhui Liu, Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Philippe Weinzaepfel, Romain Brégier, Gregory Rogez, Vincent Lepetit, Tae-Kyun Kim
European Conference on Computer Vision (ECCV), 2020.
Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild
Umar Iqbal, Pavlo Molchanov, Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, USA, 2020.
​Self-Supervised Viewpoint Learning from Image Collections
Siva Karthik Mustikovela, Varun Jampani, Shalini De Mello, Sifei Liu, Umar Iqbal, Carsten Rother, Jan Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, USA, 2020.
Few Shot Adaptive Gaze Estimation
Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz
International Conference on Computer Vision (ICCV), Seoul, South Korea, 2019
Articulated Human Pose Estimation in Unconstrained Images and Videos
Dissertation, University of Bonn, Germany, 2018.
Summa cum laude, DAGM MVTec Dissertation Award 2019
Hand Pose Estimation via Latent 2.5D Heatmap Regression
U. Iqbal, P. Molchanov, T. Breuel, J. Gall and J. Kautz
European Conference on Computer Vision (ECCV'18), Munich, Germany, 2018
Invited to the 4th Workshop on Observing and Understanding Hands in Action (HANDS), 2018
Best Poster Award @ HANDS'18
JointFlow: Temporal Flow Fields for Multi Person Pose Tracking
A. Doering, U. Iqbal, J. Gall
British Machine Vision Conference (BMVC'18), Newcastle, UK, 2018
​PoseTrack: A Benchmark for Human Pose Estimation and Tracking
M. Andriluka, U. Iqbal, A. Milan, E. Insafutdinov, L. Pishchulin, J. Gall and B. Schiele
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'18), Salt Lake City, USA, 2018
A Dual-Source Approach for 3D Human Pose Estimation from Single Images
U. Iqbal, A. Doering, H. Yasin, B. Krüger, A. Weber, and J. Gall
Computer Vision and Image Understanding (CVIU), 2018
PoseTrack: Joint Multi-Person Pose Estimation and Tracking
U. Iqbal, A. Milan, and J. Gall
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'17), Hawaii, USA, July 2017
​Pose for Action - Action for Pose
U. Iqbal, M. Garbade, and J. Gall
IEEE Conference on Automatic Face and Gesture Recognition (FG'17), Washington-DC, USA, 2017
​Multi-Person Pose Estimation with Local Joint-to-Person Associations
U. Iqbal and J. Gall
Crowd Understanding Workshop (CUW). In conjunction with ECCV'16, Amsterdam, 2016
​​A Dual-Source Approach for 3D Pose Estimation from a Single Image
H. Yasin*, U. Iqbal*, B. Krüger, A. Weber, and J. Gall (*equal contribution)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR'16), Las Vegas, USA, June 2016.

Older Publications

​Who is the Hero? - Semi-Supervised Person Re-Identification in Videos
U. Iqbal , I. D. D. Curcio, and M. Gabbouj
Int. Conference on Computer Vision Theory and Applications (VISAPP'14), Lisbon, Portugal, 2014
Image Based Vehicle Type Identification
U. Iqbal , S.W. Zamir, M.H. Shahid, K. Parwaiz, M. Yasin and M.S. Sarfraz
IEEE International Conference on Information and Emerging Technologies (ICIET'10, Oral), ​Pakistan, 2010.