I recieved a Ph.D. in Computer Science from the Shanghai Jiao Tong University (SJTU), under the supervision of Prof. Cewu Lu, in Machine Vision and Intelligence Group (MVIG). Prior to that, I worked and studied in Institute of Automation, Chinese Academy of Sciences (CASIA) under the supervision of Prof. Yiping Yang and A/Prof. Yinghao Cai (3D Reconstruction). My primary research interests are Computer Vision and Robotics. Currently, I focus on developing a knowledge-driven vision system (HAKE) that learns to effectively perceive human activities, reason human behavior logics, and interact with objects and environments.
2020.09: Our work HOI Analysis will appear at NeurIPS 2020. Code and arXiv paper are comming soon.
2020.07: Fortunate to recieve WAIC YunFan Award and be among the 2nd A-Class Project.
2020.06: Larger HAKE-Large (>120K images with activity and part state labels) is released!
2020.04: Code, data and paper of "Detailed 2D-3D Joint Representation for Human-Object Interaction (CVPR2020)" are released!
2020.04: Code, data, paper of image-based HAKE, "PaStaNet: Toward Human Activity Knowledge Engine (CVPR2020)", are released!
2020.04: The code and paper of our CVPR 2020 paper Symmetry and Group in Attribute-Object Compositions are available now!
2020.02: Three papers Image-based HAKE: PaSta-Net, 2D-3D Joint HOI Learning, Symmetry-based Attribute-Object Learning are accepted in CVPR 2020! Papers and corresponding resources (code, data) will be released soon.
5) HAKE-A2V (CVPR'20): Activity2Vec, a general activity feature extractor and PaSta (human body part states) detector based on HAKE data, converts a human (box) to a fixed-size vector, PaSta and action scores.
6) Halpe: a joint project under Alphapose and HAKE, full-body human keypoints (body, face, hand, 136 points) of 50,000 HOI images.
7) HOI Learning List: a list of recent HOI (Human-Object Interaction) papers, code, datasets and leaderboard on widely-used benchmarks.