About Me
Hi, I’m a Ph.D student majoring in computer science in Shanghai Jiao Tong University (SJTU). My Chinese name is Fang Hongjie, and you can call me Tony Fang, or just Tony if you like. Here are my educational experiences:
- B. Tech. @ Computer Science and Engineering, Shanghai Jiao Tong University, Sept. 2018 - Jun. 2022;
- B. Ec. @ Finance, Shanghai Jiao Tong University, Sept. 2018 - Jun. 2022;
- Ph.D. (candidate) @ Computer Science and Technology, Shanghai Jiao Tong University & Shanghai AI Lab., Sept. 2022 - Jun. 2027 (expected).
My research interest lies in the Robotics field. Currently I’m working on robotic grasping and manipulation field. I’m familiar with many kinds of robotic arms, including UR5, Flexiv Robot, Franka Emika Panda and Kuka IIWA 7R800. An interesting project I’m currently working on is dynamic grasp tracking.
News
2023.02: Our paper “Target-referenced Reactive Grasping for Dynamic Objects” is accepted by CVPR 2023. More details to be released.
2023.02: Our paper TransCG is accepted by ICRA 2023 as RA-L submission, see you in London!
2022.12: The preprint version of our paper AnyGrasp is released. For more details, see AnyGrasp official page.
2022.06: Our paper TransCG is accepted by RA-L. For more details, see TransCG official page.
2021.08: Our paper Graspness is accepted by ICCV 2021 as poster.
Publications
Publications
- Jirong Liu, Ruo Zhang, Hao-Shu Fang, Minghao Gou, Hongjie Fang, Chenxi Wang, Sheng Xu, Hengxu Yan, Cewu Lu, Target-referenced Reactive Grasping for Dynamic Objects, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
- Hongjie Fang, Hao-Shu Fang, Sheng Xu and Cewu Lu, TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline, IEEE Robotics and Automation Letters (RA-L), 2022: Volume 7, Issue 3, 7383-7390.
- Chenxi Wang, Hao-Shu Fang, Minghao Gou, Hongjie Fang, Jin Gao and Cewu Lu, Graspness Discovery in Clutters for Fast and Accurate Grasp Detection, IEEE International Conference on Computer Vision (ICCV), 2021: 15964-15973.
Preprints
- Hao-Shu Fang, Chenxi Wang, Hongjie Fang, Minghao Gou, Jirong Liu, Hengxu Yan, Wenhai Liu, Yichen Xie and Cewu Lu, AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domains, arXiv preprint, in submission to IEEE Transaction on Robotics (T-RO), 2022: arXiv:2212.08333.
Projects
Transparent objects are common in our daily life and frequently handled in the automated production line. Robust vision-based robotic grasping and manipulation for these objects would be beneficial for automation. However, the majority of current grasping algorithms would fail in this case since they heavily rely on the depth image, while ordinary depth sensors usually fail to produce accurate depth information for transparent objects owing to the reflection and refraction of light. In this work, we address this issue by contributing a large-scale real-world dataset for transparent object depth completion, which contains 57,715 RGB-D images from 130 different scenes. Our dataset is the first large-scale, real-world dataset that provides ground truth depth, surface normals, transparent masks in diverse and cluttered scenes. Cross-domain experiments show that our dataset is more general and can enable better generalization ability for models. Moreover, we propose an end-to-end depth completion network, which takes the RGB image and the inaccurate depth map as inputs and outputs a refined depth map. Experiments demonstrate superior efficacy, efficiency and robustness of our method over previous works, and it is able to process images of high resolutions under limited hardware resources. Real robot experiments show that our method can also be applied to novel transparent object grasping robustly. The full dataset and our method are publicly available at www.graspnet.net/transcg
ROPE
Robot Operation Python Engine (ROPE) provides tele-operation function from haptic devices and various types of robots, including UR-5, Franka Panda, Kuka IIWA, and Flexiv Robot. The project is now in final refinement, and the code will be released soon.
Current scholar search engine cannot recognize “jargon”, that is, specialized termilogy associated with a particular field or area of activity. In order to make the search more precisely, we build Oh-My-Papers, a hybrid context-aware citation recommendation system, as well as a scholar search engine. We first point out that we can learn jargons from academic paper citation information. Since specialists usually use jargons such as “ResNet” in the academic paper writings, and the reference to the corresponding paper usually follows the jargon. Moreover, citation information (especially citation context) of academic papers can help us to improve the searching results. In this work, we also create a large dataset recording citation information from papers of computer vision field in recent years. The dataset is ~10x larger than the biggest dataset from the previous works.
In this work, we review the previous protein contact-map prediction models and apply the several attention mechanisms into the classic protein contact-map prediction networks ResPRE. The combination has reached a relatively great results, which improve both short-term and long-term prediction by approximately 6%.
In this work, we use CUDA and CUDNN to implement the famous deep learning network Inception-V3. We use implicit im2col method to optimize the convolution layers and reach satisfactory performance. Our CUDA implementation has an average inference time of 61.096 ms, which only takes 60% of the CUDNN inference time.
In this work, we propose a handy toolbox to construct high dynamic range (HDR) image from multiple low dynamic range (LDR) images. We provide traditional methods using alignment, and several deep-learning-based methods (DeepHDR, NHDRRNet) as well as our proposed DeepNLHDR network. Experiments show that our model outperforms baseline models by 1% ~ 15%.
Undergraduates
Academic Performances
GPA 92.57/100, ranking 2/154.
I gained knowledges and experiences while studying courses in Computer Science during undergraduate studies, and I got great results in many of the courses. Here are some selected course:
- CS158: Data Structure (Honor) (Spring 2019, 100/100) [Project Deque and BTree]
- CS214: Algorithm and Complexity (Spring 2020, 100/100) [Homeworks and Project]
- CS145: Computer Architecture Experiments (Spring 2020, 100/100) [Labs]
- CS385: Machine Learning (Spring 2021, 97.5/100) [Project 1 and Project 2 (VAE and GAN)]
- EE447: Mobile Internet (Spring 2021, 96/100) [Homeworks, Labs, and Project Oh-My-Papers]
Other A+ courses (click to see details)
- CS157: C++ Programming Language (Honor) (Fall 2018, 99/100)
- CS467: Computational Theory (Fall 2020, 99/100)
- PH070: University Physics (Honor) (Spring 2019, 98/100)
- CS241: Principles and Practice of Problem Solving (Fall 2019, 98/100) [Homeworks and Final Project]
- CS499: Mathematical Foundation of Computer Science (Spring 2020, 98/100) [Homeworks]
- CS433: Parallel and Distributed Computing (Fall 2021, 98/100) [Homeworks and Project]
- MA239: Discrete Mathematics (Honor) (Fall 2019, 97/100)
- EI313: Engineering Practice and Technology Innovation III-D (Fall 2020, 97/100)
- CS356: Operating System Projects (Spring 2020, 97/100) [Projects]
- EE359: Data Mining Techniques (Spring 2021, 97/100) [Labs]
- EI209: Computer Organization (Spring 2020, 97/100)
- ID110: Innovative thinking and modern design (Honor) (Fall 2018, 96/100)
- MA261: Mathematical Analysis (Honor) (Spring 2019, 96/100)
- CS386: Digital Image Processing (Fall 2020, 96/100) [Project HDRLib]
- EI314: Engineering Practice and Technology Innovation III-E (Spring 2021, 96/100) [Project Alpha-Protein]
- MA262: Linear Algebra (Honor) (Fall 2018, 95/100)
- MS125: Principle and Practice of Computer Algorithms (Summer 2019, 95/100) [Project RISCV Simulator and Chatroom (Server and Client)]
- SE305: Database Techniques (Fall 2020, 95/100)
- CS240: Computer Ethics (Fall 2020, 95/100)
Sharing is caring.
I started this project to share the notes written by my friends and me, which may be helpful for other students who take the same courses in the future.
Research Experience
I’m currently research in Machine Vision and Intelligence Group (MVIG-SJTU), and advised by Prof. Cewu Lu. During undergraduates, I have done the following works.
- Adapt AlphaPose to foot keypoints;
- Revise GPD to make it work in GraspNet framework [details], and SPVCNN backbone migration to GraspNet;
- Cooperate author of paper “Graspness Discovery in Clutters for Fast and Accurate Grasp Detection” (ICCV 2021);
- Main contributor of transparent object depth completion project TransCG (RA-L 2022).
Before that, I took part in the 36th Participation in the research Program (PrP) in SJTU. The program aims at providing undergraduate students with an initial understanding of research. During the programs, I’m advised by Prof. Qinxiang Cao and have done the following works.
Honors
Titles
- Shanghai Outstanding Graduates; 2022; top 1%.
Scholarships
- Shanghai Scholarship (Shanghai Education Bureau); 2020; top 3%; CNY ¥8,000.
- Zhiyuan Scholarship (Zhiyuan College, SJTU); 2018/2019/2020/2021; top 5%; CNY ¥5,000.
- Fuguang Scholarship (Fuguang Foundation); 2018/2019/2020/2021; top 0.05% in College Entrance Examination (Gaokao); CNY ¥40,000.
- Shanghai Jiao Tong University Class B Excellent Scholarship (SJTU); 2018/2019/2020; top 30%; CNY ¥1,000.
- Shanghai Jiao Tong University Class C Excellent Scholarship (SJTU); 2021; top 50%; CNY ¥500.
- Computer Science Department Education Development Fund of ‘85 Alumni and Yang Yuanqing Education Fund Scholarship (Computer Science and Engineering Department, SJTU); 2021; top 1%; CNY ¥25,000.
Other Experiences
Competitions
- UBS Quant Hackerthon 2020, Finalist (8/371);
- 2020 Interdisciplinary Contest in Modeling, Honorable Mention;
- 2017 National Olympiads in Informatics (NOI), Bronze Medal;
- 2017 Asia-Pacific Informatics Olympiad (APIO), Bronze Medal;
- 2017 China Team Selection Competition (CTSC) in Informatics Olympiad, Bronze Medal;
- 2017 Winter Camp (WC) in Informatics Olympiad, Bronze Medal;
- 2016 National Olympiads in Informatics in Provinces (NOIP), First Prize;
- 2015 National Olympiads in Informatics in Provinces (NOIP), First Prize.
Teaching Assistants
- Spring 2019, Data Structure (Honor) (taught by Prof. Yong Yu);
- Fall 2020, C++ Programming Language (Honor) (taught by Prof. Huiyu Weng);
- Fall 2020, Mathematical Analysis (Honor) I (taught by Prof. Keying Chen);
- Fall 2021, Mathematical Analysis (Honor) I (taught by Prof. Keying Chen);
- Fall 2021, Linear Algebra (Honor) (taught by Prof. Hao Shen);
- Spring 2022, Algorithm and Complexity (taught by Prof. Xiaofeng Gao)
- Fall 2022, Linear Algebra (Honor) (taught by Prof. Hao Shen) [Course Materials];
Services
Research services
Social Services
- Apr. 2019, volunteer, Shanghai International Half Marathon;
- Jul. 2019, member, “The Choice of Youth Project” (a project aims to let the students understand the current situation of different industries);
- Aug. 2019, member, “Zhufei Project” (a project aims to help the students of SJTU who have financial difficulties);
- Nov. 2019, volunteer, Shanghai International Marathon.