Publications

Updated by Ruihang Chu on 2023-09
News: DiffComplete is accepted by NeurIPS 2023, a controllable, multi-modal, and high-fidelity shape completion method using diffusion models.
News: DiT-3D is accepted by NeurIPS 2023, a Diffusion Transformer for 3D shape generation that is powerful and supports efficient fine-tuning from 2D to 3D.
News: Cart is accepted by CVPR 2023, an approach towards articulated shape manipulation driven by simple command templates.
News: TriVol is accepted by CVPR 2023, a dense while lightweight 3D representation combined with NeRF for rendering photorealistic images from point clouds.
News: TWIST is accepted by CVPR 2022, the first self-training framework for semi-supervised 3D instance segmentation.

See Google Scholar for the full list.

Preprints

Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Yanwei Li, Yuechen Zhang, Chengyao Wang, Zhisheng Zhong, Yixin Chen, Ruihang Chu, Shaoteng Liu, Jiaya Jia
arXiv:2403.18814
[paper] [project page] [code]
DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Driving
Tianqi Wang, Enze Xie, Ruihang Chu, Zhenguo Li, Ping Luo
arXiv:2403.16996
[paper] [project page]
DialogGen: Multi-modal Interactive Dialogue System for Multi-turn Text-to-Image Generation
Minbin Huang, Yanxin Long, Xinchi Deng, Ruihang Chu, Jiangfeng Xiong, Xiaodan Liang, Hong Cheng, Qinglin Lu, Wei Liu
arXiv:2403.08857
[paper] [project page]
A Survey of Reasoning with Foundation Models
Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, Hongyang Li, Mengzhe Geng, Yue Wu, Wenhai Wang, Junsong Chen, Zhangyue Yin, Xiaozhe Ren, Jie Fu, Junxian He, Wu Yuan, Qi Liu, Xihui Liu, Yu Li, Hao Dong, Yu Cheng, Ming Zhang, Pheng Ann Heng, Jifeng Dai, Ping Luo, Jingdong Wang, Ji-Rong Wen, Xipeng Qiu, Yike Guo, Hui Xiong, Qun Liu, and Zhenguo Li
arXiv:2312.11562
[paper] [project page]

Journal Papers

ICM-3D: Instantiated Category Modeling for 3D Instance Segmentation
Ruihang Chu, Yukang Chen, Lu Qi, Tao Kong, Lei Li
IEEE Robotics and Automation Letters (RA-L), 2021
[paper]
Co-actuation: A Method for Achieving High Stiffness and Low Inertia for Haptic Devices
Ruihang Chu, Yuru Zhang, Hongdong Zhang, Weiliang Xu, Jee-Hwan Ryu, Dangxiao Wang
IEEE Transactions on Haptics (ToH), 2020
[paper]

Conference Papers

DiffComplete: Diffusion-based Generative 3D Shape Completion
Ruihang Chu, Enze Xie, Shentong Mo, Zhenguo Li, Matthias Nießner, Chi-Wing Fu, Jiaya Jia
Conference on Neural Information Processing Systems (NeurIPS), 2023
[paper] [project page]
Command-driven Articulated Object Understanding and Manipulation
Ruihang Chu, Zhengzhe Liu, Xiaoqing Ye, Xiao Tan, Xiaojuan Qi, Chi-Wing Fu, Jiaya Jia IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[paper] [video]
TWIST: Two-Way Inter-label Self-Training for Semi-supervised 3D Instance Segmentation
Ruihang Chu, Xiaoqing Ye, Zhengzhe Liu, Xiao Tan, Xiaojuan Qi, Chi-Wing Fu, Jiaya Jia IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[paper] [code]
Vehicle Re-identification with Viewpoint-aware Metric Learning
Ruihang Chu, Yifan Sun, Yadong Li, Zheng Liu, Chi Zhang, Yichen Wei
IEEE International Conference on Computer Vision (ICCV), 2019
[paper] [code]
DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation
Shentong Mo, Enze Xie, Ruihang Chu, Lewei Yao, Lanqing Hong, Matthias Nießner, Zhenguo Li
Conference on Neural Information Processing Systems (NeurIPS), 2023
[paper] [project page]
Mask-Attention-Free Transformer for 3D Instance Segmentation
Xin Lai, Yuhui Yuan, Ruihang Chu, Yukang Chen, Han Hu, Jiaya Jia
IEEE International Conference on Computer Vision (ICCV), 2023
[paper] [code]
TriVol: Point Cloud Rendering via Triple Volumes
Tao Hu, Xiaogang Xu, Ruihang Chu, Jiaya Jia
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[paper] [code]
Simultaneous Multi-task Learning for 6-DoF Grasp Pose Estimation
Yiming Li, Tao Kong, Ruihang Chu, Yifeng Li, Peng Wang, Lei Li
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
[paper] [project]
Scale-aware Automatic Augmentation for Object Detection
Yukang Chen, Yanwei Li, Tao Kong, Lu Qi, Ruihang Chu, Lei Li, Jiaya Jia
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
[paper] [code]