Jiang Ruixiang (江睿翔)

Currently I am a research assistant at The Hong Kong Polytechnic University (PolyU), mentored by Prof. Chen Changwen. I have just obtained my Bsc. degree at PolyU with first class honor, and my major is Computer Science .

My research interests primarily lie in Computer Graphics, Computer Vision and the intersection between them, with a focus on neural rendering and 3D content generation. Besides, I am also interested in Multimodal AI, especially in vision-language models (VLMs). My goal is to build AI systems that understand and manipulate 3D content with natural language.

Currently, I am looking for phd positions starting from 2023/2024.

Email: rui-x [d] jiang [AT] connect [d] polyu [d] hk.

Email  /  CV  /  Github  /  Google Scholar

photo
Publications and Preprints

Conditional Prompt Tuning for Multimodal Fusion
Ruixiang Jiang, Lingbo Liu , Changwen Chen
under review, 2023
code / arXiv

We design a prompt-tuning method for multimodal fusion, achieving similar result with fine-tuning while only require 0.7% trainable parameters.

CLIP-Count: Towards Text-Guided Zero-Shot Object Counting
Ruixiang Jiang, Lingbo Liu , Changwen Chen
ACM MM 2023, 2023
code / arXiv paper

We propose the first end-to-end object counting model that count anything using text prompt.

AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control
Ruixiang Jiang, Can Wang , Jingbo Zhang , Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
Accepted (ICCV 2023), 2023
project page / code / arXiv paper

We propose the first complete pipeline for creating, editing and animating neural human avatars.

Nerf-Art: Text-Driven Neural Radiance Fields Stylization
Can Wang , Ruixiang Jiang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
IEEE TVCG, 2023
project page / code / arXiv / paper

We stylize neural implicit scene to a specific art style by a text prompt.

Other Projects

Leaning a Neural Radiance Field for Stylized Scene
Undergraduate Research and Innovation Project, 2022

We propose to leverage toon-shading and model outlining priors to better encode non-photorealistic scene with neural implicit fields.

Realtime Hatching Rendering
Course Project, 2021
Github

A pencil-sketch (a.k.a. hatching) style shader for Unity.

Misc
Research Assistant
The Hong Kong Polytechnic University
Full time, Sep 2023 - Now
Research Internship
City University of Hong Kong
Full time, Jun 2022 - Aug 2022
Part time, Sep 2022 - Now
Awards Undergraduate Research and Innovation Scholarship, 2021
Dean's List of Outstanding Students, 2021-2022
Dean's List of Outstanding Students, 2022-2023
The Hong Kong Polytechnic University Scholarship, 2022


Last updated: Dec 9, 2023,

Theme from jonbarron 's website,