Chen Si  |  司宸

I'm a 2nd year Master's student in Computer Science & Engineering at UC San Diego. I received my Bachelor's degree in Computer Science from the University of Illinois Urbana-Champaign (UIUC). I've been fortunate to collaborate with Prof. Hao Su, Prof. Romit Choudhury, and Prof. Lianhui Qin.

I am interested in multimodal AI, with a current focus on computer vision and robotics. My research explores how models can robustly perceive, reconstruct, and interact with the physical world using signals such as RGB, depth, geometry, and dynamics. I am particularly interested in physically grounded perception for embodied systems, especially in 3D vision and hand-object interaction, with the goal of supporting simulation and real-world robotic applications.

 /  CV  /  GitHub  /  Google Scholar  /  LinkedIn

profile photo

News

  • [2026/03] 🎉 AnyHand is available on arXiv! Come to have a look on the synthetic hands!
  • [2025/11] 🎉 ArcMemo was named a Runner-Up in ARC Prize 2025!
  • [2024/09] 🎓 Started M.S. in CSE at UC San Diego!
  • [2024/05] 🎓 Graduated from UIUC as a B.S. in CS!

Research

My research focuses on multimodal AI, especially computer vision and robotics. I study how models can perceive, reconstruct, and interact with the physical world using signals such as RGB, depth, geometry, and dynamics. I am particularly interested in 3D vision, hand-object interaction, and physically grounded perception for embodied systems.

Publications are listed by recency. Key papers are in the Selected tab.

AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation
Chen Si, Yulin Liu, Bo Ai, Jianwen Xie, Rolandos Alexandros Potamias, Chuanxia Zheng, Hao Su
Website  /  arXiv  /  code
TL;DR: AnyHand is a large-scale synthetic dataset enabling robust RGB(-D) hand pose estimation across diverse scenarios.
ArcMemo: Abstract Reasoning Composition with Lifelong LLM Memory
Matthew Ho, Chen Si, Zhaoxiang Feng, Fangxu Yu, Zhijian Liu, Zhiting Hu, Lianhui Qin
arXiv
TL;DR: ArcMemo is a memory-augmented agent framework for ARC that improves puzzle solving by storing, retrieving, and reusing useful intermediate reasoning patterns across tasks.
Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation
Chen Si, Qinayi Wu, Chaitanya Amballa, Romit Roy Choudhury
arXiv
TL;DR: MiNAF leverages explicit local geometric information from 3D room meshes for fast, accurate, and high-fidelity room impulse response prediction.
Coupled management of electric vehicle workplace charging and office building loads
Shanshan Liu, Alex Vlachokostas, Chen Si, Eleftheria Kontou
Paper
Transportation Research Part D: Transport and Environment, Volume 134, September 2024
TL;DR: A framework that jointly manages workplace EV charging and office building energy use, showing that smart building controls and optimized charging schedules can cut costs across different U.S. climates.

Selected Honors

  • Bronze Tablet (Highest University Honor), UIUC 2024
  • Dean's List (all semesters), UIUC 2020 - 2024
  • James Scholarship, UIUC 2020 - 2024

Experience

University of California San Diego, USA 2024.09 - Present

M.S. in Computer Science & Engineering

University of Illinois Urbana-Champaign, USA 2020.08 - 2024.05

B.S. in Computer Science

Thank you for visiting! Feel free to contact me if you have any questions.
This website is designed based on Jon Barron. Last Update: Mar, 2026