About

I am a first-year Ph.D. student in Computer Science at Johns Hopkins University, advised by Tianmin Shu.

I received my B.A. in Honors Computer Science and B.A. in Mathematics from New York University in 2024, where I was awared the Computer Science Prize for the Most Promising Student. I have also spent time as a research intern at MIT. I received an Outstanding Paper Award at ACL 2024 for my work on multimodal Theory of Mind.

I love working on exciting and game-changing research problems. My current areas of focus include:

• Social Intelligence: Creating capable and friendly agents that can perceive, reason about, learn from, and respond to the behavior and cognition of humans or other agents; promoting strategic communication and collaboration among them.

• Advanced Reasoning: Improving and integrating System-2 deliberate reasoning with System-1 intuitive thinking; combining language models, agent models, and world models in a scalable, cognitively grounded way.

Besides academics, I enjoy playing Go, piano, badminton, hiking, and so much more.

News

• [Apr, 2025] Co-organizing the Workshop on Continual Robot Learning from Humans at RSS 2025.
• [Feb, 2025] Introducing AutoToM: an automated and SOTA Theory of Mind method (Arxiv, Twitter).
• [Jan, 2025] MuMA-ToM was accepted at AAAI 2025 as an Oral Presentation!
• [Oct, 2024] MMToM-QA was covered by Futurity, Synced, and JHU News.
• [Sep, 2024] Invited talk @ University of Washinton on “Towards Multimodal Theory of Mind”.
• [Aug, 2024] MMToM-QA won the Outstanding Paper Award at ACL 2024!

Selected Publications

(* denotes equal contribution; † denotes project lead)
For a more complete list, please see my publication page or Google Scholar page.

AutoToM : Automated Bayesian Inverse Planning and
Model Discovery for Open-ended Theory of Mind
Zhining Zhang*, Chuanyang Jin*†, Mung Yao Jia*, Tianmin Shu
Preprint
paper / project / code

OS-Genesis: Automating GUI Agent Trajectory
Construction via Reverse Task Synthesis
Qiushi Sun*, Kanzhi Cheng*, Zichen Ding*, Chuanyang Jin*, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, Ben Kao, Guohao Li, Junxian He, Yu Qiao, Zhiyong Wu
Preprint
paper / project / code

MuMA-ToM: Multi-modal Multi-Agent Theory of Mind
Haojun Shi*, Suyu Ye*, Xinyu Fang, Chuanyang Jin, Leyla Isik, Yen-Ling Kuo, Tianmin Shu
AAAI 2025 (Oral)
paper / project / code

MMToM-QA: Multimodal Theory of Mind Question Answering
Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua Tenenbaum, Tianmin Shu
ACL 2024 (Outstanding Paper Award)
paper / project / code / slides / news

How Far Are We From AGI?
Tao Feng*, Chuanyang Jin*, Jingyu Liu*, Kunlun Zhu*, Haoqin Tu, Zirui Cheng, Guanyu Lin, Jiaxuan You
TMLR 2024 / ICLR 2024 AGI Workshop (Oral)
paper / project

You can also take a look at my undergrad projects. A mountain of gratitude to those who have kindly mentored me and inspired me with their vision and passion!

Selected Honors & Awards

• ACL Outstanding Paper Award, 2024
• NYU Presidential Honors Scholar and Summa cum Laude (Top 5%), 2024
• NYU Computer Science Prize for the Most Promising Student (1 person/year), 2023
• NYU Dean’s Undergraduate Research Fund, 2023
• COMAP International Scholarship Award (Top 0.1%), 2022
• MAA Award in Mathematical Contest in Modeling (Top 0.1%), 2022
• Bronze Medal of Shing-Tung Yau Computer Science Award (Top 1%), 2019
• Finalist of FIRST Robotics Competition World Championship (Top 0.2%), 2019
• NFLS Outstanding Student Leader Award and Zhou Enlai Scholarship (Top 1%), 2018
• First Prize of Chinese Mathematical Olympiad (Top 0.1%), 2018