About

I am a first-year Ph.D. student in Computer Science at Johns Hopkins University, advised by Prof. Tianmin Shu. Previously, I obtained my B.A. in Honors Computer Science and B.A. in Mathematics from New York University in 2024, where I received the Computer Science Prize for the Most Promising Student. I have also spent time as a research intern at MIT. I received an Outstanding Paper Award at ACL 2024 for my work on multimodal Theory of Mind.

I love working on exciting and game-changing research problems. My current areas of focus include:

• Social Intelligence: Developing agents that can perceive, reason about, learn from, and respond to affect, behavior, and cognition of humans or other agents, and foster strategic collaborations among them.

• Advanced Reasoning: Improving and integrating System-2 deliberate reasoning with System-1 intuitive thinking by combining language models, agent models, and world models in a scalable, cognitively grounded way.

• Open-Ended Agents: Building the next generation of AI agents that can interact with the world through reasoning, planning, managing memory, and learning from human and environment feedback.

Besides academics, I enjoy playing Go, piano, badminton, hiking, and so much more.

News

• [Feb, 2025] Introducing AutoToM: an automated and open-ended Theory of Mind method (Arxiv, Twitter)
• [Jan, 2025] MuMA-ToM was accepted at AAAI 2025 as an Oral Presentation!
• [Oct, 2024] MMToM-QA was covered by Futurity, Synced, and JHU News.
• [Sep, 2024] Invited talk @ University of Washinton on “Towards Multimodal Theory of Mind”.
• [Aug, 2024] MMToM-QA won the Outstanding Paper Award at ACL 2024!
• [May, 2024] Released the position paper for ICLR 2024 AGI Workshop.
• [May, 2023] Released fast-DiT, state-of-the-art diffusion models with 2x speedup.
• [Apr, 2023] Received NYU Computer Science Prize for the Most Promising Student.

Selected Publications

For a more complete list, see the publication page, or my Google Scholar page.

AutoToM : Automated Bayesian Inverse Planning and
Model Discovery for Open-ended Theory of Mind
Zhining Zhang*, Chuanyang Jin*†, Mung Yao Jia*, Tianmin Shu (†: project lead)
Preprint
paper / project / code

OS-Genesis: Automating GUI Agent Trajectory
Construction via Reverse Task Synthesis
Qiushi Sun*, Kanzhi Cheng*, Zichen Ding*, Chuanyang Jin*, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, Ben Kao, Guohao Li, Junxian He, Yu Qiao, Zhiyong Wu
Preprint
paper / project / code

MuMA-ToM: Multi-modal Multi-Agent Theory of Mind
Haojun Shi*, Suyu Ye*, Xinyu Fang, Chuanyang Jin, Leyla Isik, Yen-Ling Kuo, Tianmin Shu
AAAI 2025 (Oral)
paper / project / code

MMToM-QA: Multimodal Theory of Mind Question Answering
Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua Tenenbaum, Tianmin Shu
ACL 2024 (Outstanding Paper Award)
paper / project / code / slides / news

How Far Are We From AGI?
Tao Feng*, Chuanyang Jin*, Jingyu Liu*, Kunlun Zhu*, Haoqin Tu, Zirui Cheng, Guanyu Lin, Jiaxuan You
TMLR 2024 / ICLR 2024 AGI Workshop (Oral)
paper / project

You can also take a look at my undergrad projects. A mountain of gratitude to those who have kindly mentored me and inspired me with their vision and passion!

Selected Honors & Awards

• ACL Outstanding Paper Award, 2024
• NYU Presidential Honors Scholar and Summa cum Laude (Top 5%), 2024
• NYU Computer Science Prize for the Most Promising Student (1 person/year), 2023
• NYU Dean’s Undergraduate Research Fund, 2023
• COMAP International Scholarship Award (Top 0.1%), 2022
• MAA Award in Mathematical Contest in Modeling (Top 0.1%), 2022
• Distinguished Honor Roll of American Mathematics Contest (Top 1%), 2020
• Bronze Medal of Shing-Tung Yau Computer Science Award (Top 1%), 2019
• Finalist of FIRST Robotics Competition World Championship (Top 0.2%), 2019
• NFLS Outstanding Student Leader Award and Zhou Enlai Scholarship (Top 3%), 2019
• First Prize of Chinese Mathematical Olympiad (Top 0.1%), 2018