Xiao Wang (王啸)

Phd Student

Department of Computer Science and Engineering
University at Buffalo
12 Capen Hall, Buffalo, New York 14260-1660

About Me

I am Xiao Wang, a Ph.D. student in the CSE Department at University at Buffalo, where I am advised by Dr. Venu Govindaraju. I am a part of the Center for Unified Biometrics and Sensors (CUBS) Lab, where I also work as a research assistant. My research is funded by the NSF AI Institute.

I received my M.S. degree in Computer Science from the College of Engineering and Computer Science at Syracuse University. My current research focuses on Agentic AI, with an emphasis on developing more effective and efficient ways to harness large language models as reliable, production-ready tools. In addition, I have research interests and experience in several other AI areas, including reinforcement learning, LLM post-training, and generative model, where I have also made research contributions.

Feel free to reach out to me if you are interested in collaborating. I am also actively looking for research intern positions.

News []

2026.08: Our paper, MistyPilot, has been accepted to the Assistive Computer Vision and Robotics (ACVR) Workshop at ECCV 2026 as an Oral & Poster presentation.
2026.05: Joined ByteDance/TikTok as a Research Scientist Intern for Summer 2026, working on self-evolving agents.
2026.05: Successfully passed the Qualification Exam and officially became a Ph.D. Candidate.
2026.03: Two AI for Education papers, "InterventionLens" and "ConfusionBench," were accepted to CVPR CV4Edu Workshop 2026.
2025.6: Our paper, AutoMisty: A Multi-Agent LLM Framework for Automated Code Generation in the Misty Social Robot, has been accepted for presentation at IROS 2025.
2025.05: Started my summer research intern journey at Microsoft MSAI PhD Research Interns at Reasoning and LU Group.
2024.09: Our paper, ProxyFusion: FaceFeature Aggregation Through Sparse Experts, has been accepted for presentation at NeurIPS 2024.
2024.09: Our paper on 3D sign language motion generation has been accepted by EMNLP 2024.
2024.08: A paper on enhancing facial expression inference has been accepted by the ECCV 2024 Workshop.
2024.08: Started my Ph.D. journey at University at Buffalo, SUNY,Buffalo, NY.
2024.03: Our paper "SignAvatar" has been accepted by FG 2024 .
2024.03: I have been admitted to the Fall 2024 Doctorate of Philosophy program in CSE at the University at Buffalo, with a Research Assistant position at the Center for Unified Biometrics and Sensors under the supervision of Professor Venu Govindaraju.
2023.06:Research Assistant at University at Buffalo's Human Behavior Modeling lab, under the direct supervision of Professor Ifeoma Nwogu, focused on implementing AI generative algorithms for studying human behaviors.
2023.05: Successfully completed my Master's degree at Syracuse University with 3.861 / 4 GPA, Syracuse, NY.
2021.08: Started my Master's journey at Syracuse University, Syracuse, NY.

Experience

Research Scientist Intern, ByteDance/TikTok, May 2026 - Aug 2026.

Research Intern MSAI Reasoning and LU Group, Microsoft, May 2025- Aug 2025.

Research Assistant, National AI Institute for Exceptional Education, University at Buffalo, SUNY (UB), Sep 2024 – Present

Selected Research

MistyPilot: Enabling Social-Robot Control through Multi-Agent LLM Skill Orchestration
Xiao Wang*, Lu Dong*, Ifeoma Nwogu, Srirangaraj Setlur, Venu Govindaraju
European Conference on Computer Vision (ECCV 2026) & ACVR
Code PDF Project Webpage

AutoMisty: A Multi-Agent LLM Framework for Automated Code Generation in the Misty Social Robot
Xiao Wang*, Lu Dong*, Sahana Rangasrinivasan, Ifeoma Nwogu, Srirangaraj Setlur, Venugopal Govindaraju
International Conference on Intelligent Robots and Systems (IROS 2025)
DOI PDF BibTeX Project Webpage

InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Reading
Xiao Wang*, Lu Dong*, Ifeoma Nwogu, Srirangaraj Setlur, Venu Govindaraju
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026) & CV4Edu
arXiv PDF BibTeX Project Webpage

ConfusionBench: An Expert-Validated Benchmark for Confusion Recognition and Localization in Educational Videos
Xiao Wang*, Lu Dong*, Mark G Frank, Srirangaraj Setlur, Venu Govindaraju, Ifeoma Nwogu
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026) & CV4Edu
DOI PDF BibTeX Project Webpage

Ig3D: Integrating 3D Face Representations in Facial Expression Inference
Xiao Wang*, Lu Dong*, Srirangaraj Setlur, Venu Govindaraju, Ifeoma Nwogu
Proceedings of the 18th European Conference on Computer Vision (ECCV 2024) & ABAW
DOI PDF BibTeX Project Webpage

Word-Conditioned 3D American Sign Language Motion Generation
Lu Dong, Xiao Wang, Ifeoma Nwogu
The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024)
DOI PDF BibTeX Project Webpage

ProxyFusion: Face Feature Aggregation Through Sparse Experts
Bhavin Jawade, Alexander Stone, Deen Dayal Mohan, Xiao Wang, Srirangaraj Setlur, Venu Govindaraju
The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024)
DOI PDF BibTeX Project Webpage

SignAvatar: Sign Language 3D Motion Reconstruction and Generation
Lu Dong, Lipisha Chaudhary, Fei Xu, Xiao Wang, Mason Lary, Ifeoma Nwogu
The 18th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2024)
DOI PDF BibTeX Project Webpage

Last Updated on August 16, 2026