Title: Toward Generalizable, Scalable, and Experience-Driven Robot Autonomy: From TAMP to Embodied Agents
Date: Tuesday, October 6th, 2026
Time: 3:00 PM - 4:30 PM EDT
Location: MRDC 3515
Zoom: https://gatech.zoom.us/j/96846452330?pwd=oGfmTGbPoLo2zyp5ulwGl9PjECLl0Y.1
Zhigen Zhao
Ph.D. Student
Institute for Robotics & Intelligent Machines
Georgia Institute of Technology
Committee members
Dr. Ye Zhao (advisor): Woodruff School of Mechanical Engineering, Georgia Institute of Technology
Dr. Jiachen Li: School of Industrial and Systems Engineering and Woodruff School of Mechanical Engineering, Georgia Institute of Technology
Dr. Shreyas Kousik: Woodruff School of Mechanical Engineering, Georgia Institute of Technology
Dr. Sonia Chernova: School of Interactive Computing, Georgia Institute of Technology
Dr. Shiqi Zhang: School of Computing, Binghamton University, State University of New York
Abstract
Robots deployed in unstructured, human-centric environments must carry out long-horizon tasks that couple discrete decisions with contact-rich continuous motion. Task and Motion Planning (TAMP) addresses this by decomposing the problem into a discrete task plan and a continuous motion plan, but classical TAMP requires re-engineering for each new task or environment, scales poorly with problem size and horizon, and accumulates no experience across deployments.
This proposal builds toward generalizable, scalable, and experience-driven robot autonomy by progressively replacing the hand-engineered layers of classical TAMP with learning-based counterparts. First, we formulate TAMP as a single bilevel optimization that couples symbolic search with dynamics-consistent motion and remains scalable by exploiting task structure. Second, we move this optimization offline and learn fast, robust motion policies by imitation, supported by cross-platform teleoperation and egocentric data infrastructure and by a discrete action representation that makes multi-task policies steerable at inference time. Finally, we propose an embodied agent system and an agent memory evaluation benchmark in which an LLM/VLM orchestrates VLA skills and a self-evolving multimodal memory accumulates verified experience across deployments, enabling the robot to continually self-improve from its own experience without retraining.