Abstract
Large language models (LLMs) such as ChatGPT are non-human intelligences that combine encyclopedic knowledge with complex but imperfect reasoning. When we connect an LLM to an autonomous mobile robot, we conjure up an intelligent agent that shares our physical world and can interact with us in many possible ways. Imagine playing “hospital” with a toy robot that knows enough medicine to pass board licensing exams. My students and I have been building an interface
between GPT-4o and the new VEX AIM robot that allows us to explore this potential of AI-powered robot toys. I will describe our results to date and what the future may hold.
David Touretzky

Dr. David S. Touretzky is a Research Professor of Computer Science at Carnegie Mellon University, and the founder and chair of AI4K12.org, which has developed national (U.S.) guidelines for teaching AI in K-12. Dr. Touretzky is also the creator of Calypso, an intelligent robot programming framework that puts powerful AI technologies into the hands of children.