Paper
From Woofs to Words: Towards Intelligent Robotic Guide Dogs with Verbal Communication
Authors
Yohei Hayamizu, David DeFazio, Hrudayangam Mehta, Zainab Altaweel, Jacqueline Choe, Chao Lin, Jake Juettner, Furui Xiao, Jeremy Blackburn, Shiqi Zhang
Abstract
Assistive robotics is an important subarea of robotics that focuses on the well-being of people with disabilities. A robotic guide dog is an assistive quadruped robot that helps visually impaired people in obstacle avoidance and navigation. Enabling language capabilities for robotic guide dogs goes beyond naively adding an existing dialog system onto a mobile robot. The novel challenges include grounding language in the dynamically changing environment and improving spatial awareness for the human handler. To address those challenges, we develop a novel dialog system for robotic guide dogs that uses LLMs to verbalize both navigational plans and scenes. The goal is to enable verbal communication for collaborative decision-making within the handler-robot team. In experiments, we conducted a human study to evaluate different verbalization strategies and a simulation study to assess the efficiency and accuracy in navigation tasks.
Metadata
Related papers
Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini
Ruofei Du, Benjamin Hersh, David Li, Nels Numan, Xun Qian, Yanhe Chen, Zhongy... • 2026-03-25
Comparing Developer and LLM Biases in Code Evaluation
Aditya Mittal, Ryan Shar, Zichu Wu, Shyam Agarwal, Tongshuang Wu, Chris Donah... • 2026-03-25
The Stochastic Gap: A Markovian Framework for Pre-Deployment Reliability and Oversight-Cost Auditing in Agentic Artificial Intelligence
Biplab Pal, Santanu Bhattacharya • 2026-03-25
Retrieval Improvements Do Not Guarantee Better Answers: A Study of RAG for AI Policy QA
Saahil Mathur, Ryan David Rittner, Vedant Ajit Thakur, Daniel Stuart Schiff, ... • 2026-03-25
MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
Zhuo Li, Yupeng Zhang, Pengyu Cheng, Jiajun Song, Mengyu Zhou, Hao Li, Shujie... • 2026-03-25
Raw Data (Debug)
{
"raw_xml": "<entry>\n <id>http://arxiv.org/abs/2603.12574v1</id>\n <title>From Woofs to Words: Towards Intelligent Robotic Guide Dogs with Verbal Communication</title>\n <updated>2026-03-13T02:11:00Z</updated>\n <link href='https://arxiv.org/abs/2603.12574v1' rel='alternate' type='text/html'/>\n <link href='https://arxiv.org/pdf/2603.12574v1' rel='related' title='pdf' type='application/pdf'/>\n <summary>Assistive robotics is an important subarea of robotics that focuses on the well-being of people with disabilities. A robotic guide dog is an assistive quadruped robot that helps visually impaired people in obstacle avoidance and navigation. Enabling language capabilities for robotic guide dogs goes beyond naively adding an existing dialog system onto a mobile robot. The novel challenges include grounding language in the dynamically changing environment and improving spatial awareness for the human handler. To address those challenges, we develop a novel dialog system for robotic guide dogs that uses LLMs to verbalize both navigational plans and scenes. The goal is to enable verbal communication for collaborative decision-making within the handler-robot team. In experiments, we conducted a human study to evaluate different verbalization strategies and a simulation study to assess the efficiency and accuracy in navigation tasks.</summary>\n <category scheme='http://arxiv.org/schemas/atom' term='cs.RO'/>\n <published>2026-03-13T02:11:00Z</published>\n <arxiv:comment>10 pages, 6 figures, AAAI 2026</arxiv:comment>\n <arxiv:primary_category term='cs.RO'/>\n <author>\n <name>Yohei Hayamizu</name>\n </author>\n <author>\n <name>David DeFazio</name>\n </author>\n <author>\n <name>Hrudayangam Mehta</name>\n </author>\n <author>\n <name>Zainab Altaweel</name>\n </author>\n <author>\n <name>Jacqueline Choe</name>\n </author>\n <author>\n <name>Chao Lin</name>\n </author>\n <author>\n <name>Jake Juettner</name>\n </author>\n <author>\n <name>Furui Xiao</name>\n </author>\n <author>\n <name>Jeremy Blackburn</name>\n </author>\n <author>\n <name>Shiqi Zhang</name>\n </author>\n </entry>"
}