Toward Human-Robot Symbiosis Through Multimodal Foundation Models

The emergence of foundation models has opened new frontiers in how robots perceive, act, and interact with the world. As these models are increasingly integrated into robotic systems, the long-envisioned goal of human-robot symbiosis, where humans and robots understand each other and collaborate in a mutually supportive and harmonious way, is now within reach. This Research Topic invites research that explores how foundation models can advance collaborative, adaptive, and human-centered robotic systems by leveraging their strengths in language understanding, visual grounding, multimodal perception, and high-level reasoning. It focuses on contributions addressing human-robot collaboration in dynamic environments, language-guided multimodal interaction, and shared autonomy or teleoperation where robots learn from and support humans, ultimately enhancing robot perception, decision-making, and generalization, while fostering human-robot symbiosis within structured and interpretable system designs.Achieving human-robot symbiosis has long been limited by robots' inability to perceive, reason, and interact with humans in natural and adaptive ways. The emergence of foundation models offers powerful capabilities in language, vision, and multimodal reasoning, opening new possibilities. When integrated into physical robotic systems, these models can help robots better understand human intentions and surrounding environments, reason jointly with humans to solve complex tasks, and even recognize their own limitations to request assistance. This Research Topic aims to explore approaches that leverage foundation models or learning-based methods to achieve seamless, interpretable, and human-centered collaboration between humans and robots across perception, planning, communication, and decision-making. It particularly encourages work that advances human-robot collaboration in dynamic environments, language-guided multimodal interaction, and shared autonomy or teleoperation where robots learn from and support humans. Contributions may address theory, system integration, or applications that promote mutually beneficial human-robot symbiosis, in which humans and robots build shared understanding and utilize complementary capabilities. These efforts will also support the development of intelligent, generalizable, and context-aware robotic systems, enabling reliable and adaptable deployment in human-involved environments.This Research Topic focuses on the integration of multimodal foundation models and learning-based approaches to advance human-centered robotics. While the vision encompasses a broad spectrum of human-robot symbiosis, this special issue emphasizes contributions that directly address:- Interactive human-robot collaboration in dynamic and unstructured environments- Language-guided and multimodal interaction that enhances mutual understanding between humans and robots- Shared autonomy and teleoperation frameworks where robots learn from or support humans in complex tasksWe particularly welcome studies that combine perception, reasoning, and learning to improve robots’ capabilities in interpreting human intentions, adapting to context, and providing interpretable decision-making. Research on foundational technologies (for example, multimodal perception or skill learning) is also encouraged if it explicitly contributes to these interaction-focused goals.Relevant research areas include, but are not limited to:- Human-Robot Interaction- Human-Robot Collaboration- Human-Centered Robotics- Multimodal Foundation Models in Robotics- Language Guided Robotic Manipulation- Teleoperation and Shared Autonomy- Learning from Demonstration- Mobile Manipulation- Physical Human-Robot Interaction- Interactive Laboratory Automation- Interactive Task Planning and Decision Making- Interactive Robot Learning and Skill RefinementThis Research Topic is related to the workshop Enabling Autonomy and Independence in Aging Societies through Advanced Robotics and AI: Methods, Challenges, and Future Perspectives taking place at the 2026 IEEE International Conference on Robotics & Automation (ICRA) conference, in Vienna, Austria. Topic editors: Yaonan Zhu, Yasuhisa Hasegawa, Liming Chen, Jian Huang, Yusuke Iwasawa, Yutaka Matsuo Source: https://www.frontiersin.org/research-topics/72326/toward-human-robot-symbiosis-through-multimodal-foundation-models