跳转到内容

Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI

Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI

Section titled “Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI”

⚠️ AI 生成 · 建议对照原文 本页为自动整理的学习笔记;关键数据与引用如需引用,请回查 PDF / 官方版本。

学习档位 中文笔记

类型 文献 · 更新 2026-07-19

所属 具身智能体 · 应用领域与案例 · 系统工程与评测

中文学习笔记(自动生成,需核验)

Section titled “中文学习笔记(自动生成,需核验)”

Topic: embodied-agents · Tier: foundational · Year: 2024 · Venue:
Evidence level: partial · 本地全文: 是 · 建议阅读: ~90 分钟
Paper: https://arxiv.org/abs/2407.06886
Code:
Generator: grok

这是据作者所知首个从多模态大模型(MLMs)与世界模型(WMs)视角、系统对齐网络空间(Cyber Space)与物理世界的具身AI全面综述,覆盖代表性机器人与模拟器、四大研究目标(感知/交互/智能体/sim-to-real),并提出ARIO数据集标准与大规模数据集,为AGI、智能机电系统与智能制造等应用提供基础参考与分类框架。

全面综述具身AI,强调基于MLMs与WMs对齐网络与物理空间,系统分类机器人、模拟器及感知-交互-智能体-sim-to-real四大任务,并提出ARIO统一数据集标准。

如何实现真正的人工通用智能(AGI):使智能不仅限于虚拟环境(网络空间)中的抽象问题解决,还能控制物理实体(机器人等),在复杂不可预测的物理世界中导航、感知、交互与执行任务;当前MLMs在长期记忆、复杂意图理解与复杂任务分解上仍有限。

计算机视觉、自然语言处理、机器人学基础;多模态大模型(MLMs)、大语言模型(LLMs)、世界模型(WMs)、强化学习/深度强化学习、sim-to-real迁移、具身感知与导航等相关概念。

  • 据作者所知,这是首个从基于MLMs与WMs的网络-物理空间对齐视角全面综述具身AI的工作,提供方法论、基准、挑战与应用的新洞察。
  • 将具身AI分类并总结为机器人、模拟器及四大主要研究任务:具身感知、具身交互、具身智能体与sim-to-real适应,形成详细分类体系。
  • 提出新数据集标准ARIO (All Robots In One)及统一大规模ARIO数据集,涵盖约300万episodes,来自258个series与321,064个任务,以促进鲁棒通用具身智能体发展。

作为综述论文:首先梳理代表性具身机器人与模拟器以理解研究焦点与局限;然后分析四大研究目标——1)具身感知(含主动视觉感知与视觉语言导航)、2)具身交互、3)具身智能体(含多模态基础模型与任务规划)、4)sim-to-real适应(含具身世界模型、数据收集与训练),覆盖SOTA方法、核心范式与综合数据集;进一步探讨MLMs在虚拟与真实具身智能体中的复杂性及其促进数字/物理环境交互的意义;最后总结挑战、局限与未来方向。整体框架基于ABC模型(AI brain / Embodied World Model + Body/Actor + Cross-modal sensors/Perception)。

ABC框架:A模型为具身世界模型(理解虚实环境)、B模型为执行体(动作执行、人机交互与工具使用)、C模型为跨模态主动感知(增强情境意识)。机器人分类:固定基座、轮式、履带式、四足、人形、仿生等。模拟器分通用(如Isaac Sim、Gazebo、MuJoCo、Genesis等,支持高保真物理、图形渲染、ROS集成、并行计算等)与真实场景基础模拟器。四大任务模块强调多模态元素对齐、主动探索与物理规律理解;取舍在于MLMs提供强感知/交互/规划但长期记忆与复杂分解仍受限,世界模型用于仿真与物理理解。

提出ARIO (All Robots In One)数据集标准与统一大规模数据集:约300万episodes,来自258 series与321,064 tasks。其他具体数据集、实验设置与指标待来源核验(综述提及综合数据集与基准但摘录未详列)。

提出ARIO统一大规模数据集(约300万episodes,258 series,321,064 tasks)以促进通用具身智能体;其他SOTA方法结果、对比实验与量化指标待来源核验。

当前MLMs在长期记忆、理解复杂意图与复杂任务分解上能力有限;部署物理世界成本高、挑战多;先前综述多过时或覆盖不全(MLMs/WMs/机器人/模拟器被忽视)。更全面的挑战、失败场景与适用边界待来源核验。

与前序 / 同期 / 后续方法的关系

Section titled “与前序 / 同期 / 后续方法的关系”

与先前具身AI综述[5,6,17,18]对比:多数发表于MLMs时代(约2023)之前而过时;2023后仅两篇分别聚焦视觉-语言-动作模型与智能制造具身AI系统。本文首次从MLMs+WMs网络-物理对齐视角全面覆盖,并补充机器人与模拟器最新发展。

关联项目https://github.com/HCPLab-SYSU/Embodied_AI_Paper_List(论文列表)。ARIO数据集与具体代码复现细节待来源核验;建议从项目仓库获取最新资源并参考模拟器(如Isaac Sim、MuJoCo)进行验证。

先读摘要与引言(理解动机、ABC框架与贡献);再读具身机器人(II)与模拟器(III)建立实体与环境基础;然后按四大任务顺序:具身感知(IV)→交互(V)→智能体(VI)→sim-to-real(VII);最后读挑战与未来方向(VIII)。表格与图优先浏览。

  1. Q: 具身AI与非具身AI(disembodied AI)的核心区别是什么? A: 非具身AI存在于网络空间,认知与物理实体解耦(如ChatGPT);具身AI存在于物理空间,认知整合到物理实体(机器人、车辆等设备)中(如RT-1/2/H)。
  2. Q: 本文提出的ABC模型分别代表什么? A: A: AI brain / Embodied World Model(理解虚实环境);B: Body / Actor(执行动作、人机交互与工具使用);C: Cross-modal sensors / Perception(多模态主动感知)。
  3. Q: 本文归纳的四大主要研究目标是什么? A: 1)具身感知;2)具身交互;3)具身智能体;4)sim-to-real适应。
  4. Q: ARIO数据集的规模大致是多少? A: 约300万episodes,来自258 series与321,064 tasks。
  5. Q: 当前MLMs在具身应用中仍存在哪些主要局限? A: 长期记忆、理解复杂意图以及复杂任务分解能力有限。
  • page 1 / Abstract: Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General Intelligence (AGI) and serves as a foundation for various applications (e.g., intelligent mechatronics systems, smart manufacturing) that bridge cyberspace and the physical world.
  • page 1 / Abstract: we analyze four main research targets: 1) embodied perception, 2) embodied interaction, 3) embodied agent, and 4) sim-to-real adaptation
  • page 2 / Contributions: To the best of our knowledge, this is the first comprehensive survey of embodied AI from the perspective of the alignment of cyber and physical spaces based on MLMs and WMs
  • page 2 / Contributions: we propose a new dataset standard ARIO (All Robots In One) and a unified large-scale ARIO dataset, encompassing approximately 3 million episodes collected from 258 series and 321,064 tasks.
  • page 1 / Fig.1 caption & text: The framework of the embodied agent based on MLMs and WMs, incorporates the ABC model, which stands for AI brain, Body, and Cross-modal sensors.
  • page 2 / Table I & text: Disembodied AI Cyber Space No Cognition and physical entities are disentangled ChatGPT [4], RoboGPT [8] Embodied AI Physical Space Robots, Cars, Other devices Cognition is integrated into physical entities RT-1 [9], RT-2 [10], RT-H [3]
  • page 1-2 / Introduction: Nevertheless, the capabilities of long-term memory, understanding complex intentions, and the decomposition of complex tasks are limited for current MLMs.
  • page 1 / Project: The associated project can be found at https://github.com/HCPLab-SYSU/Embodied_AI_Paper_List.
  • topic: application-domains
  • sources: asta, arxiv, openalex
  • retrieved_at: 2026-07-20
  • query: Find foundational and recent research papers for the topic «应用领域» (application-domains). Prefer peer-reviewed or widely cited work with clear method contributions. Include open-source code when available. Exclude pure survey spam unless highly cited. Core concepts: embodied AI, service robot, industrial robotics, autonomous systems applications. Search facets: embodied AI applications survey robotics; industrial robotics foundation models applications; service robots autonomous systems vertical
  • corpus_id: 271064200
  • arxiv: 2407.06886
  • doi: 10.1109/tmech.2025.3574943
  • relevance_score: 0.5812624693071252
  • score_total: 80
  • suggested_tier: recent

(no prose relevance explanation — numeric score only or HTTP source)

(no snippet evidence in candidate pool)

生成:2026-07-21 · 来源条数 2 · 模型 heuristic · 需人工核验数字

围绕「Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI」的核心问题与动机(待结合全文核验)。

  • 见原文方法章节;以下为基于摘要/摘录的要点提示。
  • IEEE/ASME TRANSACTIONS ON MECHATRONICS …

与相近工作的关系待核验;请对照 related work。

  • 勿仅凭摘要推断未给出的数值指标。
  1. 这篇工作的输入/输出表示是什么?(Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI)
  2. 训练目标与评测协议各是什么?
  3. 主要失败模式或局限是什么?
flowchart LR
A["输入 / 观测"] --> B["表示 / 编码"]
B --> C["推理 / 解码"]
C --> D["输出 / 动作或检测"]
%% method sketch for: Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI

方法结构示意(重绘;细节以原论文为准,待 PDF 核验)。

Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI arch p.1

来源:原论文约 p.1(arch);学习用途摘录。

Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI qualitative p.3

来源:原论文约 p.3(qualitative);学习用途摘录。

展开英文 Paper Card / AI deep analysis
Field Content
Year 2024
Authors Yang Liu, Weixing Chen, Yongjie Bai, Xiaodan Liang, Guanbin Li, Wen Gao, Liang Lin
arXiv 2407.06886
DOI 10.1109/tmech.2025.3574943
Topics embodied-agents, application-domains, systems-engineering
Paper https://arxiv.org/abs/2407.06886
展开 Extract / Selections / Local assets
  • embodied-agents: tier=foundational rank=1 score=80 — auto refresh 2026-07-19 sources=arxiv,openalex | promoted recent->foundational for coverage fill
  • application-domains: tier=recent rank=3 score=48 — Comprehensive survey aligning cyber space with physical world (embodied AI)
  • systems-engineering: tier=recent rank=4 score=51 — cross-topic assign from registry title match=1 keywords; 2026-07-19
IEEE/ASME TRANSACTIONS ON MECHATRONICS 1
Aligning Cyber Space with Physical World: A
Comprehensive Survey on Embodied AI
Yang Liu, Member, IEEE, Weixing Chen, Yongjie Bai, Xiaodan Liang, Senior Member, IEEE, Guanbin Li,
Member, IEEE, Wen Gao, Fellow, IEEE, Liang Lin, Fellow, IEEE
Abstract—Embodied Artificial Intelligence (Embodied AI) is Virtual Environment (Cyber Space)
Configurator
B Model
crucial for achieving Artificial General Intelligence (AGI) and Execute
Memory World
serves as a foundation for various applications (e.g., intelli- Model
Feedback
arXiv:2407.06886v8 [cs.CV] 25 Aug 2025
gent mechatronics systems, smart manufacturing) that bridge Perception Actor
cyberspace and the physical world. Recently, the emergence of Cost