论文标题
内省剂:策略,生理学和感知的相互依存关系
The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents
论文作者
论文摘要
在过去的几年中,在体现的AI领域取得了长足的进步,在该领域中,人造代理(反映生物学对应物)现在能够从相互作用中学习以完成复杂的任务。尽管取得了成功,但生物生物仍然比这些模拟剂具有一个很大的优势:适应。尽管生物和模拟代理都做出决定实现目标(策略)的决定,但生物生物已经发展为了解其环境(传感)并对其做出反应(生理)。这些因素的净收益取决于环境,生物体已经适应了。例如,在低视力的水生环境中,一些鱼进化出了特定的神经元,这些神经元提供了一种可预测但又令人难以置信的快速策略,可以逃脱捕食者。哺乳动物已经失去了这些反应性系统,但是它们具有更大的视野和脑电路,能够理解许多未来的可能性。尽管传统体现的特工会操纵环境以最能实现目标,但我们为内省的代理人争辩,该代理在其环境的背景下考虑了自己的能力。我们表明,不同的环境产生截然不同的最佳设计,而长期计划的增加通常比其他改进(例如增强的身体能力)差得多。我们提出这些发现,以扩大体现AI的改进的定义,通过了越来越复杂的模型。同样,在本质上,我们希望将策略重新构建为一种工具,包括在环境中取得成功。代码可在以下网址获得:https://github.com/sarahpratt/introspective。
The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success, biological organisms still hold one large advantage over these simulated agents: adaptation. While both living and simulated agents make decisions to achieve goals (strategy), biological organisms have evolved to understand their environment (sensing) and respond to it (physiology). The net gain of these factors depends on the environment, and organisms have adapted accordingly. For example, in a low vision aquatic environment some fish have evolved specific neurons which offer a predictable, but incredibly rapid, strategy to escape from predators. Mammals have lost these reactive systems, but they have a much larger fields of view and brain circuitry capable of understanding many future possibilities. While traditional embodied agents manipulate an environment to best achieve a goal, we argue for an introspective agent, which considers its own abilities in the context of its environment. We show that different environments yield vastly different optimal designs, and increasing long-term planning is often far less beneficial than other improvements, such as increased physical ability. We present these findings to broaden the definition of improvement in embodied AI passed increasingly complex models. Just as in nature, we hope to reframe strategy as one tool, among many, to succeed in an environment. Code is available at: https://github.com/sarahpratt/introspective.