Research Fridays - Perception in Artificial Agents: Cooperation and Alignment between Sensory Modes

Humans interact with the environment through their senses. These senses often don't work in isolation; rather, they cooperate in interpreting reality. To achieve this, each sensory mode must interpret reality in the same way. In other words, the internal representation that our brain forms of the environment based on visual data, for example, must align with the internal representation of the tactile mode.

Otherwise, we wouldn't be able to identify by touch what we see. How can an artificial agent make its senses cooperate? How can it create equivalent internal representations across different sensory modes?

In this talk, we'll provide insights on how to address these questions, answer some, and raise others that remain unanswered.