Multimodally Grounded Language Technology - MGLT

Background

The basic scientific question of the MGLT project is how to computationally model the interrelated processes of understanding natural language and perceiving and producing movement in multimodal real world contexts.

An important problem in language technology and in computer science in general is that in most cases computer systems processing symbols or language do not have access to the phenomena being referred to. In contrast, human beings can readily associate expressions with their nonlinguistic experiences. As a direct consequence, the computational systems can only reason about the symbols themselves rather than about the meaning or external references of those symbols.

Objectives

Team

The project team consists of researchers from the Departments of Information and Computer Science and Media Technology at Aalto University School of Science.