Theme IV: Select computational approaches to the vision/language interface - supplementary links

• Paul Cohen's publications (dynamic maps for verbs, and other papers).
• Papers by Tim Oates (see especially the one titled Using Syntax to Learn Semantics: An Experiment in Language Acquisition with a Mobile Robot).
• Talking Heads Experiment - a Turing-test like public experiment. The experiment is based on a set of robot bodies which have been located in several places in the world and connected through the Internet. Software agents can teleport themselves between these robot bodies and thus experience different realities and engage in grounded interaction with other agents. The interaction takes the form of a language game in which one robot attempts to identify an object in the environment to the other robot through verbal means and through pointing gestures. The language nor the ontology of the robots have been built in but must be invented and acquired by the robots autonomously through playing the game. When a game fails, the robots expand their conceptual repertoires and/or lexicons. In the experiment, a shared lexicon and a shared ontology gradually emerges through self-organisation. The lexicon is grounded in the visual experiences of the robots.
• Hermann Hesse and Glass Bead Game design.