Implicit Semantic Transmission in Social Learning: Analysis and Modelling (CoR-Lab)

Supervisors: Katharina J. Rohlfing, Frank Joublin (HRI Offenbach)
Project members: Juana Salas Poblete, Nikolas Hemion
 

Background and Research Questions

The social context of learning has increasingly gained attention in developmental psychology, cognitive science and robotics. It has been proposed that an agent - in order to learn - needs to be grounded in a meaningful embodied activity. The robotic research has just started to benefit from the use of developmental approaches: Orienting towards 'learning by communicating' offers new learning paradigms, within which it can be analyzed how semantic information is transmitted, and which effect the way of transmission has onto learning. So far this paradigm involves face-to-face scenarios, where a tutor is focusing on a student. However, this learning situation is not offered in every culture. Instead, developmental research has shown that children are likely to benefit also from other scenarios. Motivated by animal studies by e.g. Irene Pepperberg on grey parrots which were trained in a social learning paradigm (model-rival-paradigm), it is our goal to investigate multi-party learning scenarios, in which the tutor does not address the student directly but the student is learning while observing a tutoring behaviour towards another person. Thus, our assumption is that learning can take place from both, direct and indirect teaching.

With this project, we will investigate the behaviour of tutors and students and study the achieved learning effects in different situations of social learning. Based on the data gathered in psychophysical experiments on both, direct and indirect teaching scenarios, we aim to identify different verbal and non-verbal patterns, e.g. denominating objects, showing an object. Following the identification and classification of these patterns, we aim to develop a generative model for their production. The purpose of this model is twofold. Firstly, it will allow setting up a virtual tutor. A virtual tutor can be used to create simulated dialogues with the virtual tutor replacing the real tutor or tutors and an additional avatar, which replaces the child. Secondly, building a generative model for the behaviour of the tutor will allow us to understand the underlying principles of learning in a social context better and the insights from the modelling will provide valuable feedback on the design of the psychophysical experiments.
 

The results of this research should enable the setup of a social interaction simulation environment, where reproducible experiments between tutor avatars and a robotic artefact could be performed. These experiments will allow testing new hypotheses on how social learning takes place.
 

Publications

Hemion, N., Joublin, F. & Rohlfing, K.J. (2011): A competetive mechanism for self-organized learning of sensorimotor mappings. Poster presented at the Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics IEEE ICDL EPIROB, 24. - 27. August. [pdf]

Salas Poblete, J., & Rohlfing, K. J. & Joublin, F. (2011): Learning words in familar vs. unfamiliar frames. Poster presented at the XII. International Congress for Studies in Child Language, Montreal, Canada, 19. – 23. July. [pdf]

Salas Poblete, J., Rohlfing, K.J., Joublin, F. (2011): Learning manipulated pragmatic frames in triadic interactions. Poster presented at the 12th International Pragmatics Conference IPrA, Manchester, July 3-8. [pdf]

Rohlfing, K.J., Salas Poblete, J. (2011): Providing or reducing context via familiar and unfamiliar frames. Talk given at the DGfS 2011 Workshop: What is a context?, Göttingen, February 23-35, 2011.

Rohlfing, K. J., Grimminger, A. & Salas Poblete, J. (2010): When pointing is used to express iconic meaning. Paper presented at the 4th International Conference of the International Society for Gesture Studies, Frankfurt (Oder), 26. – 30. July.

Salas Poblete, J., Rohlfing, K. J. & Joublin, F. (2010): Words within frames: Imitation and transfer learning mechanisms. Poster presented at the 2010 Combined Conference on Conceptual Structure, Discourse and Language CSDL and Embodied and Situated Language Processing ESLP, San Diego, CA, 16. – 19. September. [pdf]

Hemion, N. Joublin, F. & Rohlfing, K. J. (2010): How to build a schema-representation. Poster presented at the IEEE International Conference on Development and Learning. Ann Arbor, USA, August 18-21. [pdf]

Salas Poblete, J., Rohlfing, K. J., Joublin, F. (2010): Learning color adjectives and number words in a triadic teaching scenario. Poster presented at the 2010 International Conference on Language Acquisition, Barcelona, 08. – 10. September. [pdf]

Salas Poblete, J., Rohlfing, K. J., Joublin, F. (2010): Overhearing Equals Face-to-Face in Word Learning Scenarios. Poster presented at the XVIIth Biennial International Conference on Infant Studies Baltimore, Maryland, 10. – 14. March. [pdf]