RSS Feed
ACTREP |
Action representation and focus of attention in the perception of intentions, events and objects
- Supervisor(s): Hendrik Koesling, Helge Ritter, Thomas Schack
- Project Member(s): Kai Essig, Matthias Weigelt (Universität Paderborn)
Research Area: A B
|
|
|
Abstract
This project investigates the influence of movement expertise on visual perception during the observation and/or interaction with objects and ongoing events in the environment. The focus is on the specific interplay between certain parameters of eye movements (measured with a modern mobile eye-tracker) and the quality of mental representation structures during the selective perception of action-relevant information. In a series of recent experiments, we were already able to show expertise-dependent effects of perceptual resonance during the observation of complex motor actions. Thereby, the strength of motor resonance depends directly on the quality of the observer’s own mental skill representation. The expected insights about the cognitive functions of action-based perception are of paradigmatic importance for the establishment of human-machine-interfaces and the development of humanoid robots and intelligent systems.
Research Questions and Methods
There is a growing awareness that perceptual-cognitive skills, such as anticipation and decision making are crucial to high-level performance across a range of domains. The question is how are the building blocks of cognitive representation, action-based intelligence, and intelligent interaction established and then used by the human motor system and what role does perception play in this process? To better understand such interactions, it is important to not only examine the perception-based inductions of actions (i.e., motor resonance phenomena), but also to investigate the action-based perception (i.e., perceptual resonance phenomena) of events. Our paradigmatic approach, as well as the (interdisciplinary) design of methods specifically developed for this project, goes beyond the classical view of the perceptual machinery (that simply processes information influx) and the associated experimental paradigms demonstrating the perception-based induction of actions.
read more »
Outcomes
Over the course of this project, we analyzed how different levels of movement expertise affect the relative influence of top-down mechanisms and bottom-up mechanisms during the perception of complex actions, while measuring the visual attention patterns of experts and novices. Our recent experiments in soccer and handball already revealed expertise dependent effects of perceptual resonance during the observation of complex motor actions. Additionally, the analysis of eye movements revealed group specific differences (experts versus novices) in the visual perception strategy, as well as in various eye parameters, like number of fixations and fixation durations. Furthermore, experts apply a spatial gaze strategy, i.e., they focus on relevant image regions, whereas novices consider also task-irrelevant information and social cues in their decision processes (functional gaze strategy). In order to model how different levels of movement expertise affect the influence of top-down on bottom-up mechanisms during the perception of complex actions, we extend a saliency-based visual attention model by an expertise-based component. Knowledge about the cognitive function of action-based perception and the selection process of action relevant information from the steady flow of ongoing events, is of paradigmatic importance for the establishment of natural and intuitive human-machine interfaces and intelligent systems.
Publications
Influence of Movement Expertise on Visual Perception of Objects, Events and Motor Action- A Modelling Approach.
In: Developing and Applying Biologically-Inspired Vision Systems: Interdisciplinary Concepts. Pomplun M, Suzuki J (Eds.); Hershey, PA, USA: IGI Global Publishers.
Fakultät für Psychologie und Sportwissenschaft
Abteilung Sportwissenschaft
Center of Excellence - Cognitive Interaction Technology CITEC
AG Neuroinformatik
Arbeitsbereich II - Neurokognition und Bewegung - Biomechanik
Towards an Understanding of Grasping using a Multi-Sensing Approach
In: International Conference on Robotics and Automation (ICRA). Workshop: Autonomous Grasping: IEEE International Conference on Robotics and Automation: ICRA 2011, Shanghai, China: 1 - 8.
Center of Excellence - Cognitive Interaction Technology CITEC
AG Neuroinformatik
To gain a deeper understanding of human manual dexterity, we investigate an everyday manual interaction, recording hand kinematics, the involved forces and eyemovements. Using a multi-sensing approach we hope to develop a more complete understanding of what we have termed manual intelligence, with a view to enabling robots carry out complex tasks that we take for granted. A preliminary experiment was carried out which illuminated important aspects of manual intelligence such as where to look to find suitable grasping points, as well investigating differences in hand kinematics and the applied forces while carrying out a simple manual interaction.
Classifying the differences in gaze patterns of alphabetic and logographic L1 readers - A neural network approach
In: In: L. Iliadis & C. Jayne (Ed), Engineering Applications of Neural Networks, The 12th Engineering Applications of Neural Networks Conference (EANN2011). Iliadis L, Jayne C (Eds.); Corfu, Greece: 78 - 84.
AG Neuroinformatik
Fakultät für Biologie
Abteilung Sportwissenschaft
Center of Excellence - Cognitive Interaction Technology CITEC
Fakultät für Psychologie und Sportwissenschaft
JVideoGazer - Towards an Automatic Annotation of Gaze Videos from Natural Scenes
In: World Congress on Engineering and Technology (CET). Shanghai: 1 - 4.
Center of Excellence - Cognitive Interaction Technology CITEC
Abteilung Sportwissenschaft
Hochschulrechenzentrum
Modern mobile eye-tracking systems record participants' gaze behavior while they interact in an unrestricted environment, often haptically manipulating complex objects of interest. These mobile systems can be easily set up and operated. However, the gained freedom is paid for with a difficult and cumbersome analysis of the stored gaze data, as the recorded scene videos are individually different. They have to be manually annotated, sometimes frame-by-frame, to mark regions of interest. This very time consuming and error-prone process prevents the use of eye-tracking in various areas of application. In order to speed up the annotation, we developed a new software, JVideoGazer, for fully- and semi-automatic annotation of gaze videos. This software provides two alternative algorithms for object tracking: a SURF (Speeded-Up Robust Features) interest point detector and descriptor, and a Kernel-Based Bayesian Filtering (KBBF) algorithm. We evaluated the JVideoGazer by comparing the results of the object trackers among each other and to those of a manual annotation based on scene videos of a typical day-by-day task. Results show that the JVideoGazer provides a reliable automatic video analysis even under challenging recording conditions and thus significantly speeds up the annotation process. Furthermore, the tracking algorithms show different performance advantages under diverse experimental conditions, making our modular approach with various object tracking algorithms a suitable tool for the annotation of gaze videos from natural scenes.
Eyetracking im Sport: Erste Schritte vom Labor ins reale Spiel
In: In: T. Heinen, A. Milek, T. Hohmann & M. Raab (Ed) Embodiment: Wahrnehmung - Kognition - Handlung. Tagung der dvs-Sektion Sportmotorik in Köln. Heinen T, Milek A, Hohmann T, Raab M (Eds.); Köln: Hundt-Druck GmbH: 138 - 139.
Center of Excellence - Cognitive Interaction Technology CITEC
Abteilung Sportwissenschaft
AG Neuroinformatik
Perceptual Motor Skills And Cognitive Architecture of Action - Methods and Perspectives in Motor Control Research.
In: Advances in Psychology Research. Columbus AM (Ed.); 81. New York, USA: NovaScience Publishers.: 35 - 73.
Research Institute for Cognition and Robotics
Abteilung Sportwissenschaft
Fakultät für Psychologie und Sportwissenschaft
Center of Excellence - Cognitive Interaction Technology CITEC
AG Neuroinformatik
Selection of the 'open' side - An eye-tracking study on the expertise-based influence of conscious and unconscious cues on the penalty situation in soccer
In: JOURNAL OF SPORT & EXERCISE PSYCHOLOGY. 32. HUMAN KINETICS PUBL INC: S160 - S161.
Abteilung Sportwissenschaft
Fakultät für Psychologie und Sportwissenschaft
Center of Excellence - Cognitive Interaction Technology CITEC
Research Institute for Cognition and Robotics
AG Neuroinformatik
Der 7-Meter im Handball - Eine Blickbewegungsstudie zur Untersuchung des Einflusses der Torwartposition auf das Entscheidungsverhalten von Handball-Experten und Handball-Laien
In: K. M, B. W (Eds.); Hamburg: Czwalina.
AG Neuroinformatik
Abteilung Sportwissenschaft
Fakultät für Psychologie und Sportwissenschaft
Research Institute for Cognition and Robotics
Arbeitsbereich II - Neurokognition und Bewegung - Biomechanik
Fully-automatic annotation of scene videos: Establish eye tracking effectively in various industrial applications
In: SICE Annual Conference 2010, Proceedings of. Taipei, Taiwan: 3304 - 3307.
Center of Excellence - Cognitive Interaction Technology CITEC
Fakultät für Psychologie und Sportwissenschaft
Phenomena of perception-action-coupling in teamsports - An analysis of attention control on the basis of eye movements in soccer
In: Proc. 15th European Conference on Eye Movements. Southampton, England: 76.
Center of Excellence - Cognitive Interaction Technology CITEC
Abteilung Sportwissenschaft
Fakultät für Psychologie und Sportwissenschaft
Research Institute for Cognition and Robotics
AG Neuroinformatik
Vision-Based Image Retrieval (VBIR) - A New Approach for Natural and Intuitive Image Retrieval.
Saarbrücken: VDM Verlag.
Abteilung Sportwissenschaft
Fakultät für Psychologie und Sportwissenschaft
Center of Excellence - Cognitive Interaction Technology CITEC
AG Neuroinformatik
New CITEC Building
Interactive Intelligent Systems
Funded in the Excellence-Initiative
