Interactive Software and Embodied Learning

One of the interesting potentials of interactive applications such as games is the ability to create highly effective, dynamic instructional materials.

Interactive software, through the combined engagement of visual, audio and motor feedback, enables the user to learn by doing. Software designers can use this to convey complex ideas to the user in a memorable and engaging fashion.

In my experience, several playthroughs of 2d or 3d games resulted in vivid and detailed recollection of each game level. Following gameplay, large portions of each map could be described verbally or with visual media long afterwards. The interactivity and visual information seemed to make a significant mental impression almost automatically.   

Interactive 2d and 3d interfaces are typically applied to simulations of physical objects and processes. Interaction with a spatial object, such as a map (i.e., google maps), 3 dimensional spaces (such as a walk-through architectural plan), and models of devices are useful for demonstrating the real-life use and interaction with the objects represented.

This interactive metaphor can also be used for the representation of abstract concepts and relationships. Infographics designers regularly represent concepts such as quantities, processes, and taxonomic relationships in visual terms. Interactive media could introduce additional dimensions, allowing the user to explore the data as if it were in physical space.

For example, a user could “physically” move back and forth through time to visualize events taking place during some historical period. In a graphical representation of the biological tree of life, a user could wander through the tree like a maze, encountering the creatures that live in its branches. Quantities could be represented by physical areas or volumes. Relationships between ideological and cultural movements could be represented as pathways, displaying historical figures, documents, and iconographic representation in a memorable format.

These models could be used as a type of audiovisual mnemonic for the user, creating strong, long-term mental impressions.

Spatial and motor memory - the same skills that the mind uses to navigate and explore our physical environment - could help reinforce the understanding of relationships between concepts as well as physical objects.