Home › Embodied Interaction

Embodied Interaction

This page contains all lectures and literature for the Embodied Interaction master elective course. If you follow the course within University of Twente please go to the corresponding Canvas page for all technical information, exam information, literature and so on.

This space is meant for anyone outside of the university who is interested in the topic. Newest lectures at the bottom, and below that, a literature list.

Lecture 1: General Intro

Embodied Interaction Lecture 1 Part 1: What is Embodied Technology?
Embodied Interaction Lecture 1 Part 2: The Cartesian Legacy
Embodied Interaction Lecture 1 Part 3: The Embodied Alternative
Embodied Interaction Lecture 1 Part 4:
Designing for Embodied Being-in-the-World

Lecture 2: Tangible Interaction

Embodied Interaction Lecture 2 (part 2) Tangible Interaction

Lecture 3: External representation and computation

Embodied Interaction Lecture 3 (part 1) External Computation and Representation
Embodied Interaction Lecture 3 (Part 2) External Computation and Representation

Lecture 4: Socially Situated Practices


Embodied Interaction Lecture 4 (part1): Socially Situated Practices
Embodied Interaction Lecture 4 (part 2): Socially Situated Practices

Lecture 5: Action Perception Couplings

Embodied Interaction Lecture 5 (part 1) Action Perception Couplings
Embodied Interaction Lecture 5 (part 2) Action Perception Couplings
Embodied Interaction Lecture 5 (part 3) Action Perception Couplings

Lecture 6: Participatory Sensemaking

Embodied Interaction Lecture 6 (Part 1) Participatory Sensemaking
Embodied Interaction Lecture 6 (Part 2) Participatory Sensemaking

Lecture 7: Phenomenology

Lecture 7 (complete) Phenomenology

Old recordings:

The Embodied Interaction Course was video-recorded once before, which was actually the first time it ran (so bear with me). Since then, the course changed considerably (and so did my hair), but if you want, you can still have a look at these video’s, of which the audio quality is sometimes quite bad, for which, as for all of my hair styles so far, my apologies: See: via https://vimeo.com/groups/335523

Required readings (complete)

Smit, D., Hengeveld, B., Murer, M., & Tscheligi, M. (2022). Hybrid Design Tools for Participatory, Embodied Sensemaking: An Applied Framework. Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction, 1–10. https://doi.org/10.1145/3490149.3501332 Download
Goldstein, E. B. (1981). The Ecology of J. J. Gibson’s Perception. Leonardo, 14(3), 191. https://doi.org/10.2307/1574269
Wilde, D., Vallgårda, A., & Tomico, O. (2017). Embodied Design Ideation Methods: Analysing the Power of Estrangement. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 5158–5170. https://doi.org/10.1145/3025453.3025873
Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction, 7(2), 174–196. https://doi.org/10.1145/353485.353487
Djajadiningrat, T., Matthews, B., & Stienstra, M. (2007). Easy doesn’t do it: skill and expression in tangible aesthetics. Personal and Ubiquitous Computing, 11(8), 657–676. https://doi.org/10.1007/s00779-006-0137-9 Download Download Download
van Dijk, J. (2018). Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction, 2(1), 7. https://doi.org/10.3390/mti2010007 Download
Hummels, C., & van Dijk, J. (2015). Seven Principles to Design for Embodied Sensemaking. Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’14, 21–28. https://doi.org/10.1145/2677199.2680577
Ishii, H. (2008). Tangible bits: beyond pixels. Proceedings of the 2nd International Conference on Tangible and Embedded Interaction  - TEI ’08, xv. https://doi.org/10.1145/1347390.1347392
Klemmer, S. R., Hartman, B. and T., & L. (2006). How bodies matter: five themes for interaction design. In Proc. of DIS‘06 (pp. 26–28). ACM. https://dl.acm.org/doi/10.1145/1142405.1142429
Dourish, P. (2001). Where the Action Is: The Foundations of Embodied Interaction. MIT Press.

Extra readings

(Let me know if you are interested in one but cannot find it online)

Goldstein, E. B. (1981). The Ecology of J. J. Gibson’s Perception. Leonardo, 14(3), 191. https://doi.org/10.2307/1574269
van Dijk, J., & Hummels, C. C. M. (2015). Designing for Participatory Sensemaking. European Academy of Design Conference 2015, Paris.
van Dijk, J., & Vos, G.-W. (2011, November 3). Traces in Creative Spaces. C&C’11. ACM Creativity and Cognition, Atlanta, Georgia, USA.
Jaasma, P., van Dijk, J., Frens, J., & Hummels, C. (2017). On the Role of External Representations in Designing for Participatory Sensemaking. In M. B. Alonso & E. Ozcan (Eds.), Proceedings of the Conference on Design and Semantics of Form and Movement - Sense and Sensitivity, DeSForM 2017. InTech. http://www.intechopen.com/books/proceedings-of-the-conference-on-design-and-semantics-of-form-and-movement-sense-and-sensitivity-desform-2017/on-the-role-of-external-representations-in-designing-for-participatory-sensemaking Download
van Dijk, J., & Brouwer, C. E. (2011). Making sense of brainstorms: some NOOTs to reflect on. In Participatory Innovation Conference (PINC11), Sonderborg, Danmark.
van Dijk, J., Roest, J., der, J. V., Lugt, R., & Overbeeke, C. J. (2011). NOOT: A tool for sharing moments of reflection during creative meetings. HONORABLE MENTION.
Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction, 7(2), 174–196. https://doi.org/10.1145/353485.353487
Schutz, A., Walsh, G., & Lehnert, F. (1974). The phenomenology of the social world. Northwestern University Press.
van Dijk, J., & Verhoeven, F. (2016, June 25). To Shed Some Light on Empowerment: Towards Designing for Embodied Functionality. Design Research Society Conference 2016. https://doi.org/10.21606/drs.2016.381 Download
Fernaeus, Y., Tholander, J., & Jonsson, M. (2008). Toward a new set of ideals: consequences of the practice turn. In tangible interaction. Proc of TEI’08, Feb (pp. 18–20). ACM.
Brooks, R. A. (1991). Intelligence without representation. Artificial Intelligence, 47(1–3), 139–159. https://doi.org/10.1016/0004-3702(91)90053-M
Beer, R. D. (2008). Dynamical systems and embedded cognition. In K. F. and W. Ramsey (Ed.), The Cambridge Handbook of Artificial Intelligence. University Press.
Verbeek, P.-P. (2000). De daadkracht der dingen (What things do). Boom.
van Dijk, J. (2018). Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction, 2(1), 7. https://doi.org/10.3390/mti2010007 Download
Goffman, E. (2014). Behavior in public places. Free Press. http://www.jellevandijk.org/wp-content/uploads/GOFFMAN-PART1.pdf
Shaer, O. (2009). Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends® in Human–Computer Interaction, 3(1–2), 1–137. https://doi.org/10.1561/1100000026 Download
Kirsh, D. (2010). Thinking with external representations. Ai & Society, 25(4), 441–454. https://doi.org/10.1007/s00146-010-0272-8
Di Paolo, E. A., Cuffari, E. C., & De Jaegher, H. (2018). Linguistic bodies: the continuity between life and language. The MIT Press.
van Dijk, J., & Hummels, C. (2017). Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework. Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’17, 47–56. https://doi.org/10.1145/3024969.3025007
van Dijk, J., Hendriks, N., Frauenberger, C., Verhoeven, F., Slegers, K., Brandt, E., & Branco, R. M. (2016). Empowering people with impairments: how participatory methods can inform the design of empowering artifacts. Proceedings of the 14th Participatory Design Conference on Short Papers, Interactive Exhibitions, Workshops - PDC ’16, 121–122. https://doi.org/10.1145/2948076.2948101
Verbeek, P.-P. (2008). Cyborg intentionality: Rethinking the phenomenology of human–technology relations. Phenomenology and the Cognitive Sciences, 7(3), 387–395. https://doi.org/10.1007/s11097-008-9099-x
Rogers, Y. (2006). Moving on from Weiser’s Vision of Calm Computing: Engaging UbiComp Experiences. In P. Dourish & A. Friday (Eds.), UbiComp 2006: Ubiquitous Computing (Vol. 4206, pp. 404–421). Springer Berlin Heidelberg. http://link.springer.com/10.1007/11853565_24 Download
Hengeveld, B., Frens, J., & Deckers, E. (2016). Artefact Matters. The Design Journal, 19(2), 323–337. https://doi.org/10.1080/14606925.2016.1129175
Weiser, M. (1999). The computer for the 21 st century. ACM SIGMOBILE Mobile Computing and Communications Review, 3(3), 3–11. https://doi.org/10.1145/329124.329126
Schutz, A., & Luckmann, T. (1995). The structures of the life-world. 1 1.
Riemer, K., & Johnston, R. B. (2014). Rethinking the place of the artefact in IS using Heidegger’s analysis of equipment. European Journal of Information Systems, 23(3), 273–288. https://doi.org/10.1057/ejis.2013.5
Brereton, M. (2013). Habituated objects: everyday tangibles that foster the independent living of an elderly woman. Interactions, 20(4), 20. https://doi.org/10.1145/2486227.2486233
Heyer, C., & Brereton, M. (2010). Design from the everyday: continuously evolving, embedded exploratory prototypes. 282. https://doi.org/10.1145/1858171.1858222
Höök, K., Jonsson, M. P., Ståhl, A., & Mercurio, J. (2016). Somaesthetic Appreciation Design. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 3131–3142. https://doi.org/10.1145/2858036.2858583
Hummels, C., & Lévy, P. (2013). Matter of transformation: designing an alternative tomorrow inspired by phenomenology. Interactions, 20(6), 42–49. https://doi.org/10.1145/2533713
Dreyfus, H. (1991). Being-in-the-world: a commentary on Heidegger’s Being and time, division I. MIT Press.
Loke, L., & Robertson, T. (2013). Moving and making strange: An embodied approach to movement-based interaction design. ACM Trans. Comput.-Hum. Interact., 20(1), 1–25.
Svanaes, D. (2013). Interaction Design for and with the Lived Body: Some Implications of Merleau-ponty’s Phenomenology. ACM Trans. Comput.-Hum. Interact., 20(1), 8:1-8:30. https://doi.org/10.1145/2442106.2442114
Clark, A. (2003). Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence. Oxford University Press.
Bannon, L. J., & Bødker, S. (1991). Beyond the interface: encountering artifacts in use. In J. M. Carroll (Ed.), Designing interaction (pp. 227–253). Cambridge University Press.
Winograd, T., & Flores, F. (1986). Understanding Computers and Cognition: A new foundation for Design. Addisson-Wesley.
Stienstra, J. T., Overbeeke, C. J., & Wensveen, S. A. G. (2011). Embodying complexity through movement sonification : case study on empowering the speed-skater. Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity, 13–16.
Stienstra, J. T., Bruns, M., Wensveen, S. A. G., & Kuenen, C. D. (2012, October). How to design for transformation of behavior through interactive materiality. Proceedings of the 7th Nordic Conference on Human-Computer Interaction (NordiCHI.
Schön, D. A. (1983). The reflective practitioner - how professionals think in action. Basic Books.
Schiphorst, T. (1992). The Choreography Machine: A Design Tool For Character and Human Movement, CyberArts: Exploring Art and. Technology, Miller Freeman Inc., Book Division.
Ryle, G. (1949). The Concept of Mind. Barnes &Noble.
Rietveld, E., De Haan, S., & Denys, D. (2012). Social affordances in context: What is it that we are bodily responsive to? Behavioral and Brain Sciences.
Overbeeke, C. J., & Wensveen, S. A. G. (2003). From Perception to Experience, from Affordances to Irresistibles. Proceedings of DPPI’03, 92–97.
Robertson, T. (2002). The public availability of actions and artefacts. Computer Supported Cooperative Work, 11, 299–316.
Robertson, T. (1997). Cooperative Work and Lived Cognition: A Taxonomy of Embodied Actions. In Proc Fifth ECCSCW (pp. 205–220). Kluwer Academic Publishers.
Pye, D. (1968). The Nature and Art of Workmanship. Cambridge University Press.
Maturana, H. and V., & F.J. (1984). The tree of knowledge. Biological basis of human understanding. Shambhala.
Lakoff, G., & Johnson, M. (1999). Philosophy In The Flesh: The Embodied Mind and Its Challenge to Western Thought. Basic Books.
Lave, J., & Wenger, and E. (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge University Press.
Kirsh, D. (2009). Problem Solving and Situated Cognition. In P. R. In & M. Aydede (Eds.), The Cambridge Handbook of Situated Cognition (pp. 264–306). Cambridge University Press.