Embodied Interaction

This page contains all lectures and literature for the Embodied Interaction master elective course. If you follow the course within University of Twente please go to the corresponding Canvas page for all technical information, exam information, literature and so on.

This space is meant for anyone outside of the university who is interested in the topic. Newest lectures at the bottom, and below that, a literature list.

Lecture 1: General Intro

Embodied Interaction Lecture 1 Part 1: What is Embodied Technology?
Embodied Interaction Lecture 1 Part 2: The Cartesian Legacy
Embodied Interaction Lecture 1 Part 3: The Embodied Alternative
Embodied Interaction Lecture 1 Part 4:
Designing for Embodied Being-in-the-World

Lecture 2: Tangible Interaction

Embodied Interaction Lecture 2 (part 2) Tangible Interaction

Lecture 3: External representation and computation

Embodied Interaction Lecture 3 (part 1) External Computation and Representation
Embodied Interaction Lecture 3 (Part 2) External Computation and Representation

Lecture 4: Socially Situated Practices


Embodied Interaction Lecture 4 (part1): Socially Situated Practices
Embodied Interaction Lecture 4 (part 2): Socially Situated Practices

Lecture 5: Action Perception Couplings

Embodied Interaction Lecture 5 (part 1) Action Perception Couplings
Embodied Interaction Lecture 5 (part 2) Action Perception Couplings
Embodied Interaction Lecture 6 (part 3) Action Perception Couplings

Lecture 6: Participatory Sensemaking

Embodied Interaction Lecture 6 (Part 1) Participatory Sensemaking
Embodied Interaction Lecture 6 (Part 2) Participatory Sensemaking

Lecture 7: Phenomenology

Lecture 7 (complete) Phenomenology

Old recordings:

The Embodied Interaction Course was video-recorded once before, which was actually the first time it ran (so bear with me). Since then, the course changed considerably (and so did my hair), but if you want, you can still have a look at these video’s, of which the audio quality is sometimes quite bad, for which, as for all of my hair styles so far, my apologies: See: via https://vimeo.com/groups/335523

Required readings (complete)

Djajadiningrat, T., Matthews, B., & Stienstra, M. (2007). Easy doesn’t do it: skill and expression in tangible aesthetics. Personal and Ubiquitous Computing, 11(8), 657–676. https://doi.org/10.1007/s00779-006-0137-9 Download
van Dijk, J. (2018). Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction, 2(1), 7. https://doi.org/10.3390/mti2010007 Download
Hummels, C., & van Dijk, J. (2015). Seven Principles to Design for Embodied Sensemaking. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’14 (pp. 21–28). Stanford, California, USA: ACM Press. https://doi.org/10.1145/2677199.2680577
Goffman, E. (2014). Behavior in public places. Place of publication not identified: Free Press. Retrieved from http://www.jellevandijk.org/wp-content/uploads/GOFFMAN-PART1.pdf
Goldstein, E. B. (1981). The Ecology of J. J. Gibson’s Perception. Leonardo, 14(3), 191. https://doi.org/10.2307/1574269
Kirsh, D. (2010). Thinking with external representations. Ai & Society, 25(4), 441–454. https://doi.org/10.1007/s00146-010-0272-8
Ishii, H. (2008). Tangible bits: beyond pixels. In Proceedings of the 2nd international conference on Tangible and embedded interaction  - TEI ’08 (p. xv). Bonn, Germany: ACM Press. https://doi.org/10.1145/1347390.1347392
Klemmer, S. R., Hartman, B. an. T., & L. (2006). How bodies matter: five themes for interaction design. In Proc. of DIS‘06 (pp. 26–28). New York: ACM. Retrieved from https://dl.acm.org/doi/10.1145/1142405.1142429
van Dijk, J., & Hummels, C. (2017). Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’17 (pp. 47–56). Yokohama, Japan: ACM Press. https://doi.org/10.1145/3024969.3025007

Extra readings

(Let me know if you are interested in one but cannot find it online)

Brave, S., & Dahley, A. (1997). inTouch: a medium for haptic interpersonal communication. In CHI ’97 extended abstracts on Human factors in computing systems looking to the future - CHI ’97 (p. 363). Atlanta, Georgia: ACM Press. https://doi.org/10.1145/1120212.1120435
van Dijk, J., & Verhoeven, F. (2016). To Shed Some Light on Empowerment: Towards Designing for Embodied Functionality. Presented at the Design Research Society Conference 2016. https://doi.org/10.21606/drs.2016.381 Download
Fernaeus, Y., Tholander, J., & Jonsson, M. (2008). Toward a new set of ideals: consequences of the practice turn. In tangible interaction. Proc of TEI’08, Feb (pp. 18–20). New York: ACM.
Brooks, R. A. (1991). Intelligence without representation. Artificial Intelligence, 47(1–3), 139–159. https://doi.org/10.1016/0004-3702(91)90053-M
Beer, R. D. (2008). Dynamical systems and embedded cognition. In K. F. and W. Ramsey (Ed.), The Cambridge Handbook of Artificial Intelligence. Cambridge: University Press.
Verbeek, P.-P. (2000). De daadkracht der dingen (What things do). Amsterdam: Boom.
van Dijk, J. (2018). Designing for Embodied Being-in-the-World: A Critical Analysis of the Concept of Embodiment in the Design of Hybrids. Multimodal Technologies and Interaction, 2(1), 7. https://doi.org/10.3390/mti2010007 Download
Shaer, O. (2009). Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends® in Human–Computer Interaction, 3(1–2), 1–137. https://doi.org/10.1561/1100000026 Download
Di Paolo, E. A., Cuffari, E. C., & De Jaegher, H. (2018). Linguistic bodies: the continuity between life and language. Cambridge, Massachusetts: The MIT Press.
van Dijk, J., & Hummels, C. (2017). Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’17 (pp. 47–56). Yokohama, Japan: ACM Press. https://doi.org/10.1145/3024969.3025007
Jaasma, P., Dijk, J. van, Frens, J., & Hummels, C. (2017). On the Role of External Representations in Designing for Participatory Sensemaking. In M. B. Alonso & E. Ozcan (Eds.), Proceedings of the Conference on Design and Semantics of Form and Movement - Sense and Sensitivity, DeSForM 2017. InTech. Retrieved from http://www.intechopen.com/books/proceedings-of-the-conference-on-design-and-semantics-of-form-and-movement-sense-and-sensitivity-desform-2017/on-the-role-of-external-representations-in-designing-for-participatory-sensemaking
van Dijk, J., Hendriks, N., Frauenberger, C., Verhoeven, F., Slegers, K., Brandt, E., & Branco, R. M. (2016). Empowering people with impairments: how participatory methods can inform the design of empowering artifacts. In Proceedings of the 14th Participatory Design Conference on Short Papers, Interactive Exhibitions, Workshops - PDC ’16 (pp. 121–122). Aarhus, Denmark: ACM Press. https://doi.org/10.1145/2948076.2948101
Verbeek, P.-P. (2008). Cyborg intentionality: Rethinking the phenomenology of human–technology relations. Phenomenology and the Cognitive Sciences, 7(3), 387–395. https://doi.org/10.1007/s11097-008-9099-x
Rogers, Y. (2006). Moving on from Weiser’s Vision of Calm Computing: Engaging UbiComp Experiences. In P. Dourish & A. Friday (Eds.), UbiComp 2006: Ubiquitous Computing (Vol. 4206, pp. 404–421). Berlin, Heidelberg: Springer Berlin Heidelberg. Retrieved from http://link.springer.com/10.1007/11853565_24
Hengeveld, B., Frens, J., & Deckers, E. (2016). Artefact Matters. The Design Journal, 19(2), 323–337. https://doi.org/10.1080/14606925.2016.1129175
Weiser, M. (1999). The computer for the 21 st century. ACM SIGMOBILE Mobile Computing and Communications Review, 3(3), 3–11. https://doi.org/10.1145/329124.329126
Schutz, A., & Luckmann, T. (1995). The structures of the life-world. 1 1.
Schutz, A., Walsh, G., & Lehnert, F. (4197). The phenomenology of the social world. Evanston, lllinois: Northwestern University Press.
Riemer, K., & Johnston, R. B. (2014). Rethinking the place of the artefact in IS using Heidegger’s analysis of equipment. European Journal of Information Systems, 23(3), 273–288. https://doi.org/10.1057/ejis.2013.5
Brereton, M. (2013). Habituated objects: everyday tangibles that foster the independent living of an elderly woman. Interactions, 20(4), 20. https://doi.org/10.1145/2486227.2486233
Heyer, C., & Brereton, M. (2010). Design from the everyday: continuously evolving, embedded exploratory prototypes (p. 282). ACM Press. https://doi.org/10.1145/1858171.1858222
Höök, K., Jonsson, M. P., Ståhl, A., & Mercurio, J. (2016). Somaesthetic Appreciation Design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 3131–3142). ACM Press. https://doi.org/10.1145/2858036.2858583
Hummels, C., & Lévy, P. (2013). Matter of transformation: designing an alternative tomorrow inspired by phenomenology. Interactions, 20(6), 42–49. https://doi.org/10.1145/2533713
Dreyfus, H. (1991). Being-in-the-world: a commentary on Heidegger’s Being and time, division I. Cambridge, Mass: MIT Press.
Loke, L., & Robertson, T. (2013). Moving and making strange: An embodied approach to movement-based interaction design. ACM Trans. Comput.-Hum. Interact., 20(1), 1–25.
Svanaes, D. (2013). Interaction Design for and with the Lived Body: Some Implications of Merleau-ponty’s Phenomenology. ACM Trans. Comput.-Hum. Interact., 20(1), 8:1-8:30. https://doi.org/10.1145/2442106.2442114
Clark, A. (2003). Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence. Oxford University Press.
Bannon, L. J., & Bødker, S. (1991). Beyond the interface: encountering artifacts in use. In J. M. Carroll (Ed.), Designing interaction (pp. 227–253). Cambridge University Press.
Winograd, T., & Flores, F. (1986). Understanding Computers and Cognition: A new foundation for Design. California: Addisson-Wesley.
Stienstra, J. T., Overbeeke, C. J., & Wensveen, S. A. G. (2011). Embodying complexity through movement sonification : case study on empowering the speed-skater. In Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity (pp. 13–16). Alghero, Italy.
Stienstra, J. T., Bruns, M., Wensveen, S. A. G., & Kuenen, C. D. (2012). How to design for transformation of behavior through interactive materiality. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction (NordiCHI. Copenhagen, Denmark, New York: ACM.
Schön, D. A. (1983). The reflective practitioner - how professionals think in action. New York: Basic Books.
Schiphorst, T. (1992). The Choreography Machine: A Design Tool For Character and Human Movement, CyberArts: Exploring Art and. San Francisco, CA: Technology, Miller Freeman Inc., Book Division.
Ryle, G. (1949). The Concept of Mind. New York: Barnes &Noble.
Rietveld, E., De Haan, S., & Denys, D. (2012). Social affordances in context: What is it that we are bodily responsive to? Behavioral and Brain Sciences.
Overbeeke, C. J., & Wensveen, S. A. G. (2003). From Perception to Experience, from Affordances to Irresistibles. In Proceedings of DPPI’03 (pp. 92–97). Pittsburgh, Pennsylvania.
Robertson, T. (2002). The public availability of actions and artefacts. Computer Supported Cooperative Work, 11, 299–316.
Robertson, T. (1997). Cooperative Work and Lived Cognition: A Taxonomy of Embodied Actions. In Proc Fifth ECCSCW (pp. 205–220). Dordrecht: Kluwer Academic Publishers.
Pye, D. (1968). The Nature and Art of Workmanship. Cambridge: Cambridge University Press.
Maturana, H. an. V., & F.J. (1984). The tree of knowledge. Biological basis of human understanding. Boston: Shambhala.
Lakoff, G., & Johnson, M. (1999). Philosophy In The Flesh: The Embodied Mind and Its Challenge to Western Thought. New York: Basic Books.
Lave, J., & Wenger, and E. (1991). Situated Learning: Legitimate Peripheral Participation. Cambridge: Cambridge University Press.
Kirsh, D. (2009). Problem Solving and Situated Cognition. In P. R. In & M. Aydede (Eds.), The Cambridge Handbook of Situated Cognition (pp. 264–306). Cambridge: Cambridge University Press.
Kaptelinin, V. an. N., & B. (2006). Acting with Technology: Activity Theory and Interaction Design. Cambridge: MIT Press.
Kirsh, D., & Maglio, P. (1994). On distinguishing epistemic from pragmatic action. Cognitive Science, 18, 513–549.
De Jaegher, H., & Di Paolo, Ezequiel. (2007). Participatory sense-making: An enactive approach to social cognition. Phenomenology and the Cognitive Sciences, 6(4), 485–507.
Ingold, T. (2000). Making culture and weaving the world. (M. Matter & M. C. M.Graves-Brown, Eds.). London: Routledge.
Hummels, C. C. M., Overbeeke, C. J., Appleby, R. S., Frens, J. W., & Wensveen, S. A. G. (2008). The power of embodiment for design and vice versa. Form +. Zweck, 22, 6–11.
Helmes, J., Hummels, C. an. S., & A. (2009). The Other Brother: Re-experiencing Spontaneous Moments from Domestic Life. In Proceedings of the Third International Conference on Tangible and Embedded Interaction (p. 233). Cambridge, UK.
Heath, C., & Luff, P. (2000). Technology in action. Cambridge University Press.