Kinect+Processing

Cecilia Margareta

Tjärnberg

Intro, project review presentation

Kinect+Processing


The motion point cloud data was created through 3d scanning using a Kinect motion sensor paired with a computer and the open-source software Processing. This project was a part of the MFA thesis BIG DATA DESIGN. During this collaborative project "low tech scanning" as a creative outlet was explored utilizing a discontinued device from the gaming industry. The workshop was done together with Alexander Wallin, a computer programmer, and musician, and with support from Palle Torsson visual artist and Senior Lecturer at Konstfack and Gunnar Söder artist and Lecturer at Konstfack.




Music by Alexander Wallin, computer programmer, and musician.

Process from collaborative workshop, Kinect and Processing, Cecilia Margareta Tjärnberg and Alexander Wallin 2019

Filming with Alexander we took advantage of our direct surroundings and built a temporary interactive stage using bubblewrap and mirrors. The effects were amazing. Another new alternative material that is being developed is augmented reality. Through further collaboration with computer programmers, the field of architecture can utilize the technology to create an interactive digital spatial design. We already create digital material and to explore different ways to interact with this material is a natural next step. Through augmented reality, we can see and interact with three-dimensional digital architecture outside the computer. You just need a smartphone. Working with the Kinect, I have experimented with projecting recorded live-streaming three-dimensional point-cloud motion. This digital interactive architecture does not require the user to interact with a smartphone and it can be never-endlessly scaled up, limited only by the power of the projector or the size of the available screen. When working with 3D data in the computer, you can change the perspective of the design at any time. This is practical. The same can be done with a mirrored point cloud recording while a person is dancing in front of a Kinect sensor. The experience of seeing yourself on the wall from a side perspective when you know you are facing the camera directly is reminiscent of entering a funhouse mirror section. It's confusing and because your brain wants to catch up with what's happening, you will start raising an arm, move a little to the left and then move back. I am used to working in 16 15 three-dimensional digital space, but the physical experience of this interaction is challenging. It is different when the whole body becomes part of the interaction.

Screenshot from music video developed by Alexander Wallin

Screenshot from music video developed by Alexander Wallin

Artistic research - selected material / Kinect+Processing

MFA thesis BIG DATA DESIGN strange but familiar

Supervisors; Einar Rodhe, Senior Lecturer, Konstfack University of Arts, Crafts and Design, Department of Design, Interior Architecture and Visual Communication (DIV).

Christian Björk, Visiting Lecturer, -


Examiners; Tor Lindstrand, Senior Lecturer, Konstfack University of Arts, Crafts and Design, Department of Design, Interior Architecture and Visual Communication (DIV).


Guest critic; Marcia Harvey Isaksson, Inredningsarkitekt MSA


Sponsors; Sundsvalls Kommun - Cultural Grant, SCA Östrands massafabrik - paper material, Kasthall - yarn


Selected tutors and collaborating partners; Palle Torsson, Senior Lecturer, Department of Fine Art. Gunnar Söder, Lecturer within the Department of Design at Konstfack. Alexander Wallin, a computer programmer, and musician. Rassmus Nossbring, Glass/Craft Artist.



Cecilia Margareta Tjärnberg 2019 © copyright