#prosthetic knowledge

Colorspace

Installation by Soso is a long arrangement of LED lighting that changes colours when you send it a text message:

Colorspace is an interactive sculpture that translates text messages into breathtaking animations of colored light. Boston Properties commissioned us to create the artwork for the mezzanine of their iconic Boston skyscraper at 200 Clarendon Street.

As tenants enter the space, they pass a long marble wall of suspended light pendants. Anybody with a mobile device can send a text message to the number printed on the wall. The sculpture replies with a sparkling wash of light that sweeps across the wall, illuminating the space with new colors.

Each color palette is unique. Beach lights up the space with blues and yellows. Watermelon gives you shades of pink and green. Disco makes the sculpture sparkle with hot pinks and purples.  

Colorspace perpetually evolves through an ongoing conversation with the community around it. It gives tenants ownership of their shared space and provides a playful, surprising moment as they enter and exit the building every day. It transforms the lobby into a dynamic, participatory space.

More Here

ar line drawing

Another fantastic Augmented Reality camera experiment from Zach Lieberman calculates a visual doodle which is spatially fixed:

A post shared by zach lieberman (@zach.lieberman) on Nov 8, 2017 at 2:52pm PST

Link

Voice Experiments

Project from Experiments with Google is a series of creative explorations of voice recognition technology that run in browser or with smart speakers, ranging from music creation, guesing games and meme making:

Mixlab

Mystery Animal

Meme Buddy

Voice Experiments is a showcase of what’s possible when you bring open-ended, natural conversation into games, music, storytelling, and more. These experiments were made with tools like Dialogflow and the Actions on Google platform, that make it easier for developers to create new voice experiences that work on devices such as the Google Home, or even right in the browser. 

You can find out more and play around with the projects here

Neural Kubrick

Project from Interactive Architecture Lab explores use of Machine Learning and Neural Networks for analysis and reconstruction of cinematic data:

Stanley Kubrick in 1968 speculated on the arrival of human-level Artificial Intelligence in “2001 A Space Odyssey”. Some 16 years past his prediction, our project “Neural Kubrick” examines the state of the art in Machine Learning, using the latest in “Deep Neural Network” techniques to reinterpret and redirect Kubrick’s own films. Three machine learning algorithms take respective roles in our AI film crew; Art Director, Film Editor and Director of Photography.

The outlook of the project is an artist-machine collaboration. The limitations of the machine are achieved by the artist and the limitations of the artist are achieved by the algorithm. In the context of the project, what the machine interprets is limited to either numbers, classification of features or generation of abstract images. This output is curated by us into a coherent narrative, translated back into human perception.

The project is based on Stanley Kubrick’s movies as input for three machine learning models, namely The Shining, A Clockwork Orange and 2001 A Space Odyssey. The generated videos display a machinic interpretation of the three movies, through a collaborative effort between the artist and the algorithm.

More Background to the project can be found here

Official website can be found here

Music Mouse

Project put together by Tero Parviainen is a web-based version of musical tool originally by Laurie Spiegel to create music by moving your mouse. It also has MIDI support.

Try it out for yourself here

CheekInput

HCI project from Keio University uses sensors to turn your cheek into a touch interface for head mounted displays:

We propose a novel technology called “CheekInput” with a head-mounted display (HMD) that senses touch gestures by detecting skin deformation. We attached multiple photo-reflective sensors onto the bottom front frame of the HMD. Since these sensors measure the distance between the frame and cheeks, our system is able to detect the deformation of a cheek when the skin surface is touched by fingers. Our system uses a Support Vector Machine to determine the gestures: pushing face up and down, left and right. We combined these 4 directional gestures for each cheek to extend 16 possible gestures. To evaluate the accuracy of the gesture detection, we conducted a user study. The results revealed that CheekInput achieved 80.45% recognition accuracy when gestures were made by touching both cheeks with both hands, and 74.58 % when by touching both cheeks with one hand. 

Link

Asad & Assad

Kickstarter campaign for project by Asad J. Malik is a Mixed Reality documentary using DepthKit captures and Microsoft Hololens, on the subject of US Muslim students and their experiences:

Put on the Hololens and take a walk, stopping to meet holograms of numerous Muslim college students of distinct identities as they are questioned by an unseen interlocutor. Watch and listen as these interrogations become startlingly intimate encounters between you and them.

Augmented Reality allows for the viewer to deeply empathize with the characters since they appear to be in the same room.

Whenever you look at the holograms, they share rich personal stories. Stories of childhood, family, work, faith, lack of faith, war, privilege, sex, drugs, youth, love, and a life far from home. Stories of ideologies from complex humans that contradict each other and themselves.

More Here