{"id":1805,"date":"2020-11-09T16:44:08","date_gmt":"2020-11-09T21:44:08","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/48-339\/f2020\/?p=1805"},"modified":"2020-11-10T19:08:05","modified_gmt":"2020-11-11T00:08:05","slug":"hearing-the-colors","status":"publish","type":"post","link":"https:\/\/courses.ideate.cmu.edu\/48-339\/f2020\/?p=1805","title":{"rendered":"Hearing the Colors"},"content":{"rendered":"

Context:<\/strong> One of the main contributions of technology is mediation: technology mediates the agency of both disabled and fully enabled humans in the world, rebuilding their relation with the environment.<\/p>\n

Problem:<\/strong> For visually impaired people, many applications \u00a0have been developed that scan and recognise objects in space for visually impaired people. This way, the user can perceive spatial information without employing touch. The visual information is translated into auditory words, which describe an object or a spatial condition.<\/p>\n

This method facilitates the daily life for people with visual impairment. However, it is inadequate when it comes to the perception of art. A \u00a0colourful painting cannot be described through a sequence of colour matches that may bear no meaning to people with congenital vision disability.<\/p>\n

Solution: <\/strong>\u2018Hearing the\u00a0colours \u00a0is a wearable interface that turns the experience of colours and visual art into an audio performance. The wearable prompts the user to move their hand and ‘grasp’ the sounds of the colours in a similar way with that they execute to ‘grasp’ the Braille dots for reading.<\/p>\n

The interface plays the role of a sensory substitution device (SSD). After practice, the user learns to stimulate spontaneously the experiential quality of \u201cseeing a color\u201d through a new set of sensoricognitive skills. . This changes the classical definition of sensory modalities and contributes to the emergence of a form of “artificial synaesthesia”.<\/p>\n

The interface is designed to transform the static observation of art into an interplay of visuals, sound and body movement. However, hearing the colors through a wearable device should not only be constrained to the spectrum of artwork. It contains the potential to turn the body into a scanning device, that moves and interacts with the space itself, even with other human beings.<\/p>\n

\"\"
Idea<\/figcaption><\/figure>\n
\"\"
Perceiving the colours in art<\/figcaption><\/figure>\n
\"\"
Perceiving people through their skin colour<\/figcaption><\/figure>\n

Color as a R:G:B and H:S:B code<\/strong><\/p>\n

\"\"<\/p>\n

 <\/p>\n

Computational Logic:<\/strong><\/p>\n

\"\"<\/p>\n

Demonstration Demo:<\/strong><\/p>\n