Introduction
In our computer vision music sampler, we sought to create a physical interface that would allow the user to explore a song in a new way. Using computer vision software, a webcam, a projector, and interactive play surface, our sampler allows the user to move through a piece of music and make it their own.

Piece by piece, the user places the acrylic pieces on the play surface. As in a traditional sampler, clips of music will play according to the objects’ positioning. However instead of using a typical rectilinear layout, we have chosen a polar system, to be both stage-like and reminiscent of a record player.

In this prototype we are working with nine song clips which are distinguished by the color and geometry of our pieces. We have chosen to explore the song Come Together by the Beatles for its strong beats, bassline, and vocal hooks, as well as its recognizability.

As a finished product, we imagine that the user would be able to draw from a larger number of clips, from any number of different songs.

Video

Technical Notes

Software

Github Link

Construction

The physical aspects of the computer vision sampler were realized mostly through computer aided design processes. Modeled in rhino, and laser cut from 1/4 in MDF, the structure was designed with several things in mind: accessibility from multiple angles, the need to mount both a camera and projector, and the need to easily adjust the positioning of said equipment. The shapes used to control the samples, and the labels noting the different instruments available, are colored acrylic plexiglass.

Additional Photos

Team members: Marc Julien, Kaitlin Schaer

Our idea for the physical computing final project is to build a computer vision synthesizer toy. Using the Open CV python libraries, and a virtual midi synthesizer, we will create a product that stays true to the basic way of playing with blocks, but with the added feature of producing a musical soundscape. The synthesizer will be comprised of a play surface, a variety of colored blocks to experiment with, and a Playstation eye camera to detect the arrangements the user makes.

The type of composition our synthesizer will create is still being decided- ideas as of yet include: percussive beats; classical music in which each block represents an instrument in the arrangement; music in which each block represents a sequence (all blocks in the same key) that can be arranged in something hopefully pleasing to the ear.

Kaitlin Schaer, Rachel Ciavarella

Introduction

In our exploration of robot autonomy, we wished to create two simple robots that could engage in basic conversation with one another. We chose to do this through the motion of the high-five. Though the motion is simple and highly constrained, we were excited to view the variety of interactions that came about between the two robots, as the motion was often unexpected and humorous.

Video

Technical Notes

Circuit Diagram

Arduino Code

Our code is a simple one-in, one-out from the IR proximity sensor data to the servo position. We constrained the sensor values to a manageable range, added a delay to smooth the values, and mapped them to a range of positions on the servo. The servo points chosen were experimentally determined to best suit the kind of high-five gestures we were after. Also written into the code is the “autonomy” of the high-five bots: in the loop, we randomly initiate the command to either send the servo to the forward, or reverse position. This allows the robots to initiate or reject contact with one another.

working_randomness_retract_uno.ino

Additional Photos

Kaitlin Schaer as scribe; Bryan Gardiner as tutor; Ruben Markowitz as designer; Anna Failla as integrator

Introduction

In a time where the logistics of sleep can be all too much to handle, there is a solution! There is a smarter pillow, a pillow that will wake you up just when you need to get your day started. Perry the Predator Pillow is an adorable yet creepy little friend that will help you out with all your sleep scheduling needs. Perry has a programmable wake-up time, so that your day can start off right. But this is no ordinary alarm clock pillow — the only way to shut off the alarm is to open up Perry’s mouth, revealing his big teeth, teeth that will stop you from going back to bed!

 Video

Technical Notes

Circuit Diagram

Our Arduino code works quite simply- it checks whether pressure is applied to the pressure pad within, and if there is, a few different things can happen. If this is the first time pressure is applied in the cycle (as in when laying your head on Perry,  going to bed for the night), Perry will play a soothing little tune to help you fall asleep. The music is created by indicating a sequence of frequencies that correspond to the correct notes for the particular song, and plays through two small speakers. After a defined interval (which is editable based on how long you need to sleep for), another tune is played, this time to wake you up. They will keep going, at increasing volume, until you get up. The only way to turn off the noise is to open Perry’s mouth, which turns off the circuit. Once open, the teeth are exposed, preventing you from going back to bed.

Photos