Contextual Living Room Table

Summary:

Generating interactive 3D contents on a living room table using AR and a haptic puck.

Description:

The living room tables have rich stories behind it – conversation with family, studying for a homework, eating dinner, kids playing with LEGO, and so on. What if these tables in a living room could provide us interactive and engaging contents such as weather forecasting and entertainment for kids? This project allows the user to engage with the AR information and artifacts that are coupled to a physical desk through a haptic interface that consists of an array of small vibrators and a heat pad. The goal is to design text-less and immersive AR interaction techniques that enrich everyday living room table experience.

Process:

1. Test BLE on Unity and iOS
2. Test IR tracking using a webcam (or depth camera)
3. Battery check (drive 4 vibrators and BLE board)
4. Get all tracking, wireless, and actuation working
5. AR contents programming
6. 3D print a package for haptics
7. Prepare a table and a webcam installation

Important tools:

1. BLE board
2. heating pad
3. IR emitter
4. LiPo battery (x5 for backups)
5. webcam
6. webcam setup tools

Deliverables for show:

Space for a table, PC, and a webcam installed on top of table

Media:

Demo video

DESCRIPTIVE PARAGRAPH

Why a music box?

I like to put music on while i’m working, however in this digital age, the “recommendations” and changing between screens can be quite a distraction. A music box with physical interaction should be able to minize that as much as possible, while still kept the interaction entertaining.

How it works:

The music box would come with figurines with RFID tags. When different figurines are put on top of the music box,  different sets of music would play. Ideally, if it can be achieved, the user can put their own music album and make their own figurine.

YOUR PLAN

The final project would be based on the previous assignment where I used touch sensor and Arduino Uno with a simple p5js interface. Here is the basic outline of the project:

1. Incorporate/test RFID onto the project
2. Connect speaker to the box instead of using laptop
3. Refine the music library
4. Refine the p5js interface
5. Add the feature where user are able to make their own input
6. Switch Arduino Uno to a Particle Photon
8. Add lipo battery and battery shield/battery baby sitter
9. Make a shell with laser cutted plywood

MATERIALS NEEDED

1. Arduino Uno/Particle Photon
2. RFID Reader chip and RFID tags
3. Wifi base (I might be able to just use my laptop)
4. Plywood for laser cutted bounding box
5. Music Pieces (20s-30s per sample)
6. Lipo battery
7. Battery shield/baby sitter
8. Some LEDs for indication
9. Some buttons for play buttons etc.
10. A cheap speaker should workout

DELIVERABLES FOR SHOW

On the day of the show, I would need a outlet for charging the battery, and a wifi base, which potentially could be my laptop. The speaker won’t be too loud so it should be ok to be somewhat close to other projects.

MEDIA FOR SHOW

I probably would put up a slide show on my laptop or some print out handouts/flyers

Summary: An projected animal companion assists you on your runs and logs your pace.

What is it

This projection is meant to be an entertaining way to help runners keep their pace. As an ex-cross country runner, I often find myself trying to run at a pace I can’t maintain anymore. Last year, I got shin splints halfway through training for a half marathon because I was pushing myself too hard. In cases like mine, or for runners who are training alone, without others to help set the pace, this projection helps the runner set goals and gives them a visual pace-keeper.

This allows runners to increase their pace in a constructive manner by analyzing their step per minute count for every minute of their run, and comparing it to their previous runs and their long-term target pace. The mechanism can then suggest a target pace for their next run. The visual projection of a running animal can allow the runner to keep their short-term target pace in a simple way, by keeping up with their animal friend.

PLAN

1. draw a couple of running animal animations, for different paces
2. use geolocation tracking to determine pace (on run)
3. code pace graph viewer (3-line graph) (off run)
4. code short-term pace goal calculator (off run)
5. animal selector based on short-term goal pace (on run)
6. sync animal run pace and short-term goal pace (on run)
7. code animal noise for excessive pace deviation (on run)
8. combine on-run and off-run modes — based on device motion
9. adjust for phone use and display
10. find a portable projector
11. animal projection
12. create armband including projector and phone holder

MATERIALS NEEDED

This project is meant to be lightweight and useable for high intensity physical activity. I would need a portable projector and materials to create an armband that could carry the projector and a phone while still allowing the animal image to be projected and the phone screen to be visible (fabric, needle, thread).

DELIVERABLES FOR SHOW

What I need: Place for laptop, dark hallway or area to walk around in (so people can see the projection)

MEDIA FOR SHOW

Poster or storyboard to explain functionality of the equipment and/or wifi connection instructions so that people can work the basic non-projection code on their phones.

An interactive experience for office workers.

DESCRIPTIVE PARAGRAPH

The goal of this project is to add interactive functionality to an adjustable standing desk. Countless times my workflow gets interrupted by my environment, whether it be the room being too dark or too stuffy. I use my room as a home office, and it is important that my housemates and friends know when I am on an important call and cannot be interrupted. In the age of social media and technology, it is also increasingly difficult for people to focus on the task at hand without getting side tracked by notifications.

I am going to resolve this with interaction design by building solutions for these individual issues and integrating it into a seamless working experience for the user. It will detect when the user approaches the desk and begins to work and activate the other functions. There will be a light system that automatically turns on when the room starts to get too dark to do work. There will be a simple visual system placed directly outside the room to determine if the user can be interrupted or not. There will be a fan that turns on if the room temperature surpasses a certain number. There will be a task organization system to help increase productivity. It will use RFID cards and a timer to alert the user when they have been working on a task too long. There will also be an alert system for when users need to get up and take a break.

A success would be creating a visually appealing and functional desk that could be used as a polished product prototype. I assume that some of these planned functions may change or be altered according to my research on best practices for productivity. Ideally, the desk would not require a computer to be connected to the system and they would all run on their own battery powered arduinos.

YOUR PLAN

1. Find sensor materials needed (proximity sensor, switches, photoresistor, RFID reader and cards, adafruit LEDs, arduino(s), potentially a LED display for timer functionality)
2. Make the proximity sensor accurate enough to distinguish between someone walking by versus someone sitting/standing at the station to work
3. Create the light system for the desk itself
4. Create the out-of-room light alert system for housemates
5. Build the fan functionality
6. Build the RFID productivity organizer
7. Build the “stand up and take a break” alert system

MATERIALS NEEDED

Sensor materials listed above and a pre-built standing desk.

DELIVERABLES FOR SHOW

I’ll need space for the standing desk.

MEDIA FOR SHOW

I’d like to have a video showing all the functionality of the desk. It may be impossible for me to physically alter the entire room to be so hot the fan turns on etc…

Here’s a suggested format, I’ll use my cello project as an example.  Include images, sketches, circuits, or “I’m not sure what to do about this bit?” footnotes.

Title: An Interactive Cello Partner

Summary (if needed): An Arduino Responds to a Cellist’s Performance with Dynamically Generated Music

Descriptive paragraph

Describe the goal of your project in a paragraph or two.  Include your purpose (“why does it exist”), how you’ll resolve this with interaction design (“how it works”), and what you consider success.

YouR PLAN

How are you going to complete this project?  It can be an outline.

1. find accelerometer
2. make glove mount
3. attach to Arduino, test software
4. use glove to perform cello music and see if this actually possible
5. repeat as needed
6. manufacturing: how will I make the final version for the show that will survive hours of performance?

Materials Needed

Looking at everything you’ve written so far, what parts do you need?  How much time do you need on laser cutters or 3d printers?  Do you need to order parts?   If you’re using parts from A10, do you already have working parts?  The final few weeks of class students tend to horde things they don’t need — I found a 30m spool of NeoPixels in someone’s storage container.  One of my phys comp students had their parts “borrowed” 2 weeks before the final show.

Deliverables for Show

It’s the day of the show, what do you need?  How much space?  Power?  Place for your laptop?  Speakers?  Projector?

For my cello project I’d need a chair, a music stand, space for a synthesizer, speakers, power for the speakers and synt.

MEDIA for Show

What do you need to document your  project at the show?  Space for a poster?  Fliers?

I would have a poster behind me so people could read about why/what/how my cello/synth works.