Contextual Living Room Table
Generating interactive 3D contents on a living room table using AR and a haptic puck.
The living room tables have rich stories behind it – conversation with family, studying for a homework, eating dinner, kids playing with LEGO, and so on. What if these tables in a living room could provide us interactive and engaging contents such as weather forecasting and entertainment for kids? This project allows the user to engage with the AR information and artifacts that are coupled to a physical desk through a haptic interface that consists of an array of small vibrators and a heat pad. The goal is to design text-less and immersive AR interaction techniques that enrich everyday living room table experience.
- Test BLE on Unity and iOS
- Test IR tracking using a webcam (or depth camera)
- Battery check (drive 4 vibrators and BLE board)
- Get all tracking, wireless, and actuation working
- AR contents programming
- 3D print a package for haptics
- Prepare a table and a webcam installation
- BLE board
- heating pad
- IR emitter
- LiPo battery (x5 for backups)
- webcam setup tools
Deliverables for show:
Space for a table, PC, and a webcam installed on top of table
An wireless music player with physical interaction to minimize distraction.
Why a music box?
I like to put music on while i’m working, however in this digital age, the “recommendations” and changing between screens can be quite a distraction. A music box with physical interaction should be able to minize that as much as possible, while still kept the interaction entertaining.
How it works:
The music box would come with figurines with RFID tags. When different figurines are put on top of the music box, different sets of music would play. Ideally, if it can be achieved, the user can put their own music album and make their own figurine.
The final project would be based on the previous assignment where I used touch sensor and Arduino Uno with a simple p5js interface. Here is the basic outline of the project:
- Incorporate/test RFID onto the project
- Connect speaker to the box instead of using laptop
- Refine the music library
- Refine the p5js interface
- Add the feature where user are able to make their own input
- Switch Arduino Uno to a Particle Photon
- Add lipo battery and battery shield/battery baby sitter
- Make a shell with laser cutted plywood
- Arduino Uno/Particle Photon
- RFID Reader chip and RFID tags
- Wifi base (I might be able to just use my laptop)
- Plywood for laser cutted bounding box
- Music Pieces (20s-30s per sample)
- Lipo battery
- Battery shield/baby sitter
- Some LEDs for indication
- Some buttons for play buttons etc.
- A cheap speaker should workout
DELIVERABLES FOR SHOW
On the day of the show, I would need a outlet for charging the battery, and a wifi base, which potentially could be my laptop. The speaker won’t be too loud so it should be ok to be somewhat close to other projects.
MEDIA FOR SHOW
I probably would put up a slide show on my laptop or some print out handouts/flyers
Do you ever find yourself tapping your fingers on your arm or legs, out of boredom, anxiety, anger? This projects aims to convert said anxious behavior, tapping your fingers, into a more tangible output. While it may not reduce the stresses that cause us to fidget, perhaps a slightly more positive outlook could be achieved. This project doesn’t exist to fix a problem, but rather to reduce it or reframe it. This project would be considered a success if people were able to view their anxious habit as rewarding, via sound or animation, rather than as a result of negative outward effects. Form may depend on how the user taps. Perhaps they tap, but maybe they swirl their finger in circles? Final animation and sounds will be influenced by meditative imagery or sound, symmetrical and calming.
create wearable patch that can live on cloths and upload to computer
• flora, lilypad, or particle
• capacitive touch board
• eeprom or some type of data storage for taps
p5js or processing sketch to output the data collected
• controls that influence color
• tones to match taps
• controls for pitch, tone, etc.
• people need to be able to tap
• plug into computer
• select sound or animation
• “clear data”?
• Flora, lily pad, particle
• capacitive touch capabilities
• eeprom or data storage of some kind
• conductive fabric or thread
• May need to order some things such as extra storage and conductive fabric/ink
• Leave time to program with data in p5 or processing
• Need a desk for laptop and potentially patch
• Perhaps I have a jacket or lap pad that people can actually wear to tap
Media for Show:
I may want an additional flyer or poster
Anxiety can consume me, making it difficult to breathe. While I have meditation and breathing exercises, I often feel I do them ‘wrong’ or am too stressed to even remember them. This project is a desktop friend that lives on your workspace, detects when you need to calm down, and starts to breathe. You can see the monster’s breath rising and falling, prompting the user to follow along with the subtle breathing creature. You can set, perhaps based on heart rate, how long the breathing lasts. Perhaps the silly form of a friendly monster will help reduce anxiety in addition to the meditative breathing. Research may include different types of breathing techniques and may influence final form. For example, 5 seconds in, hold, 7 second out, or breath counting. Lights may be involved to help guide the user through the exercise. But depending on the breathing exercise, maybe the monster has one eye..or three, form decisions like that may come after more research.
create a monster of sorts, friendly of course
• find fabrics that allow for movement and fur like look
• figure out heart rate detection? perhaps through fitbit or other existing wearables?
• catch attention of stressed user (light? sound? haptic buzz?)
• test, bit by bit each step of the interaction
• detection of HR
• turning on and off muscle wire
• completion phase
• maybe monster smiles
• eyes that light based on touch?
• design monster
• figure out power relay
• Arduino or particle or two
• HR api, sensors
• muscle wire
• power relay
• May need to order some things
• muscle wire, HR sensor?, power relay
• time to..
• build/construct monster
• set muscle wires and insulate
- Need a desk for laptop
- depending on monster’s form, somewhere to put him
Media for Show:
- I may want an additional flyer or poster
Title: Pace Yourself
Summary: An projected animal companion assists you on your runs and logs your pace.
What is it
This projection is meant to be an entertaining way to help runners keep their pace. As an ex-cross country runner, I often find myself trying to run at a pace I can’t maintain anymore. Last year, I got shin splints halfway through training for a half marathon because I was pushing myself too hard. In cases like mine, or for runners who are training alone, without others to help set the pace, this projection helps the runner set goals and gives them a visual pace-keeper.
This allows runners to increase their pace in a constructive manner by analyzing their step per minute count for every minute of their run, and comparing it to their previous runs and their long-term target pace. The mechanism can then suggest a target pace for their next run. The visual projection of a running animal can allow the runner to keep their short-term target pace in a simple way, by keeping up with their animal friend.
- draw a couple of running animal animations, for different paces
- use geolocation tracking to determine pace (on run)
- code pace graph viewer (3-line graph) (off run)
- code short-term pace goal calculator (off run)
- animal selector based on short-term goal pace (on run)
- sync animal run pace and short-term goal pace (on run)
- code animal noise for excessive pace deviation (on run)
- combine on-run and off-run modes — based on device motion
- adjust for phone use and display
- find a portable projector
- animal projection
- create armband including projector and phone holder
This project is meant to be lightweight and useable for high intensity physical activity. I would need a portable projector and materials to create an armband that could carry the projector and a phone while still allowing the animal image to be projected and the phone screen to be visible (fabric, needle, thread).
DELIVERABLES FOR SHOW
What I need: Place for laptop, dark hallway or area to walk around in (so people can see the projection)
MEDIA FOR SHOW
Poster or storyboard to explain functionality of the equipment and/or wifi connection instructions so that people can work the basic non-projection code on their phones.
Title: Smart Desk
An interactive experience for office workers.
The goal of this project is to add interactive functionality to an adjustable standing desk. Countless times my workflow gets interrupted by my environment, whether it be the room being too dark or too stuffy. I use my room as a home office, and it is important that my housemates and friends know when I am on an important call and cannot be interrupted. In the age of social media and technology, it is also increasingly difficult for people to focus on the task at hand without getting side tracked by notifications.
I am going to resolve this with interaction design by building solutions for these individual issues and integrating it into a seamless working experience for the user. It will detect when the user approaches the desk and begins to work and activate the other functions. There will be a light system that automatically turns on when the room starts to get too dark to do work. There will be a simple visual system placed directly outside the room to determine if the user can be interrupted or not. There will be a fan that turns on if the room temperature surpasses a certain number. There will be a task organization system to help increase productivity. It will use RFID cards and a timer to alert the user when they have been working on a task too long. There will also be an alert system for when users need to get up and take a break.
A success would be creating a visually appealing and functional desk that could be used as a polished product prototype. I assume that some of these planned functions may change or be altered according to my research on best practices for productivity. Ideally, the desk would not require a computer to be connected to the system and they would all run on their own battery powered arduinos.
- Find sensor materials needed (proximity sensor, switches, photoresistor, RFID reader and cards, adafruit LEDs, arduino(s), potentially a LED display for timer functionality)
- Make the proximity sensor accurate enough to distinguish between someone walking by versus someone sitting/standing at the station to work
- Create the light system for the desk itself
- Create the out-of-room light alert system for housemates
- Build the fan functionality
- Build the RFID productivity organizer
- Build the “stand up and take a break” alert system
Sensor materials listed above and a pre-built standing desk.
DELIVERABLES FOR SHOW
I’ll need space for the standing desk.
MEDIA FOR SHOW
I’d like to have a video showing all the functionality of the desk. It may be impossible for me to physically alter the entire room to be so hot the fan turns on etc…
We’ll review these next Tuesday.
Here’s a suggested format, I’ll use my cello project as an example. Include images, sketches, circuits, or “I’m not sure what to do about this bit?” footnotes.
Title: An Interactive Cello Partner
Summary (if needed): An Arduino Responds to a Cellist’s Performance with Dynamically Generated Music
Describe the goal of your project in a paragraph or two. Include your purpose (“why does it exist”), how you’ll resolve this with interaction design (“how it works”), and what you consider success.
How are you going to complete this project? It can be an outline.
- find accelerometer
- make glove mount
- attach to Arduino, test software
- use glove to perform cello music and see if this actually possible
- repeat as needed
- manufacturing: how will I make the final version for the show that will survive hours of performance?
Looking at everything you’ve written so far, what parts do you need? How much time do you need on laser cutters or 3d printers? Do you need to order parts? If you’re using parts from A10, do you already have working parts? The final few weeks of class students tend to horde things they don’t need — I found a 30m spool of NeoPixels in someone’s storage container. One of my phys comp students had their parts “borrowed” 2 weeks before the final show.
Deliverables for Show
It’s the day of the show, what do you need? How much space? Power? Place for your laptop? Speakers? Projector?
For my cello project I’d need a chair, a music stand, space for a synthesizer, speakers, power for the speakers and synt.
MEDIA for Show
What do you need to document your project at the show? Space for a poster? Fliers?
I would have a poster behind me so people could read about why/what/how my cello/synth works.