Not discussed in class: hiding things in plain sight sometimes using asshat mobile phone “security”. Any physical penetration tester could find/defeat these within minutes but a drunk person at a party would not do so well. John Wick had a good plan.
This is a counter to sampling and using electronics to invent new music. Instruments from one style of music are used to perform a style of music from a completely unrelated genre. My favorite example is “piratemetal” or the band Orkestra Obsolete playing famous pop music.
Songs and patterns that transfer information over time
We have a history of using air raid sirens from WWI and WWII as a means to notify the population of an area of an event or condition.
air raid siren, dual pitch — my borough uses one of these at 9:45pm to signal curfew hours for children. The local volunteer fire department have a different one they use to alert volunteers to a fire.
Are 30mm arcade buttons are accessible? Do they simply nterrupt or do they provide constant state? Are the buttons convex or concave? How high are the guards around the buttons? If you want to use Universal Design, how do you decide how big the button should be and where it’s located?
What is wrong with the E-Stop button in A10?
Recessed button “hidden” in a guard
No signage on the wall like we have with fire extinguishers
Are controls like buttons the wrong answer? Is better output the way to go?
Schedule is updated to reflect changes in crit dates.
Interrupts and kinetic interaction
Interrupts as inputs to state machines
Human interruption as part of a UI
Environmental interruption as part of interaction, state machines that can self-correct or shutdown
Interrupts that limit motion — end-stop switches
SPI/I2C and complex communications protocols
How we get complex data from sensors – a lot of this is hidden in libraries
Simple controls for complex output: neopixel
SparkFun’s version: Qwiic
Show examples of interrupt code in the environment
switches on mobiles
remote controls for the projectors
complex interrupt systems in video game controllers
rotary encoder (we’ll do a demo later in the semester)
for now, we only use digital inputs for interrupts
Code samples, show how an interrupt can be used to toggle a state by one increment compared to holding down a switch and falling through a number of states.
Note that holding down the switch means the interrupt service routine (ISR) only functions once
Compare to using delay() to sample data every so many units of time.
Use an interrupt to stop a task that takes a long time, say a long for() or while() loop, by adjusting the terminating conditions
Question: What if you were playing mp3 files or video, how would you use interrupts as part of the interface?
For the purposes of this class we’re looking at physical representation of information over time at a small scale. Think tabletop or handheld representations.
vibration: usually done with “tactors” but also a feature of mobile devices and handheld devices. Mobile phones can vibrate, some tools for electronics vibrate as a way of sending notification.
thumps and pokes: using motion from a solenoid or servo to relay information with pressure or tapping motions
temperature: peltier pads (what we use to cool CPUs and GPUs) that can heat/cool, flowing water or air that is heated or cooled. Electric heaters or coolers are probably too complex for this class. Dry ice is another option but can be hazardous to work with.
Think about coaching, providing good feedback and encouragement to take a positive action.
Example: sports trainer that monitors your HR, BP, breathing rate, and hydration and knows your training course. It encourages you to do better instead of punishing you for not doing enough.
Example: music “coach” that helps you learn to perform music. Watches your body and helps you correct form/posture. Reminds you that you are always performing, even when you’re just practicing a scale or an etude.
Alice Miller’s “For Your Own Good“, a criticism arguing that we replace the pedagogy of punishment with support for learning, using the German pedagogy that gave rise to support of fascism as one study.
We fly spacecraft with computers, there are no joysticks ala Star Wars or any other movie that uses WWII airplane controls to navigate in space. However, on the Enterprise…
MIX MECHANICAL AND OTHER CONTROLS WHERE APPROPRIATE Mechanical controls are better for some uses, though they can’t as easily serve multiple functions. Nonmechanical controls, like touch-screen buttons, are easier to change into other controls but don’t offer the same kind of haptic feedback, making them impossible to identify without looking at them and creating questions about whether they’ve been actuated. Design interfaces with an appropriate combination that best fits the various uses and characteristics.
– Shedroff, Nathan. Make It So: Interaction Design Lessons from Science Fiction (p. 26). Rosenfeld Media. Kindle Edition.
Data filtering and cleanup
look at input over time for kinetic outputs
How do you smooth data, similar to what I showed on the whiteboard?
Arrival is perhaps my favorite film, and while I was already familiar with the Wolfram documentary, and the original Ted Chiang story, I am always excited to revisit these ideas, and learn more about the interplay of language and cognition. I was impressed with the way the Electric Didact dissected this concept in the film and tied it back to the root of the very word “understand.”
Even more interesting to me is when we try to use language to express what we see, thereby translating visual cognition into an audible expression and back again. (As we are aiming to do with our projects in this course.)
This idea reminds me of a study that found that Russian speakers, who have separate words to distinguish between light and dark blue, are quicker to recognize these subtle differences than English speakers when shown two different shades, thus indicating language affecting visual perception right here on our own blue planet.
On the other end of the same cycle, Vox did an interesting piece looking at the evolution of words for color in language across different cultures, beginning almost always with just light and dark, then next to red before blue and green.
I’m curious if there is any way to actively adapt the interconnection between visual and linguistic cognition for use in interface design, or to create new connections by building a new vocabulary to map optical cues to concepts that do not have representations in the visual spectrum.