shamal@andrew.cmu.edu – Introduction to Physical Computing

Scott Final Project

shamal@andrew.cmu.edu — Thu, 07 Dec 2017 03:51:10 +0000

Initially my idea was to create a text to speech keyboard in order to give the anyone with fingers the ability to speak. I found libraries that worked for this, as well as the speaker and power components I struggled with the keyboard part of the project. After researching online I thought I would be able to use an old school ps/2 connector keyboard with a library I found but I struggled with making the connection perfect with the pins. So I bought a piece online that would do this for me. When it arrived, I tried to get it to work the same way I saw it done online but finally gave up after some fruitless time debugging as well as seeing a few people online with the same issue (never being able to see power in the keyboard) and no known solution.

So I pivoted to making my own controller with force sensors attached to a spongey material underneath a flexible material that the user could push down in different spots on

Then I was able to use the varying sensor values for when the user pushed down in 7 different spots to get 7 different “keys” from the 3 sensors while still being able to know where the user is pressing. Since the mid point I added volume to the speaker with a LM386 audio amplifier as well replacing the power so the circuit could be plugged directly into a wall outlet.

The last touch which was something I had never done before was lazer cutting the box that I put everything inside of. I from an online box-generating site where I entered the dimensions and it gave me a .svg file. I then used illustrator to add the additional circles I wanted cut in certain walls for the speaker and wiring and export the file to use on the lazer cutter.

download code/fritz: codeAndFritz

Assignment 7: Scott

shamal@andrew.cmu.edu — Tue, 21 Nov 2017 21:43:13 +0000

For my project I wanted to incorporate text to speech in physical computing in order give the ability of speech through typing.

After looking online I believed I could use an old ps/2 port keyboard to work with the Arduino by soldering wires to the correct pins and then using a library to get the key presses in my code. After a lot of struggling with getting the connection between the pins and wires, I decided to order the piece that will make this connection much easier, by plugging into the port and giving the output wires that go into the Arduino. This part hasn’t arrived yet so for this stage of the assignment I used the Serial input from the computer’s keyboard in order to show my idea.

^when I realized that this was probably not going to work

I found two text to speech libraries online for the Arduino, and incorporated both into my current project. The first library has the ability to take any string and will attempt to make the speaker speak it. It also has an adjustable pitch which I gave access to via buttons. To be honest, the outcome of this was a little disappointing. You can sort of tell what is being said, but its pretty hard to understand.

The second library I found had a bunch of pre-made words that it could say if initially written to memory. I use this library by having the speaker read the letters out that were typed. You can switch between these two modes with the switch on my breadboard.

To Do:

Currently, the volume is too low and I need to use an audio amplifier/bigger speaker to so that this will be audible in a noisy environment.

Once the ps/2 port that I ordered shows up, I will hopefully be able to interface with the ps/2 keyboard so that I don’t need to use the keyboard that the arduino is plugged into via USB. This will be nice because my final vision for this project is to not have it be plugged into a computer but standalone box with a keyboard and speaker and everything else tucked inside, including a power supply.

code

video

Assignment 6: Text-to-Speech Keyboard

shamal@andrew.cmu.edu — Tue, 07 Nov 2017 21:25:04 +0000

Abstract / concept statement

I want to make a mobile keyboard that reads aloud the words typed into it. If someone were to lose their ability to speak, this device could be an easy way for them to quickly communicate by typing what they want to say, since typing has become so natural to most people.

Hardware

The most crucial element of hardware in my project is the keyboard. After doing some research I believe that using a keyboard with the older PS/2 port I will be able to have my keyboard interact with the arduino. I will also need a speaker and power supply or maybe rechargeable battery (it would be nice to have it all be wireless).

Software

The trickiest part of the software process will probably be the text-to-speech. I have found a library on github that is used for arduino text-to-speech and an example of it being used online so hopefully I wont run into any issues with that. I’ve also found a library for the keyboard.

https://github.com/jscrane/TTS text to speech

https://github.com/PaulStoffregen/PS2Keyboard ps/2 keyboard

Order of construction and testing

1. get keyboard input

2. use keyboard input to make text-to-speech happen

3. figure out wireless power supply

4. craft some sort of container that hides wires, leaving just the keyboard and speaker exposed.

I’m not sure if this project is maybe too simple for a final project, but I like this idea because of the accessibility it could provide someone in need. It is possible that I will add to or modify this idea to better suit the assignment if needed.

Assignment 5 Final: Scott

shamal@andrew.cmu.edu — Tue, 31 Oct 2017 03:08:30 +0000

For this assignment I aimed to make a music pattern generator. I wanted to have an interface for the user to make a custom pattern and then the ability to play that pattern back and hear it as they see time moving across the pattern. I had a few iterations of ideas with sound that all focused on the user having the ability to customize what they were hearing. I was fortunate that Aditi let me use the 8×8 LED matrix with the backpack she attached, and this was perfect for showing a pattern of notes in time.

zip: assignment5

Assignment 5: Scott

shamal@andrew.cmu.edu — Tue, 24 Oct 2017 02:17:40 +0000

I want my final product to have some sort of generated music playing and then something for the user to interact with to change how the music sounds. I’m not sure exactly how I want the final piece to look, but my prototype explores playing with the speed and tone with a sliding potentiometer.

zip

video

Assignment 4: Scott

shamal@andrew.cmu.edu — Thu, 12 Oct 2017 02:54:06 +0000

zip: assignment 4

video: https://youtu.be/h3AtkzsaTRg

Assignment 3: Scott

shamal@andrew.cmu.edu — Wed, 27 Sep 2017 23:32:53 +0000

For my project I wanted to express panic. I made a cardboard figure with wings attached by servo, and a tilt sensor. When the figure is upside down, the servos speed up and the figure appears quite panicked.

zip: assignment3-ScottHamal