For this project, I decided to take camera input and use different characteristics of the video to generate sound. I split the input into 4 matrices, and used different characteristics of each of the 4 matrices and mapped them to 4 different sounds. The characteristics I used included the hue, saturation, and lightness values as well as the RGB values of the images. I also wanted to add a visual component, so I used jit.sobel for edge detection on all 4 parts, with 2 of the parts remaining as the output of the edge detection, and the other 2 parts having the edge detection output blended with the video with the brightness and saturation varying based on the original video input. I then stitched the parts back together to get a cool distorted image to go along with the eerie sound that is generated.
Here is my patch:
<pre><code> | |
----------begin_max5_patcher---------- | |
3038.3oc4bs0iihiE94Zjl+CnnceYlZq02.C6S896XznHRBUJ5l.YAR0Uui1 | |
429B1jKjfImbhIUHiZoNcaR3b7mO2s84O94e5oIyx9HpXhy+x42bd5o+nZjm | |
TiUOxSaG3oIqB+XdRXg5KNIM56Yy95jmadVYzGkpw+mNdhW1Mb7B0fUey+A2 | |
a2noaVksoLIpT8pnaGdcX472hSWNMOZdolanDh7ExyNtAA0evE0+Mi8Bw422 | |
9qJJ+QRjhJ6d+5Wd4OVGoeKSdMIKr5M96Gv.woaoOSM3+6m+o5Oq934ADCDH | |
v.eYfFBD2gPvpnhhvkQmhAEgkaxCKiyRc9azNwBFJ4Apa87WFvp+vmfCLtg3 | |
vr73kuUlV8XC3.yGANDzFF32KvfIMhuFW9xr74YEgcBAtFf.V+hBT0jm4pUO | |
vgAUb1zUgk4weL4YyHBc.rQPY9cZjfgwHAUnrSJEJMBAcjXmzHFvQfAbkZfj | |
IuCg.71IYnrSxnZ6CxGEyjTLRDLuCQgQtUROLFI0xA9hfwnMxZ7HLY8agyRh | |
RWzIlDf.TB7UfBkH8UfCcHQE1mAp3i.UXZsDJkwGqnRxlUgeK5GNeoLKwg7B | |
uSyoAnh0fqEU7avH2GTvAkMFoBMBnAiVroHaVTRW.h.i4EtRHIP6uwkN9r4Z | |
DN3HfCWWWsbgG8gCOXHvCg1K7VuOOT3AEAdv0gnDDLJgiEgy+yNMbXxRJoOK | |
oTh6AozpsibVrvR1GWFFm18TAU14MSEOuc0qpRluN6zKacsHdYZXR8ZZb5go | |
ksNLObUTYT9znz5.gZAseVq4bDq4xlvsj2UK4XLr0LSjT1ncE2LfPvDQciJP | |
vecTA3AHTAZvIeW9sWE3hmf9Hlfhl5PvI2Q53bIlfWzRwtd9Obhzy+w7jntQ | |
JWDkdZKRwTJ+BjIE0.T2rjg9EGVm0ikhoHjdZeZtTkzOK3E2QPMo+EGd2H.A | |
SYXkZgflhQeeg.0Qxu96woKx9dmS3.Lw8IDJKCTltRILgxlNsN398SfSKw5M | |
OElkIahb9Rd12KbXNeYdVxlUoU+ytABAJfPnABhR5m54MjI1HrNHU3TWvntw | |
CJBefdDc4PHpreEdWtOP6KHrIcc37u4Pz+oy4puo.ZD8VxCp1nuRDvGYU2qc | |
M9bWebSUT3q5FW7wfK57ZE5RD5RvYNToG77mgQi7kyXuUzckO7QENUywZQpj | |
W7XiqZeXNhIpDSHS6pY.idOFyTka3p2zN59ZV9pPEm60IBfpT5Tp93N4QZzP | |
HX0PlElt7FGY8EBPRTaDifMdAHSJR+pinauORebpQ5RoRtpCLVOdZX2PDH.0 | |
oDqQJYDg.+cGlgHPHWgLfPqgv8G0H.EkLPUPX9bNWJFWv.jfRYHB9hRX90Ab | |
IHOvQkxQALTkbA2iO9BKEfzhq.AnHnphUH3zGVgEWLBKBc9q7.x3SVom30EX | |
pu2182P3OlJw4uZ.A3WABnEJvVeuadQdMf.XN2wLsAhsaHvHAA5SSv8JPAVv | |
3OwUAlDW45fJDZGEOz4sJvj2Zi.xeIvGLG9Tp9PQMNwmqH1LAlxKWE++CSrY | |
8URUWBpSiJSmy+nrjp8EtJEinRCZ3KFegqZHLEJlZhIoz5otm95QMxCTihol | |
XROY8jt4hzNVPfJ58mNjWB59LIPPII3pvAWcg14CQnZCgtfC0vAy.SwwjAzC | |
.At23HysdhZG0kjS5pUIzmOkwR9q8gBXxg0yibfrv3N2ETWj3Fw.gT9vGaNp | |
62imu63EethXyYRDAbsErXjG6XyYXxxq4.Ax0mC1GnXyYXRiaKZHGga6vZm2 | |
iWrHtnLKur6CMGES6dIPmRKWuisxq+lDZxeTKdHJuAB1hAU1QiShdOJuHNK8 | |
Pd9oIgqWev3Oc3OpF59Zl5cIed+Xwo5w36GKO583suB28CGlWgGkUfwlb8T7 | |
Cuckjs9MksHJOcS79UT8h4VV6PIK8MtSql0zRH7O7TZWsvuLIa92hVbnQ2Jr | |
bcTZb557nhnzRUWIn8yWD8Z3ljxoulkVVD+eUro59dz0W30v4Ql+4oU19Uyx | |
+cdb3NiLOMYYd7hrzZFoMxWO9VRVWvH0Tzs0bR8URCW20OuRnrBeL8zhpI6l | |
hYg40KLMthX6dZYVVR6ms+WlD8ZYyyWGmldLfVlstmmpZ5A877YYUOcUuud0 | |
iJlV4OS83oUptkSKBe+HjuLLIoQY9HJ7QXZbk1RTYrd8fQ1+Tse42Jlmmkjz | |
ddqez6c8nEUh2yi9d7hx2TDqk3Q0OHd8VAqI6W1WDuLpn7nAKCWVbzPmZ.nZ | |
rMyZTjmVFsZcR0r4nuQqFbUKk1CMA19AGYJTY8Xu5notSQOV7LVjFc1X5yDa | |
ycDokxpg48Y5VEmZ1ib3SlmsZUTZ4oux3zEQerOp8m165XqEGzXnlaMBhrd. | |
QxY.Q80GUn6ALWHH11Y4kARTqCRG0iTZ638sMQSqhhNI5f1jxo9duFgwJutL | |
2Zvy2PSSwZhi1W9p50OqxatAbQ1CrvNCrvXpjD2tQejqDUNIYnylPjon5rJ7 | |
0JZuSi9sR3yD15dEXKkni5Sa.TbkRblRO3d..OJiJicaBLfn1Iht7tcjZ0CA | |
F1cV6F6RE8jPl4Szg9NM5aZu0tHb774weOHUtOoVi82BDHYi.IkKMjd6Eaw7 | |
zzbuEnW+w8cEdZ8NndZ2QQ8YBAOHOqj3TiQSqln0eACXaQ1l74aY6FuxNGMq | |
qxRnLNcW5m+19vZp+lvWguXdwELuvFbdQ.kWFdVoxfpCGBqHGbVodxRgvJ7A | |
mUnbnqPhgmWnP4E2gmWrCqr8A6Kw0j5xZrXptRNSCKqhOY1lRsknVUu6Bqxv | |
xjrYgIMUPXWYo5ujC6qLwNtb3tH1nZBY5qbt1whtAf5Q9DtD1maxgYG67ZtL | |
05xDeGO4P0Orn95LMuymbA3ObVe9ysd6tYyiKJxxK.1d.LsQXt8hC5d.mt5J | |
TeoM1IL3+uauh.tdW6AMNAJq4CwmgzRqxJMw7tWz9pKh4bBqad0b1sbq1qvn | |
3UaV0Zy45rjnSNdaePinkYKWlD08c3Byk8SmttF1za8Nibc2xuawgSvX2vdd | |
RVQzEJuIvbPv35ycsVGiGX4Fjs0EaLBXpcz6xvKNpVLO4P7RduiWlby8epjr | |
yypLvPtPPyEuxoFyjH6umGYOqqsW9yBLUsSn7vY0M8HhijcoXJCSThMfJkpi | |
ffPFzyRCPrT+yaWdnFr83rH2hvmj8XPqrGMj4nW6uTV9B8Y3nmyYncY.0cSn | |
SVfdyXACL.wBLfODFH3fz2udxwO670tzic9kXqRO5YoG0ZzyCl.TceMqF2sA | |
E8gSQKMGgPPlm0nmKH5Yu0PAHBVeYMqEsrAAYfHH2dDjdqgTBDBxsmcFAHeY | |
1idbInInu8HHHsPNydDDjVAWZOBBZMjYQHkei0J3fz6Y1yaHGtqBlUHHK.rd | |
ncrrw7uwPJCjdnm8jRYvbGZOSaLX5g1yRCClXJ2dDjcAY9XC5Ax8q+.lkALN | |
f5MfYZwfaKxNlF1EB74Ho8LNPAY9SLfoTCiCN1lhUWngwBpFH1fIuCjGLJvy | |
sAO3G.JYz.6EfgpWACfj9AVjjRXK29VjjbXyRlEIICTgL7oVljmuVM9DKRRX | |
tIj1T7g.ij1T7ABEsnSAILiQRoEIIrhDI8rHIgkQrXH87.iGTsL6gy0iDVl5 | |
dCJP3AGHnCFP.qtZ1TSCplskhvzU.wq.2hyPWXt9bEVjjTPjTXQmBtvbJ3ZQ | |
usvp10PF4NHNfx7GR6FtvCadvLaHfE1rvhQDnH44itSHsLIOezcBK5gV.qVY | |
7gT.CFOPICoCZArnDroiIAr8PaPCNBFOnm1CmxMLKLBK5+R.qLPVb61zuK.j | |
zhInBbOEsXxh7aaQTUc9E.9EXVzHMrcWfZwhuqYe.yROKSxy68yhahBE1tnP | |
sn9ACX3U1jjvrBPsXfLv1YCpE2SSJvsVfZu87S0MJgRRaMKggq1aOpnPKgsu | |
8vUXUFyldsfctTFxnhfI8dbQtsaPQv3A2AM6SB7fjrzZO38Q+To6lS+5QcHL | |
EoNtyfcbWAqiNBVOcCrS5DXJdn5u9+HXfs9H | |
-----------end_max5_patcher----------- | |
</code></pre> |
Here is a video that shows the patch working: