Category Archives: Gallery

Trippy Rave Visual Processor

I wanted to make an interesting convolution effect such that the kernel was applied at a single point and then at all the other points it exponentially decays till the edge of the image, or a given radius. Unfortunately I was doing a lot of pixel by pixel calculation and, as I found out much later, jitter doesn’t really like that (apparently I would have had to write my own shader).

So I settled for this trippy video processor that takes video and audio, feeds the video through some delay lines and then convolves them with randomly generated kernels weighted towards specific effects, based on thresholds in the audio signal. I figured it would be fine, since people at raves don’t usually tend to be too picky.

For the video, I used one of my favorite songs, Figure 8 by FKA Twigs, paired with one of my favorite dance clips, an excerpt from the pas de deux of Matthew Bourne’s all-male Swan Lake. I hope you enjoy!

<pre><code>
----------begin_max5_patcher----------
4686.3oc6cs9iiaas+y69WgfwdAZal0Q7kdTbwEI.6saCRun.sMseHHXfrMG
OZGYIWI4YlsAI+seIE0SaIYJGZYpDsC1Yrodc3Oc34AOGd3O912rXUzqzjEF
+Qiu23Mu4Ge6adSVS7FdS92eyhcdutNvKI6zV7I+zk6ewObSzKKtSbb+MYGI
Z0mdODTzX3gc9gAzzrqBT0XzgzhVg4st2Kc8i9gauOltNUPKD6kl2YPLw7+.
bD+AyZz3GxuHw8I8y6ohqXwh6X+23G3G8md6a4+5NI6R6nIIdaoETdJ80LpX
QL0aiwe+Euv+h2Szk6hdt3LRR+bP1icQaPfYqP.rUH.zMD.yf.jsaVeGZx+C
D1KBbQ89P5KLx9jNO+8LqK6SYOaGSC6ptUu8dfiZX.D8dLuCy58lNmu2yH36
24kF6+5kyIbFla0z0vtfr9lqUMdbDx75vbuOv6yA9Io+rTu9HjAzGIc2GQnr
2XjkD1qMWwfYTecvD+sgdA7tYaeh++M9qS8iB8h+7hxay5.+8OR829X1ikvY
VDGXiWpWNnjiJhStTTWsCvNzC9AzPucBX4ePi+mQaih2468Aeucdga79nGCO
WtaOJGcJtlmXrJYWi2gM9Q7VpcBAQQ64Gzrpo0Qgozvz6SR8RoEzWcJg81zK
g0QODxvyb1EbIrIftX+s9LbgQwaSeTbNYBGVj5u9ojEMN4+8Au.+zOmCxY26
lm.m8H+dzrce16zjG8eH+EJXY6TQJc29n7SAZdzI8.CD8BSWGEy4LXu757I0
+orKZCs6tPRvg3T+czRnnMZn+dg.K2kz9sHYOkto8avCQAAQurMHZUCnn4Iw
ItjzXJqeVd3hilMZV7g7FEsnFg3Igd6SdLJ8mYhPkS9MAoFsW1Hgja6LgbtR
n85gfHuTkpB6+9mMdO6ACkqiCUaGGm8GB47c7bwbprmu2fwytNM1K3aowgzf
ORCowdoQw+kJEa8iF.EgFBX.BbDbCnAoGu7jxtyz3iknyE39LMNIWrQNc7lE
d62Wq4FRXYv2mhxtQ12U1jennIXYSwzm8KtdbYqdwr9WJqycHVfbu5Xsn51v
jREGdvOiTda9f5BRplkMBUi410A.YPhEttjkEqXRTV+jPnSg5iEQ6oLsB6io
ILUHdExJKO7F5CdGBRu+AlNlD++SFABJ0H173O3sl14EWpH7qi84peyOksw9
ahB4DQCrl2bwiiIeLiem+6pNS1YvDD0xEyX0X3RGGjqj7PxJuX9qhUBd0h2P
KRihBZdnxqKf9PZ9g26GFdDJlFsu6CFyMkn6CuJhcvc8cuyNRx8GBEG8d1.U
l1dumah1oLMN4ibad6e0Kzmw6SKTmAMKOHy9DVG8wj0wLUNM5uhi7bKGYCiK
dM8E+MB6DLqyLvNc+8ELQKJeKuweKSWUy1R81lzrkSjcvZ5vp7Qo2yUDFjaf
S0IzvSylleUIi6Hig5wMsVbUye29CAITvxO85CKYhQtyXkGyJp5ZxOgt6x4s
Nk80s7utjAl66FvFT5EaSYf85M2QFIb2EBdMTTzD69BCvfvH.9JfQtYhCcE5
Gbyba3rHjeX5nARaY7yFvghTnK.ofRgT.TFSEAKIyzcplgJqqLLz.1IZX9Kj
uQnRU.IHyyAFEVZV6bVGsaGMLWtmBQIwydPvjSmnDnSTxTJTB6.5AltVPvEv
nnd9Djo0v4SxzdLJXTOBdRMVY7vvfO2KfC5LRcHNB63yGtAjSpiP8aSW6zRD
indDyVLudPah9iXIq8BnFlbyMMYVIRL.KICB.6liy5RGwVvwgx8Sx8VX0Tel
bBGDBYqdalHPAlj6hsjFMoq.jk5AHrMZIjCJ4lbeSPndF1EydzzAZRIV8VTV
vGYJB4hysxhREiTWAauwVXcGo16s9IC.6GykCyw2NQKzkN7y1zjOfCkOCWtZ
lauYHkI+mggTHW0CUEAAzTOgpXuvMQ6LFl.cnyUSkW9ToXIoQUi47DbYPE7J
n7yBoCPUeFHjPSWSCBLdGv3cPim8XeBcAyYm0UXN6JFPhQ2v4r6zrQ3DqAbT
uiKParHb8YdL6j4qrkoVojqg+JvkFVCTBto5cWwVnkCJbzCXRzTQ3lllCSzj
q5GbYkiUlYXkyu1DM0cLzNlODHE11Q.8FtFAASIA4rD.YLp3alfMNLS23m1J
zKi4X8CwOQ+bQFi.5fqFIkbyFHOpGjGW6HA9gToTwvzIyMO1FV95PnsAhO5s
wduXVeMkFeuHTeGOSnsJLlOb4tR4x0N6Whh27Rr29iuKqC7W+TItMVSUWBMf
gHFAJbXEDq1Wtmy8Y9KPKKarSywVDgU7nyMzRf.pW+I25AtLrU7TIXQiIwN3
DuU5GbYjXAiAoVy0B4bczaEiAiFydJhjpHO6zp90w4P0psMNWWWHD3bWqe53
KkmZA7wax+vdrcZt9jAaJsT4iSihSXqbZvV8H+0QCR0AYQrstqwmbQHGB7TJ
mcgkQxmPjRTT2JAv.qJk.VYJArIKcrssMAMk8vtzSyDFdpRD8xIbQmvayS7z
RoPmHIhcKpRdSHYbD4jkWyYoWjAvHaZ1QPCjARkBfrkV.zY4fX5HbI.G6KU5
DB5TaJq.PgwVfyITp0jo9j7UrLiaJT4cZpcjQR7i29asjnCwqKdn4QR3nrmb
CMI0OzqJ2PKCx0Qm3i9a1PCOFM23mv0YJRTGoXwFJIaKIIym3HCfVPxbWlkh
lg1ZCLaMDXVOHYrjjrsVQwfoEuLRVQFsvzeynYfpG+syey9HlM+4hgw.L24B
hMnTMORjD1szDvNypUnqKecnXyuvplZRjWejQVIS7X1qKuMkkATqnXvzRVJT
1g4SPRFoORl3QsQJZFqOjrrFf4L8HY7DjlAZD2rrVfAQWldVhCXoUwj+XUM4
OVX2kH1+rwc2NxpZl+HhvzU0zHq1EJqgeWJPYA+UBPgT8nfi4nDcProY0zBK
LlqpowtOCkUOl9LveB5fKb54GCvc54TNvcHF+B0CZlHK6r9.yDY0nnOnrrVK
.zGAc.YckC5NAoYmIHMC0KZVJoFZjFEY0BBzGGPAxZrQKS62MklkheViv4gH
dVESNcYE4nnjI38Lcy8hEs98doow9qNjJh7U8xRvfVb0hZGR9RmtL7h8sRqq
VN1Judgrwasb0IH7PJxUl8TmuvhBF.Prj7pkMR2xhfBxQMU+BbdTWEKkoaSQ
P4+4mMjtFnfrUU+1Rj1rhLIEbSpAJ+AdGmHW+lnn9sHme.hjGNecYoy8arZe
eeS62+6czz3HChj0oNEUterfnZ04HKIJ2O4qp3KnimFscaYEFq+t2PpBeRz6
DCjg3iSOw9RMw9xf2qZMrCnnZXmkKJKFpYqZvhjhehTC69+7VyP6njGM9ye3
O9keWBMN4KexakeVsP6Quu7CQuDxT0rI4K+Se6Wa7O9WeyG+6u23O8Me769a
+uFNF+tu969v27W+8yE7t4BdmtVv65plstNHJQNQjHEoAHOm5.4EWC2QtNst
23Y+MznOP470RIdrci7vCV2fP7Hx1tZcB8a6J6lskvLHRdIcyTrJgMmqrayU
1s4J6lZKQP3qPMBBTZim70HnVjocqpTPYK3invmiBdldyKSYPQEbGIJf21lx
sLyjIsyGwRwUOUrrKtVbU.LNlSiZw0UnXbkWLelrCzDUiDlmPzWGFVZdEJGf
1N0VvwxNNSGJGftpmwBht.I3K9sSUvKmYQGwm9VL1LRZ+gz7Es06FVU.BhT+
5WOWDNDXWqlkpOK0++KCxPWj+lWMPBHp+cXh9UpVduwvPIfy0CkFVMbaLQop
0KYBM03qDebczgvTNalwWsweGyJOSCHl8ENMZr9QuXiuh4m.ec4xOO7Uu9mJ
mwnPKGQpUhTm0n21EAoi1rJrbldoNkzoxqyDLsV0nLTyYBlER3wNUSFwr8Bn
QYnFXxMDT5j8B3L4RbpoGEqr0Zzu4R0qgG2HjZhaDTry2fD4Jwbbi9dCKKAH
X5NG2n43FMG2HEVfLgp2YRGACsn7pd6JOlywLaNlYywLaNlYywLaNlYywLaN
lYywLaNlYywLaNlYywLaNlYywLaNlYywLaNlYSNRFNGlu4v7MGlOEFlOtonz
W2yLtzOj4PXhAx3qx99uyO76M+g+f4RD52+E7u.p+EX9WjJxfv1WvsnViLHr
mHCJbuFSDdYK1.pjNzf2cwKrtC6VQikKFnVCXoE2SO0Fg46YHVPK9rIjYnM4
z.gNnEWMu+e4Ks7gfAX0fAHfKuhPZQr3NwQt8XPWKozrIsrZNTNC5.TypJEJ
b3JuvnPrF4UUZlSnz3ZyJR+ca2V60jV603y1qESIqXI22emt9tbzc+Bpv.mF
Iw117l+Exwm6QsSGQNr2obVo0HC4pFLVJp3fHVdzhMYFhilTfLHpo.Yj24J1
ItuQ0Gitjbkk.ERUNmT6RgWHtBYOxBs3Ch2F6sRNA0pYLc9LYCDyRl8HYwRW
ozUxdFgE6E7sLCOoAejFRi8Rih+y9aeTtZhfhFx6BpgJ40FmeamiWPTFVHx8
M.HeOwFClywq4b7ZNGutvfbFS81X3ua+gfDJX4md8gkLwHWvNH80HVdYEGnx
8e6azFsZOwn5KL.pJ6wtbLx0sVzf0v.4skwOa.GJRcERMrbjBHlgDBd5jxJ8
jOXl+B4aDpTkMmLJJsliPhYbAoMmi5yZtbTBmWXpz9rl6Jjcph5R4v3Sxc+7
1ltboFqLdXXvmq5yA.hSdJVHFtI4F0tP8ayZYqVhXD0iX1hRfJTjAO5Mhkr1
KfxLOz.sz38.1+gKUTxHZcoCXKX3P40QWyagQS8YwIbPHjs5MYhTLUSCJ4mz
U.xR8.D1FsDxAkbKtuIHzYSD5gYQIV8FTVvGIB9D14VYPohQpqfo2XKrtiT6
8V+jAf8i4vjf2so4nKc3mMSlMupflOAWtZlWuYHkI+mggTHW0CUDgsBHS8Dp
h8B2DsyXXBzgNWMUd4yjhEP+xJ5KCpfWAkeVHc.p5y.gDZ5ZZPfw6.FuCZ7r
G6SnKXJ6rtBSYWw.RL5FNkcmeMshuFY6cQ8s251tpVkzcExRC6AJ.2T8dqXK
TxAEt44B0TA3lCcks3p9gVV4PkYFT47qMAScG.siYCARgscDMugqOPrDGInp
MV2ajXMNLS23m1JzKiwX8CwOQ+bwdl.XvKpMPWHOpGjGW6HkKikyofgoQNqj
4WseFKz0TOmQNWdizsn35ICUi61KQwadI1a+w2k0A9qepD2Fq4oKgFvPDi.E
NrBhU6K2y47L+EXwlYcswVhs+IH5bCsDHf50dlUMCXxvVwyifEMlA6fS7Uoe
vkQhELFjZMWKdy0QuULFLZL6oHxnh78mkpec7tHxpsMNWWWHD3bWqe53KkmW
A7wax+vdrcZd3Kx71xghSXqbZvV8H+0QCR0AYQrstqwmbQHGB7TJmcgkgwmP
jRTT2JAv.qJk.hrwylrzw111r4hwYO6ROMMX34IQzKmvEcBuMeeZpdJY1TRD
6VTsWGAIi8xwz.XjMG6HnAx.oRAP1RK.5rbPLcDtDfi8kJcBAcpMgU44jGDL
8W4l5yNXr8P11y0ik5lkzKCRasAlsld6t7xtHHs0JJFLs3kQxJxvReVdrHfp
G+syey9HlM+IEohNNa6JzFTplGI1xYaoIdUMg0Dz0kuPqr4WXUSMIxqOxH8R
sjnOuMkkATqnXvzRVJT1g4SPRFoORlfxVrAzmcBdn8zqLTHKIimfzLPi3lwp
tbebjdVhCfutUES9iU0j+XgcWhX+yF2c6HqpY9iHBRWUSirZWnrF9co.kE7W
I.ER0iBNliRzAwllUSKrvXtplF69LTV8XSv57i936Eb54GCvc54TNvcHF+B0
CZlL8pYNDY0nnOnLd5UC1.x5JGzcBRyNSPZFpWz7TqvwIqVP.d5UdvZYZ+to
zrT7y3oWABSU0TvoWABKqS2LdbhZHwwXcdkjn+3u0E913EwoX6o35IkzBYIG
GYHG3nQNVRPNtZE0zrhDd6ImQiZHDIHGr43RO.YnGf9POHhd89BgGO5AIA8P
FQ9YnLzCZ7nGfLC24ytBZbnGIHGqQCcvZkrPjLpQGOVGjsLjy3o3BICuCApW
zyQf3UkdvZF9f0L7ApWi1kgZPilfYnLbyiGySy4531a0LPFYyPhlQO.8hd.1
ZF8LdJSA1xx+.GG5wR12WiD8nY9ABzL+.AZlef.MyOP.V1w6iD+LR1w6iD+C
TV+j0H5AMdjiztIqSzyHhORPNWpxcwjgeTk.lSHGUAfOp5+dZk+s6p96wU7W
1S9md6+Ou0G.z
-----------end_max5_patcher-----------
</code></pre>
view raw gistfile1.txt hosted with ❤ by GitHub

I am sitting in a system

01 lucier sitting

In this well-known piece Alvin Lucier elegantly demonstrates that any acoustic space is a system that processes sound.  In a room, sounds bounce off walls, ceilings, floors, and other reflective surfaces, producing standing waves.  These waves add harmonics and reverberation to the original sound.  The frequency of the added harmonics depends upon the distance that the sound waves travel between the various reflective surfaces (amongst other factors).  In many rooms the added harmonics and reverberations are so subtle that they go unnoticed – we don’t think of sounds in a room as being processed.  But in this piece Lucier reveals these subtle transformations in a very dramatic way.

In I am Sitting in a Room, the composer reads a text aloud whilst using a microphone to record his voice.  The recording is then played back in the room, and the microphone now records the sound of the playback occurring in the room.  This second recording has now gone through the room twice (once during the original reading and again during the playback), and the harmonics and reverberations from the room are accumulating.  The second recording is then played back and re-recorded, and the process repeats over and over.  With each iteration of the process more and more reverberation and harmonics accumulate, until eventually the composer’s voice is an unintelligible blur of gorgeous room-o-licious tone-clouds.  Glorious!

This piece also demonstrates the use of feedback in a system, but on a time-scale that is larger than what we might expect.  Feedback is used in filters and echo systems to produce effects that are immediately noticeable.  In this piece, the feedback accumulation is rather slow (with one cycle of the system feeding back once every 90 seconds or so), allowing us to hear the subtle transformation of each feedback cycle with much more detail.

In fact, I would say this piece is a prime example of feedback art.  Aside from generating the original source signal (the composer reading a text), the only procedure that is used in the work is to present the output of a system back to the input stage of that same system.

feedback

Here is a live performance of the piece:

And here is an interesting homage called “I am Sitting in a Video Room”:

This piece also demonstrates the slow accumulation of feedback through a system.  In this case the system is not an acoustic space, but is Youtube.  A video is uploaded to Youtube, resulting in compression artifacts, little glitches in the sound and image, that are usually not noticeable.  The Youtube video is then downloaded and re-uploaded, resulting in a second iteration of artifacts.  The process repeats and the artifacts accumulate until the images and sounds in the video are a computery scrambled-up nightmare.  Terrifying!

And then there’s this:

Mind = Blown.

While not a direct reference to Lucier’s piece, Search by Image, Recursively, Transparent PNG, #1 by Sebastian Schmieg is another great example of feedback art.  The artist starts off by uploading a blank image to Google’s search-for-similar-images service.  The first hit that results is then presented back to Google and a similar-image search is performed on that image.  Each iteration of the system produces an image that is slightly different from the last one*, creating a slowly transforming visual landscape.

  • This feedback system could have resulted in a recursive loop rather than the linear progression we see in the video.  If a similar-image search for image A produces image B, it makes sense that a similar-image search for image B would produce image A.  This would create a video that just goes A-B-A-B-A-B-A… To avoid this the artist skipped search results that had already been used in the video, choosing the next-most-similar image beyond the already-seen image.