{"id":959,"date":"2022-09-29T11:19:57","date_gmt":"2022-09-29T15:19:57","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/?p=959"},"modified":"2022-10-08T21:37:17","modified_gmt":"2022-10-09T01:37:17","slug":"facial-recognition-recognition-but-with-drawing","status":"publish","type":"post","link":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/sensoruncensored\/09\/29\/facial-recognition-recognition-but-with-drawing\/","title":{"rendered":"Facial Recognition Recognition \u2026\u00a0but with drawing"},"content":{"rendered":"

I proposed to create a typology of surveillance power by building facial recognition recognition. That is, I plan to build a computer vision pipeline that can automatically recognize clippings of surveillance cameras from images of street scenes, and an image classifier that categorizes these segmented images into the kind of camera, their technical capability for facial recognition, and the institution they are owned by and send data back to. This will enable me to automate the creation of both <\/span>power<\/span><\/i> maps and <\/span>topographic<\/span><\/i> maps of surveillance, that is: both representations of the relationships between institutions of power the surveillance acts on behalf of, as well as representations of the spatial locations different kinds of surveillance can be found.\u00a0<\/span><\/p>\n

This project is a step toward that. I am inspired by the maps of Manhattan surveillance cameras in the Institute for Applied Autonomy\u2019s <\/span>Routes of Least Surveillance<\/span><\/i><\/a>. <\/span><\/i>This work is also inspired by the <\/span>Pittsburgh Surveillance Walking Tour<\/span><\/a> made by the Coveilance Collective (of which I am a member). The idea of an abstracted map came from \u201cLearning from Las Vegas\u201d by Denise Scott Brown, Robert Venturi, and Steven Izenour, depicting street signs visible from the Las Segas strip (shown below).\u00a0<\/span><\/p>\n

\"\"<\/span><\/p>\n

While similarly enthralled with the geography of surveillance and exhaustive geographic accounts of specific features of a place, my new work seeks to build on these projects by recognizing that surveillance cameras are not singular, but varied in their age, technical capabilities, their owner, and who they do and do not share data with. This work seeks to surmise tentative answers from a detailed study of cameras\u2019 outward characteristics.<\/span><\/p>\n

I had originally intended to build a computer vision algorithm that would recognize surveillance cameras, and classify them according to their capacity to support facial recognition and resulting data owner. However, after attempting to collect training data for this idea, I realized that a more detailed examination of the physicality of the varied cameras that appear in the Pittsburgh landscape was needed. I therefore decided to create drawings of these cameras in three short stretches of street across Pittsburgh.\u00a0<\/span><\/p>\n

 <\/p>\n

***<\/span><\/p>\n

Border of The Hill and Duquesne University\r\n<\/b>\r\nContext: The Hill district is a historically Black neighborhood. Just to its southwest tip lies Duquesne University private a predominantly white university. \r\n\r\n\"\"\r\n\r\nAppears to be mostly older-generation cameras, of uncertain facial recognition ability.\u00a0\u00a0<\/span>\r\n\r\nHardened, placed high up on private businesses.\u00a0<\/span>\r\n\r\nPNC bank had a camera swiveling loudly on a timer.\u00a0<\/span>\r\n\r\nDuquesne has a \u201cBlue Light Pole\u201d of dubious effectiveness with a camera towering atop.<\/span><\/pre>\n
***<\/p>\n
\"\"<\/p>\n
***<\/span><\/p>\n
 <\/p>\n
As noted in book <\/span>Photography and Science<\/span><\/i> by Kelley Wilder, cameras are often used to record the particular, whereas drawing provides a medium suited for drawing the \u201cideal specimen\u201d by abstracting away extraneous visual information. Also, noticing small differences between ostensibly similar cameras requires a long period of focused looking, the same kind of looking that is required to produce a drawing. In this way, drawing is the appropriate capture technique for this project.\u00a0<\/span><\/p>\n
 <\/p>\n
***<\/span><\/p>\n
Bloomfield\r\n<\/b>\r\nBloomfield is an \"up and coming\" historically Italian neighborhood, now home to hip bars and restaurants. \r\n\"\"\r\nMany newer generation IoT cameras, higher resolution and internet-connected.\u00a0<\/span>\r\n\r\nFootage could be shared with law enforcement directly though partner programs. \u2028<\/span>\r\nOften lower to the ground, more at eyeline.<\/span>\r\n\r\nSome video doorbells.<\/span><\/pre>\n
***<\/span><\/p>\n
\"\"<\/p>\n
***<\/p>\n
To produce this project, I meticulously drew every visible surveillance camera on three stretches of street in the areas of Bloomfield, Walnut Street, and the border of The Hill District and Duquesne University Campus. I then carefully digitized these drawings, and put them on a map of where exactly each camera exists. I then wrote a short analysis of the kinds of surveillance technology characteristic to each neighborhood, presented on the poster and interspersed in this blog post.<\/span><\/p>\n
***<\/span><\/p>\n
Walnut Street.\r\n<\/b>\r\nContext: this is the bougie shopping street. Think Apple, Banana Republic, and overpriced cocktail bars. \r\n\"\"\r\nLower density of privately-owned cameras. \u2028\r\n\r\nCity-owned cameras on utility poles.\u00a0<\/span>\r\n\r\nHighly visible street signs announcing this surveillance.\u00a0<\/span>\r\n\r\nWho gets this data? How?<\/span><\/pre>\n
***<\/p>\n
\"\"<\/p>\n
***<\/p>\n
 <\/p>\n
I have not yet achieved my goal of building a facial recognition recognition system, by building a computer vision system able to recognize cameras capable of facial recognition. However, this project is a step in that direction, and opens new opportunities, chiefly: When I do build such a system, what can we learn about the different modalities and owners of surveillance, between different neighborhoods?<\/span><\/p>\n
***<\/p>\n
David Gray Widder is a Doctoral Student in the School of Computer Science<\/a> at Carnegie Mellon University where he\u00a0studies how people creating \u201cArtificial Intelligence\u201d systems think about the downstream harms their systems make possible. He has\u00a0previously worked at Intel Labs, Microsoft Research, and NASA\u2019s Jet Propulsion Laboratory. He was born in Tillamook, Oregon and raised in Berlin and Singapore. You can follow his research on Twitter,<\/a>\u00a0art on Instagram<\/a>, and life on both.<\/p>\n
***<\/p>\n
bonus @Bankrupt Bodega<\/a>:<\/p>\n
\"\"<\/p>\n
 <\/p>\n","protected":false},"excerpt":{"rendered":"
I proposed to create a typology of surveillance power by building facial recognition recognition. That is, I plan to build a computer vision pipeline that can automatically recognize clippings of surveillance cameras from images of street scenes, and an image classifier that categorizes these segmented images into the kind of camera, their technical capability for … Continue reading “Facial Recognition Recognition \u2026\u00a0but with drawing”<\/span><\/a><\/p>\n","protected":false},"author":10,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[7],"tags":[12],"_links":{"self":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/959"}],"collection":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/comments?post=959"}],"version-history":[{"count":8,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/959\/revisions"}],"predecessor-version":[{"id":1191,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/959\/revisions\/1191"}],"wp:attachment":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/media?parent=959"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/categories?post=959"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/tags?post=959"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
See the entire full res poster including maps side by side here.<\/a><\/p>\n
Finally, by placing the camera drawings on correspondent maps, and comparing between these three neighborhoods, I reached tentative hypotheses. As well as being presented here, these maps, drawings, and hypotheses are presented on a poster.<\/a>.\u00a0<\/span><\/p>\n