Student Area

starry – facereadings

Kyle McDonald – Appropriating New Technologies

“What we discovered is that that expression alone is sufficient to create marked changes in the autonomic nervous system” (Paul Ekman)

I thought this was interesting because it seems like human emotion is usually dictated by some internal mechanism within the brain and being able to induce emotion purely based on physical motions was not something I’d considered before.

Nabil Hassein – Against Black Inclusion in Facial Recognition

“Machine learning researchers have even reinvented the racist pseudoscience of physiognomy, in a study claiming to identify criminals with approximately 90% accuracy based on their faces alone — using data provided by police.”

I thought the arguments the author discussed were very interesting, the quote above reminded me about how important it is to understand the societal impact of any piece of technology especially when it can perpetuate racist ideas and not simply focus on innovation or technical mastery.

 

hunan-facereadings

Against Black Inclusion & How I’m Fighting Bias

The discussion around algorithmic justice (especially with facial recognition) had been at the center of attention for a while now. I’ve thought a lot about it and concluded the following:

  1. I don’t think we’ll be solving the problem by eliminating the technology. Technological advancements have been a constant in human history except for a few cases where mass destruction (biological, chemical, nuclear weapons) or major ethical challenges (human cloning) are concerned. Facial recognition and its application are not qualitatively different from many other biometric systems such as fingerprinting.
  2. Though facial recognition is more powerful, it is not qualitatively disruptive as other technologies such as cloning humans. Thus, the technology itself should not be the subject of concern — it merely reveals and amplifies the existing systemic injustice and oppression. For example, it was mentioned in one of the articles that the US is planning on using facial recognition to trach everyone who is leaving the country. However, the same tracking system (implemented with fingerprinting) has been in the U.S. for aliens and in China for all citizens. With qualitatively different and destructive technologies, it would make more sense to control the technology itself, as its destructive quality is independent of its ownership and usage. Whereas in this case, it would make more sense to direct the fight for justice towards those who are using the weapon (the state, the government, the capital, etc.) than the weapons themselves (the technology.)
  3. I’m by no means downplaying the potential harm of misusing technology as a tool of oppression. As someone who’s lived in China and seen how technology is fast-tracking the blatant violation of basic human rights in Xinjiang and Tibet (and many other places around the world,) I’ve witnessed the destructive power of information technology. This is not new — IBM’s punchcard and computer systems found some of their earliest uses in the Holocaust and greatly improved the efficiency of ethnic cleansing. However, compared to other technologies, information technology does provide hope for more open-sourced, democratic distribution of power. Unlike military and nuclear power, which are held exclusively by the state, we see more individuals and NGOs leveraging the power of information technology to exert influence on a previously unimaginable scale (a recent example would be the involvement of civilian hackers in the Russian invasion of Ukraine; decentralized cryptocurrency is another example.) Though alarmed by its potential harm, I also remain optimistic for the future of technology and democracy.

merlerker-facereadings

Happy Things by Kyle McDonald & Theo Watson (link)

Dug a bit into this project and I love the concept – it posts a screenshot of your computer whenever you smile (w the implicit assumption that something on your screen made you smile). Sadly most of the screenshots showcased are people testing out the app 🙁 Would want to “live” with it for a while.

Useful tip: Aligning eye position to do face averaging.

 

Last Week Tonight / Against Black Inclusion … / How I’m Fighting Bias …

Reflecting on why exactly we need to be wary of applying facial recognition / “coptech.”

1) As we rely on facial recognition more, the times it is wrong are disastrous. The points where an infrastructure (technologies that are so embedded/hidden in the way we do things that they’re invisible) become visible are where it breaks/fails.

2) The benefit is not worth the invasion of privacy. There’s always going to be some terrible human who has the power to abuse access to personal information and will do it (like the Russian app demo’d for creeping on women, finding excuses to arrest BLM protesters)

3) Reinforces existing privileges in our society. Lack of inclusion/recognition of black faces – proposed as a form of privacy protection by Hassein, but as long as law enforcement uses facial recognition that increases the risk of misidentification.

 

Agree with John Oliver then that we need laws that require a person’s permission to use facial recognition on them, or stop developing facial recognition entirely. And instead, let’s use it to make art! (I think someone notable said that it’s the best use of surveillance tech.)

duq-facereadings

“Joy Buolamwini of the Algorithmic Justice League speak on wearing a white mask to get her own highly imaginative “Aspire Mirror” project involving facial recognition to perceive her existence”. I didn’t realize that biases in AI would compound into many projects that did not introduce any bias.

“In the early 1960s, Paul Ekman set out to discover whether facial expressions for communicating emotions are universal or cultural. He travelled the world with photographs of distinct faces, even traveling to remote locations, and found that they were interpreted consistently”. It seems obvious today that facial features are based in nature as opposed to nurture, I hadn’t realized that someone most likely had to prove it before it became common knowledge.

Sneeze-facereadings

Zach Lieberman, Más Que La Cara Overview
I liked how their process went above and beyond what I was expecting. They hosted workshops with high schoolers to create cardboard masks to connect with the community as well as get some ideas. I think that this was really thoughtful and considered the local culture’s perception of masks. It was also an interesting way to collect ideas for masks.

Last Week Tonight: Face Recognition
It was interesting how the government of many large countries are investing in facial recognition technology for the reason of discovering criminals, but the idea is terrifying when thinking about if the government is corrupt because the technology is extremely powerful. Both gathering information about one individual or many similar individuals and could be abused in the wrong hands. I think that even if some countries decide to implement laws and regulations on the technology, other countries will not and the tools will still be abused.

hunan-VQGAN+CLIP

Since I don’t have Colab Pro, I spent a lot of time trying to get the notebook working on a local runtime so I can get the bigger models working. But many library issues and differences between Windows and Linux made it very annoying. So I resorted to using a smaller model on Colab.

Lemongrass under the pink sky rendered in blender

hunan-TextSynthesis

This is the first time I’ve used GTP-3 and was honestly a little disappointed. Don’t get me wrong — it’s an amazing model, I just didn’t see the improvements over GPT-2 that I was looking forward to (given the massive increase in parameter size over the already massive GPT-2.) Maybe the improvements in text generation are already marginal and it would take something like DALL-E to tell the difference.

I tried putting in the first sentence of a news article generated by GPT-2 for one of my previous projects into GPT-3 as a prompt. The following is what I got.

The family of a Maryland woman who was killed by a stray bullet last year has settled a wrongful death lawsuit brought by the family of Kimberly Ballinger, a 19-year-old who was struck by a stray bullet in March 2018.

News outlets report attorneys for Ballinger’s family confirmed in a news release that the lawsuit against Baltimore County was settled on Aug. 17 for an undisclosed amount.

Sarah Gelsomino was struck in the neck by the bullet that struck Ballinger as the two were in a car. The lawsuit alleged that Ballinger was inadvertently killed by Gelsomino’s boyfriend, Charles Lee Thornton Jr.

Gelsomino survived and filed a lawsuit in June against Thornton. The lawsuit alleged the shooting was “reckless and unreasonable,” and that Thornton acted recklessly, setting into motion Ballinger’s death.

Advertisement

Thornton was charged in Ballinger’s death. It’s unclear if he has a lawyer.

Copyright © 2018 The Associated Press. All rights reserved. This material may not be published, broadcast, written or redistributed.

This is the original article generated by GPT-2:

The family of a Maryland woman who was killed by a stray bullet last year has settled a wrongful death lawsuit brought by the family of Kimberly Ballinger, a 19-year-old who was struck by a stray bullet in March 2018. Ballinger’s family said they were given about four weeks to file their claims, and on Monday the family settled the case. “The family is relieved that this case is closed,” Ballinger’s family attorney, Stephen R. Kaufman, said in a statement. “They have been unable to pursue their claims against the gun manufacturer that manufactured the bullet and that illegally sold it to the gun shop owner.” The Maryland shooting happened at a gun shop in Fayetteville, Maryland, when Ballinger was shopping with her father and a friend. The store owner, Lorne Ahrens, fatally shot Ballinger, who was a student at Towson University, according to the complaint. The gun shop owner’s wife, Tammy Ahrens, was also shot. “The bullet struck Ms. Ballinger squarely in the back of the head,” the complaint said. “Although Ms. Ballinger did not have a bullet wound, the bullet went through her inner right arm and into her right shoulder, severing a major part of her arm and causing her to lose her life.” Ballinger was struck on the left side of her body and her right arm, the complaint said. Ballinger was in critical condition at a hospital for about 24 hours before being transferred to a hospital for treatment of an arm injury, according to the complaint. The bullet was recovered from her body, and the gun shop owner was arrested and charged with first-degree murder, the complaint said. He had been held on $500,000 bond. Ballinger’s family asked that the $1 million awarded to Ahrens be increased to compensate for Ballinger’s loss of life and a $100,000 reward for information leading to his arrest. The gun shop owner and his wife pleaded not guilty to murder charges. The family is asking for unspecified monetary awards, restitution and attorney’s fees. The family is also asking for the gun shop owner to be held accountable for his actions. CNN’s Artemis Moshtaghian contributed to this report.

hunan-Pix2Pix

Cats are always fun. Not many surprises here as it’s just a classic Pix2Pix model. But I was surprised to find that many art projects, including this one (edges to cats) and the “Learning to see: Gloomy Sunday” we saw in class were actually included in the original Pix2Pix paper, which I thought was kinda cool. This site seems to run inference on the frontend and is quite unstable (I would get “page unresponsive” multiple times for each generation.)

hunan-ArtBreeder

It’s alright. There are still some deconvolution artifacts that give it away immediately (at least with the more photorealistic genres I’ve played with.) I love the freedom and flexibility it provides with various keywords and parameters, but the actual effect of these parameters in the images is rather disappointing. Resolution is not bad for generative models.

Dr. Mario – AugmentedBody

Nose Dodger:

 

 

This is a game about dodging and eating using your nose to guide the player and your mouth to eat the food.

And here’s what it looks like while you’re playing:

 

This was such a fun project, I was a little worried about how it would turn out while I was working on it, but once I got the base mechanics in I had blast throwing my face around the screen to dodge the projectiles. The face detection is a little weird at times but I figured out how to get mouth open and closed, my function could also be easily changed to get the distance from the screen to the face. I think handsfree.js has a lot of versatility and I will definitely be returning to it in the future.