Experimental Knowledge Capture

banner image of concept map
banner image

For this project, I (mis)use corporate knowledge transfer methods to make a portrait of my grandfather. 

Through it, I get an extremely weird, sometimes unsettling, and usually hilarious point of view on corporate culture.

I’m also able to impose some of my HCI education and push it into a space where it’s not “supposed to go.” I get to see how human-centered design principles (like interview techniques, concept mapping, etc.) hold up against the extremes of the hyper-logical and the hyper-personal.

Background

(In all seriousness) I have one grandparent left, and we’ve gotten closer over the last few years. He expresses some regret over not having been an active part of my childhood (thanks to living on opposite ends of the country). I want to help close this gap, find a way to capture his wisdom, and consider the knowledge-based “heirlooms” he might be passing down.

What do we do in the face of this problem? We turn to the experts. When you google “intergenerational knowledge transfer” or even “family knowledge transfer,” all I found was corporate knowledge transfer methods. What happens if I apply these methods to my family as if it were an organization?

———————-

Method

Method derived from: Ermine, Jean-Louis. (2010). Knowledge Crash and Knowledge Management. International journal of knowledge and systems science (IJKSS). 1. 10.4018/jkss.2010100105.

password: excap20

Phase I: Strategic analysis of the Knowledge Capital.

First, identify the Knowledge Capital. One day, I called my grandpa and gathered a list of every single thing he had done that day.

I also supplemented this list with some more characteristics, gathered through a call with my sister.

Next, perform an “audit” to identify the knowledge domains that are most critical, by using the following metrics:

every domain gets a score; the highest score is the most critical knowledge domain.

My table (full version here):

The results show that making breakfast is the most critical knowledge domain (with a high score of 14). I’m not surprised at all. It’s an incredibly specific ritual for him – he has been making the same bowl of cereal, 7 days a week, for at least 30 years. It’s in my earliest memories of him (even when he was visiting us in Colorado, we would make sure we had all the ingredients on hand). It’s interesting that the “knowledge audit” managed to capture the salience of this task as well.

Phase 2: Capitalization of the Knowledge Capital.

Now that I know the most important knowledge, I convert the tacit knowledge of how to do it into explicit terms. Or, in other words,

“collect this important knowledge in an explicit form to obtain a ‘knowledge corpus’ that is structured and tangible, which shall be the essential resource of any knowledge transfer device. This is called ‘capitalisation,’ as it puts a part of the Knowledge Capital, which was up to now invisible, into a tangible form.”

As a fun aside, the last line there is essentially the business-speak definition of “experimental capture” – bringing something that was invisible into tangible form.

To “capitalize the knowledge capital” (not a joke – this is what it’s actually called), the literature calls for the use of “graphical models,” and give several examples such as the phenomena model, activity model, concept model, task model, and history model.

Before making the model, it’s important to interview the stakeholders. I relied on interview techniques from my research background, as well as some inspiration from Rachel Strickland’s Portable Portraits, and conducted a contextual inquiry over FaceTime where I asked my grandpa to walk me through making breakfast in excruciating detail. (Arguably the hardest part of this whole capture was remotely helping a 89-year old figure out how to flip the camera view 🙂 ).

Next, as I am the knowledge corpus (literally), I needed to convert the tacit knowledge I had learned into an explicit model. I chose to make a concept map. 

Concept maps appear not only in the KM literature but also in my HCI curriculum. Each field has a slightly different definition, but overall, concept maps are meant to be highly structured & methodical to articulate a user’s mental model in a specific situation. Each element in the map must be a noun, and every arrow must be a verb.

Counterintuitively, it’s the constraints that allow strong stories to emerge. We are taught this in HCI, and I am really taking that and pushing it to the limit here. To what extent can I tell a hyper-personal story within the strict constraints of a concept map?

concept map of my grandfather's process of making breakfast
Each word is a noun; each arrow is a verb that shows the flow of information. Despite these strict rules, one can follow a personal story (complete with direct grandpa quotes) throughout the diagram.
Phase 3: Transfer of the Knowledge Capital

I completed a capture for one specific task. The next step would be to repeat this capturing-and-modeling process for a whole series of critical knowledge domains. With all the models together, the organization goes on to create a “Knowledge Book” (or “Knowledge Portal” if it’s online) where it can be disseminated to new employees.

reflection

Beyond having some fun with corporate literature, using (or mis-using) these highly structured tools are an opportunity for me to critique my academic background. I don’t get a lot of opportunities to do this, so I loved being able to push up on the edge of user research tactics in ways that would probably not fly in my career.

I often struggle to position myself within my field and feel generally suspended between art, design, and tech. This project was not incredibly profound or anything, but it was a way of placing myself directly between two emotional extremes and sort of navigating that ambiguous space, all within the nice constraints of a single quotidian task.


Some “making of” content:

after a few iterations of concept mapping

 

 

Work in Progress

Using corporate knowledge transfer methods to make a portrait of my grandfather

Background: (in all seriousness) I have one grandparent left, and we’ve been getting closer over the last few years. He expresses a sort of regret over not having been an active part of my childhood (thanks to living on opposite ends of the country). I want to help close this gap, find a way to capture his wisdom, and consider the knowledge-based “heirlooms” he might be passing down.

What do we do in the face of this problem? We turn to the experts. When you google “intergenerational knowledge transfer” or even “family knowledge transfer,” all you get is corporate knowledge transfer methods. What happens if I apply these methods to my family as if it were an organization? Going down this rabbit hole makes for a super weird and fun project.

 

Intro: 

Method derived from: Ermine, Jean-Louis. (2010). Knowledge Crash and Knowledge Management. International journal of knowledge and systems science (IJKSS). 1. 10.4018/jkss.2010100105.

  • “Inter-generational knowledge transfer is a recent problem which is closely linked to the massive number of retirements expected in the next few years.”
  • “This phenomenon has never occurred before: this is the first time in the history of mankind that ageing is growing like this, and, according to the UN, the process seems to be irreversible.”
  • “According to the OECD’s studies, this will pose a great threat to the prosperity and the competitiveness of countries.”
  • “[We can tackle this] inter-generational knowledge transfer problem with Knowledge Management (KM), a global approach for managing a knowledge capital, which will allow a risk management in a reasonable, coherent, and efficient way.”
  • “We propose a global methodology, starting from the highest level in the organization” —> for me, this means the patriarch of the family.

 

The Method: 3 phases

  1. Strategic analysis of the Knowledge Capital.
    1. First, identify the Knowledge Capital. Last week, I called my grandpa and gathered a list of every single thing he had done that day.

      I also supplemented this list with some more characteristics, gathered through a call with my sister.
    2. Next, perform an “audit” to identify the knowledge domains that are most critical, by using the following table:
      every domain here will get a score; those with the highest score are the most important.

       

  2. Capitalization of the Knowledge Capital. Now that I know the most important task(s), convert the tacit knowledge of how to do it (them) into explicit knowledge. Or, in other words,

    “collect this important knowledge in an explicit form to obtain a ‘knowledge corpus’ that is structured and tangible, which shall be the essential resource of any knowledge transfer device. This is called ‘capitalisation’, as it puts a part of the Knowledge Capital, which was up to now invisible, into a tangible form.”

    As a fun aside, the last line there is essentially the corporate-speak definition of “experimental capture.” 🙂 To do this, I’ll be drawing on interview techniques from Rachel Strickland’s Portable Portraits, as well as some “Knowledge Modeling” techniques from the corporate article, such as  the “phenomena model,” “concept model,” and “history model.”

    • Phenomena model: describe the events that need to be controlled/known/triggered/moderated to complete the task
    • Concept model: mental maps – may ask him to draw a diagram of how he does a task
    • History model: learn more about the “evolution of knowledge.” Ask why – hear the story behind a particular artifact, etc.
    • TL;DR – the capture technique is a mixture of video, drawing, and interview, depending on the task (and whether or not video creates too many technical difficulties for a 90 year old :))

     

  3. Transfer of the Knowledge Capital. This is all about how the Knowledge Corpus is disseminated.  This usually goes in the form of a “Knowledge Book” (or a “Knowledge Portal” if it’s online). Furthermore, to ensure successful transfer it’s often good practice for the recipient to do something actionable with the Knowledge Corpus.
    • Existential Question: since I am literally a body of genetic transfer… am I the recipient, or am I the actual Knowledge Corpus itself?
    • Either way, I plan to take action by recreating (and recording) the task(s) myself, relying on my own memory as a source of tacit knowledge. If I am the “recipient” of the book/portal, this will be my way of proving successful transfer via action. If I am the corpus itself, this will be a final capture method to convert tacit knowledge into explicit knowledge and create the book/portal.

 

Ta-da! I have created a kind of fucked up heirloom.

End of Semester Plan

For the remainder of the semester, I’m working on a project about communication between generations.

Since the launch of the Person in Time project, I’ve been thinking about capturing something about my elders – specifically my grandfather. We’ve always lived on opposite sides of the country, and in the last couple years, he’s expressed a sort-of regret over not having been as active a presence in my life (we’ve also gotten quite a bit closer, so that might show some contrast to how things were when I was a kid).

my notes from last week’s brainstorm with Nica
The general frame is this: 
  • I think about the things he says like “I regret never getting to know you as well as I wish I could have”
  • I notice changes in him and changes in my dad (his son) over time.
  • Lately, I’m also wondering whether I will be able to see him again.
How might I close this gap that he is worried about? How might I remotely capture the passing of time & knowledge between these 3 generations?
1. To dive in more, I’ve been doing research on  ‘knowledge transfer’ methods to see what other people out there tend to say in very different disciplines.
  • “Objective”corporate knowledge transfer methods —> would be weird, and maybe awesome to try and repurpose a stiff “corporate knowledge transfer machine” for hyper-personal use. So far, I’ve done quite a bit of reading and I have to say that the results are hilarious. :)
  • “Subjective” –
    • ‘knowledge as an heirloom’
    • indigenous knowledge transfer methods
2. Possible Capture Methods – this is an old list, I haven’t revisited yet since doing research above.
  • Mobility: walk cycles, motion capture
  • Storytelling, audio interviews
  • handwriting
  • Facetime – record audio & video from there
  • Diary study (via sms?)
  • Collaboration over an app (we all download the same one, and capture something about our lives)
  • We all capture ourselves doing the same thing (could use a fun app above)
  • “Leaving a trail” – Nina Katchadourian’s sorted books
3. Possible Output – also an old list
  • Generally, video with interview audio overlay
  • Family dinner —> do it live over some digital tool, or create a digital one via certain artifacts

I will have more to share about the research – but I want to post this for now! Sorry for the delay.

pictures I didn’t take

The readings about poor images reminded me of a project by Matthias Brown (@traceloops on Instagram), in which he finds photos (of people he does not know) that all have the same generic filename, and then paints them, transforming them from forgotten digital artifacts to permanent, deliberate works of art.

link to the post

I realized I could do a similar thing for myself via my iMessages archive.

Even after new phones/computers over the years, I still have this iMessage archive going back to 2013…or maybe earlier. It looks like this – just hundreds of cryptically-named folders, each with a cryptically-named subfolder within it…each filled with forgotten images, screenshots, etc. from old text conversations.
my imessage archive of poor images

These are the photos no one ever saved. Each of the subfolders seems to be labeled with a number between 0 and 13. I chose to look at all the folders labeled “9.” (I’m choosing 9 randomly).

In these folders, there’s absolutely no organization whatsoever. a photo from 2014 will be next to a photo from 2020. All from different times of day. There’s no context besides the date and time, and no way to know who I was talking to, or whether this is a photo I sent or received.

I think this is so awesome. 

Usually, when I go through my camera roll, filled with photos I’ve deliberately taken and saved, I can pick out a random one and after a couple seconds of thinking, say “ah yes” and remember what that picture was about.

The photos in the messages archive, however, precisely fit my understanding of “poor images.” They were never saved to a camera roll; they are forgotten images. Now devoid of context, their stories are a complete mystery. Did I send this? Did I receive this? What was the conversation we were having around this picture? They are silly, scary, dark, intimate. Some bring back memories of my sort of “past-selves” – an ex’s kitchen; the bathroom in a place I used to live.

I am so obsessed with these, and I spent WAY too many hours digging through this archive…I would love to continue this project in some way. For now, here is a small collection of photos I didn’t take. Some of the scenes are more familiar than others; but what stands out is I was not the photographer – yet I am somehow the owner. This is a crazy thing to think about – what are the ethics around this in the digital age?!

 

you may have to zoom in to read the captions – scroll through one by one 🙂

display.land misuse

I chose to play with the photogrammetry app display.land.

To think about ways to misuse it, I checked out the tutorials for inspiration.

 

EXPERIMENTS

  • when you’re capturing, there is a little progress bar on the bottom, showing you the minimum amount of capturing you need to do to make an image. I wondered what would happen if I ended the capture early. But it wouldn’t let me:

  • the app says “direct sunlight is ok, but beware of your own shadow.” –> to misuse, I tried allowing my own shadow to interfere. spoiler alert – it looks absolutely terrible. The funny thing is though, my shadow doesn’t appear in it anywhere…
It’s supposed to be a swingset. check it out here: https://displayland.app.link/DP2IsgPPa5
  • in general, you’re not supposed to do photogrammetry with transparent/clear objects –> to misuse, I captured my water glass.
check out here: https://displayland.app.link/WzDoU8OOa5
  •  I tried to capture something smaller, and from below – a chain hanging from the ceiling. Somehow, the anchor point of the chain was preserved, but the links exploded all over the place.

link to this one: https://displayland.app.link/p20yifoQa5

a photo of the actual chain:

 

77 worms (& 2 slugs)

On Friday, I woke up to it absolutely pouring rain outside. By 8:30, it all suddenly cleared up, and I went out for a walk. There was an absurd amount of worms everywhere. I took pictures of them for about an hour (and was extremely careful where I stepped…)

To sort them:

  1. I asked my computer to sort them into 5 groups via a quick k-means clustering script I found online.
  2. I sorted them by hand, by worm orientation. This was super tedious and it’s not as pretty as I’d like, but it’s as good as it’s gonna get today!

Enjoy! (see if you can find the 2 bonus slugs). I will post the high-quality versions online somewhere…

computer sorted into 5 groups
sorted by hand by worm orientation

L2LYM – art gallery

Make a gallery of the art in your parents’ boyfriend’s house.

I’m now in Burlington, VT, staying with my boyfriend and his roommates. It’s great & helpful to be able to spend this time with someone I love.

But we haven’t spent this much time together in a long time, and it’s weird and new and challenging to say the least.

All the art in his house is slightly crooked (lol). We got a good laugh out of that the other day, and decided that it felt like a Wes Anderson movie or something, where all the decor is just slightly off. There’s a vase on the mantle, but it’s empty. There are a couple plants, but they’ve definitely been neglected. It’s kind of cozy, but kind of incomplete; kind of home-y, but kind of unsettling. It’s a good match for how I feel.

 

IRL Distortion – work from home edition

The exact moment we talked about taking an “IRL distortion portrait” during last week’s zoom call, I looked up and saw my reflection in the back of my roommate’s computer monitor.

She and I had crammed our workspaces together on a table way too small for the two of us – I assume many of you are having similar situations where you’re learning to share new spaces that you haven’t shared before.

The silver lining of me being up close and personal with her screen was this funhouse-style look.

Person In Time Project Ideas

I’m pretty excited about this project and sort of in awe of the possibilities; I haven’t really gathered my thoughts enough to have fully fleshed-out ideas, but some areas of interest that have stuck with me:

Elder Wisdom/Intergenerational Communication

  • Marcell Esterhazy’s timelapse of his grandfather eating a bowl of soup has seriously stuck with me since we watched it in January. It’s so captivating to me.
  • My family is originally from Pittsburgh (despite this year being my first time living here) – my family roots are all over the city, my parents met here, grandparents and great grandparents lived a few blocks from where I live now, etc. Not very many people are left…(though they are all buried in the same Jewish cemetery in Millvale). But this is a special place for me to be living right now. This project might be an opportunity to capture that somehow…though I’m not sure what that would look like.
  • I’ve been thinking a lot about intergenerational communication lately, passing down knowledge, etc. How might I capture elder wisdom in a novel way? This was somewhat inspired by a previous classmate who captured elder wisdom through a series of interviews. With the tools in this class, I could definitely go beyond audio.
  • To build upon Marey’s motion capture suit of the “average male gait,” (see photo below) I am interested in capturing the gait of other bodies – seniors, children, etc. through chronophotography or stroboscopy.
Marey’s chronophotography in the original motion capture suit

 

The Digital Grotesque

I’m also very interested in this concept of the digital grotesque, and am really drawn to artists using motion capture to distort the human form. Cool 3D World projects, copy/pasting parts of the human body (like adding an arm to a knee), the walk cycle projects, and animations of bodies sort of “melting” or being pulled through holes in the floor…all of these are super intriguing to me.

I don’t have a specific idea yet for this one, but I would love to learn how to work with motion capture and particles and distortions in general. (I remember Nica saying something about knowing how to do this…we should talk :))