{"id":2210,"date":"2022-12-06T16:17:34","date_gmt":"2022-12-06T21:17:34","guid":{"rendered":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/?p=2210"},"modified":"2022-12-06T16:17:34","modified_gmt":"2022-12-06T21:17:34","slug":"jade-final","status":"publish","type":"post","link":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/sung\/12\/06\/jade-final\/","title":{"rendered":"jade-final"},"content":{"rendered":"<h1>Visualization of Distracted Mind<\/h1>\n<p>This project aims to visualize the human mind that is susceptible to distraction through the use of eye-tracking technology.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-2217\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/output.gif\" alt=\"\" width=\"320\" height=\"320\" \/><\/p>\n<p>The GIF above illustrates the subject&#8217;s repeated attempts to follow the <em>Walking to the Sky<\/em> sculpture through gaze on CMU campus. The lines represent the trajectory of eye gaze in each attempt. The eye gaze was tracked by a Unity application on Meta Quest Pro. Despite the straight shape of the sculpture, the visualizations show the difficulty of following a straight line in presence of distracting objects in the surroundings.<\/p>\n<p><iframe loading=\"lazy\" title=\"tracking distraction\" width=\"840\" height=\"630\" src=\"https:\/\/www.youtube.com\/embed\/dUpF1aX0LZ4?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>People often say that the eyes are the window to the soul. When I saw the new release of the eye-tracking feature in one of the newest AR headsets Meta Quest Pro (shown in the picture below), I became interested in using this for the investigation of humans minds, using eye gaze as a proxy to the human mind. For this investigation, I developed a Unity application that tracks the right eye of the user and draws the trajectory of the eye gaze. The app also features record &amp; replay, which generated the output above. The video shows exactly what the wearer sees in the headset. The project and workflow was largely inspired by <a href=\"https:\/\/vimeo.com\/18998570\"><em>A Sequence of Lines Traced by Five Hundred Individuals<\/em><\/a>.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-2326\" src=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-content\/uploads\/2022\/12\/IMG_2539-640x447.jpg\" alt=\"\" width=\"275\" height=\"199\" \/><\/p>\n<p>Evaluating the current state of the work, it would be better to showcase the idea through a better setup for the recording. My original plan was to build a 3D eye gaze heatmap like <a href=\"https:\/\/twitter.com\/StrangeNative\/status\/1592554373519142913\">this work by Shopify<\/a>. But only after spending a lot of time experimenting the eye-tracking and passthrough features, I realized this requires a separate 3D model of the space. In the future, I&#8217;d like to investigate more into 3D eye gaze tracking and also different implementations of experiments, for example, collaborative gaze work and more scientific investigation into how shared AR artifacts in a space impact people&#8217;s perception and experience in the space.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Visualization of Distracted Mind This project aims to visualize the human mind that is susceptible to distraction through the use of eye-tracking technology. The GIF above illustrates the subject&#8217;s repeated attempts to follow the Walking to the Sky sculpture through gaze on CMU campus. The lines represent the trajectory of eye gaze in each attempt. &hellip; <a href=\"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/sung\/12\/06\/jade-final\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;jade-final&#8221;<\/span><\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[20],"tags":[],"_links":{"self":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/2210"}],"collection":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/comments?post=2210"}],"version-history":[{"count":3,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/2210\/revisions"}],"predecessor-version":[{"id":2327,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/posts\/2210\/revisions\/2327"}],"wp:attachment":[{"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/media?parent=2210"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/categories?post=2210"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/courses.ideate.cmu.edu\/60-461\/f2022\/wp-json\/wp\/v2\/tags?post=2210"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}