SentimentVoice is a live VR performance art project that utilizes emotion-tracking AI technology to amplify the narratives of immigrant populations. Inspired by the pervasive use of emotional surveillance and the vulnerabilities surrounding emotion data, SentimentVoice subverts emotion AI technology, typically used for surveillance or commercial purposes, into an empathetic mediator for actively listening to the stories of immigrants. The project incorporates human voice and facial expression as the core material for the performance, which is detected and analyzed by emotion AI. This analysis leverages various technologies, including face tracking, the ChatGPT, and speech-to-text conversion. Emotion-tracking AI, such as lie detectors and facial recognition, has often been used to create monitored environments, frequently targeting minority populations. However, it is important to recognize that emotion data can also be harnessed to cultivate empathy, foster deep connections, and promote mutual understanding. SentimentVoice originated as an oral-history project in Richmond, Virginia, collecting authentic immigrant narratives across five sites of memory, airports, schools, immigration offices, hospitals, and workplaces. From these interviews, a script was developed, staged with actors, and later adapted into a video documentary. In this festival, SentimentVoice is opened to the public, inviting the audience to share their emotional stories while navigating the five VR locations. As the participants navigate the five VR locations and tell the associated stories, Emotion AI responds to their speech with visual (particles, textures, lights, etc.) and sound acknowledgement within the VR environment. Once tools of surveillance, emotion-tracking methods are being reimagined to highlight the emotional core of personal narratives and foster cross-cultural empathy. 《緒語》是一項現場VR表演藝術計劃，通過運用情緒追蹤AI技術去放大呈現移民人口的故事。項目靈感源自情緒監控的普遍使用以及情緒資料的漏洞，它顛覆了通常用於監控或商業目的情緒追蹤AI技術，將之轉化成聆聽移民者故事的移情中介。項目以人類的聲音及臉部表情作為表演的核心素材，並由情緒追蹤AI進行偵測和分析。分析運用到各種技術，包括臉部追蹤、ChatGPT以及語音轉換為文字等。情緒追蹤AI（如測謊器和臉部識別）常被用來創造監控環境，也經常針對少數族群，然而人們必須認知情緒資料也可以被利用來培養同理心、促進深層聯繫以及相互理解。 《緒語》項目是維志尼亞洲的口述歷史計劃，分別在機場、學校、移民局、醫院及特定工作場所等五個記憶地點收集真實的移民故事。在這些訪談中，團隊編寫了劇本、並與演員一起演出，之後改編成為錄像紀錄片。在是次藝術節中《緒語》﹐當觀眾遊走在五個VR的場景時，情緒追蹤AI會在環境中以視覺（微粒、紋理、燈光等）和聲音去回應他們的說話。情緒追蹤方法曾經是監控工具，但現在已經可以被重新想像，並以強調個人斜述為情緒核心，並促進跨文化的交流。

About the Artist 藝術家簡介 Semi Ryu (Creator/Director) Semi Ryu (創作者/導演)

Semi Ryu, a media artist, specializes in experimental 3D animations, Avatar, and Extended Reality projects inspired by Korean healing rituals. She is a full professor of Kinetic Imaging at VCU Arts and an associate professor of Internal Medicine at VCU Medicine (affiliate). Ryu earned a BFA from Korea National University of Arts, an MFA from Carnegie Mellon University, and a Ph.D. with the Highest Honor from Doctoral program in Humanities and Communication at Universitat Oberta de Catalunya, Barcelona, with thesis "Embodied Avatar Performance, Han Healing Ritual and Life-Review: Intersections of Art, Health and Virtual Reality.” Ryu's work is featured in 23 countries at international screenings, exhibitions, and performances. Her articles are published in top journals including International Journal of Performance Arts and Digital Media (SJR:Q1), Journal of Palliative Medicine (JCR: Q1), and Arts & Health (SJR: Q2). Her chapter “End-of-Life Review: Embracing Art, Technology, and Culture.”, has been published for the Routledge Handbook of Arts and Health, this year. She received the 2020 Hamilton International Arts in Health award (first place in Arts for Innovation), VCU Arts Faculty Award for Distinguished Achievement in Research 2017, and VCU National International Recognition Award 2023 and has been featured at TEDxRVA, with her talk “Virtual Reality for Han”. Ryu has earned various grants, including VCU Presidential Research Quest Fund, VCU Breakthrough, Massey Cancer Center, NEH, NSF, Commonwealth Cyber Initiative and Korea Creative Content Agency at the Ministry of Culture. 柳世美是一位媒體藝術家，專注於由韓國療癒儀情所啓發去研究3D動畫、虛擬化身以及延展實境。她現任維珍尼亞VCU藝術學院動態影像學的全職教授，也是VCU醫學院（附屬）內科的副教授。半龍擁有韓國國立藝術大學的美術學士學位、卡內基梅隆大學的美術碩學位，以及巴塞隆拿加泰羅尼亞大學人文科學及傳播博士課程的最高榮譽博士學位﹐論文為「體現式虛擬替身演出、韓國療癒儀式與生命回顧：藝術、健康及虛擬實境的交集。」 柳世美的作品曾於 23 個國家的國際放映會、展覽和表演中展出過。她的文章發表於頂尖期刊，包括 International Journal of Performance Arts and Digital Media (SJR:Q1)、Journal of Palliative Medicine (JCR:Q1)、Arts & Health (SJR:Q2)。她的文章End-of-Life Review: Embracing Art, Technology, and Culture 今年刊登於Routledge Handbook of Arts and Health﹐並曾獲得 2020 年漢密爾頓國際健康藝術獎（創新藝術第一名）、2017 年 VCU 藝術學院傑出研究成就獎，以及 2023 年 VCU 國家國際認可獎。她也曾在 TEDxRVA 上發表有關虛擬實境的演講，並曾獲取各種獎助金，包括 VCU Presidential Research Quest Fund、VCU Breakthrough、Massey Cancer Center、NEH、NSF、Commonwealth Cyber Initiative 和文化部韓國創意內容局等。 Full Credits: Creative Director: Semi Ryu AI Engineer/VR Developer: Miles Popiela, Henry Bryant, Ariana Thomas 3D visual producer (Modeling & Texturing): Matthew Labella Video Producer: Hanna Chou Sound Producer: Chrystine Rayburn Actors: Ryan Flores, Katherine Nguyen Script Writer: Hanna Chou, Katherine Nguyen, Ryan Flores Videographer: Hanna Chou, Kiara Brown, Uday Illa, Ryan Alvarado Interviewer: Hanna Chou, Richmond Animation Archive, Menna Hassanain Scientific Advisor: Alberto Cano 3D preliminary modeling: Menna Hassanain Assistant AI Engineer: Josiah Wilson Technical diagram: Rayna Hugo Interviewee: Hanna B, Kevin C, Tradie D, Kevin G, Maria G, Tina H. Dominica Ko, Sabrina Kim, Grace Kim, Magdalena Song, Sumaya S, Watt S, and more. Special thanks to Commonwealth Cyber Initiative, Noren Gelberg-Hagmaier, the VCU AAPIA student group, and everyone who shared their stories with us.