CHAI Home Research Directions Publications Contact People Prospective Students



Publications


Journal Papers

Emily Mower Provost, Yuan (June) Shangguan, Carlos Busso, "UMEME: University of Michigan Emotional McGurk Effect Dataset," IEEE Transactions of Affective Computing, To Appear, (2015). [preprint]

Chi-Chun Lee, Emily Mower, Carlos Busso, Sungbok Lee and Shrikanth S. Narayanan, Emotion recognition using a hierarchical binary decision tree approach (2011), in: Speech Communication, 53:9-10(1162-1171). [pdf]

Emily Mower, Maja J. Mataric and Shrikanth S. Narayanan, “A Framework for Automatic Human Emotion Classification Using Emotional Profiles,” IEEE Transactions on Audio, Speech and Language Processing, 19:5(1057-1070). May 2011. [pdf]

Emily Mower, Maja Matarić, Shrikanth Narayanan. "Human Perception of Audio-Visual Synthetic Character Emotion Expression in the Presence of Ambiguous and Conflicting Information." IEEE Transactions on Multimedia. 11:5(843-855). August 2009. [pdf]

Carlos Busso, Murtaza Bulut, Chi-Chun Lee, Abe Kazemzadeh, Emily Mower, Samuel Kim, Jeannette Chang, Sungbok Lee, and Shrikanth Narayanan. "IEMOCAP: Interactive emotional dyadic motion capture database." Journal of Language Resources and Evaluation, 42:4(335-359). November 2008. [SpringerLink]

Michael Grimm, Kristian Kroschel, Emily Mower, and Shrikanth Narayanan. "Primitives based estimation and evaluation of emotions in speech." Speech Communication 49, 49:10-11(787-800). November 2007. [pdf]

Conference Papers

Yelin Kim, Jixu Chen, Ming-Ching Chang, Xin Wang, Emily Mower Provost, and Siwei Lyu. "Modeling Transition Patterns Between Events for Temporal Human Action Segmentation and Classification." IEEE International Conference on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia, May, 2015.[Coming soon!]

Biqiao Zhang, Emily Mower Provost, Robert Swedberg, Georg Essl. "Predicting Emotion Perception Across Domains: A Study of Singing and Speaking." AAAI. Austin, TX, USA, January 2015. [pdf]

Yelin Kim and Emily Mower Provost. "Say Cheese vs. Smile: Reducing Speech-Related Variability for Facial Emotion Recognition." Proceedings of the ACM International Conference on Multimedia. Florida, USA, November, 2014. [pdf, Note: winner, best student paper!]

Duc Le and Emily Mower Provost. " Modeling Pronunciation, Rhythm, and Intonation for Automatic Assessment of Speech Quality in Aphasia Rehabilitation" Interspeech. Singapore. September, 2014. [pdf]

Duc Le, Keli Licata, Elizabeth Mercado, Carol Persad, Emily Mower Provost. ``Automatic Analysis of Speech Quality for Aphasia Treatment.'' International Conference on Acoustics, Speech and Signal Processing (ICASSP). Florence, Italy. May 2014. [pdf]

Zahi N Karam, Emily Mower Provost, Satinder Singh, Jennifer Montgomery, Christopher Archer, Gloria Harrington, Melvin Mcinnis. ``Ecologically Valid Long-term Mood Monitoring of Individuals with Bipolar Disorder Using Speech.'' International Conference on Acoustics, Speech and Signal Processing (ICASSP). Florence, Italy. May 2014. [pdf]

Duc Le and Emily Mower Provost. “Emotion Recognition From Spontaneous Speech Using Hid- den Markov Models With Deep Belief Networks.” Automatic Speech Recognition and Understanding (ASRU). Olomouc, Czech Republic. December, 2013. [pdf]

Theodora Chaspari, Emily Mower Provost, and Shrikanth S. Narayanan. "Analyzing the Structure of Parent-Moderated Narratives from Children with ASD Using an Entity-Based Approach." Interspeech. Lyon, France. August, 2013. [pdf]

Emily Mower Provost, Irene Zhu, and Shrikanth Narayanan. "Using Emotional Noise to Uncloud Audio-Visual Emotion Perceptual Evaluaion." International Conference on Multimedia and Expo (ICME) . San Jose, CA. July, 2013. [pdf][Examples][Data Mining Workshop Talk]

Yelin Kim and Emily Mower Provost. "Emotion Classification via Utterance-Level Dynamics: A Pattern-Based Approach to Characterizing Affective Expressions." International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Vancouver, British Columbia, Canada. May, 2013. [pdf]

Yelin Kim, Honglak Lee, and Emily Mower Provost. "Deep Learning for Robust Feature Generation in Audio-Visual Emotion Recognition." International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Vancouver, British Columbia, Canada. May, 2013. [pdf]

Emily Mower Provost. "Identifying Salient Sub-Utterance Emotion Dynamics Using Flexible Units and Estimates of Affective Flow." International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Vancouver, British Columbia, Canada. May, 2013. [pdf]

Emily Mower Provost and Shrikanth Narayanan, "Simplifying Emotion Classification Through Emotion Distillation", Asia-Pacific Signal and Information Processing Association (APSIPA), Los Angeles, CA, 2012. [pdf]

Theodora Chaspari, Emily Mower Provost, Athanasios Katsamanis and Shrikanth Narayanan, "An Acoustic Analysis of Shared Enjoyment in ECA Interactions of Children with Autism", Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan, 2012. [Coming Soon!]

Emily Mower, Chi-Chun Lee, James Gibson, Theodora Chaspari, Marian Williams, and Shrikanth Narayanan. "Analyzing the Nature of ECA Interactions in Children with Autism." International Speech Communication Association (Interspeech). Florence, Italy, August, 2011. [pdf]

Emily Mower, Matthew Black, Elisa Flores, Marian Williams, and Shrikanth S. Narayanan. "Rachel: Design of an Emotionally Targeted Interactive Agent for Children with Autism." International Conference on Multimedia & Expo (ICME) . Barcelona, Spain, July, 2011. [pdf]

Emily Mower and Shrikanth S. Narayanan. "A Hierarchical Static-Dynamic Framework for Emotion Classification." International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Prague, Czech Republic, May, 2011. [pdf]

Emily Mower, Maja J Matarić, and Shrikanth S. Narayanan. "Robust Representations for Out-of-Domain Emotions Using Emotion Profiles." IEEE Workshop on Spoken Language Technology (SLT). Berkeley, CA, December 2010. [pdf]

Emily Mower, Kyu Jeong Han, Sungbok Lee and Shrikanth S. Narayanan. "A Cluster-Profile Representation of Emotion Using Agglomerative Hierarchical Clustering." International Speech Communication Association (InterSpeech). Makuhari, Japan, September 2010. [pdf]

Dongrui Wu, Thomas Parsons, Emily Mower and Shrikanth S. Narayanan. "Speech Emotion Estimation in 3D Space" IEEE International Conference on Multimedia & Exp (ICME) 2010. Singapore, 2010. [pdf]

Emily Mower, Angeliki Metallinou, Chi-Chun Lee, Abe Kazemzadeh, Carlos Busso, Sungbok Lee, Shrikanth Narayanan. "Interpreting Ambiguous Emotional Expressions." ACII Special Session: Recognition of Non-Prototypical Emotion from Speech- The Final Frontier? (Invited paper). Amsterdam, The Netherlands, September 2009. [pdf]

Emily Mower, Maja J Matarić, Shrikanth Narayanan. "Evaluating Evaluators: A Case Study in Understanding the Benefits and Pitfalls of Multi-Evaluator Modeling." International Speech Communication Association (Interspeech). Brighton, England, September 2009. [pdf]

Chi-Chun Lee, Emily Mower, Carlos Busso, Sungbok Lee and Shrikanth S. Narayanan. "Emotion recognition using a hierarchical binary decision tree approach." International Speech Communication Association (Interspeech). Brighton, England, September 2009. [Emotion Challenge Winner] [pdf]

Emily Mower, Maja J Matarić, Shrikanth Narayanan. "Selection of Emotionally Salient Audio-Visual Features for Modeling Human Evaluations of Synthetic Character Emotion Displays" IEEE International Symposium on Multimedia (ISM) 2008. Berkeley, California, December 2008. [pdf]

Emily Mower, Sungbok Lee, Maja J Matarić, Shrikanth Narayanan. "Joint-processing of audio-visual signals in human perception of conflicting synthetic character emotions." IEEE International Conference on Multimedia & Expo (ICME), Hannover, Germany, June 2008. [pdf]

Emily Mower, Sungbok Lee, Maja J Matarić, Shrikanth Narayanan. "Human perception of synthetic character emotions in the presence of conflicting and congruent vocal and facial expressions." IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2008. Las Vegas, Nevada, March-April 2008. [pdf]

Emily K. Mower, David J. Feil-Seifer, Maja J Matarić, and Shrikanth Narayanan. "Investigating Implicit Cues for User State Estimation in Human-Robot Interaction Using Physiological Measurements." IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN), Jeju Island, South Korea, Aug 2007. [pdf]

Michael Grimm, Emily Mower, Kristian Kroschel, and Shrikanth Narayanan. "Combining categorical and primitives-based emotion recognition." European Signal Processing Conference (EUSIPCO), Florence, Italy, September 2006. [pdf]

Zhou, W., Wu, W., Palmer, N., Mower, E., Daniels, N., Cowen, L., Blumer, A. "Microarray Data Analysis of Survival Times of Patients with Lung Adenocarcinomas Using ADC and K-Medians Clustering." Critical Assessment of Massive Data Analysis (CAMDA). Durham, North Caroline, November 14, 2003. [pdf]