Skip to main content

Trinity College Dublin, The University of Dublin

Menu Search

Trinity College Dublin By using this website you consent to the use of cookies in accordance with the Trinity cookie policy. For more information on cookies see our cookie policy.

Profile Photo

Dr. Naomi Harte

Assoc Prof. in Digital Media Systems (Electronic & Elect. Engineering)

Naomi is an Associate Professor in Digital Media Systems in the School of Engineering in Trinity College. She is Co-PI and a founding member of the ADAPT SFI Centre. There she leads a Research Theme centred on Multimodal Interaction, involving researchers from 5 Universities in Ireland. She is also a lead academic of the hugely successful Sigmedia Research Group in the School of Engineering. She was appointed as an SFI Engineering Initiative Lecturer in Digital Media in TCD in 2008 (Stokes Programme). Prior to returning to academia, Naomi worked in high-tech start-ups in the field of DSP Systems Development, including her own company. She also previously worked in McMaster University in Canada. She was a Visiting Professor at ICSI in 2015, and became a Fellow of TCD in 2017. She earned a Google Faculty Award in 2018 and was shortlisted for the AI Ireland Awards in 2019. Naomi's research centres around Human Speech Communication. She likes to consider speech as something we both hear and see, with a strong multimodal aspect to her work. Her research involves the design and application of mathematical algorithms to enhance or augment speech communication between humans and technology. Much of that work is underpinned by signal processing and machine learning, but also requires an understanding of how humans interact. Her current research projects include audio-visual speech recognition, speech synthesis evaluation, multimodal speech analysis, and birdsong. Her industrial background brings a real-world approach to her research.
  Audio-visual speech processing   Birdsong Analysis   Emotion in Speech   Human-Computer Interaction   Information/Communication Systems   Multimedia   Signal Processing   Speaker Recognition   SPEECH   Speech Biometrics   Speech processing/technology   Speech Quality   SPEECH RECOGNITION
 Dynamic Visual Features and Improved Audio-Visual Fusion for Automatic Speech Recognition
 Robust Speaker Verification
 Audio-Visual Fusion for Human Computer Interaction.
 Speech Quality for VoIP
 Advanced Metrics for Audio-Visual Signal Quality in Internet Communications

Details Date
International Expert Reviewer for Swiss National Science Foundation (SNSF)
Peer reviewing for top conferences and journals, e.g.: IEEE ICASSP, Interspeech, ACM ICMI, EUSIPCO, IEEE ASRU, IEEE ICIP, ACL, Speech Communication, JASA, IEEE Trans Multimedia ongoing
Senior Technical Program Committee for ACM ICMI 2019
TCD Representative to MIDAS (MicroElectronics Design Association of Ireland)
Irish representative to the EU COST Action 2101 entitled "Biometrics for Identity Documents and Smart cards"
Regular Session Chair at Interspeech ongoing
Irish representative to the EU COST Action IC1006 Integrating Biometrics and Forensics for the Digital Age
ICT Evaluator for FP6 ICT Call FP6-2004-SME-COOP in Co-operative research (Research involving SMEs, Universities and research organisations). Acted as Group Rapporteur.
Expert Evaluator for FP7 Call FP7-REGIONS-2012-2013-1 in Transnational cooperation between regional research-driven clusters
PhD External Examiner University of Cambridge
PhD External Examiner, Victoria University, New Zealand
PhD External Examiner, University of York
PhD External Examiner, Athlone Institute of Technology
PhD External Examiner, University of East Anglia
Language Skill Reading Skill Writing Skill Speaking
English Fluent Fluent Fluent
French Basic Basic Basic
German Basic Basic Basic
Irish Medium Medium Medium
Details Date From Date To
IEEE (Institute of Electrical and Electronics Engineers)
ISCA (International Speech Communication Association)
IEEE Women in Engineering
IEEE Signal Processing Society
Fernandez-Lopez, Adriana and Karaali, Ali and Harte, Naomi and Sukno, Federico M, ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, pp6294--6298 , Conference Paper, PUBLISHED
Le Maguer, Sebastien and Harte, Naomi, Investigation of Auditory Nerve Model Based Analysis for Vocoded Speech Synthesis, 2020, pp1--6 , Conference Paper, PUBLISHED  DOI
Sterpu G., Saam C., Harte N., How to Teach DNNs to Pay Attention to the Visual Modality in Speech Recognition, IEEE/ACM Transactions on Audio Speech and Language Processing, 28, 2020, p1052 - 1064, p1052-1064 , Journal Article, PUBLISHED  DOI
Roddy, Matthew and Harte, Naomi, Neural Generation of Dialogue Response Timings, ACL The 58th Annual Meeting of the Association for Computational Linguistics, 2020, Journal Article, PUBLISHED
Jassim, Wissam A and Harte, Naomi, Estimation of a priori signal-to-noise ratio using neurograms for speech enhancement, The Journal of the Acoustical Society of America, 147, (6), 2020, p3830--3848 , Journal Article, PUBLISHED
Motion, Interaction and Games in, Motion, Interaction and Games, 2019, pp1--6 , [Torre, Ilaria and Carrigan, Emma and McDonnell, Rachel and Domijan, Katarina and McCabe, Killian and Harte, Naomi], Book Chapter, PUBLISHED
Clark, L. and Cowan, B.R. and Edwards, J. and Edlund, J. and Szekely, E. and Munteanu, C. and Murad, C. and Healey, P. and Aylett, M. and Harte, N. and Torre, I. and Moore, R.K. and Doyle, P., Mapping theoretical and methodological perspectives for understanding speech interface interactions, CHI EA '19 Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems , (3299009), 2019, Notes: [cited By 0], Conference Paper, PUBLISHED  TARA - Full Text  DOI
Wissam A. Jassim and Naomi Harte, Voice Activity Detection Using Neurograms, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, Alberta, Canada, 15-20 April 2018, 2018, Conference Paper, PUBLISHED
Roddy, M. and Skantze, G. and Harte, N., Multimodal continuous turn-taking prediction using multiscale Rnns, ICMI '18 Proceedings of the 20th ACM International Conference on Multimodal Interaction, 2018, pp186-190 , Notes: [cited By 1], Conference Paper, PUBLISHED  TARA - Full Text  DOI
Sterpu, G. and Saam, C. and Harte, N., Attention-based audio-visual fusion for robust automatic speech recognition, ICMI '18 Proceedings of the 20th ACM International Conference on Multimodal Interaction , 20th ACM International Conference on Multimodal Interaction , 2018, pp111-115 , Notes: [cited By 1], Conference Paper, PUBLISHED  TARA - Full Text  DOI

Page 1 of 12
Dr. Silvia Giordani, Poster Making and Presentation, TCD, Chemistry Dept, 2007, Notes: [power point presentation on how to create a poster fro research and presentation tips for students.], Poster, PUBLISHED


Award Date
AI Awards (Shortlisted in Best Application of AI in an Academic Research Body) 2019
Google Faculty Award 2018
Fellow of Trinity College Dublin 2017
Cognitec Best Student Paper Award for PhD Student Finnian Kelly, International Conference on Biometrics (ICB) 2012
Shortlisted for Provost Teaching Award 2011
British Telecom Research Scholarship 1997-1999
IEE Leslie H. Paddle Scholarship 1995-1998
Glen Dimplex British Council Chevening Scholarship 1995-1996
Awarded a Gold Medal for Distinction in Engineering upon graduation. 1995
Maurice F. Fitzgerald Prize - first overall in the Engineering Faculty in the Degree exams. 1995
David Clark Prize - first place in the Microelectronic and Electrical Engineering Degree exams. 1995