Skip to main content

Trinity College Dublin, The University of Dublin

Menu Search



Nick Campbell
Adjunct Professsor, Computer Science

Biography

Nick Campbell (nick@tcd.ie) is a Professor and Fellow Emeritus, Director of the Speech Communication Lab at Trinity College Dublin (The University of Dublin) in Ireland. He received his Ph.D. degree in Experimental Psychology from the University of Sussex in the U.K. He was invited to TCD in 2008 as Professor of Phonetics and Speech Communication, and was an SFI Stokes Professor until 2015 when he suffered mandatory age-related retirement and was appointed to the School of Computer Science and Statistics as Adjunct Professor. Until 2008 he was a Senior Scientist at the Japanese National Institute of Information and Communications Technology, (as nick@nict.go.jp) and Chief Researcher in the Department of Acoustics and Speech Research, Advanced Telecommunications Research Institute International (as nick@atr.jp), Kyoto, Japan, where he also served as Research Director for the JST/CREST Expressive Speech Processing and the SCOPE "Robot's Ears" projects. He was first invited as a Research Fellow at the IBM U.K. Scientific Centre, where he developed algorithms for speech synthesis, and later at the AT&T Bell Laboratories, where he worked on the synthesis of Japanese. He served as Senior Linguist at the Edinburgh University Centre for Speech Technology Research before joining ATR in 1990. His research interests are based on large speech databases, and include nonverbal speech processing, concatenative (and interactive) speech synthesis, and prosodic information modeling. He was Visiting Professor at the School of Information Science, Nara Institute of Science and Technology (NAIST), Nara, Japan, and Visiting Professor at Kobe University, Kobe, Japan for 10 years. [h-index 37(23), i10 131(63) May '17]

Publications and Further Research Outputs

Peer-Reviewed Publications

Calixto, I.; Liu, Q.; Campbell, N., Doubly-Attentive Decoder for Multi-modal Neural Machine Translation., ACL 2017, 2017 Conference Paper, 2017

Hayakawa Akira, Carl Vogel, Saturnino Luz, Nick Campbell , Speech Rate Comparison when Talking to a System and Talking to a Human: A study from a Speech-to-Speech, Machine Translation mediated Map Task, Interspeech, Stockholm, edited by ISCA , 2017 Conference Paper, 2017

Fasih Haider, Fahim A. Salim, Saturnino Luz, Carl Vogel, Owen Conlan and Nick Campbell, Visual, Laughter, Applause and Spoken Expression Features for Predicting Engagement Within TED Talks, Proceedings of the 18th Annual Conference of the International Speech Communication Association (INTERSPEECH2017), Stockholm, Sweden, August 20-24, 2017, ISCA, 2017, pp2381-2385 Conference Paper, 2017 DOI

Data Collection and Synchronisation: Towards a Multiperspective Multimodal Dialogue System with Metacognitive Abilities in, Dialogues with Social Robots, singapore, springer, 2017, pp245-256 , [Fasih Haider, Saturnino Luz, Nick Campbell] Book Chapter, 2017

Hayakawa Akira, Carl Vogel, Saturnino Luz and Nick Campbell, Speech Rate Comparison When Talking to a System and Talking to a Human: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task, Proceedings of the 18th Annual Conference of the International Speech Communication Association (INTERSPEECH2017), Stockholm, Sweden, August 20-24, 2017, ISCA, 2017, pp3286-3290 Conference Paper, 2017 DOI

Fasih Haider, Fahim A Salim, Saturnino Luz, Carl Vogel, Owen Conlan, Nick Campbell, Visual, Laughter, Applause and Spoken Expression Features for Predicting Engagement within TED Talks, Interspeech, edited by ISCA , 2017 Conference Paper, 2017

Engagement in dialogue with social robots in, Dialogues with Social Robots, Singapore, Springer, 2017, pp313-319 , [Loredana Cerrato, Nick Campbell] Book Chapter, 2017

Gilmartin, Emer, Campbell, N., Cowan, B. R., & Vogel, C., Chunks in Multiparty Conversation - Building Blocks for Extended Social Talk., IWSDS, 2017 Conference Paper, 2017

Yuyun Huang, Emer Gilmartin, Benjamin R Cowan, Nick Campbell, A Preliminary Exploration of Group Social Engagement Level Recognition in Multiparty Casual Conversation, International Conference on Speech and Computer, Budappest, Hungary, 2016/8/23, Springer International Publishing, 2016, pp75-83 Conference Paper, 2016

Gilmartin, E, Su, K., Cowan, B. R., Huang, Y., & Campbell, N., Collecting a  human-machine, human-human, and human-woz comparative social talk corpus., LREC MMC Workshop, Portoroz, Slovenia, 2016 Conference Paper, 2016

Attitude recognition of video bloggers using audio-visual descriptors, Fasih Haider, Loredana Sundberg Cerrato, Saturnino Luz, Nick Campbell, Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction Pages, ACM, 2016, pp38-42 Conference Paper, 2016

Nick Campbell, Modern Japanese Speech Grammar from the Viewpoint of Conversational Robotics (特集 関連領域から照射した現代語文法), 日本語文法 (Japanese Syntax), 16, (2), 2016, p65-76 Journal Article, 2016

Fasih Haider, Loredana Cerrato, Nick Campbell, Saturnino Luz, Presentation quality assessment using acoustic information and hand movements, Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on, 2016/3/20, IEEE, 2016, pp2812-2816 Conference Paper, 2016

Hayakawa Akira, Saturnino Luz, Nick Campbell, Talking to a System and Talking to a Human: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task, Interspeech 2016, Seattle, USA, 2016, pp1422-1426 Conference Paper, 2016

F. Haider, N. Campbell and S. Luz, Active speaker detection in human machine multiparty dialogue using visual prosody information,, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP),, Washington DC, DC, USA,, 2016, pppp. 1207-1211. Conference Paper, 2016

Noor Alhusna Madzlan, Justine Reverdy, Francesca Bonin, Loredana Cerrato, Nick Campbell, Annotation and multimodal perception of attitudes: A study on video blogs, Proceedings from the 3rd European Symposium on Multimodal Communication, Dublin,, Linköping University Electronic Press, 2016 Conference Paper, 2016

Gilmartin, E, Su, K., Cowan, B. R., Huang, Y., Elias, C., & Campbell, N., Making Idle Talk: Designing and Implementing Casual Talk, LREC Just Talking workshop, Portoroz, Slovenia, 2016 Conference Paper, 2016

Fasih Haider, Loredana Sundberg Cerrato, Saturnino Luz, Nick Campbell, Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, ICMI 2016, Tokyo, Japan, November , ACM, 2016, pp38 - 42 Conference Paper, 2016

Böck, R., Bonin, F., Campbell, N., Poppe, R. (Eds.), Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, Springer, 2016 Book, 2016

Ya Li, Nick Campbell, JianHua Tao, Voice Quality: not only about "you" but also about "your interlocutor", ICASSP, Canada, edited by IEEE , 2015 Conference Paper, 2015

Emer Gilmartin, Francesca Bonin, Loredana Cerrato, Carl Vogel, Nick Campbell, Nick Campbell Nick Campbell [PDF] from researchgate.net What's the Game and Who's Got the Ball? Genre in Spoken Interaction, 2015 AAAI Spring Symposium Series, 2015/3/13, AAAI, 2015 Conference Paper, 2015

Keith Curtis, Gareth JF Jones, Nick Campbell, Effects of good speaking techniques on audience engagement, Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 2015/11/9, 2015, pp35-42 Conference Paper, 2015

Fahim A Salim, Fasih Haider, Owen Conlan, Saturnino Luz, Nick Campbell, Analyzing multimodality of video for user engagement assessment, Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 2015/11/9, ACM, 2015, pp287-290 Conference Paper, 2015

Ronald Bock, Francesca Bonin, Nick Campbell, Ronald Poppe, Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, Springer, 2015 Book, 2015

Hayakawa Akira, Fasih Haider, Loredana Cerrato, Nick Campbell, Saturnino Luz, Detection of cognitive states and their correlation to speech recognition performance in speech-to-speech machine translation systems., Interspeech 2015, 2015, pp2539-2543 Conference Paper, 2015

Nick Campbell, Engaging Machines, Workshop on Engagement in Social Intelligent Virtual Agents, Delft, Netherlands, 25th August, 2015, Intelligent Virtual Agents (IVA 2015 Satellite Workshop) Invited Talk, 2015

Nick Campbell, Human-robot speech communication, interaction, and co-vocalization systems, International Workshop on Speech Robotics, Dresden, Germany, September 11, 2015, 2015, Interspeech (Satellite Workshop) Invited Talk, 2015 URL

Yuyun, Huang, Christy Elias., Cabral, João P. Cabral, Atul Nautiyal, Christian Saam and Nick Campbell, Towards Classification of Engagement in Human Interaction with Talking Robots, Communications in Computer and Information Science , 17th International Conference on Human-Computer Interaction, Los Angeles, USA, 2-7 August 2015, 528, Springer, 2015, pp741 - 746 Published Abstract, 2015 URL DOI

Loredana Cerrato, Hayakawa Akira, Nick Campbell, Saturnino Luz, A Speech-to-Speech, Machine Translation Mediated Map Task: An Exploratory Study, International Workshop on Future and Emergent Trends in Language Technology, 2015/11/19, Springer International Publishing, 2015, pp53-64 Conference Paper, 2015

Böck R, Bonin F, Campbell N, Poppe R, Multimodal analyses enabling artificial agents in human-machine interaction second international workshop, ma3hmi 2014 held in conjunction with interspeech 2014 singapore, singapore, september 14, 2014 revised selected papers, 8757, 2015, - Miscellaneous, 2015 DOI URL

Emer Gilmartin, Carl Vogel, Nick Campbell, Disfluency in Multiparty Social Talk, Disfluency in Spontaneous Speech 2015 , Edinburgh, UK, 8-9 August, 2015, 2015 Conference Paper, 2015 URL TARA - Full Text

Annotating the TCD D-ANS Corpus - a multimodal multimedia monolingual biometric corpus of spoken social interaction in, editor(s)Ronald Boeck and Francesca Bonin , Multimodal Analyses Enabling Artificial Agents in Human-Machine Interaction", Heidelberg, Springer Verlag, 2015, [Nick Campbell and Shannon Hennig] Book Chapter, 2015

Fasih Haider, Fahim A Salim, Saturnino Luz, Owen Conlan, Nick Campbell, High level visual and paralinguistic features extraction and their correlation with user engagement, Signal Processing and Information Technology (ISSPIT), 2015 IEEE International Symposium on, 2015/12/7, IEEE, 2015, pp326-331 Conference Paper, 2015

Laurence Devillers, Sophie Rosset, Guillaume Dubuisson Duplessis, Mohamed A Sehili, Lucile Béchade, Agnes Delaborde, Clément Gossart, Vincent Letard, Fan Yang, Yücel Yemez, Bekir B Türker, Metin Sezgin, Kévin El Haddad, Stéphane Dupont, Daniel Luzzati, Yannick Esteve, Emer Gilmartin, Nick Campbell, Multimodal data collection of human-robot humorous interactions in the joker project, Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on, IEEE, 2015, pp348-354 Conference Paper, 2015

Madzlan N.A, Huang Y, Campbell N, Automatic classification and prediction of attitudes: Audio - visual analysis of video blogs, 9319, 2015, 96 - 104 Miscellaneous, 2015 URL DOI

Nick Campbell, Interactive Dialogue Systems: Human-Machine Partnerships, International Symposium on Companion Technology, Ulm, Germany, 25 September, 2015, Transregional Collaborative Research Centre SFB/TRR 62 "Companion-Technology for Cognitive Technical Systems" Invited Talk, 2015

Emotional Speech Synthesis in, editor(s)Rafael Calvo, Sidney D'Mello, Jonathan Gratch, and Arvid Kappas , The Oxford Handbook of Affective Computing , Oxford, Oxford University Publishing, 2015, pp223 - 227, [Felix Burkhardt, Nick Campbell ] Book Chapter, 2015

Fahim A Salim, Killian Levacher, Owen Conlan, Nick Campbell, Examining Multimodal Characteristics of Video to Understand User Engagement., UMAP Workshops, 2015 Conference Paper, 2015

Expressivity in Interactive Speech Synthesis; Some Paralinguistic and Nonlinguistic Issues of Speech Prosody for Conversational Dialogue Systems in, editor(s)K. Hirose, J. Tao , Speech Prosody in Speech Synthesis: Modeling and generation of prosody for high quality and flexible speech synthesis, 2015, pp97 - 107, [Nick Campbell and Ya Li] Book Chapter, 2015

Francesca Bonin, Nick Campbell and Carl Vogel, The discourse value of social signals at topic change moments, Proceedings of the 16th Annual Conference of the International Speech Communication Association (INTERSPEECH 2015), Dresden, Germany, September 6-10, 2015, 2015, pp1967-1971 Conference Paper, 2015 TARA - Full Text URL

Nick Campbell, An introduction to the TCD D_ANS Corpus - a multimodal multimedia biometric corpus of spoken social interaction, MA3HMI, Singapore, Sept 14th, 2014, Interspeech Invited Talk, 2014

Nick Campbell, Introduction to the work of the Speech Communication Lab at TCD, Project Kickoff, Nanjing Normal University, China, June 6th, 2014, Prof Gu Wentao Invited Talk, 2014

Nick Campbell, Understanding Machines, Mayo 2040 Science Week, GMIT Castlebar, Nov 12th, 2014, SFI/GMIT Invited Talk, 2014

Noor Alhusna Madzlan, JingGuang Han, Francesca Bonin, Nick Campbell, Automatic Recognition of Attitudes in Video Blogs - Prosodic and Visual Feature Analysis, interspeech 2014, Singapore, Sept 2014, edited by ISCA , 2014 Conference Paper, 2014

More Than Just Words: Building a Chatty Robot in, Joseph Mariani, Sophie Rosset, Martine Garnier-Rizet, Laurence Devillers , Natural Interaction with Robots, Knowbots and Smartphones, New York, Springer, 2014, pp179 - 185, [Emer Gilmartin, Nick Campbell] Book Chapter, 2014

Matej Rojc, Niick Campbell, Coverbal Synchrony in Human-Machine Interaction, Boca Raton, CRC Press, 2014, 1 - 434pp Book, 2014 DOI

Poppe R, Böck R, Bonin F, Campbell N, de Kok I, Traum D, From multimodal analysis to real-time interactions with virtual agents, Journal on Multimodal User Interfaces, 8, (1), 2014, p1 - 3 Journal Article, 2014 URL DOI

Speech Technology and Conversational Activity in Human-Macjube Interaction in, editor(s)Rojc & Campbell , Coverbal Synchrony in Human-Machine Interaction, USA, CRC Presss, 2014, pp1 - 16, [Nick Campbell] Book Chapter, 2014

Journal of Multimodal User Interfaces, (2014), Poppe, Ronald, Boeck, Ronald, Bonin, Francesca, Campbell, Nick, de Kok, Iwan, Traum, David , [eds.] Journal, 2014

Hayakawa Akira, Nick Campbell, Saturnino Luz, 'Interlingual Map Task Corpus Collection ', Interspeech 2014, Singapore, 2014, - Exhibition, 2014

Céline De Looze, Stefan Scherer, Brian Vaughan, Nick Campbell, Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction, Speech Communication, 58, (1), 2014, p11 - 34 Journal Article, 2014 DOI

Shannon Hennig, Ryad Chellali, Nick Campbell, The D-ANS Corpus: the Dublin Autonomous Nervous Syystem Corpus of Biosignal and Multimodal Recordings of Conversational Speech, LREC 2014, Reykjavik, May 28-30 2014, edited by ELRA , 2014 Conference Paper, 2014

Campbell, N., Cabral, J., Kenny, E., & Gilmartin, E. , Multimodal Interactive Language Learning Agent., eNTERFACE 2014, Spain, 04/07/14, 2014 Conference Paper, 2014

Martin Heckmann, Murtaza Bulut, Carlos Busso, Nick Campbell, Laurence Devillers, Anna Esposito, Sungbok Lee, Roger Moore, Mark Sandler, Khiet Truong, and Rita Singh , Interaction and Affect, Computational Audio Analysis, Germany, 2014 Conference Paper, 2014 DOI

Nick Campbell, Beyond D64 - A fresh look at multimodal dialogue systems from the FastNet point of view - how we are incorporating different modalities into an interactive speech synthesis system., Multimodality- interdisciplinary perspectives: new questions and new methodologies, in Paris, at INALCO, June the 6th., 2014, UMR SFL - Université Paris 8 et CNRS Invited Talk, 2014

Francesca Bonin, Carl Vogel and Nick Campbell, Social sequence analysis: temporal sequences in interactional conversations , 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom), 5-7 Nov. 2014 , IEEE, 2014, pp403-406 Conference Paper, 2014 DOI

Nick Campbell (ed.), 7th International Conference on Speech Prosody, Proceedings of Speech Prosody 2014, Ireland, 20/05/14, 2014 Proceedings of a Conference, 2014

Francesca Bonin, Emer Gilmartin, Carl Vogel, Nick Campbell, Topics for the future: Genre differentiation, annotation and linguistic content integration in interaction analysis, Roadmapping the Future of Multimodal Interaction Research including Business Opportunities and Challenges, Istanbul, Turkey , edited by ICMI 2014 , 2014 Conference Paper, 2014 DOI

Bonin, Francesca, Nick Campbell and Carl Vogel, Time for laughter, Knowledge-Based Systems, 71, 2014, p15-24 Journal Article, 2014 TARA - Full Text DOI

Nick Campbell, Are Smart Cities Making us Dumb?, Innovation Academy Panel, Dublin (Foster Place), Nov 5th , 2014 Invited Talk, 2014

FastNet Lab, 'Humanising Human-Machine Interaction', CNGL, Croke Park, 2014, - Exhibition, 2014

Hayakawa akira, Saturnino Luz, Nick Campbell , Interlingual MapTask Corpus Collection, SICSA - Speech Technology and Human Computer Interaction Workshop, United Kingdom, 27/03/2014, 2014 Conference Paper, 2014

Bonin, Francesca, Emer Gilmartin, Carl Vogel and Nick Campbell, Topics for the Future: Genre Differentiation, Annotation, and Linguistic Content Integration in Interaction Analysis, RFMIR '14: Proceedings of the 2014 Workshop on Roadmapping the Future of Multimodal Interaction Research Including Business Opportunities and Challenges, Istanbul, Turkey, edited by Heylen, Dirk and Alessandro Vinciarelli , ACM, 2014, pp5-8 Conference Paper, 2014 DOI URL

João P. Cabral, Nick Campbell, Sree Ganesh, Mina Kheirkhah, Emer Gilmartin, Fasih Haider, Eamonn Kenny, Andrew Murphy, Neasa Ní, Chiaráin, Thomas Pellegrini and Odei Rey Orozko, MILLA: A Multimodal Interactive Language Learning Agent, SemDial 2014, Edinburgh, United Kingdom, September 1st-3rd, 2014 Conference Paper, 2014 URL

Francesca Bonin, Nick Campbell, Carl Vogel, Time for Laughter, Knowledge-based systems, 71, 2014, p15 - 24 Journal Article, 2014 DOI

Shannon Hennig, Ryad Chellali and Nick Campbell , The D-ANS corpus: the Dublin-Autonomous Nervous System corpus of biosignal and multimodal recordings of conversational speech , The 9th edition of the Language Resources and Evaluation Conference, Reykjavik, Iceland, 26-31 May, ELRA, 2014 Conference Paper, 2014

Shannon Hennig and Nick Campbell, D-ANS, SFI-FastNet, 2014 Dataset, 2014 URL

SCL, CLCS, 'Robots with Personality', Dublin Research Night, Speech Communication Lab, 2014, - Exhibition, 2014

Emer Gilmartin 1 , Shannon Hennig, Ryad Chellali, Nick Campbell, Exploring Sounded and Silent Laughter in Multiparty Task-based and Social Interaction - Audio, Video and Biometric Signals, 1st European Symposium on Multimodal Communication, University of Malta, Valletta, October 17-18, 2013, pp17 - 27 Conference Paper, 2013

Emer Gilmartin, Francesca Bonin, Carl Vogel and Nick Campbell, Exploring the Role of Laughter in Multiparty Conversation, Proceedings (SemDial), semdial 2013 - DialDam, Amsterdam, 18-20 December 2013, 2013 Conference Paper, 2013

Gilmartin, Emer and Francesca Bonin and Carl Vogel and Nick Campbell, Laugher and Topic Transition in Multiparty Conversation, Proceedings of the SIGDIAL 2013 Conference, Metz, France, Association for Computational Linguistics, 2013, pp304-308 Conference Paper, 2013 URL TARA - Full Text

Catharine Oertel, Fred Cummins, Jens Edlund, Petra Wagner, Nick Campbell, D64: a corpus of richly recorded conversational interaction, Journal on Multimodal User Interfaces, 7, (1-2), 2013, p19 - 28 Journal Article, 2013 DOI

Francesca Bonin, Celine De Looze, Sucheta Ghosh, Emer Gilmartin, Carl Vogel, Anna Polychroniou, Hugues Salamin, Alessandro Vinciarelli and Nick Campbell , Investigating fine temporal dynamics of prosodic and lexical accommodation, 14th Annual Conference of the International Speech Communication Association, Lyon, INTERSPEECH, 2013, pp539-543 Conference Paper, 2013 TARA - Full Text

De Looze, C. and Scherer, S. and Vaughan, B. and Campbell, N., Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction, Speech Communication, 58, 2013, p11 - 34 Journal Article, 2013 DOI

An acoustic analysis of 7395 dog barks in, editor(s)Rudiger Hoffman , Festschrift , 2013, [Nick Campbell ] Book Chapter, 2013

Matej Rojc & Nick Campbell (eds), Speech, Gaze, and Affect: concepts of reactive and natural human-machine interaction techniques employing ECAs with personality, 1, Jersey, Science Publishers, 2013 Book, 2013

Hiroki Tanaka Nick Campbell, Classification of Social Laughter in Natural Conversational Speech, Speech Communication, Academic Press, 28, (1), 2013, p314 - 325 Journal Article, 2013 DOI

Gilmartin, Emer and Francesca Bonin and Carl Vogel and Nick Campbell, Exploring the Role of Laughter in Multiparty Conversation, DialDam: Proceedings of the 17th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL2013), Amsterdam, December 16-18, 2013, edited by Raquel Fernandez and Amy Isard , ILLC, 2013, pp191-193 Conference Paper, 2013 URL TARA - Full Text

Hiroki Tanaka, Sakriani Sakti, Graham Neubig, Tomoki Toda, Nick Campbell, Satoshi Nakamura, Non-verbal cognitive skills and autistic conditions: An analysis and training tool, IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), 2012, Kosice, Slovakia, 2nd-3rd December, 2012, pp41 - 46 Conference Paper, 2012 DOI

De Looze, C., Scherer, S., Vaughan, B. & Campbell, N., Vers une mesure automatique de l'adaptation prosodique en interaction conversationnelle, 29eme Journees d'Etude sur la Parole , Grenoble, France, JEP 2012 , 2012 Conference Paper, 2012

Terry Barry(ed.), Timber Castles, Newsletter of Society for Medieval Archaeology, UCL London, (48), 13 October 2012, Society for medieval Archaeology, 2012, 3 p Proceedings of a Conference, 2012

D. Gibbon, D. Hirst, and N. Campbell, Rhythm, Melody, and Harmony in Speech, Poznan, Polish Phonetic Association, 2012 Book, 2012

Gilmartin, E., Campbell, N. , More than just words: Building a chatty robot, International Workshop on Spoken Dialog Systems (IWSDS 2012), 28 Nov 2012 - 30 Nov, 2012 Conference Paper, 2012 DOI URL

Emer Gilmartin, Céline De Looze, Nick Campbell, Priming, Timing, and the Phatic Component in Machine-Mediated Dialogue, The Listening Talker (LISTA 2012), Edinburgh, Scotland, 2-3 May, edited by ISCA , 2012 Conference Paper, 2012

JingGuang Han, Nick Campbell, Kristiina Jokinen, Graham Wilcock, nvestigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot, IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), 2012, Kosice, Slovakia, 2nd-3rd December, 2012, pp679 - 683 Conference Paper, 2012

Han, J., Campbell, N., Jokinen, K., Wilcock, G., Investigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot, Proceedingsof 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2012 , 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom , Kosice; Slovakia, 2-5 Dec, 2012, 679-683 Conference Paper, 2012 DOI

Francesca Bonin, Ronald Bock, Nick Campbell, How Do We React to Context? Annotation of Individual and Group Engagement in a Video Corpus, Privacy, Security, Risk and Trust (PASSAT), 2012 International Conference on and 2012 International Confernece on Social Computing (SocialCom), Amsterdam, September 3-5, IEEE, 2012, pp899 - 903 Conference Paper, 2012 DOI

Francesca Bonin, Nick Campbell, Carl Vogel, Temporal distribution of laughter in conversation, Third Interdisciplinary Workshop on Laughter and other Non-­‐Verbal Vocalisations in Speech, Dublin, Ireland, October 26-27, 2012, 2012 Conference Paper, 2012

Stefan Scherer, Georg Layher, John Kane, Heiko Neumann and Nick Campbell, An audiovisual political speech analysis incorporating eye-tracking and perception data, Conference on Language Resources and Evaluation (LREC'12), Istanbul, Turkey, 21-27 May 2012, 2012 Conference Paper, 2012

Conversational Involvement and Synchronous Nonverbal Behaviour in, Esposito, A., Vinciarelli, A., Hoffmann, R., & Müller, V. (Eds.) , Cognitive Behavioural Systems, Springer, 2012, pp343 - 352, [Altmann, U., Oertel, C., & Campbell, N.] Book Chapter, 2012 DOI

Carlos Toshinori Ishi, Nick Campbell, Analysis of acoustic-prosodic features of spontaneous expressive speech, Revista de Estudos da Linguagem, 12, (2), 2012, p38 - 49 Journal Article, 2012 DOI

]Francesca Bonin, Ronald Böck and Nick Campbell,, How do we react to context? Annotation of individual and group engagement in a video corpus., Proceedings of the CBAR Workshop, ASE/IEEE International Conference on Social Computing , Amsterdam, The Netherlands, September 2012, 2012, pp899 - 903 Conference Paper, 2012

Vaughan, B., Han, G. J., Gilmartin, E & Campbell, N., Designing and Implementing a Platform for Collecting Multi-Modal Data of Human-Robot Interactio, Acta Polytechnica Hungarica, 9, (1), 2012, p7 - 17 Journal Article, 2012

Ronald Böck, Francesca Bonin, Nick Campbell, Jens Edlund, Iwan Kok, Ronald Poppe, David Traum(ed.), Joint Proceedings of the IVA 2012 Workshops, USA, (ISBN: 9783940961839), September 2012, 2012 Proceedings of a Conference, 2012

Han, J., Gilmartin, E., De Looze, C., Vaughan, B., & Nick Campbell, The Herme Database of Spontaneous Multimodal Human-­‐Robot Dialogues, Conference on Language Resources and Evaluation (LREC'12), Istanbul, Turkey, 21-27 May 2012 , edited by ELRA , 2012 Conference Paper, 2012

Oertel, C., De Looze, C., Campbell, N. and Wagner, P., Identification of cues for the automatic detection of hotspots in natural conversation. , SSPnet-COST 2102 PINK International Conference., Budapest, Hungary, May, 2011, 2012 Conference Paper, 2012

Bonin, Francesca and Nick Campbell and Carl Vogel, Laughter and Topic Changes: Temporal Distribution and Information Flow, 3rd IEEE Conference on Cognitive Infocommunications, Kosice, Slovakia, December 2-5, 2012, IEEE, 2012, pp53 - 58 Conference Paper, 2012 TARA - Full Text DOI

Tanaka Hiroki & Nick Campbell, Acoustic features of four types of laughter in natural conversational speech, ICPhS, Hong Kong, China, 17-21 August 2011, 2011 Conference Paper, 2011

Nick Campbell, Nordic symposium in multimodal communications, Helsinki, 27-28 May, 2011, CICERO Learning Invited Talk, 2011

Nick Campbell, 'D64 Speech Corpus', Speech Communication Lab, Dublin, speech-data.jp/nick/mmx/d64.html, 2011, - Digital research resource production, 2011

On the fragmented nature of spoken interaction and an attempt to model its apparent regularities in, editor(s)Marciej Karpinski , Gesture & Speech in Interaction, 2011, [Nick Campbell & Stefan Scherer] Book Chapter, 2011

De Looze, C., Oertel, C., Rauzy, S. & Campbell, N., Measuring dynamics of mimicry by means of prosodic cues in conversational speech., The 17th International Congress of Phonetic Sciences (ICPhS XVII) , Hong Kong, China, August 17-21, 2011 Conference Paper, 2011

Nick Campbell, Talking with people (and robots); the nonverbal aspects, International workshop on voice and speech processing in social interaction, University of Glasgow, 18-19 April, 2011, UG Institute of Neuroscience & Psychology Invited Talk, 2011

Towards the Automatic Detection of Involvement in Conversation in, editor(s)Anna Esposito, Alessandro Vinciarelli, Klara Vicsi, Catherine Pelachaud, Anton Nijholt , Analysis of Verbal and Nonverbal Communication and Enactment, Berlin/Heidelberg, Springer, 2011, pp163 - 170, [Catharine Oertel, Celine de Looze, Stefan Scherer, Andreas Windmann, Petra Wagner, Nick Campbell] Book Chapter, 2011

CLCS Speech Communication Lab (all members), Herme, the chat robot, 2011, - Exhibition, 2011 URL

FastNet Project, 'HERME', Speech Communication Lab, Science Gallery, TCD, 2011, - Software, 2011

Nick Campbell, Talking with robots, Advances in speech technologies, IRCAM, Paris, France, 24th June , 2011, IRCAM Invited Talk, 2011

Nick Campbell, John Kane and Helena Moniz, Processing 'yup!' and other short utterances in interactive speech, Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing , ICASSP - , Prague, May , IEEE, 2011, pp5832 - 5835 Conference Paper, 2011 DOI TARA - Full Text URL

Laurence Devillers, Nick Campbell, Special issue of computer speech and language on "affective speech in real-life interactions" , Computer Speech and Language, 25, (1), 2011, p1 - 3 Journal Article, 2011 DOI

Oertel, Scherer & Campbell, On the use of multimodal cues for the prediction of degrees of involvement in spontaneous conversation., Proceedings of the Annual Conference of the International Speech Communication Association, 12th Annual Conference of the International Speech Communication Association, Florence, Italy, 27 -31 Aug, edited by ISCA , Interspeech, 2011, pp1541-1544 Conference Paper, 2011

Han, Dalton, Vaughan, Oertel, Dougherty, De Looze & Campbell, Collecting multi-modal data of human-robot interaction, Proceedings of 2nd International Conference on Cognitive Infocommunications, The 2nd International Conference on Cognitive Infocommunications (CogInfoCom2011) , Budapest, Hungary, 7-9 July, 2011, ppArticle number 5999468 Conference Paper, 2011

Computer Speech and Language, Volume 25, Issue 1, (2011), 1 - 126p, Laurence Devillers, Nick Campbell, [eds.] Journal, 2011

Tools and resources for visualising conversational speech interaction in, editor(s)Kipp, Martin, Paggio, and Heylen , Multimodal Corpora; from Models of Natural Interaction to Systems and Applications - Lecture Notes in Computer Science, Berlin, Springer Verlag, 2010, pp176 - 188, [Nick Campbell] Book Chapter, 2010 DOI URL

STEFAN SCHERER1, MICHAEL GLODEK, FRIEDHELM SCHWENKER Ulm University NICK CAMPBELL Trinity College Dublin and GU ̈NTHER PALM Ulm University, Spotting laughter in naturalistic multiparty conversations: A comparison of automatic online and offline approaches using audiovisual data, ACM Transactions on Interactive Intelligent Systems., 2010 Journal Article, 2010 DOI

Expressive Speech Processing and Prosody Engineering: An Illustrated Essay on the Fragmented Nature of Real Interactive Speech in, editor(s)FangChen ·KristiinaJokinen , Speech Technology Theory and Applications, New York Dordrech tHeidelberg London, Springer, 2010, pp105 - 120, [Nick Campbell] Book Chapter, 2010

Nick Campbell, Multimodal Expressive; conversation as a pre‐ linguistic social activity, 3rd COST 2102 INTERNATIONAL TRAINING SCHOOL on Toward Autonomous, Adaptive, and Context‐Aware Multimodal Interfaces: Theoretical and Practical Issues, Caserta Italy, 15‐19 March, 2010, COST 2102 Invited Talk, 2010

Nick Campbell, Multimodal Expressivity (Conversation as a prelinguistic social activity), Hungarian Academy of Science, 27th July, 2010, SZTAKI Invited Talk, 2010

Nick Campbell, Processing 'niblets' for conversational speech interaction/, 2010, COST 2102 International Conference, Budapest, Hungary, 7-11 September, 2010 Conference Paper, 2010

Nick Campbell & Stefan Scherer, Comparing Measures of Synchrony and Alignment in Dialogue Speech Timing with respect to Turn-taking Activity, 11th Annual Conference of the International Speech Communication Association, Tokyo, 26-30 September , ISCA, 2010, pp2546-2549 Conference Paper, 2010

Oertel, C., Cummins, R., Campbell, N., Edlund, J, & Wagner. P., , D64: a corpus of richly recorded conversational interaction, Language Resources and Evaluation Conference, Malta, May, 2010 Conference Paper, 2010 DOI

Nick Campbell, Speech Technology and Empathy in Conversational Interaction, Oriental COCOSDA, Kathmandu, India, November 2010, edited by IEEE , 2010 Conference Paper, 2010

Esposito, Anna, Campbell, Nick, Vogel, Carl., Hussain, Amir, Nijholt, Anton (eds), Development of Multimodal Interfaces; Active Listening & Synchrony, Berlin, Springer, 2010, XVII, 446pp Book, 2010 URL

Helena Moniz, John Kane, Nick Campbell, and Isabel Trancoso, Towards a Description of the Dynamics of Spontaneous Speech based on Axoustic-Prosodic Properties of Fragmentary Discursive Events, COST 2102 International Conference, Budapest, Hungary, 7-11 September, 2010 Conference Paper, 2010

Nick Campbell & Akiko Tabata, A software toolkit for viewing annotated multimodal data interactively over the web, Proc Language Resources & Evaluation Conference, Language Resources & Evaluation Conference, Malta, May 2010, edited by ELRA , 2010 Conference Paper, 2010

Nick Campbell, Automatic detection of social aspects of interactive spoken conversation, CogInfoCom, Tokyo, Japan, Nov 28-30 , 2010, 1st International Workshop on Cognitive Infocommunications Invited Talk, 2010

Nick Campbell, Workshop on Preparation for a Digital Corpus of Japanese Everyday Talk, Alberta, Canada, June 11-14 , 2010, University of Alberta Invited Talk, 2010

Nick Campbell, Language Resources of the Future (a speech-based position paper), FLaReNet Forum, Barcelona, 2010, FLaReNet Invited Talk, 2010 TARA - Full Text URL

Nick Campbell, MMX - processing MultiModal eXpressive interaction, ЧЕТВЁРТАЯ МЕЖДУНАРОДНАЯ КОНФЕРЕНЦИЯ ПО КОГНИТИВНОЙ НАУКЕ, THE FOURTH INTERNATIONAL CONFERENCE ON COGNITIVE SCIENCE, Tomsk, Russia, June 22-26, 2010, Volume 1, (ISBN 5-94621-316-4), THE INTERREGIONAL ASSOCIATION FOR COGNITIVE STUDIES, 2010, pp29 - 39 Conference Paper, 2010

Multimodal Laughter Detection in Natural Discourses in, editor(s)Helge Ritter, Gerhard Sagerer, Rüdiger Dillmann and Martin Buss , HUMAN CENTERED ROBOT SYSTEMS, Cognitive Systems Monographs,, Springer Verlag, 2009, pp111 - 120, [Stefan Scherer, Friedhelm Schwenker, Nick Campbell and Günther Palm] Book Chapter, 2009

Scherer, S. and Schwenker, F. and Campbell, W. N. and Palm, G, Multimodal laughter detection in natural discourses, 3rd International Workshop on Human-Centered Robotic Systems, Munich, 2009, pp111 - 121 Conference Paper, 2009 DOI

Nick Campbell, Tracking the second channel of information in speech, IEEE International workshop on Social Signal Processing, Amsterdam, September , 2009 Invited Talk, 2009 URL

Preface in, editor(s)Raquel de Pedro Ricoy, Isabelle Perez and Christine Wilson , Interpreting and Translating in Public Service Settings Policy, Practice, Pedagogy, Manchester, St. Jerome, 2009, ppvii - viii, [Lorraine Leeson ] Book Chapter, 2009

Nick Campbell, An Audio-Visual Approach to Measuring Discourse Synchrony in Multimodal Conversation Data, Interspeech 2009, Brighton, England, September 2009, edited by ISCA , 2009 Conference Paper, 2009 URL TARA - Full Text

Nick Campbell, The expanding role of prosody in speech communication technology, DIAHOLMIA, KTH, Sweden, June 2009, 2009 Invited Talk, 2009 URL

Individual Traits of Speaking Style and Speech Rhythm in a Spoken Discourse in, editor(s)Esposito et al , Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction, Berlin, Springer Verlag, 2008, pp107 - 120, [Nick Campbell] Book Chapter, 2008 URL

Expressive/Affective Speech Synthesis in, editor(s)Benesty, Jacob; Sondhi, M. M.; Huang, Yiteng , Springer Handbook of Speech Processing, Berlin, Heidelberg, Springer Verlag, 2008, [Nick Campbell] Book Chapter, 2008 URL URL

Nick Campbell, Differences in the speaking styles of a Japanese male according to interlocutor; showing the effects of affect in conversational speech, International Journal of Computational Linguistics and Chinese Language Processing, 11, (1), 2007, p1 - 16 Journal Article, 2007

On the Use of Nonverbal Speech Sounds in Human Communication in, editor(s)Esposito et al , Verbal and Nonverbal Communication Behavior, Berlin, Heidelberg, Springer, 2007, pp117 - 128, [Nick Campbell] Book Chapter, 2007

Robust real time face tracking for the analysis of human behavior in, Machine Learning & Multimodal Interaction, Berlin, Heidelberg, 2007, pp1 - 15, [Nick Campbell, Damien Douxchamps] Book Chapter, 2007

How Speech Encodes Affect and Discourse Information - Conversational Gestures, in, editor(s)Esposito et al , NATO Security through Science, Amsterdam, IOS Press, 2007, pp103 - 114, [Nick Campbell] Book Chapter, 2007

Nick Campbell, The Role and Use of Speech Gestures in Discourse, Archives of Acoustics, 32, (4), 2007, p803 - 814 Journal Article, 2007

Nick Campbell, Conversational Speech Synthesis and the need for some laughter, IEEE Transactions on Audio, Speech, and Language Processing,, 14, (4), 2006, p1171 - 1178 Journal Article, 2006 DOI URL

Nick Campbell , Getting to the heart of the matter; speech as the expression of affect; rather than just text or language, Language Resources and Evaluation, 39, (1), 2005, p109 - 118 Journal Article, 2005 URL DOI

Nick Campbell, Developments in Corpus-Based Speech Synthesis; Approaching Natural Conversational Speech, IEICE Transactions on Information & Systems, E88-D, (3), 2005, p376 - 383 Journal Article, 2005 DOI

Campbell, N., Erickson,D.,, What do people hear? - a study of the perception of non-verbal affective information in conversational speech, Journal of the Phonetic Society of Japan, 8, (1), 2004, p9 - 28 Journal Article, 2004

Nick Campbell, Databases of Expressive Speech, Journal of Chinese Language and Computing, 14, (4), 2004, p295 - 305 Journal Article, 2004

Speech Communication, Special Issue on Speech & Emotion, 40, 1-2, (2003), Nick Campbell, [eds.] Journal, 2003

Speech Synthesis in, Encyclopaedia of Artificial Intelligence, Tokyo, Kyoritu Syuppan, 2003, [Nick Campbell] Book Chapter, 2003

Ishi, C.T., Mokhtari, P., Campbell, N., , Perceptually-related acoustic-prosodic features of phrase finals in spontaneous speech, Eurospeech 2003, 2003, pp405 - 408 Conference Paper, 2003

Akemi Iida, Nick Campbell, Speech database Design for a Concatenative Text-to-Speech Synthesis System for Individuals with Communicative Disorders, International Journal of Speech Technology, 6, 2003, p574 - 582 Journal Article, 2003

Journal of the Phonetic Society of Japan, Special Issue on Phonetics and Speech Technology, 7, 3, (2003), Nick Campbell, [eds.] Journal, 2003

Iida, A., Higuchi, F., Campbell,N., Yasumura, M. , A Corpus-based Speech Synthesis System with Emotion, Speech Communication, 40, (1), 2003, p161 - 187 Journal Article, 2003 DOI

Nick Campbell, Recording Techniques for Capturing Natural Every-Day Speech, Language Resources & Evaluation Conference, Gran Canarias, 2002, ELRA, 2002 Conference Paper, 2002

Ishi, C.T., Campbell, N. , Analysis of Acoustic-Prosodic Features of Spontaneous Expressive Speech, 1st International Congress of Phonetics and Phonology, Rio de Janeiro, 2002, pp102 - 110 Conference Paper, 2002 DOI

M. Mashimo, T. Toda, H. Kawanami, K. Shikano, N. Campbell, Cross-language Voice Conversion Using a Bilingual Database, Journal of the Information Processing Society of Japan, 43, (7), 2002, p2177 - 2175 Journal Article, 2002

IEEE Trans Speech & Audio Processing, Special Issue on Speech Synthesis, (2001), Nick Campbell, [eds.] Journal, 2001

Sagisaka Y., Campbell N, Description, Acquisition and Evaluation of Rules and Data for Speech Synthesis, IEICE TRANS. INF.& SYST.,, J83-D-II, (11), 2000, p2068 - 2076 Journal Article, 2000

A. Iida, N. Campbell, M. Yasumura, Corpus-based Speech Synthesis for ALS patients to assist their communication, Technical Report of the IEICE, 33, (1), 2000, p37 - 42 Journal Article, 2000

Speech Synthesis in, editor(s)John G. Webster, Ph.D. , The Wiley Encyclopedia of Electrical and Electronics Engineering, New York, Wiley, 1999, [Nick Campbell] Book Chapter, 1999

Information Transfer in Example-Based Speech Translation in, Automated Spoken Dialogue Systems, Boston, MIT Press, 1999, [N.Campbell & H. Iida,] Book Chapter, 1999

Timing in Speech: a multi-level process in, editor(s)Horne et al , Prosody; Theory and Experimen, Dordrecht, Kluwer Academic, 1999, [Nick Campbell] Book Chapter, 1999

Nick Campbell, Advances in Speech Synthesis, springer, 1999 Book, 1999

Synthesising Spontaneous Speech in, editor(s)Sagisaka, Campbell & Higuchi , Computing Prosody, Berlin, Springer Verlag, 1997, [Nick Campbell] Book Chapter, 1997

Nich Campbell, Computing Prosody, Springer Verlag, 1994 Book, 1994

Nick Campbell, Automatic Detection of Prosodic Boundaries in Speech, Speech Communication, 13, (1), 1993, p343 - 354 Journal Article, 1993

Syllable-Based Segmental Duration, in, editor(s)eds. G. Bailly & C. Benoit , Talking Machines, Amsterdam, Elsevier Science, 1991, [Nick Campbell] Book Chapter, 1991

W. N. Campbell & S. D. Isard, Segment Durations in a Syllable Frame, Journal of Phonetics, 19, (1), 1991, p37 - 48 Journal Article, 1991

Watching People Talk; How Machines Can Know We Understand Them - a Study of Engagement in a Conversational Corpus in, editor(s)Prof. Dr. Laszlo Hunyadi , The temporal patterns of multimodal communication, Springer, [Nick Campbell] Book Chapter,

Non-Peer-Reviewed Publications

Nick Campbell, Synthesising colloquial speech with the GBO Corpus, Kaken Onseigengo, Kyoto, Japan, July 15, 2017 Invited Talk, 2017

Iacer Calixto, Qun Liu, Nick Campbell, Nick Campbell Nick Campbell [PDF] from arxiv.org Incorporating Global Visual Features into Attention-Based Neural Machine Translation, ACM, 2017 Conference Paper, 2017

Nick Campbell, Corpora of Spoken Interaction; Watching People Talk, Oriental COCOSDA 2017, Seoul, Korea, Nov 2nd, 2017 Invited Talk, 2017

Nick Campbell, Towards Interactive Speech Synthesis; an example of robot-human dialogues in a spontaneous environment, CAPSS , Budapest, 15 May, 2017, Hungarian Academy of Science Invited Talk, 2017

I Calixto, Q Liu, N Campbell , Multilingual Multi-modal Embeddings for Natural Language Processing , arXiv preprint arXiv:1702.0110, 2017 Conference Paper, 2017

Nicc Campbell, Machine Processing of Dialogue States; Speculations on Conversational Entropy, International Conference on Speech and Computer, Budapest, Hungary, Springer International Publishing, 2016, pp18-25 Conference Paper, 2016

Fasih Haider, Nick Campbell, Saturnino Luz, Nick Campbell Nick Campbell Active speaker detection in human machine multiparty dialogue using visual prosody information, Signal and Information Processing (GlobalSIP), 2016 IEEE Global Conference on, 2016 Conference Paper, 2016

Keith Curtis, Gareth JF Jones, Nick Campbell, Speaker impact on audience comprehension for academic presentations, Proceedings of the 18th ACM International Conference on Multimodal Interaction, Washington DC, 2016, pp129-136 Conference Paper, 2016

Nick Campbell, Specom , Budappest, Hungary, 2016 Invited Talk, 2016

Saturnino Luz, Bridget Kane, Jing Su, Saturnino Luz, Fasih Haider, Loredana Cerrato, Nick Campbell, Fasih Haider, Saturnino Luz, Nick Campbell, Bridget Kane, Saturnino Luz, Bridget Kane, Saturnino Luz, Su Jing, Saturnino Luz, Saturnino Luz, Perspectives on Intelligent Systems Support for Multidisciplinary Medical Teams, AAAI Spring Symposium Series, 27, Springer International Publishing, 2015, pp87-109 Conference Paper, 2015

ISCA SproSIG, Social and Linguistic Speech Prosody, 20-23 May 2014, In:SP7: Speech Prosody 2014, 2014, TCD Burke Theatre, Nick Campbell, ISCA/SproSIG Meetings /Conferences Organised, 2014

ISCA, MA3HMI 2014 workshop,, September 14, In: Interspeech 2014,, 2014, Singapore Meetings /Conferences Organised, 2014

Nick Campbell, "D-ANS corpus: a new corpus of multimodal biometric spontaneous speech recordings" , Meeting of Kaken A, Osaka, Japan, Dec 6th, 2014, Kobe University Invited Talk, 2014

nick campbell, An introduction to the TCD D-ANS Corpus - a multimodal multimedia monolingual biometric corpus of spoken social interaction !, Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, Singapore, 14 sept , 2014, ISCA Satellite Workshop Invited Talk, 2014

Joao Cabral, Nick Campbell, Shree Ganesh, Emer Gilmartin, Fasih Haider, Eamon Kenny, Mina Kheirkhah, Andy Murphy, Neasa Ní Chiaráin, Thomas Pellegrini, Odei Rey Orosko, 'MILLA - A Multimodal Interactive Language Agent', eNTERFACE, 2014, - Software, 2014 TARA - Full Text

Nick Campbell, An introduction to the TCD Biometric corpus of multimodal spoken interaction - D-ANS, Kaken Research Meeting, Osaka, Japan, 6th Dec. , 2014, Kobe University Invited Talk, 2014

IVA (Intelligent Virtual Agenms), IVA 2012 workshops: MA3 2012 and RCVA 2012, Septemner 15, In:International Workshop on Multimodal Analyses for Human Machine Interaction, 2012, Santa Cruz, Böck, Bonin, Campbell, Edlund, De Kok, Poppe, Traum Meetings /Conferences Organised, 2012

N. Campbell, Social aspects and speechability in CogInfoCom systems, CogInfoCom 2012, Kosice, Slovakia, 2nd December, 2012, Hungarian Academy of Sciences Invited Talk, 2012

N. Campbell, Introduction to the Speech Communication Lab at Trinity College Dublin, UK & IE Speech Meeting,, Birmingham,, Dec 17-18, 2012, 2012 Invited Talk, 2012

Speech Communication Lab, TCD, Laughter and other Non-Verbal Vocalisations in Speech, October 26-27, 2012, In:Interdisciplinary Workshop, 2012, Dublin Meetings /Conferences Organised, 2012 URL

Nick Campbell, Managing contact in interactive speech synthesis, talk series, Imperial College London, 5th July, 2011 Invited Talk, 2011

Nick Campbell, Geza Nemeth, Adam Miklosi, Analysis of 7395 dog barks, 2010 Working Paper, 2010 URL

Nick Campbell, On the continued use of prosody in speech technology, ICCS/HCRC Seminar Series, Edinburgh University, 25 Feb, 2010 Invited Talk, 2010

Cognitive Processing - International Quarterly of Cognitive Science, Springer, [Advisory Editor], 2009 Editorial Board, 2009

Computer Speech and Language , Elsevier, [Guest Editor], 3-years, 2008 Editorial Board, 2008 URL

Nick Campbell, AAAC Conference on Affective Computing and Intelligent Interaction Asia, May 20 -22, 2018, Beijing, China Meetings /Conferences Organised,

Yuyun Huang, Emer Gilmartin, Nick Campbell, Conversational engagement recognition using auditory and visual cues, Proceedings of Interspeech, Interspeech , 2016 Conference Paper,

Research Expertise

Description

My background is in experimental psychology and linguistics, but most of my experience is in speech technology. I prefer corpus-based approaches and have pioneered advanced (and paradigm-shifting) methods of speech synthesis and natural conversational speech collection in a multimodal environment. My principal interest is in speech prosody, extending this research to social interaction to show how the voice is used in discourse to express personal relations as well as propositional content. Most of my previous work has used speech materials collected in Japan, and I am happy now to be in Ireland where I can confirm the universality of my previous findings - both for Irish and for Hiberno-English. Ultimately, I am working to produce a friendlier speech-based human-machine interface for web-based information, customer-services, games, and robotics, while trying to understand how humans perform such often perfect communication.

Projects

  • Title
    • FastNet
  • Summary
    • Focus on Actions in Social Talk; Network-Enabling Technology (Lead PI 5 years)
  • Funding Agency
    • SFI
  • Date From
    • April 1st 2010
  • Date To
    • March 31st 2015
  • Title
    • CNGL-II
  • Summary
    • Theme Leader - Delivery & Interaction 10meuro (approx) for 30 months
  • Funding Agency
    • SFI
  • Date From
    • Jan 2012
  • Date To
    • Sept 2015
  • Title
    • METALOGUE
  • Summary
    • Multiperspective Multimodal Dialogue: dialogue system with metacognitive abilities The goal of METALOGUE is to produce a multimodal dialogue system that is able to implement an interactive behaviour that seems natural to users and is flexible enough to exploit the full potential of multimodal interaction. It will be achieved by understanding, controlling and manipulating system's own and users' cognitive processes. The new dialogue manager will incorporate a cognitive model based on metacognitive skills that will enable planning and deployment of appropriate dialogue strategies. The system will be able to monitor both its own and users' interactive performance, reason about the dialogue progress, guess the users' knowledge and intentions, and thereby adapt and regulate the dialogue behaviour over time. The metacognitive capabilities of the METALOGUE system will be based on a state-of-the-art approach incorporating multitasking and transfer of knowledge among skills. The models will be implemented in ACT-R, providing a general framework of metacognitive skills. http://cordis.europa.eu/projects/rcn/110655_en.html
  • Funding Agency
    • EU
  • Date From
    • Nov 2013
  • Date To
    • Oct 2016
  • Title
    • JOKER
  • Summary
    • JOKe and Empathy of a Robot/ECA: Towards social and affective relations with a robot This project will build and develop JOKER, a generic intelligent user interface providing a multimodal dialogue system with social communication skills including humor, empathy, compassion, charm, and other informal socially-oriented behavior. Talk during social interactions naturally involves the exchange of propositional content but also and perhaps more importantly the expression of interpersonal relationships, as well as displays of emotion, affect, interest, etc. This project will facilitate advanced dialogues employing complex social behaviors in order to provide a companion-machine (robot or ECA) with the skills to create and maintain a long term social relationship through verbal and non verbal language interaction. Such social interaction requires that the robot has the ability to represent and understand some complex human social behavior. It is not straightforward to design a robot with such abilities. Social interactions require social intelligence and 'understanding' (for planning ahead and dealing with new circumstances) and employ theory of mind for inferring the cognitive states of another person. JOKER will emphasize the fusion of verbal and non-verbal channels for emotional and social behavior perception, interaction and generation capabilities. Our paradigm invokes two types of decision: intuitive (mainly based upon non-verbal multimodal cues) and cognitive (based upon fusion of semantic and contextual information with non-verbal multimodal cues.) The intuitive type will be used dynamically in the interaction at the non-verbal level (empathic behavior: synchrony of mimics such as smile, nods) but also at verbal levels for reflex small- talk (politeness behavior: verbal synchrony with hello, how are you, thanks, etc). Cognitive decisions will be used for reasoning on the strategy of the dialog and deciding more complex social behaviors (humor, compassion, white lies, etc.) taking into account the user profile and contextual information. http://www.chistera.eu/projects/joker
  • Funding Agency
    • EU-FP7
  • Date From
    • Jan 2014
  • Date To
    • Dec 2016
  • Title
    • ADAPT
  • Summary
    • Centre for Global Intelligent Digital Content
  • Funding Agency
    • SFI
  • Date From
    • Jan 2015
  • Date To
    • Dec 2020
  • Title
    • ISCA
  • Summary
    • The International Strategic Cooperation Award (ISCA) programme supports new and existing research-based collaborations between Ireland's Higher Education Institutions (HEIs) and partner organisations in Japan
  • Funding Agency
    • SFI
  • Date From
    • 2014
  • Date To
    • 2015
  • Title
    • Speech Prosody (SP7)
  • Summary
    • conference grant
  • Funding Agency
    • SFI
  • Date From
    • May 2014
  • Date To
    • May 2014
  • Title
    • Stokes Professorship
  • Summary
    • SFI Stokes Award - 5 year
  • Funding Agency
    • SFI
  • Date From
    • Oct 2008
  • Date To
    • Sep 2013
  • Title
    • MOSAIC:  自然で双方向的な対話処理モデル
  • Summary
    • http://kaken.nii.ac.jp/d/p/24500256.ja.html joint research with NAIST, Japan and TCD, Ireland
  • Funding Agency
    • Kaken (Japan)
  • Date From
    • 1/4/2012
  • Date To
    • 31/3/2015

Keywords

Cognition; Communication engineering, technology; Communication Sciences; Computational linguistics; Computer Science/Engineering; Databases, database management, data mining; Discourse & Dialogue; Human computer interactions; Information Technology; Intelligent agents; Language and technology; Multimedia; Numerical analysis; Remote sensing; Signal processing; Speech Processing; Speech processing/technology; SPEECH PROSODY; Speech synthesis; Virtual Reality

Recognition

Representations

Board member: Japan British Association of the Kansai 2005-present

Board member: International Speech Communication Association 2009-resigned in protest 2016

Board Member - European Language Resources Association (ELRA) Nov 2010 - Dec 2016

Vice President - European Language Resources Association Feb 2011 - Dec 2016

Steering Committee member - Digital Humanities Research (TCD) August 2012

Member - META-NET (EU) Vision Group 2010-2012

Member, Spoken Language Technical Committee, IEEE Signal Processing Society Oct 2011 - 2015

member of Management Committee, European Science Foundation (ESF) funded Research Network: COST 2102: Cross- Modal Analysis of Verbal and Non-verbal Communication. 2008-2011

Humaine (EU) Executive Committee member 2007-2011

Member of the Editorial Board: Cognitive Processing 2009-2012

Member of the Editorial Board, Language Resources and Evaluation 2004-2009

Member of the Editorial Board, Phonetica 2003-2004

Associate Editor, Language & Speech 1999-2009

Associate Editor, Journal of the Phonetic Society of Japan 2000-2009

Associate Editor - IEEE Transactions on Speech & Audio 1999-2004

Guest Editor - IEEE Trans SP Special Issue on Speech Synthesis 2001-2002

ISCA Speech Synthesis SIG - Vice Chairman, ILO 1998-2009

External Expert, European Commission, 'Humaine' Network of Excellence. 2007-2008

Speech Synthesis Working Group Convenor COCOSDA 1995-2000

DISC Advisory Panel (member) 1997-1999

Secretary/Communications Officer COCOSDA 1991-present

Guest Editor, IEEE Trans Speech & Audio - Special Issue on Expressive Speech Synthesis 2004-2006

51st Annual Meeting of the Association for Computational Linguistics in 2013. (Programme Committee member) Dec 2012

PC member - 14th International Conference on Computational Linguistics and Intelligent Text Processing Dec 2012

SciCom member - 12th International Conference on Auditory-Visual Speech Processing (AVSP2013) Nov 2012

PC member - Beyond AI: Artificial Dreams BAI 2011, 2012 Jun 2012

Organising Committee member - Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction. Jan 2012

International Advisory Committee member - 15th Oriental COCOSDA Conference, Macao, 2012 Jan 2011

OrgCom CogInfoCom 2012 Dec 2012

PC member - BCS/CPHC Distinguished Dissertations competition 2012 Dec 2012

PC member (HLT-10) The Fourth Baltic Conference on Human Language Technologies Aprli 2010

PC member - IWSDS 2012 - International Workshop on Spoken Dialog Systems 2012 Aug 2012

PC member - SocialCom 2012 - ASE/IEEE International Conference on Social Computing Sep 2012

PC member - PLM2012 - 43rd Poznań Linguistic Meeting Mar 2012

PC member - SP2012 - 6th International Conference on Speech Prosody May 2012

PC member - SSPW2009 - Social Signal Processing Workshop Jan 2009

PC member - TAL 2012 - The Third International Symposium on Tonal Aspects of Languages May 2012

PC member - Simpe 2010 - Fifth Workshop on Speech in Mobile and Pervasive Environments May 2010

Organiser - Laughter and other Non-Verbal Vocalisations in Speech - Long Room Hub - International Workshop Oct 2012

PC member - LREC2012 - The 8th International Conference on Language Resources and Evaluation May 2012

General Chair 7th Speech Prosody International Conference Dublin, Ireland May 2014

Co-organiser MA3HMI, Singapore Sep 2014

Co-Organiser - 3rd European Symposium on Multimodal Communication, MMSYM-2015, Dublin 17,18 Sept 2015

Co-Organiser - Engagement in Social Intelligent Virtual Agents - satellite w/s of Fifteenth International Conference on Intelligent Virtual Agents (IVA 2015), August 26-28, Delft Aug 2015

PC member BAI 2012 May 2015

PC member - CICLing 2013, 2014, 2015, 2016, 2017 Apr 2015

PC member - IWSDS 2012, 2014, 2015 Apr 2015

PC member - LTC 2009, 2011, 2013, 2015 Jun 2015

Co-Organiser/Local Host - MMSYM 2015 Jun 2015

PC member - SPECOM 2015, 2016, 2017 Jun 2015

PC member - CogInfoCom 2012, 2014 Apr 2014

Co-Organiser - ESIVA - satellite of Interspeech 2015 May 2015

PC member SP8 2016 - Speech Prosody, Boston

PC member HSCR 2017

PC member SLSP 2014, 2016

PC member AICS 2017

PC member ICMR 2017

PC member ICCT 2017

PC member MMC 2013, 2017

PC member SSW8

PC member Oriental COCOSDA 2014, 2015, 2016, 2017

PC member MMSYM 2016

PC member ACII 2013, 2015

PC member IVA 2008, 2017

PC member WASA 2015

PC member Poital 2014

Awards and Honours

Fellow of Trinity College Dublin 2010

Track Leader (SFI CSET-CNGL) ILT August 2011

Kaken (Japanese Govt funding) 3yrs August 2012

Theme Leader CNGL-ii 2013

Founding Co-PI ADAPT Centre 2014

Theme Leader ADAPT Centre 2015

ISCA (Japan Collaboration) 2014

GoogleScholar h-index: 37(23), i-10: 132 (63) Nov 2014

Memberships

International Phonetic Association, Coordinating Committee on Speech I/O Database Assessment, International Committee of Acoustic Society of Japan, International Speech Communication Association Institute of Acoustics (adherent) U.K., Acoustic Society of America, Acoustic Society of Japan. IEEE Signal Processing Society