Professor Nick Campbell
Fellow Emeritus, Computer Science
Biography
Nick Campbell (nick@tcd.ie) is a Professor and Fellow Emeritus, Director of the Speech Communication Lab at Trinity College Dublin (The University of Dublin) in Ireland. He received his Ph.D. degree in Experimental Psychology from the University of Sussex in the U.K. He was invited to TCD in 2008 as Professor of Phonetics and Speech Communication, and was an SFI Stokes Professor until 2015 when he suffered mandatory age-related retirement and was appointed to the School of Computer Science and Statistics as Adjunct Professor. Until 2008 he was a Senior Scientist at the Japanese National Institute of Information and Communications Technology, (as nick@nict.go.jp) and Chief Researcher in the Department of Acoustics and Speech Research, Advanced Telecommunications Research Institute International (as nick@atr.jp), Kyoto, Japan, where he also served as Research Director for the JST/CREST Expressive Speech Processing and the SCOPE "Robot's Ears" projects. He was first invited as a Research Fellow at the IBM U.K. Scientific Centre, where he developed algorithms for speech synthesis, and later at the AT&T Bell Laboratories, where he worked on the synthesis of Japanese. He served as Senior Linguist at the Edinburgh University Centre for Speech Technology Research before joining ATR in 1990. His research interests are based on large speech databases, and include nonverbal speech processing, concatenative (and interactive) speech synthesis, and prosodic information modeling. He was Visiting Professor at the School of Information Science, Nara Institute of Science and Technology (NAIST), Nara, Japan, and Visiting Professor at Kobe University, Kobe, Japan for 10 years. Ranked #3 in TCD and #12 in Ireland by http://guide2research.com/scientists/uni-187 - Google Scholar [h-index 45(21), i10 168(67) October '22] Out of College since Covid! Currently working with Kyoto University on deep learning for expressive speech syntheis - results indistinguishable from natural speech in formal trials - but not written up yet - do I have the funding to continue publications??? where is the 'emeritus' rule book???
Publications and Further Research Outputs
Peer-Reviewed Publications
Haider, Fasih and Koutsombogera, Maria and Conlan, Owen and Vogel, Carl and Campbell, Nick and Luz, Saturnino, An Active Data Representation of Videos for Automatic Scoring of Oral Presentation Delivery Skills and Feedback Generation, Frontiers in Computer Science, 2, 2020, p1
Haider, F., Akira, H., Vogel, C., Campbell, N., Luz, S. , 2 Analysing patterns of right brain-hemisphere activity prior to speech articulation for identification of system-directed speech, Speech Communication, 18, (25), 2019, p1-
Emer Gilmartin, Carl Vogel and Nick Campbell, Chats and Chunks: Annotation and Analysis of Multiparty Long Casual Conversations, Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, May 7-12, 2018, edited by Nicoletta Calzolari, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Koiti Hasida, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis, Takenobu Tokunaga , 2018, pp1964-1970
Emer Gilmartin, Carl Vogel and Nick Campbell, Stitching Together the Conversation: Considerations in the Design of Extended Talk, International Workshop on Spoken Dialogue Systems Technology (IWSDS 2018), Singapore, May 14-16, 2018
Akira Hayakawa ,Carl Vogel ,Saturnino Luz and Nick Campbell, Speech Rate Calculations with Short Utterances: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task, LREC, Miyazaki, Japan, ELRA, 2018
Keith Curtis ,Nick Campbell and Gareth Jones, Development of an Annotated Multimodal Dataset for the Investigation of Classification and Summarisation of Presentations using High-Level Paralinguistic Features, LREC, Miyazaki, Japan, ELRA, 2018
Fasih Haider, Hayakawa Akira, Saturnino Luz, Carl Vogel, Nick Campbell, On-Talk and Off-Talk Detection: A Discrete Wavelet Transform Analysis of Electroencephalogram, ICASSP, Montreal, Canada, Thursday, April 19, edited by IEEE , 2018
Emer Gilmartin ,Carl Vogel and Nick Campbell, Chats and Chunks: Annotation and Analysis of Multiparty Long Casual Conversations, European Language Resources Association (ELRA), 2018
Akira Hayakawa, Carl Vogel, Saturnino Luz and Nick Campbell, Speech Rate Calculations with Short Utterances: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task, Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, May 7-12, 2018, edited by Nicoletta Calzolari, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Koiti Hasida, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis, Takenobu Tokunaga , European Language Resources Association (ELRA), 2018, pp3176-3183
Gilmartin, Emer and Brendan Spillane and Christian Saam and Carl Vogel and Nick Campbell and Vincent Wade, Stitching together the conversation - considerations in the design of extended social talk, 9th INTERNATIONAL WORKSHOP ON SPOKEN DIALOGUE SYSTEMS TECHNOLOGY (IWSDS2018), Singapore, May 14-16, 2018, 2018
Volha Petukhova ,Andrei Malchanau ,Youssef Oualil ,Dietrich Klakow ,Saturnino Luz ,Fasih Haider ,Nick Campbell ,Dimitris Koryzis ,Dimitris Spiliotopoulos ,Pierre Albert ,Nicklas Linz and Jan Alexandersson, The Metalogue Debate Trainee Corpus: Data Collection and Annotations, LREC, Miyazaki, Japan, May 7-12 , edited by ELRA , 2018
Utilisation of Linguistic and Paralinguistic Features for Academic Presentation Summarisation in, editor(s)HUCAPP Secretariat , HUCAPP 2018, Springer, 2018, [Keith Curtis, Gareth J. F. Jones and Nick Campbell ]
Laurence Devillers, Sophie Rosset, Guillaume Dubuisson Duplessis, Lucile Bechade, Yücel Yemez, Berker Bekir Turker, Engin Erzin, Metin Sezgin, Kevin El Haddad, Stéphane Dupont, Paul Deleglise, Yannick Esteve, Carole Lailler, Emer Gilmartin and Nick Campbell, Multifaceted Engagement in Social Interaction with a Machine: the JOKER Project, 13th IEEE International Conference on Automatic Face and Gesture Recognition, Xi'an, China, edited by IEEE , 2018
Gilmartin, Emer, Cowan, Ben, Vogel, Carl and Campbell, Nick, Explorations in Multiparty Casual Social Talk and its Relevance for Social Human Machine Dialogue, Journal on Multimodal user Interfaces, 12, (4), 2018, p297-308
Emer Gilmartin ,Christian Saam ,Brendan Spillane ,Maria O'Reilly ,Ketong Su ,Arturo Calvo ,Loredana Cerrato ,Killian Levacher ,Nick Campbell and Vincent Wade, The ADELE Corpus of Dyadic Social Text Conversations:Dialog Act Annotation with ISO 24617-2, LREC, Miyazaki, Japan, 7-12 May 2018, European Language Resources Association (ELRA), 2018
Redefining Concatenative Speech Synthesis for use in Spontaneous Conversational Dialogues; a Study with the GBO Corpus in, editor(s)Maria Gosy , CAPSS, Budapest, Hungary, 2018, [Nick Campbell]
Fasih Haider, Saturnino Luz, Nick Campbell, Improving Response Time of Active Speaker Detection using Visual Prosody Information Prior to Articulation, INTERSPEECH , 2018
Emer Gilmartin, Maria O'Reilly, Christian Saam, Benjamin Cowan, Carl Vogel, Nick Campbell and Vincent Wade, "Silence and overlap in chat and chunk phases of multiparty casual conversation", Speech Prosody 9, Poznan, Poland, 2018
Watching People Talk; How Machines Can Know We Understand Them - a Study of Engagement in a Conversational Corpus in, editor(s)Prof. Dr. Laszlo Hunyadi , The temporal patterns of multimodal communication, Springer, 2018, [Nick Campbell]
Fasih Haider, Hayakawa Akira, Saturnino Luz, Carl Vogel, Nick Campbell, On-Talk and Off-Talk Detection: A Discrete Wavelet Transform Analysis of Electroencephalogram, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2018), Calgary, Alberta, Canada, 15-20 April 2018, edited by Hayes, M. & Ko, H. , 2018, pp960-964
Fasih Haider, Fahim A Salim, Saturnino Luz, Carl Vogel, Owen Conlan, Nick Campbell, Visual, Laughter, Applause and Spoken Expression Features for Predicting Engagement within TED Talks, Interspeech, edited by ISCA , 2017
Keith Curtis, Gareth JF Jones, Nick Campbell, Utilising High-Level Features in Summarisation of Academic Presentations, Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval, ACM International Conference on Multimedia Retrieval, Washington, USA, June 2017, edited by ACM , 2017, pp315 - 321
Fasih Haider, Fahim A. Salim, Saturnino Luz, Carl Vogel, Owen Conlan and Nick Campbell, Visual, Laughter, Applause and Spoken Expression Features for Predicting Engagement Within TED Talks, Proceedings of the 18th Annual Conference of the International Speech Communication Association (INTERSPEECH2017), Stockholm, Sweden, August 20-24, 2017, ISCA, 2017, pp2381-2385
Emer Gilmartin, Brendan Spillane, Maria O'Reilly, Christian Saam, Ketong Su, Killian Levacher, Loredana Cerrato, Benjamin R Cowan, Leigh MH Clark, Arturo Calvo, Nick Campbell, Vincent Wade, Annotation of Greeting and Leave-taking in Social Text Dialogues Using ISO 24617-2, 13th Joint ISO-ACL Workshop on Interoperable Semantic Annotation (isa-13), France, July 2017, 2017
Gilmartin, E. and Spillane, B. and O'Reilly, M. and Su, K. and Saam, C. and Cowan, B.R. and Campbell, N. and Wade, V., Dialog acts in greeting and leavetaking in social talk, 2017, pp29-30
Iacer Calixto, Qun Liu, Nick Campbell, Incorporating Global Visual Features into Attention-Based Neural Machine Translation, ACM, 2017
Keith Curtis, Gareth JF Jones, Nick Campbell, Identification of Emphasised Regions in Audio-Visual Presentations, 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016), Copenhagen, 29,30 September 2016, edited by Linköping University Electronic Press , 2017
Hayakawa Akira, Carl Vogel, Saturnino Luz, Nick Campbell , Speech Rate Comparison when Talking to a System and Talking to a Human: A study from a Speech-to-Speech, Machine Translation mediated Map Task, Interspeech, Stockholm, edited by ISCA , 2017
Yuyun Huang, Emer Gilmartin, Nick Campbell, Speaker Dependency Analysis, Audiovisual Fusion Cues and A Multimodal BLSTM for Conversational Engagement Recognition, Interspeech , Stockholm, Sweden, August 2017, edited by ISCA , 2017
Gilmartin, Emer, Campbell, N., Cowan, B. R., & Vogel, C., Chunks in Multiparty Conversation - Building Blocks for Extended Social Talk., IWSDS, 2017
Engagement in dialogue with social robots in, Dialogues with Social Robots, Singapore, Springer, 2017, pp313-319 , [Loredana Cerrato, Nick Campbell]
Hayakawa Akira, Carl Vogel, Saturnino Luz and Nick Campbell, Speech Rate Comparison When Talking to a System and Talking to a Human: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task, Proceedings of the 18th Annual Conference of the International Speech Communication Association (INTERSPEECH2017), Stockholm, Sweden, August 20-24, 2017, ISCA, 2017, pp3286-3290
Data Collection and Synchronisation: Towards a Multiperspective Multimodal Dialogue System with Metacognitive Abilities in, Dialogues with Social Robots, singapore, springer, 2017, pp245-256 , [Fasih Haider, Saturnino Luz, Nick Campbell]
Calixto, I.; Liu, Q.; Campbell, N., Doubly-Attentive Decoder for Multi-modal Neural Machine Translation., ACL 2017, 2017
Gilmartin, Emer and Spillane, Brendan and O'Reilly, Maria and Saam, Christian and Su, Ketong and Levacher, Killian and Cerrato, Loredana and Cowan, Benjamin R. and Clark, Leigh and Calvo, Arturo and Campbell, Nick and Wade, Vincent, Annotation of greeting, introduction, and leavetaking in dialogues, 2017
Keith Curtis, Gareth JF Jones, Nick Campbell, Speaker impact on audience comprehension for academic presentations, Proceedings of the 18th ACM International Conference on Multimodal Interaction, Washington DC, 2016, pp129-136
Nick Campbell, Machine Processing of Dialogue States; Speculations on Conversational Entropy, International Conference on Speech and Computer, Budapest, Hungary, Springer International Publishing, 2016, pp18-25
Gilmartin, E, Su, K., Cowan, B. R., Huang, Y., & Campbell, N., Collecting a human-machine, human-human, and human-woz comparative social talk corpus., LREC MMC Workshop, Portoroz, Slovenia, 2016
Yuyun Huang, Emer Gilmartin, Benjamin R Cowan, Nick Campbell, A Preliminary Exploration of Group Social Engagement Level Recognition in Multiparty Casual Conversation, International Conference on Speech and Computer, Budappest, Hungary, 2016/8/23, Springer International Publishing, 2016, pp75-83
Attitude recognition of video bloggers using audio-visual descriptors, Fasih Haider, Loredana Sundberg Cerrato, Saturnino Luz, Nick Campbell, Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction Pages, ACM, 2016, pp38-42
Nick Campbell, Modern Japanese Speech Grammar from the Viewpoint of Conversational Robotics (特集 関連領域から照射した現代語文法), 日本語文法 (Japanese Syntax), 16, (2), 2016, p65-76
Gilmartin, E, Su, K., Cowan, B. R., Huang, Y., Elias, C., & Campbell, N., Making Idle Talk: Designing and Implementing Casual Talk, LREC Just Talking workshop, Portoroz, Slovenia, 2016
Hayakawa Akira, Saturnino Luz, Nick Campbell, Talking to a System and Talking to a Human: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task, Interspeech 2016, Seattle, USA, 2016, pp1422-1426
Nick Campbell, CHATR the Corpus; a 20-year-old archive of Concatenative Speech Synthesis., LREC, Slovenia, May 2016, 2016
Fasih Haider, Nick Campbell, Saturnino Luz, Active speaker detection in human machine multiparty dialogue using visual prosody information, Signal and Information Processing (GlobalSIP), 2016 IEEE Global Conference on, 2016
F. Haider, N. Campbell and S. Luz, Active speaker detection in human machine multiparty dialogue using visual prosody information,, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP),, Washington DC, DC, USA,, 2016, pppp. 1207-1211.
Fasih Haider, Loredana Sundberg Cerrato, Saturnino Luz, Nick Campbell, Proceedings of the Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, ICMI 2016, Tokyo, Japan, November , ACM, 2016, pp38 - 42
Yuyun Huang, Emer Gilmartin, Nick Campbell, Conversational engagement recognition using auditory and visual cues, Proceedings of Interspeech, Interspeech , 2016, 2016
Fasih Haider, Loredana Cerrato, Nick Campbell, Saturnino Luz, Presentation quality assessment using acoustic information and hand movements, Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE International Conference on, 2016/3/20, IEEE, 2016, pp2812-2816
Böck, R., Bonin, F., Campbell, N., Poppe, R. (Eds.), Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, Springer, 2016
Noor Alhusna Madzlan, Justine Reverdy, Francesca Bonin, Loredana Cerrato, Nick Campbell, Annotation and multimodal perception of attitudes: A study on video blogs, Proceedings from the 3rd European Symposium on Multimodal Communication, Dublin,, Linköping University Electronic Press, 2016
Ronald Bock, Francesca Bonin, Nick Campbell, Ronald Poppe, Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, Springer, 2015
Laurence Devillers, Sophie Rosset, Guillaume Dubuisson Duplessis, Mohamed A Sehili, Lucile Béchade, Agnes Delaborde, Clément Gossart, Vincent Letard, Fan Yang, Yücel Yemez, Bekir B Türker, Metin Sezgin, Kévin El Haddad, Stéphane Dupont, Daniel Luzzati, Yannick Esteve, Emer Gilmartin, Nick Campbell, Multimodal data collection of human-robot humorous interactions in the joker project, Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on, IEEE, 2015, pp348-354
Madzlan N.A, Huang Y, Campbell N, Automatic classification and prediction of attitudes: Audio - visual analysis of video blogs, 9319, 2015, 96 - 104
Nick Campbell, Engaging Machines, Workshop on Engagement in Social Intelligent Virtual Agents, Delft, Netherlands, 25th August, 2015, Intelligent Virtual Agents (IVA 2015 Satellite Workshop)
Fahim A Salim, Fasih Haider, Owen Conlan, Saturnino Luz, Nick Campbell, Analyzing multimodality of video for user engagement assessment, Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 2015/11/9, ACM, 2015, pp287-290
Böck R, Bonin F, Campbell N, Poppe R, Multimodal analyses enabling artificial agents in human-machine interaction second international workshop, ma3hmi 2014 held in conjunction with interspeech 2014 singapore, singapore, september 14, 2014 revised selected papers, 8757, 2015, -
Annotating the TCD D-ANS Corpus - a multimodal multimedia monolingual biometric corpus of spoken social interaction in, editor(s)Ronald Boeck and Francesca Bonin , Multimodal Analyses Enabling Artificial Agents in Human-Machine Interaction", Heidelberg, Springer Verlag, 2015, [Nick Campbell and Shannon Hennig]
Emotional Speech Synthesis in, editor(s)Rafael Calvo, Sidney D'Mello, Jonathan Gratch, and Arvid Kappas , The Oxford Handbook of Affective Computing , Oxford, Oxford University Publishing, 2015, pp223 - 227, [Felix Burkhardt, Nick Campbell ]
Fasih Haider, Fahim A Salim, Saturnino Luz, Owen Conlan, Nick Campbell, High level visual and paralinguistic features extraction and their correlation with user engagement, Signal Processing and Information Technology (ISSPIT), 2015 IEEE International Symposium on, 2015/12/7, IEEE, 2015, pp326-331
Saturnino Luz, Bridget Kane, Jing Su, Saturnino Luz, Fasih Haider, Loredana Cerrato, Nick Campbell, Fasih Haider, Saturnino Luz, Nick Campbell, Bridget Kane, Saturnino Luz, Bridget Kane, Saturnino Luz, Su Jing, Saturnino Luz, Saturnino Luz, Perspectives on Intelligent Systems Support for Multidisciplinary Medical Teams, AAAI Spring Symposium Series, 27, Springer International Publishing, 2015, pp87-109
Loredana Cerrato, Hayakawa Akira, Nick Campbell, Saturnino Luz, A Speech-to-Speech, Machine Translation Mediated Map Task: An Exploratory Study, International Workshop on Future and Emergent Trends in Language Technology, 2015/11/19, Springer International Publishing, 2015, pp53-64
Nick Campbell, Interactive Dialogue Systems: Human-Machine Partnerships, International Symposium on Companion Technology, Ulm, Germany, 25 September, 2015, Transregional Collaborative Research Centre SFB/TRR 62 "Companion-Technology for Cognitive Technical Systems"
Yuyun, Huang, Christy Elias., Cabral, João P. Cabral, Atul Nautiyal, Christian Saam and Nick Campbell, Towards Classification of Engagement in Human Interaction with Talking Robots, Communications in Computer and Information Science , 17th International Conference on Human-Computer Interaction, Los Angeles, USA, 2-7 August 2015, 528, Springer, 2015, pp741 - 746
Keith Curtis, Gareth JF Jones, Nick Campbell, Effects of good speaking techniques on audience engagement, Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, 2015/11/9, 2015, pp35-42
Hayakawa Akira, Fasih Haider, Loredana Cerrato, Nick Campbell, Saturnino Luz, Detection of cognitive states and their correlation to speech recognition performance in speech-to-speech machine translation systems., Interspeech 2015, 2015, pp2539-2543
Expressivity in Interactive Speech Synthesis; Some Paralinguistic and Nonlinguistic Issues of Speech Prosody for Conversational Dialogue Systems in, editor(s)K. Hirose, J. Tao , Speech Prosody in Speech Synthesis: Modeling and generation of prosody for high quality and flexible speech synthesis, 2015, pp97 - 107, [Nick Campbell and Ya Li]
Emer Gilmartin, Carl Vogel, Nick Campbell, Disfluency in Multiparty Social Talk, Disfluency in Spontaneous Speech 2015 , Edinburgh, UK, 8-9 August, 2015, 2015
Nick Campbell, Human-robot speech communication, interaction, and co-vocalization systems, International Workshop on Speech Robotics, Dresden, Germany, September 11, 2015, 2015, Interspeech (Satellite Workshop)
Francesca Bonin, Nick Campbell and Carl Vogel, The discourse value of social signals at topic change moments, Proceedings of the 16th Annual Conference of the International Speech Communication Association (INTERSPEECH 2015), Dresden, Germany, September 6-10, 2015, 2015, pp1967-1971
Fahim A Salim, Killian Levacher, Owen Conlan, Nick Campbell, Examining Multimodal Characteristics of Video to Understand User Engagement., UMAP Workshops, 2015
Ya Li, Nick Campbell, JianHua Tao, Voice Quality: not only about "you" but also about "your interlocutor", ICASSP, Canada, edited by IEEE , 2015
Emer Gilmartin, Francesca Bonin, Loredana Cerrato, Carl Vogel, Nick Campbell, Nick Campbell Nick Campbell [PDF] from researchgate.net What's the Game and Who's Got the Ball? Genre in Spoken Interaction, 2015 AAAI Spring Symposium Series, 2015/3/13, AAAI, 2015
Matej Rojc, Niick Campbell, Coverbal Synchrony in Human-Machine Interaction, Boca Raton, CRC Press, 2014, 1 - 434pp
Nick Campbell, Introduction to the work of the Speech Communication Lab at TCD, Project Kickoff, Nanjing Normal University, China, June 6th, 2014, Prof Gu Wentao
Bonin, Francesca, Nick Campbell and Carl Vogel, Time for laughter, Knowledge-Based Systems, 71, 2014, p15-24
Shannon Hennig, Ryad Chellali and Nick Campbell , The D-ANS corpus: the Dublin-Autonomous Nervous System corpus of biosignal and multimodal recordings of conversational speech , The 9th edition of the Language Resources and Evaluation Conference, Reykjavik, Iceland, 26-31 May, ELRA, 2014
Poppe R, Böck R, Bonin F, Campbell N, de Kok I, Traum D, From multimodal analysis to real-time interactions with virtual agents, Journal on Multimodal User Interfaces, 8, (1), 2014, p1 - 3
Shannon Hennig and Nick Campbell, D-ANS, SFI-FastNet, 2014
Francesca Bonin, Emer Gilmartin, Carl Vogel, Nick Campbell, Topics for the future: Genre differentiation, annotation and linguistic content integration in interaction analysis, Roadmapping the Future of Multimodal Interaction Research including Business Opportunities and Challenges, Istanbul, Turkey , edited by ICMI 2014 , 2014
Nick Campbell (ed.), 7th International Conference on Speech Prosody, Proceedings of Speech Prosody 2014, Ireland, 20/05/14, 2014
Martin Heckmann, Murtaza Bulut, Carlos Busso, Nick Campbell, Laurence Devillers, Anna Esposito, Sungbok Lee, Roger Moore, Mark Sandler, Khiet Truong, and Rita Singh , Interaction and Affect, Computational Audio Analysis, Germany, 2014
Shannon Hennig, Ryad Chellali, Nick Campbell, The D-ANS Corpus: the Dublin Autonomous Nervous Syystem Corpus of Biosignal and Multimodal Recordings of Conversational Speech, LREC 2014, Reykjavik, May 28-30 2014, edited by ELRA , 2014
Nick Campbell, Understanding Machines, Mayo 2040 Science Week, GMIT Castlebar, Nov 12th, 2014, SFI/GMIT
More Than Just Words: Building a Chatty Robot in, Joseph Mariani, Sophie Rosset, Martine Garnier-Rizet, Laurence Devillers , Natural Interaction with Robots, Knowbots and Smartphones, New York, Springer, 2014, pp179 - 185, [Emer Gilmartin, Nick Campbell]
Hayakawa akira, Saturnino Luz, Nick Campbell , Interlingual MapTask Corpus Collection, SICSA - Speech Technology and Human Computer Interaction Workshop, United Kingdom, 27/03/2014, 2014
Bonin, Francesca, Emer Gilmartin, Carl Vogel and Nick Campbell, Topics for the Future: Genre Differentiation, Annotation, and Linguistic Content Integration in Interaction Analysis, RFMIR '14: Proceedings of the 2014 Workshop on Roadmapping the Future of Multimodal Interaction Research Including Business Opportunities and Challenges, Istanbul, Turkey, edited by Heylen, Dirk and Alessandro Vinciarelli , ACM, 2014, pp5-8
Francesca Bonin, Carl Vogel and Nick Campbell, Social sequence analysis: temporal sequences in interactional conversations , 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom), 5-7 Nov. 2014 , IEEE, 2014, pp403-406
Noor Alhusna Madzlan, JingGuang Han, Francesca Bonin, Nick Campbell, Automatic Recognition of Attitudes in Video Blogs - Prosodic and Visual Feature Analysis, interspeech 2014, Singapore, Sept 2014, edited by ISCA , 2014
FastNet Lab, 'Humanising Human-Machine Interaction', CNGL, Croke Park, 2014, -
Francesca Bonin, Nick Campbell, Carl Vogel, Time for Laughter, Knowledge-based systems, 71, 2014, p15 - 24
Nick Campbell, An introduction to the TCD D_ANS Corpus - a multimodal multimedia biometric corpus of spoken social interaction, MA3HMI, Singapore, Sept 14th, 2014, Interspeech
Nick Campbell, Are Smart Cities Making us Dumb?, Innovation Academy Panel, Dublin (Foster Place), Nov 5th , 2014
Céline De Looze, Stefan Scherer, Brian Vaughan, Nick Campbell, Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction, Speech Communication, 58, (1), 2014, p11 - 34
Journal of Multimodal User Interfaces, (2014), Poppe, Ronald, Boeck, Ronald, Bonin, Francesca, Campbell, Nick, de Kok, Iwan, Traum, David , [eds.]
Campbell, N., Cabral, J., Kenny, E., & Gilmartin, E. , Multimodal Interactive Language Learning Agent., eNTERFACE 2014, Spain, 04/07/14, 2014
Nick Campbell, Beyond D64 - A fresh look at multimodal dialogue systems from the FastNet point of view - how we are incorporating different modalities into an interactive speech synthesis system., Multimodality- interdisciplinary perspectives: new questions and new methodologies, in Paris, at INALCO, June the 6th., 2014, UMR SFL - Université Paris 8 et CNRS
João P. Cabral, Nick Campbell, Sree Ganesh, Mina Kheirkhah, Emer Gilmartin, Fasih Haider, Eamonn Kenny, Andrew Murphy, Neasa Ní, Chiaráin, Thomas Pellegrini and Odei Rey Orozko, MILLA: A Multimodal Interactive Language Learning Agent, SemDial 2014, Edinburgh, United Kingdom, September 1st-3rd, 2014
Speech Technology and Conversational Activity in Human-Macjube Interaction in, editor(s)Rojc & Campbell , Coverbal Synchrony in Human-Machine Interaction, USA, CRC Presss, 2014, pp1 - 16, [Nick Campbell]
Hayakawa Akira, Nick Campbell, Saturnino Luz, 'Interlingual Map Task Corpus Collection ', Interspeech 2014, Singapore, 2014, -
SCL, CLCS, 'Robots with Personality', Dublin Research Night, Speech Communication Lab, 2014, -
Catharine Oertel, Fred Cummins, Jens Edlund, Petra Wagner, Nick Campbell, D64: a corpus of richly recorded conversational interaction, Journal on Multimodal User Interfaces, 7, (1-2), 2013, p19 - 28
Gilmartin, Emer and Francesca Bonin and Carl Vogel and Nick Campbell, Exploring the Role of Laughter in Multiparty Conversation, DialDam: Proceedings of the 17th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL2013), Amsterdam, December 16-18, 2013, edited by Raquel Fernandez and Amy Isard , ILLC, 2013, pp191-193
An acoustic analysis of 7395 dog barks in, editor(s)Rudiger Hoffman , Festschrift , 2013, [Nick Campbell ]
Francesca Bonin, Celine De Looze, Sucheta Ghosh, Emer Gilmartin, Carl Vogel, Anna Polychroniou, Hugues Salamin, Alessandro Vinciarelli and Nick Campbell , Investigating fine temporal dynamics of prosodic and lexical accommodation, 14th Annual Conference of the International Speech Communication Association, Lyon, INTERSPEECH, 2013, pp539-543
De Looze, C. and Scherer, S. and Vaughan, B. and Campbell, N., Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction, Speech Communication, 58, 2013, p11 - 34
Emer Gilmartin 1 , Shannon Hennig, Ryad Chellali, Nick Campbell, Exploring Sounded and Silent Laughter in Multiparty Task-based and Social Interaction - Audio, Video and Biometric Signals, 1st European Symposium on Multimodal Communication, University of Malta, Valletta, October 17-18, 2013, pp17 - 27
Hiroki Tanaka Nick Campbell, Classification of Social Laughter in Natural Conversational Speech, Speech Communication, Academic Press, 28, (1), 2013, p314 - 325
Gilmartin, Emer and Francesca Bonin and Carl Vogel and Nick Campbell, Laughter and Topic Transition in Multiparty Conversation, Proceedings of the SIGDIAL 2013 Conference, Metz, France, Association for Computational Linguistics, 2013, pp304-308
Emer Gilmartin, Francesca Bonin, Carl Vogel and Nick Campbell, Exploring the Role of Laughter in Multiparty Conversation, Proceedings (SemDial), semdial 2013 - DialDam, Amsterdam, 18-20 December 2013, 2013
Matej Rojc & Nick Campbell (eds), Speech, Gaze, and Affect: concepts of reactive and natural human-machine interaction techniques employing ECAs with personality, 1, Jersey, Science Publishers, 2013
Oertel, C., De Looze, C., Campbell, N. and Wagner, P., Identification of cues for the automatic detection of hotspots in natural conversation. , SSPnet-COST 2102 PINK International Conference., Budapest, Hungary, May, 2011, 2012
Emer Gilmartin, Céline De Looze, Nick Campbell, Priming, Timing, and the Phatic Component in Machine-Mediated Dialogue, The Listening Talker (LISTA 2012), Edinburgh, Scotland, 2-3 May, edited by ISCA , 2012
Francesca Bonin, Ronald Bock, Nick Campbell, How Do We React to Context? Annotation of Individual and Group Engagement in a Video Corpus, Privacy, Security, Risk and Trust (PASSAT), 2012 International Conference on and 2012 International Confernece on Social Computing (SocialCom), Amsterdam, September 3-5, IEEE, 2012, pp899 - 903
Conversational Involvement and Synchronous Nonverbal Behaviour in, Esposito, A., Vinciarelli, A., Hoffmann, R., & Müller, V. (Eds.) , Cognitive Behavioural Systems, Springer, 2012, pp343 - 352, [Altmann, U., Oertel, C., & Campbell, N.]
Hiroki Tanaka, Sakriani Sakti, Graham Neubig, Tomoki Toda, Nick Campbell, Satoshi Nakamura, Non-verbal cognitive skills and autistic conditions: An analysis and training tool, IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), 2012, Kosice, Slovakia, 2nd-3rd December, 2012, pp41 - 46
Carlos Toshinori Ishi, Nick Campbell, Analysis of acoustic-prosodic features of spontaneous expressive speech, Revista de Estudos da Linguagem, 12, (2), 2012, p38 - 49
Gilmartin, E., Campbell, N. , More than just words: Building a chatty robot, International Workshop on Spoken Dialog Systems (IWSDS 2012), 28 Nov 2012 - 30 Nov, 2012
Terry Barry(ed.), Timber Castles, Newsletter of Society for Medieval Archaeology, UCL London, (48), 13 October 2012, Society for medieval Archaeology, 2012, 3 p
Stefan Scherer, Georg Layher, John Kane, Heiko Neumann and Nick Campbell, An audiovisual political speech analysis incorporating eye-tracking and perception data, Conference on Language Resources and Evaluation (LREC'12), Istanbul, Turkey, 21-27 May 2012, 2012
Han, J., Gilmartin, E., De Looze, C., Vaughan, B., & Nick Campbell, The Herme Database of Spontaneous Multimodal Human-‐Robot Dialogues, Conference on Language Resources and Evaluation (LREC'12), Istanbul, Turkey, 21-27 May 2012 , edited by ELRA , 2012
De Looze, C., Scherer, S., Vaughan, B. & Campbell, N., Vers une mesure automatique de l'adaptation prosodique en interaction conversationnelle, 29eme Journees d'Etude sur la Parole , Grenoble, France, JEP 2012 , 2012
Vaughan, B., Han, G. J., Gilmartin, E & Campbell, N., Designing and Implementing a Platform for Collecting Multi-Modal Data of Human-Robot Interactio, Acta Polytechnica Hungarica, 9, (1), 2012, p7 - 17
Han, J., Campbell, N., Jokinen, K., Wilcock, G., Investigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot, Proceedingsof 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2012 , 3rd IEEE International Conference on Cognitive Infocommunications, CogInfoCom , Kosice; Slovakia, 2-5 Dec, 2012, 679-683
]Francesca Bonin, Ronald Böck and Nick Campbell,, How do we react to context? Annotation of individual and group engagement in a video corpus., Proceedings of the CBAR Workshop, ASE/IEEE International Conference on Social Computing , Amsterdam, The Netherlands, September 2012, 2012, pp899 - 903
Francesca Bonin, Nick Campbell, Carl Vogel, Temporal distribution of laughter in conversation, Third Interdisciplinary Workshop on Laughter and other Non-‐Verbal Vocalisations in Speech, Dublin, Ireland, October 26-27, 2012, 2012
Ronald Böck, Francesca Bonin, Nick Campbell, Jens Edlund, Iwan Kok, Ronald Poppe, David Traum(ed.), Joint Proceedings of the IVA 2012 Workshops, USA, (ISBN: 9783940961839), September 2012, 2012
JingGuang Han, Nick Campbell, Kristiina Jokinen, Graham Wilcock, nvestigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot, IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), 2012, Kosice, Slovakia, 2nd-3rd December, 2012, pp679 - 683
D. Gibbon, D. Hirst, and N. Campbell, Rhythm, Melody, and Harmony in Speech, Poznan, Polish Phonetic Association, 2012
Bonin, Francesca and Nick Campbell and Carl Vogel, Laughter and Topic Changes: Temporal Distribution and Information Flow, 3rd IEEE Conference on Cognitive Infocommunications, Kosice, Slovakia, December 2-5, 2012, IEEE, 2012, pp53 - 58
Laurence Devillers, Nick Campbell, Special issue of computer speech and language on "affective speech in real-life interactions" , Computer Speech and Language, 25, (1), 2011, p1 - 3
Oertel, Scherer & Campbell, On the use of multimodal cues for the prediction of degrees of involvement in spontaneous conversation., Proceedings of the Annual Conference of the International Speech Communication Association, 12th Annual Conference of the International Speech Communication Association, Florence, Italy, 27 -31 Aug, edited by ISCA , Interspeech, 2011, pp1541-1544
Towards the Automatic Detection of Involvement in Conversation in, editor(s)Anna Esposito, Alessandro Vinciarelli, Klara Vicsi, Catherine Pelachaud, Anton Nijholt , Analysis of Verbal and Nonverbal Communication and Enactment, Berlin/Heidelberg, Springer, 2011, pp163 - 170, [Catharine Oertel, Celine de Looze, Stefan Scherer, Andreas Windmann, Petra Wagner, Nick Campbell]
Nick Campbell, 'D64 Speech Corpus', Speech Communication Lab, Dublin, speech-data.jp/nick/mmx/d64.html, 2011, -
Nick Campbell, John Kane and Helena Moniz, Processing 'yup!' and other short utterances in interactive speech, Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing , ICASSP - , Prague, May , IEEE, 2011, pp5832 - 5835
Nick Campbell, Talking with robots, Advances in speech technologies, IRCAM, Paris, France, 24th June , 2011, IRCAM
On the fragmented nature of spoken interaction and an attempt to model its apparent regularities in, editor(s)Marciej Karpinski , Gesture & Speech in Interaction, 2011, [Nick Campbell & Stefan Scherer]
Tanaka Hiroki & Nick Campbell, Acoustic features of four types of laughter in natural conversational speech, ICPhS, Hong Kong, China, 17-21 August 2011, 2011
Nick Campbell, Nordic symposium in multimodal communications, Helsinki, 27-28 May, 2011, CICERO Learning
FastNet Project, 'HERME', Speech Communication Lab, Science Gallery, TCD, 2011, -
Computer Speech and Language, Volume 25, Issue 1, (2011), 1 - 126p, Laurence Devillers, Nick Campbell, [eds.]
Han, Dalton, Vaughan, Oertel, Dougherty, De Looze & Campbell, Collecting multi-modal data of human-robot interaction, Proceedings of 2nd International Conference on Cognitive Infocommunications, The 2nd International Conference on Cognitive Infocommunications (CogInfoCom2011) , Budapest, Hungary, 7-9 July, 2011, ppArticle number 5999468
Nick Campbell, Talking with people (and robots); the nonverbal aspects, International workshop on voice and speech processing in social interaction, University of Glasgow, 18-19 April, 2011, UG Institute of Neuroscience & Psychology
CLCS Speech Communication Lab (all members), Herme, the chat robot, 2011, -
De Looze, C., Oertel, C., Rauzy, S. & Campbell, N., Measuring dynamics of mimicry by means of prosodic cues in conversational speech., The 17th International Congress of Phonetic Sciences (ICPhS XVII) , Hong Kong, China, August 17-21, 2011
Esposito, Anna, Campbell, Nick, Vogel, Carl., Hussain, Amir, Nijholt, Anton (eds.), Development of Multimodal Interfaces; Active Listening & Synchrony, Berlin, Springer, 2010, XVII, 446pp
Tools and resources for visualising conversational speech interaction in, editor(s)Kipp, Martin, Paggio, and Heylen , Multimodal Corpora; from Models of Natural Interaction to Systems and Applications - Lecture Notes in Computer Science, Berlin, Springer Verlag, 2010, pp176 - 188, [Nick Campbell]
Nick Campbell & Akiko Tabata, A software toolkit for viewing annotated multimodal data interactively over the web, Proc Language Resources & Evaluation Conference, Language Resources & Evaluation Conference, Malta, May 2010, edited by ELRA , 2010
Nick Campbell, Processing 'niblets' for conversational speech interaction/, 2010, COST 2102 International Conference, Budapest, Hungary, 7-11 September, 2010
Helena Moniz, John Kane, Nick Campbell, and Isabel Trancoso, Towards a Description of the Dynamics of Spontaneous Speech based on Axoustic-Prosodic Properties of Fragmentary Discursive Events, COST 2102 International Conference, Budapest, Hungary, 7-11 September, 2010
Nick Campbell & Stefan Scherer, Comparing Measures of Synchrony and Alignment in Dialogue Speech Timing with respect to Turn-taking Activity, 11th Annual Conference of the International Speech Communication Association, Tokyo, 26-30 September , ISCA, 2010, pp2546-2549
Oertel, C., Cummins, R., Campbell, N., Edlund, J, & Wagner. P., , D64: a corpus of richly recorded conversational interaction, Language Resources and Evaluation Conference, Malta, May, 2010
Nick Campbell, MMX - processing MultiModal eXpressive interaction, ЧЕТВЁРТАЯ МЕЖДУНАРОДНАЯ КОНФЕРЕНЦИЯ ПО КОГНИТИВНОЙ НАУКЕ, THE FOURTH INTERNATIONAL CONFERENCE ON COGNITIVE SCIENCE, Tomsk, Russia, June 22-26, 2010, Volume 1, (ISBN 5-94621-316-4), THE INTERREGIONAL ASSOCIATION FOR COGNITIVE STUDIES, 2010, pp29 - 39
Nick Campbell, Workshop on Preparation for a Digital Corpus of Japanese Everyday Talk, Alberta, Canada, June 11-14 , 2010, University of Alberta
Nick Campbell, Multimodal Expressivity (Conversation as a prelinguistic social activity), Hungarian Academy of Science, 27th July, 2010, SZTAKI
Nick Campbell, Multimodal Expressive; conversation as a pre‐ linguistic social activity, 3rd COST 2102 INTERNATIONAL TRAINING SCHOOL on Toward Autonomous, Adaptive, and Context‐Aware Multimodal Interfaces: Theoretical and Practical Issues, Caserta Italy, 15‐19 March, 2010, COST 2102
STEFAN SCHERER1, MICHAEL GLODEK, FRIEDHELM SCHWENKER Ulm University NICK CAMPBELL Trinity College Dublin and GU ̈NTHER PALM Ulm University, Spotting laughter in naturalistic multiparty conversations: A comparison of automatic online and offline approaches using audiovisual data, ACM Transactions on Interactive Intelligent Systems., 2010
Nick Campbell, Speech Technology and Empathy in Conversational Interaction, Oriental COCOSDA, Kathmandu, India, November 2010, edited by IEEE , 2010
Nick Campbell, Language Resources of the Future (a speech-based position paper), FLaReNet Forum, Barcelona, 2010, FLaReNet
Expressive Speech Processing and Prosody Engineering: An Illustrated Essay on the Fragmented Nature of Real Interactive Speech in, editor(s)FangChen ·KristiinaJokinen , Speech Technology Theory and Applications, New York Dordrech tHeidelberg London, Springer, 2010, pp105 - 120, [Nick Campbell]
Nick Campbell, Automatic detection of social aspects of interactive spoken conversation, CogInfoCom, Tokyo, Japan, Nov 28-30 , 2010, 1st International Workshop on Cognitive Infocommunications
Nick Campbell, The expanding role of prosody in speech communication technology, DIAHOLMIA, KTH, Sweden, June 2009, 2009
Preface in, editor(s)Raquel de Pedro Ricoy, Isabelle Perez and Christine Wilson , Interpreting and Translating in Public Service Settings Policy, Practice, Pedagogy, Manchester, St. Jerome, 2009, ppvii - viii, [Lorraine Leeson ]
Nick Campbell, An Audio-Visual Approach to Measuring Discourse Synchrony in Multimodal Conversation Data, Interspeech 2009, Brighton, England, September 2009, edited by ISCA , 2009
Scherer, S. and Schwenker, F. and Campbell, W. N. and Palm, G, Multimodal laughter detection in natural discourses, 3rd International Workshop on Human-Centered Robotic Systems, Munich, 2009, pp111 - 121
Nick Campbell, Tracking the second channel of information in speech, IEEE International workshop on Social Signal Processing, Amsterdam, September , 2009
Multimodal Laughter Detection in Natural Discourses in, editor(s)Helge Ritter, Gerhard Sagerer, Rüdiger Dillmann and Martin Buss , HUMAN CENTERED ROBOT SYSTEMS, Cognitive Systems Monographs,, Springer Verlag, 2009, pp111 - 120, [Stefan Scherer, Friedhelm Schwenker, Nick Campbell and Günther Palm]
Expressive/Affective Speech Synthesis in, editor(s)Benesty, Jacob; Sondhi, M. M.; Huang, Yiteng , Springer Handbook of Speech Processing, Berlin, Heidelberg, Springer Verlag, 2008, [Nick Campbell]
Individual Traits of Speaking Style and Speech Rhythm in a Spoken Discourse in, editor(s)Esposito et al , Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction, Berlin, Springer Verlag, 2008, pp107 - 120, [Nick Campbell]
On the Use of Nonverbal Speech Sounds in Human Communication in, editor(s)Esposito et al , Verbal and Nonverbal Communication Behavior, Berlin, Heidelberg, Springer, 2007, pp117 - 128, [Nick Campbell]
Robust real time face tracking for the analysis of human behavior in, Machine Learning & Multimodal Interaction, Berlin, Heidelberg, 2007, pp1 - 15, [Nick Campbell, Damien Douxchamps]
Nick Campbell, Differences in the speaking styles of a Japanese male according to interlocutor; showing the effects of affect in conversational speech, International Journal of Computational Linguistics and Chinese Language Processing, 11, (1), 2007, p1 - 16
How Speech Encodes Affect and Discourse Information - Conversational Gestures, in, editor(s)Esposito et al , NATO Security through Science, Amsterdam, IOS Press, 2007, pp103 - 114, [Nick Campbell]
Nick Campbell, The Role and Use of Speech Gestures in Discourse, Archives of Acoustics, 32, (4), 2007, p803 - 814
Nick Campbell, Conversational Speech Synthesis and the need for some laughter, IEEE Transactions on Audio, Speech, and Language Processing,, 14, (4), 2006, p1171 - 1178
Nick Campbell , Getting to the heart of the matter; speech as the expression of affect; rather than just text or language, Language Resources and Evaluation, 39, (1), 2005, p109 - 118
Nick Campbell, Developments in Corpus-Based Speech Synthesis; Approaching Natural Conversational Speech, IEICE Transactions on Information & Systems, E88-D, (3), 2005, p376 - 383
Campbell, N., Erickson,D.,, What do people hear? - a study of the perception of non-verbal affective information in conversational speech, Journal of the Phonetic Society of Japan, 8, (1), 2004, p9 - 28
Nick Campbell, Databases of Expressive Speech, Journal of Chinese Language and Computing, 14, (4), 2004, p295 - 305
Speech Synthesis in, Encyclopaedia of Artificial Intelligence, Tokyo, Kyoritu Syuppan, 2003, [Nick Campbell]
Journal of the Phonetic Society of Japan, Special Issue on Phonetics and Speech Technology, 7, 3, (2003), Nick Campbell, [eds.]
Iida, A., Higuchi, F., Campbell,N., Yasumura, M. , A Corpus-based Speech Synthesis System with Emotion, Speech Communication, 40, (1), 2003, p161 - 187
Speech Communication, Special Issue on Speech & Emotion, 40, 1-2, (2003), Nick Campbell, [eds.]
Ishi, C.T., Mokhtari, P., Campbell, N., , Perceptually-related acoustic-prosodic features of phrase finals in spontaneous speech, Eurospeech 2003, 2003, pp405 - 408
Akemi Iida, Nick Campbell, Speech database Design for a Concatenative Text-to-Speech Synthesis System for Individuals with Communicative Disorders, International Journal of Speech Technology, 6, 2003, p574 - 582
Ishi, C.T., Campbell, N. , Analysis of Acoustic-Prosodic Features of Spontaneous Expressive Speech, 1st International Congress of Phonetics and Phonology, Rio de Janeiro, 2002, pp102 - 110
Nick Campbell, Recording Techniques for Capturing Natural Every-Day Speech, Language Resources & Evaluation Conference, Gran Canarias, 2002, ELRA, 2002
M. Mashimo, T. Toda, H. Kawanami, K. Shikano, N. Campbell, Cross-language Voice Conversion Using a Bilingual Database, Journal of the Information Processing Society of Japan, 43, (7), 2002, p2177 - 2175
IEEE Trans Speech & Audio Processing, Special Issue on Speech Synthesis, (2001), Nick Campbell, [eds.]
Sagisaka Y., Campbell N, Description, Acquisition and Evaluation of Rules and Data for Speech Synthesis, IEICE TRANS. INF.& SYST.,, J83-D-II, (11), 2000, p2068 - 2076
A. Iida, N. Campbell, M. Yasumura, Corpus-based Speech Synthesis for ALS patients to assist their communication, Technical Report of the IEICE, 33, (1), 2000, p37 - 42
Nick Campbell, Advances in Speech Synthesis, springer, 1999
Timing in Speech: a multi-level process in, editor(s)Horne et al , Prosody; Theory and Experimen, Dordrecht, Kluwer Academic, 1999, [Nick Campbell]
Information Transfer in Example-Based Speech Translation in, Automated Spoken Dialogue Systems, Boston, MIT Press, 1999, [N.Campbell & H. Iida,]
Speech Synthesis in, editor(s)John G. Webster, Ph.D. , The Wiley Encyclopedia of Electrical and Electronics Engineering, New York, Wiley, 1999, [Nick Campbell]
Synthesising Spontaneous Speech in, editor(s)Sagisaka, Campbell & Higuchi , Computing Prosody, Berlin, Springer Verlag, 1997, [Nick Campbell]
Nich Campbell, Computing Prosody, Springer Verlag, 1994
Nick Campbell, Automatic Detection of Prosodic Boundaries in Speech, Speech Communication, 13, (1), 1993, p343 - 354
W. N. Campbell & S. D. Isard, Segment Durations in a Syllable Frame, Journal of Phonetics, 19, (1), 1991, p37 - 48
Syllable-Based Segmental Duration, in, editor(s)eds. G. Bailly & C. Benoit , Talking Machines, Amsterdam, Elsevier Science, 1991, [Nick Campbell]
Non-Peer-Reviewed Publications
nick campbell, Multimodal Agents for Aging and Multicultural Societies, Shonan Meeting on Multimodal Agents for Aging and Multicultural Societies, Tokyo, Japan, Oct 26-Nov 1st, 2018, NII
Nick Campbell, Corpora of Spoken Interaction - past, present, and future?, Institute of Phonetics Lecture Series, Beijing, China, May 24th, 2018, Chinese Academy of Social Sciences
Nick Campbell, Watching people talk - spoken interaction between human and machines, Advanced Lecture Series in Pattern Recognition, Beijing, China, May 22, 2018, Chinese Academy of Science
Nick Campbell, Paralinguistic & non-verbal information in spoken dialogue system processing, Keihanna Interlab Forum, Kyoto, Japan, June 27, 2018, International Institute for Advanced Studies
Nick Campbell, Towards Interactive Speech Synthesis; an example of robot-human dialogues in a spontaneous environment, CAPSS , Budapest, 15 May, 2017, Hungarian Academy of Science
Nick Campbell, Corpora of Spoken Interaction; Watching People Talk, Oriental COCOSDA 2017, Seoul, Korea, Nov 2nd, 2017
I Calixto, Q Liu, N Campbell , Multilingual Multi-modal Embeddings for Natural Language Processing , arXiv preprint arXiv:1702.0110, 2017
Nick Campbell, Synthesising colloquial speech with the GBO Corpus, Kaken Onseigengo, Kyoto, Japan, July 15, 2017
Nick Campbell, Specom , Budappest, Hungary, 2016
ISCA, MA3HMI 2014 workshop,, September 14, In: Interspeech 2014,, 2014, Singapore
Joao Cabral, Nick Campbell, Shree Ganesh, Emer Gilmartin, Fasih Haider, Eamon Kenny, Mina Kheirkhah, Andy Murphy, Neasa Ní Chiaráin, Thomas Pellegrini, Odei Rey Orosko, 'MILLA - A Multimodal Interactive Language Agent', eNTERFACE, 2014, -
Nick Campbell, "D-ANS corpus: a new corpus of multimodal biometric spontaneous speech recordings" , Meeting of Kaken A, Osaka, Japan, Dec 6th, 2014, Kobe University
nick campbell, An introduction to the TCD D-ANS Corpus - a multimodal multimedia monolingual biometric corpus of spoken social interaction !, Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction, Singapore, 14 sept , 2014, ISCA Satellite Workshop
ISCA SproSIG, Social and Linguistic Speech Prosody, 20-23 May 2014, In:SP7: Speech Prosody 2014, 2014, TCD Burke Theatre, Nick Campbell, ISCA/SproSIG
Nick Campbell, An introduction to the TCD Biometric corpus of multimodal spoken interaction - D-ANS, Kaken Research Meeting, Osaka, Japan, 6th Dec. , 2014, Kobe University
Speech Communication Lab, TCD, Laughter and other Non-Verbal Vocalisations in Speech, October 26-27, 2012, In:Interdisciplinary Workshop, 2012, Dublin
N. Campbell, Introduction to the Speech Communication Lab at Trinity College Dublin, UK & IE Speech Meeting,, Birmingham,, Dec 17-18, 2012, 2012
IVA (Intelligent Virtual Agenms), IVA 2012 workshops: MA3 2012 and RCVA 2012, Septemner 15, In:International Workshop on Multimodal Analyses for Human Machine Interaction, 2012, Santa Cruz, Böck, Bonin, Campbell, Edlund, De Kok, Poppe, Traum
N. Campbell, Social aspects and speechability in CogInfoCom systems, CogInfoCom 2012, Kosice, Slovakia, 2nd December, 2012, Hungarian Academy of Sciences
Nick Campbell, Managing contact in interactive speech synthesis, talk series, Imperial College London, 5th July, 2011
Nick Campbell, Geza Nemeth, Adam Miklosi, Analysis of 7395 dog barks, 2010
Nick Campbell, On the continued use of prosody in speech technology, ICCS/HCRC Seminar Series, Edinburgh University, 25 Feb, 2010
Cognitive Processing - International Quarterly of Cognitive Science, Springer, [Advisory Editor], 2009
Computer Speech and Language , Elsevier, [Guest Editor], 2008-2011
Nick Campbell, AAAC Conference on Affective Computing and Intelligent Interaction Asia, May 20 -22, 2018, Beijing, China
Research Expertise
Description
My background is in experimental psychology and linguistics, but most of my experience is in speech technology. I prefer corpus-based approaches and have pioneered advanced (and paradigm-shifting) methods of speech synthesis and natural conversational speech collection in a multimodal environment. My principal interest is in speech prosody, extending this research to social interaction to show how the voice is used in discourse to express personal relations as well as propositional content. Most of my previous work has used speech materials collected in Japan, and I am happy now to be in Ireland where I can confirm the universality of my previous findings - both for Irish and for Hiberno-English. Ultimately, I am working to produce a friendlier speech-based human-machine interface for web-based information, customer-services, games, and robotics, while trying to understand how humans perform such often perfect communication.Projects
- Title
- FastNet
- Summary
- Focus on Actions in Social Talk; Network-Enabling Technology (Lead PI 5 years)
- Funding Agency
- SFI
- Date From
- April 1st 2010
- Date To
- March 31st 2015
- Title
- CNGL-II
- Summary
- Theme Leader - Delivery & Interaction 10meuro (approx) for 30 months
- Funding Agency
- SFI
- Date From
- Jan 2012
- Date To
- Sept 2015
- Title
- METALOGUE
- Summary
- Multiperspective Multimodal Dialogue: dialogue system with metacognitive abilities The goal of METALOGUE is to produce a multimodal dialogue system that is able to implement an interactive behaviour that seems natural to users and is flexible enough to exploit the full potential of multimodal interaction. It will be achieved by understanding, controlling and manipulating system's own and users' cognitive processes. The new dialogue manager will incorporate a cognitive model based on metacognitive skills that will enable planning and deployment of appropriate dialogue strategies. The system will be able to monitor both its own and users' interactive performance, reason about the dialogue progress, guess the users' knowledge and intentions, and thereby adapt and regulate the dialogue behaviour over time. The metacognitive capabilities of the METALOGUE system will be based on a state-of-the-art approach incorporating multitasking and transfer of knowledge among skills. The models will be implemented in ACT-R, providing a general framework of metacognitive skills. http://cordis.europa.eu/projects/rcn/110655_en.html
- Funding Agency
- EU
- Date From
- Nov 2013
- Date To
- Oct 2016
- Title
- JOKER
- Summary
- JOKe and Empathy of a Robot/ECA: Towards social and affective relations with a robot This project will build and develop JOKER, a generic intelligent user interface providing a multimodal dialogue system with social communication skills including humor, empathy, compassion, charm, and other informal socially-oriented behavior. Talk during social interactions naturally involves the exchange of propositional content but also and perhaps more importantly the expression of interpersonal relationships, as well as displays of emotion, affect, interest, etc. This project will facilitate advanced dialogues employing complex social behaviors in order to provide a companion-machine (robot or ECA) with the skills to create and maintain a long term social relationship through verbal and non verbal language interaction. Such social interaction requires that the robot has the ability to represent and understand some complex human social behavior. It is not straightforward to design a robot with such abilities. Social interactions require social intelligence and 'understanding' (for planning ahead and dealing with new circumstances) and employ theory of mind for inferring the cognitive states of another person. JOKER will emphasize the fusion of verbal and non-verbal channels for emotional and social behavior perception, interaction and generation capabilities. Our paradigm invokes two types of decision: intuitive (mainly based upon non-verbal multimodal cues) and cognitive (based upon fusion of semantic and contextual information with non-verbal multimodal cues.) The intuitive type will be used dynamically in the interaction at the non-verbal level (empathic behavior: synchrony of mimics such as smile, nods) but also at verbal levels for reflex small- talk (politeness behavior: verbal synchrony with hello, how are you, thanks, etc). Cognitive decisions will be used for reasoning on the strategy of the dialog and deciding more complex social behaviors (humor, compassion, white lies, etc.) taking into account the user profile and contextual information. http://www.chistera.eu/projects/joker
- Funding Agency
- EU-FP7
- Date From
- Jan 2014
- Date To
- Dec 2016
- Title
- ADAPT
- Summary
- Centre for Global Intelligent Digital Content
- Funding Agency
- SFI
- Date From
- Jan 2015
- Date To
- Dec 2020
- Title
- ISCA
- Summary
- The International Strategic Cooperation Award (ISCA) programme supports new and existing research-based collaborations between Ireland's Higher Education Institutions (HEIs) and partner organisations in Japan
- Funding Agency
- SFI
- Date From
- 2014
- Date To
- 2015
- Title
- Speech Prosody (SP7)
- Summary
- conference grant
- Funding Agency
- SFI
- Date From
- May 2014
- Date To
- May 2014
- Title
- Stokes Professorship
- Summary
- SFI Stokes Award - 5 year
- Funding Agency
- SFI
- Date From
- Oct 2008
- Date To
- Sep 2013
- Title
- ＭＯＳＡＩＣ： 自然で双方向的な対話処理モデル
- Summary
- http://kaken.nii.ac.jp/d/p/24500256.ja.html joint research with NAIST, Japan and TCD, Ireland
- Funding Agency
- Kaken (Japan)
- Date From
- 1/4/2012
- Date To
- 31/3/2015
Recognition
Representations
Board member: Japan British Association of the Kansai
Board member: International Speech Communication Association
Board Member - European Language Resources Association (ELRA)
Vice President - European Language Resources Association
Steering Committee member - Digital Humanities Research (TCD)
Member - META-NET (EU) Vision Group
Member, Spoken Language Technical Committee, IEEE Signal Processing Society
member of Management Committee, European Science Foundation (ESF) funded Research Network: COST 2102: Cross- Modal Analysis of Verbal and Non-verbal Communication.
Humaine (EU) Executive Committee member
Member of the Editorial Board: Cognitive Processing
Member of the Editorial Board, Language Resources and Evaluation
Member of the Editorial Board, Phonetica
Associate Editor, Language & Speech
Associate Editor, Journal of the Phonetic Society of Japan
Associate Editor - IEEE Transactions on Speech & Audio
Guest Editor - IEEE Trans SP Special Issue on Speech Synthesis
ISCA Speech Synthesis SIG - Vice Chairman, ILO
External Expert, European Commission, 'Humaine' Network of Excellence.
Speech Synthesis Working Group Convenor COCOSDA
DISC Advisory Panel (member)
Secretary/Communications Officer COCOSDA
Guest Editor, IEEE Trans Speech & Audio - Special Issue on Expressive Speech Synthesis
51st Annual Meeting of the Association for Computational Linguistics in 2013. (Programme Committee member)
PC member - 14th International Conference on Computational Linguistics and Intelligent Text Processing
SciCom member - 12th International Conference on Auditory-Visual Speech Processing (AVSP2013)
PC member - Beyond AI: Artificial Dreams BAI 2011, 2012
Organising Committee member - Workshop on Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction.
International Advisory Committee member - 15th Oriental COCOSDA Conference, Macao, 2012
OrgCom CogInfoCom 2012
PC member - BCS/CPHC Distinguished Dissertations competition 2012
PC member (HLT-10) The Fourth Baltic Conference on Human Language Technologies
PC member - IWSDS 2012 - International Workshop on Spoken Dialog Systems 2012
PC member - SocialCom 2012 - ASE/IEEE International Conference on Social Computing
PC member - PLM2012 - 43rd Poznań Linguistic Meeting
PC member - SP2012 - 6th International Conference on Speech Prosody
PC member - SSPW2009 - Social Signal Processing Workshop
PC member - TAL 2012 - The Third International Symposium on Tonal Aspects of Languages
PC member - Simpe 2010 - Fifth Workshop on Speech in Mobile and Pervasive Environments
Organiser - Laughter and other Non-Verbal Vocalisations in Speech - Long Room Hub - International Workshop
PC member - LREC2012 - The 8th International Conference on Language Resources and Evaluation
General Chair 7th Speech Prosody International Conference Dublin, Ireland
Co-organiser MA3HMI, Singapore
Co-Organiser - 3rd European Symposium on Multimodal Communication, MMSYM-2015, Dublin
Co-Organiser - Engagement in Social Intelligent Virtual Agents - satellite w/s of Fifteenth International Conference on Intelligent Virtual Agents (IVA 2015), August 26-28, Delft
PC member BAI 2012
PC member - CICLing 2013, 2014, 2015, 2016, 2017
PC member - IWSDS 2012, 2014, 2015
PC member - LTC 2009, 2011, 2013, 2015
Co-Organiser/Local Host - MMSYM 2015
PC member - SPECOM 2015, 2016, 2017
PC member - CogInfoCom 2012, 2014
Co-Organiser - ESIVA - satellite of Interspeech 2015
PC member HSCR 2017
PC member SP8 2016 - Speech Prosody, Boston
PC member SLSP 2014, 2016
PC member AICS 2017
PC member ICMR 2017
PC member ICCT 2017
PC member MMC 2013, 2017
PC member SSW8
PC member Oriental COCOSDA 2014, 2015, 2016, 2017
PC member MMSYM 2016
PC member ACII 2013, 2015
PC member IVA 2008, 2017
PC member WASA 2015
PC member Poital 2014
Awards and Honours
Fellow of Trinity College Dublin
Track Leader (SFI CSET-CNGL) ILT
Kaken (Japanese Govt funding) 3yrs
Theme Leader CNGL-ii
Founding Co-PI ADAPT Centre
Theme Leader ADAPT Centre
ISCA (Japan Collaboration)
GoogleScholar h-index: 41(23), i-10: 144 (68)
Memberships
International Phonetic Association, Coordinating Committee on Speech I/O Database Assessment, International Committee of Acoustic Society of Japan, International Speech Communication Association Institute of Acoustics (adherent) U.K., Acoustic Society of America, Acoustic Society of Japan. IEEE Signal Processing Society