UniBi
CITEC - Center of Excellence in "Cognitive Interaction Technology"
Sociable Agents Group
Projects
Teaching
Activities
Publications
Presentations
               



Dr.-Ing.

Kirsten Bergmann
photo
Address:





Universität Bielefeld
Research Group 'Sociable Agents'
CITEC - Cognitive Interaction Technology
Postfach 100131
D-33615 Bielefeld
Germany
Phone: +49 521 106-12143
Fax:
Room: H1-119
Email: kirsten.bergmann@Uni-Bielefeld.DE

About

I am currently affiliated with the Sociable Agents Group of the Center of Excellence "Cognitive Interaction Technology" (CITEC) at Bielefeld University. I am working as a research associate in the Collaborative Research Center 673 "Alignment in Communication" and in the CLARIN-D working group "Multimodality".

Research Interests
The use of speech-accompanying iconic gestures is a ubiquitous characteristic of human-human communication, especially when spatial information is expressed. It is therefore desirable to endow virtual agents with similar gestural expressiveness and flexibility to improve the interaction between humans and machines. My objective is to devise and probe computational simulation models based on the results of empirical studies to increase the understanding of the cognitive mechanisms that underlie this intuitive form of human communication.

Projects

SFB 673, Project B1 "Speech-Gesture Alignment"

CLARIN-D working group "Speech and other modalities"


Teaching

Winter Term 2012/13
Lecture "Human-Machine Interaction" (ekVV)

Winter Term 2011/12
Tutorial "Human-Machine Interaction" (ekVV)

Winter Term 2010/11
Tutorial "Human-Machine Interaction" (ekVV)

Summer Term 2008
Journal Club "Cognition in Communication" (Webseite, ekVV, Stud-IP)

Summer Term 2007
Seminar "Multiagentensysteme" (Website, ekVV)


Activities

MOG 2010   
3rd Workshop on Multimodal Output Generation
Trinity College, Dublin, Ireland, July 6, 2010

GW 2009
8th International Gesture Workshop 
Bielefeld University, Germany, February 25-27, 2009      


Publications

Bergmann, K., Eyssel, F.A., & Kopp, S. (forthcoming). A second chance to make a first impression? How appearance and nonverbal behavior affect perceived warmth and competence of virtual agents over time. In M. Walker, M. Neff, A. Paiva & Y.I. Nakano (Eds.), Proceedings of the 12th International Conference on Intelligent Virtual Agents. Berlin/Heidelberg: Springer.

Lücking, A., K. Bergmann, F. Hahn, S. Kopp & H. Rieser (2012). Data-based Analysis of Speech and Gesture: The Bielefeld Speech and Gesture Alignment Corpus (SaGA) and its Applications. In Journal on Multimodal User Interfaces. [pdf]

Bergmann, K. & S. Kopp (2012). Gestural Alignment in Natural Dialogue. In D. Peebles, N. Miyake & R.P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (CogSci 2012), Austin, TX: Cognitive Science Society, pages 1326–1331. [pdf]

Rieser H., K. Bergmann & S. Kopp (forthcoming). How do iconic gestures convey visuo-spatial information? Bringing together empirical, theoretical, and simulation studies. In E. Efthimiou & G. Kouroupetroglou (Eds.), Gestures in Embodied Communication and Human-Computer Interaction. Berlin/Heidelberg: Springer.

Lücking A., S. Ptock & K. Bergmann (forthcoming). Assessing Agreement on Segmentations by Means of Staccato, the Segmentation Agreement Calculator according to Thomann. In E. Efthimiou & G. Kouroupetroglou (Eds.), Gestures in Embodied Communication and Human-Computer Interaction. Berlin/Heidelberg: Springer.

Kopp, S., & K. Bergmann (2012). Individualized Gesture Production in Embodied Conversational Agents. In M. Zacarias & J.V. de Oliveira (Eds.), Human-Computer Interaction: The Agency Perspective (pp. 287–302). Berlin/Heidelberg: Springer.

Bergmann K. (2012). The Production of Co-Speech Iconic Gestures: Empirical Study and Computational Simulation with Virtual Agents. Bielefeld: University. [pdf]
Dissertation Award by Westfälisch-Lippische Universitätsgesellschaft


Bergmann, K., V. Aksu, & S. Kopp (2011). The Relation of Speech and Gestures: Temporal Synchrony Follows Semantic Synchrony. In Proceedings of the 2nd Workshop on Gesture and Speech in Interaction. Bielefeld, Germany. [pdf]

Bergmann, K., S. Kopp, & H. Rieser (2011). Grounding the Simulation of Iconic Gestures in Gesture Typology. In E. Efthimiou, & G. Kouroupetroglou (Eds.), Proceedings of the 9th International Gesture Workshop: Gestures in Embodied Communication and Human-Computer Interaction. Athens, Greece. [pdf]

Lücking, A., S. Ptock, & K. Bergmann (2011). Staccato: Segmentation Agreement Calculator according to Thomann. In E. Efthimiou, & G. Kouroupetroglou (Eds.), Proceedings of the 9th International Gesture Workshop: Gestures in Embodied Communication and Human-Computer Interaction. Athens, Greece. [pdf]

Bergmann, K., H. Rieser, & S. Kopp. (2011). Regulating Dialogue With Gestures---Towards an Empirically Grounded Simulation with Virtual Agents. In J.Y. Chai, J.D. Moore, R.J. Passonneau, & D.R. Traum (Eds.), Proceedings of the SIGdial 2011 Conference. Portland, OR, USA: Association for Computational Linguistics, pages 88–97 [pdf]

Bergmann, K., Kopp, S., & Eyssel, F. (2010). Individualized Gesturing Outperforms Average Gesturing–Evaluating Gesture Production in Virtual Humans. In J. Allbeck et al. (Eds.), Proceedings of the 10th Conference on Intelligent Virtual Agents (LNAI 6356, pp. 104–117). Berlin/Heidelberg: Springer. [preprint]

van der Sluis, I., Bergmann, K., van Hooijdonk, C., & Theune, M. (2010), Proceedings of the 3rd Workshop on Multimodal Output Generation (MOG 2010). CTIT Workshop Proceedings WP 2010-02. [pdf]

Bergmann, K., & Kopp, S. (2010). Modelling the Production of Co-Verbal Iconic Gestures by Learning Bayesian Decision Networks. In Applied Artificial Intelligence 24(6):530–551. [preprint]

Buschmeier, H., Bergmann, K., & Kopp, S. (2010). Modelling and Evaluation of Lexical and Syntactic Alignment with a Priming-based Microplanner. In E. Krahmer & M. Theune (Eds.), Empirical methods in natural language generation. Berlin/Heidelberg: Springer.

Lücking, A., Bergmann, K., Hahn, F., Kopp, S., & Rieser, H. (2010). The Bielefeld Speech and Gesture Alignment Corpus (SaGA). In M. Kipp, J.-C. Martin, P. Paggio & D. Heylen (Eds.), LREC 2010 Workshop: Multimodal Corpora–Advances in Capturing, Coding and Analyzing Multimodality. [pdf]

Buschmeier, H., Bergmann, K., & Kopp, S. (2010). Adaptive expressiveness–Virtual Conversational Agents that can Align to their Interaction Partner. In W. van der Hoek, G.A. Kaminka, Y. Lespérance, M. Luck and S. Sen (Eds.), Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), pages 91–98. [pdf]

Bergmann, K., & Kopp, S. (2010). Systematicity and Idiosyncrasy in Iconic Gesture Use: Empirical Analysis and Computational Modeling. In S. Kopp & I. Wachsmuth (Eds.), Gesture in Embodied Communication and Human-Computer Interaction (LNAI 5934, pp. 182-194). Berlin/Heidelberg: Springer. [preprint]

Kopp, S., Bergmann, K., Buschmeier, H. & Sadeghipour, A. (2009). Requirements and Building Blocks for Sociable Embodied Agents. In B. Mertsching et al. (Eds.), KI 2009: Advances in Artificial Intelligence (LNAI 5803, pp. 508-515). Berlin/Heidelberg: Springer. [preprint]

Bergmann, K., & Kopp, S. (2009). GNetIc–Using Bayesian Decision Networks for Iconic Gesture Generation. In Z. Ruttkay et al. (Eds.), Proceedings of the 9th Conference on Intelligent Virtual Agents (LNAI 5773, pp. 76–89). Berlin/Heidelberg: Springer. [preprint]
Nominated for Best Paper Award

Buschmeier, H., Bergmann, K., and Kopp, S. (2009). An alignment-capable microplanner for natural language generation. In E. Krahmer & M. Theune (Eds.), Proceedings of the 12th European Workshop on Natural Language Generation (pp. 82–89), Athens, Greece. [pdf]

Bergmann, K., & Kopp, S. (2009). Increasing expressiveness for virtual agents–Autonomous generation of speech and gesture for spatial description tasks. In K. Decker, J. Sichman, C. Sierra, and C. Castelfranchi (Eds.), Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2009), pages 361–368. [pdf]
Pragnesh Jay Modi Best Student Paper Award

Kopp, S., Bergmann, K. & Wachsmuth, I. (2008). Multimodal communication from multimodal thinking - towards an integrated model of speech and gesture production. Semantic Computing 2(1):115–136. [pdf]

Bergmann, K. & Kopp, S. (2008). Multimodal content representation for speech and gesture production. In M. Theune, I. van der Sluis, Y. Bachvarova and E. André (Eds.), Symposium at the AISB Annual Convention: Multimodal Output Generation (pp. 61–68). Aberdeen, UK. [pdf]

Kopp, S. & Bergmann, K. (2007). Towards an architecture for aligned speech and gesture production. In C. Pelachaud, J. Martin, E. André, G. Chollet, K. Karpouzis, & D. Pelé (Eds.), Proceedings of 7th Conference on Intelligent Virtual Agents (LNAI 4722, pp. 389–390). Berlin/Heidelberg: Springer.

Bergmann, K., & Kopp, S. (2007). Co-expressivity of speech and gesture: Lessons for models of aligned speech and gesture production. In P. Olivier & C. Kray (Eds.), Symposium at the AISB Annual Convention: Language, Speech and Gesture for Expressive Characters (pp. 153–158). Newcastle, UK.  [pdf]
Bergmann, K. & Kopp, S. (2006). Verbal or visual? How information is distributed across speech and gesture in spatial dialog. In David Schlangen and Raquel Fernandez (Eds.): Proceedings of the 10th Workshop on the Semantics and Pragmatics of Dialogue (pp. 90–97), Potsdam: Universitätsverlag. [pdf]


Presentations

Gestural Alignment in Human-Human and Human-Machine Dialogue. Presentation at the 11th Biannual Conference of the German Cognitive Science Society (KogWis 2012)<\a>. Bamberg, Germany, September 30-October 3, 2012.

A second chance to make a first impression? How appearance and nonverbal behavior affect perceived warmth and competence of virtual agents over time. Paper presentation at the
12th International Conference on Intelligent Virtual Agents<\a>. Santa Cruz, CA, USA, September 12-14, 2012

Gestural Alignment in Natural Dialogue. Poster presentation at the
34th Annual Conference of the Cognitive Science Society (CogSci 2012). Sapporo, Japan, August 1-4, 2012.

Gestural Alignment in Natural Dialogue. Presentation at the 5th Conference of the International Society for Gesture Studies (ISGS 2012). Lund, Sweden, July 24-27, 2012.

Gesture Use in Dialogue---From Empirical Analysis to Virtual Humans and Back. Inivited presentation in collaboration with S. Kopp at the Nijmegen Gesture Centre (NGC). Nijmegen, The Netherlands, April 24th, 2012.

The Use of Iconic Co-Speech Gestures---Insights from Computational Modeling with Virtual Agents. Presentation at the 1st Interdisciplinary Workshop on Cognitive Systems. Duisburg, Germany, September 28-29, 2011.

The Relation of Speech and Gestures: Temporal Synchrony Follows Semantic Synchrony. Paper presentation at the 2nd Workshop on Speech and Gesture Integration (GeSpIn 2011). Bielefeld, Germany, September 5-7, 2011.

Regulating Dialogue With Gestures---Towards an Empirically Grounded Simulation with Virtual Agents. Paper presentation at the 12th annual SIGdial Meeting on Discourse and Dialogue. Portland, OR, USA, June 17-18, 2011.

Grounding the Simulation of Iconic Gestures in Gesture Typology. Paper presentation at the 9th International Gesture Workshop 2011---Gesture in Embodied Communication and Human-Computer Interaction. Athens, Greece, May 25-27, 2011.

Staccato: Segmentation Agreement Calculator according to Thomann. Paper presentation at the 9th International Gesture Workshop 2011---Gesture in Embodied Communication and Human-Computer Interaction. Athens, Greece, May 25-27, 2011.

What Shapes Co-Speech Iconic Gestures? Empirical Study and Computational Simulation with Virtual Agents. Poster presentation at the Exbodied Mind Workshop. RWTH Aachen, Germany, April 8-9, 2011.

On the production and perception of iconic gestures: Insights from computational modelling and empirical studies. Presentation at the 10th Biannual Meeting of the German Society for Cognitive Science. Potsdam, Germany, October 3-6, 2010.

Individualized Gesturing Outperforms Average Gesturing-Evaluating Gesture Production in Virtual Humans. Paper presentation at the 10th International Conference on Intelligent Virtual Agents (IVA '10). Philadelphia, PA, USA, September 20-22, 2010.

What Shapes Inconic Gestures? Insights from Computational Modelling. Presentation at the 4th Conference of the International Society for Gesture Studies (ISGS). European University Viadrina Franfurt/Oder, Germany, July 25-30, 2010.

The Bielefeld Speech and Gesture Alignment (SaGA) corpus. Invited presentation at the CLARIN and FLaReNet Workshop on "Best practices for speech and multimodal databases". KTH Stockholm, Sweden, November 25-26, 2009.

GNetIc—Using Bayesian Decision Networks for Iconic Gesture Generation. Paper presentation at the 9th International Conference on Intelligent Virtual Agents (IVA '09). Amsterdam, The Netherlands, September 14-16, 2009.

Increasing Expressiveness for Virtual Agents—Autonomous Generation of Speech and Gesture in Spatial Description Tasks. Paper presentation at the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS '09). Budapest, Hungary, May 10-15, 2009.

Systematicity and Idiosyncrasy in Iconic Gestures—A Probabilistic Model of Gesture Use.  Presentation at the 8th International Gesture Workshop 2009—Gesture in Embodied Communication and Human-Computer Interaction. Bielefeld University, Germany, February 25-27, 2009.

Multimodal Content Representation for Speech and Gesture Production. Presentation at the Symposium at the AISB Annual Convention: Multimodal Output Generation (MOG 2008), University of Aberdeen, UK, April 3-4, 2008.

Empirical Study: Representation Techniques in Gesture Use. Poster presentation at the AISB Annual Convention, University of Aberdeen, UK, April 1-4, 2008.

Speech-Gesture Alignment. Project Panel in collaboration with S. Kopp, A. Lücking, H. Rieser and I. Wachsmuth at the 3rd Congress of the ISGS on "Integrating Gestures", Northwestern University, Evanston, IL, USA, June 18-21, 2007.

Computational Modeling of Coexpressivity between Speech and Gesture. Presentation at the Workshop on "Visual Prosody in Language Communication", Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands, May 10-11, 2007.
Computational Modeling of Speech and Gesture Alignment. Poster presentation at the Interdisciplinary College 2007 (IK 2007), Günne at lake Möhne, March 9-16, 2007.

Verbal or visual? How Information is Distributed Across Speech and Gesture in Spatial Dialog. Paper presentation at the 10th Workshop on the Semantics and Pragmatics of Dialogue (brandial 2006), University of Potsdam, Germany, September 11-13, 2006.
Koexpressivität von Sprache und Gestik in Wegbeschreibungen. Presentation at the 16th Student Conference of Computational Linguistics (TaCoS 2006), Saarland University, Saarbrücken, Germany, June 8-11, 2006. 



Last update: 27/08/2012