Andreas Liesenfeld

Andreas Liesenfeld

Postdoc in language technology

The Hong Kong Polytechnic University

About

I am a social scientist working in Conversational AI. My work focuses on understanding how humans interact with voice technologies in the real world. I aspire to produce useful insights for anyone who designs, builds, uses or regulates talking machines. Late naturalist under pressure. “You must collect things for reasons you don’t yet understand.” — Daniel J. Boorstin

My research interests originate in the study of human-human conversation and story-telling based on video-recordings. Then I became interested in how people aspire to build voice bots that can participate in these activities. What theoretical and computational tools would we need to build voice user interfaces that can hold up their end of conversations?

I am also interested in speech processing of speaker traits and various aspects of social intelligence such as turn-taking coordination, stance, rapport, and humor. What tools, pipelines, and representations would enable us to build voice bots that interact with humans in more useful ways? How can we ensure that this pervasive technology is used for good?

I hope my work will contribute to raise awareness about societal issues related to the rise of voice tech. Let’s democratize the field and make the technologies more accessible.

I also work as a conversation design consultant in the Greater Bay Area and currently write a book chapter on crowd-sourcing in voice technology.

Interests
  • Ethnomethodology and Conversation Analysis
  • Conversational AI
  • Computational Linguistics
Education
  • PhD in Conversation Analysis, 2019

    Nanyang Technological University, Singapore

Projects

Limits of automation in Conversational AI

Limits of automation in Conversational AI

Looking back at 70 years of work on talking machines. This is a literature review on the prospects of automating talk now and then.

Anthology of EMCA studies on AI

Anthology of EMCA studies on AI

We compile a collection of existing literature in the tradition of Ethnomethodology and Conversation Analysis on the topic of Artifical Intelligence.

Natural Language Understanding in action

Natural Language Understanding in action

Combining video-based analysis and software development, I explore how current NLU technology fares in real-world contexts.

Data-driven frame semantics for dialog systems [Completed]

Data-driven frame semantics for dialog systems [Completed]

A series of studies on how to build data-driven pipelines for frame semantics as well as their applications in dialog systems.

Malaysia Cantonese Corpus [Completed]

Malaysia Cantonese Corpus [Completed]

The Malaysia Cantonese Corpus (馬來西亞粵語語料庫) is a collection of recordings of Malaysian Cantonese naturally-occurring speech mainly collected in Perak, Malaysia.

Experience

 
 
 
 
 
The Hong Kong Polytechnic University
Post-doctoral Research Fellow
The Hong Kong Polytechnic University
Jul 2019 – Present Hong Kong
Postdoc in the Linguistics theory and Language Technology (LLT) group led by Prof Huang Chu-ren
 
 
 
 
 
Nanyang Technological University
Doctoral Researcher
Nanyang Technological University
Aug 2014 – Jun 2019 Singapore
Junior researcher in the Conversation Analysis group led by Prof Luke Kang Kwong
 
 
 
 
 
The University of Hong Kong
Postgraduate student
The University of Hong Kong
Aug 2011 – Aug 2013 Hong Kong
 
 
 
 
 
Rheinische Friedrich-Wilhelms-Universität Bonn
Undergraduate student
Rheinische Friedrich-Wilhelms-Universität Bonn
Aug 2006 – Aug 2010 Bonn

Professional Training

Contact