As a Ph.D. student at the University of Rochester, I focused on dialog parsing, natural language understanding in the context of spoken dialogue. I extended traditional syntactic analysis to encompass overlapping speech and speech repairs, disruptions to spoken utterances such as self-corrections and filled pauses (e.g., um, uh). Another aspect of dialog parsing is recognition of the intended actions (i.e., dialogue acts) associated with an utterance. I worked with the Discourse Resource Initiative in an effort to unify dialogue annotation schemes from different groups to facilitate collaborative efforts to build large, annotated corpora. James Allen and I wrote up the final annotation scheme, DAMSL (Dialog Act Markup in Several Layers), which has been used as a starting point for a number of dialogue annotation efforts. Although not the focus of my thesis, I also explored using dialogue act co-occurences as a tool for discourse analysis of the problem-solving dialogues in my test corpus.
As a research fellow at the University of Edinburgh, I shifted my focus from dialogue systems acting as conversational assistants to dialogue systems acting as intelligent tutoring systems. In addition to working on natural language understanding, I annotated human tutoring dialogues to inform design of our system through discourse analysis. In particular, I investigated management of initiative (i.e., control of the dialogue) exploring who had initiative (student or tutor) and when.
As a research scientist at USC's Institute for Creative Technologies, one of my research areas is the use of dialogue systems as virtual role players allowing learners to practice interpersonal skills. Related research areas:
A key aspect of lifelong learning is tracking learner engagement to support tutoring strategies that not only encourage cognitive growth but also promote positive attitudes toward the subject material and learning in general. I have explored a number of related research areas including learning analytics, multi-modal analysis of learners (e.g., recognition of facial affect), and automated classification of engagement (e.g., through semi-supervised learning). Another challenge in lifelong learning is the authoring bottleneck. Although large-language-model-based chat bots have the potential to provide interactive learning activities on demand, it is crucial to ensure that such activities actually promote learning.
Copyright Mark G. Core. All rights reserved.