Ellie Pavlick: What Do Models of Natural Language "Understanding" Actually Understand | IACS Seminar скачать в хорошем качестве

Ellie Pavlick: What Do Models of Natural Language "Understanding" Actually Understand | IACS Seminar

Presented by Ellie Pavlick, Assistant Professor of Computer Science at Brown University. Full Talk Title: What Do Models of Natural Language "Understanding" Actually Understand? Abstract: Natural language processing has become indisputably good over the past few years. We can perform retrieval and question answering with purported super-human accuracy, and can generate full documents of text that seem good enough to pass the Turing test. In light of these successes, it is tempting to attribute the empirical performance to a deeper "understanding" of language that the models have acquired. Measuring natural language "understanding", however, is itself an unsolved research problem. In this talk, Dr. Pavlick argues that we have made real, substantive progress on modeling the form of natural language, but have failed almost entirely to capture the underlying _meaning_. She'll discuss recent work which attempts to illuminate what it is that state-of-the-art models of language are capturing by inspecting the models' internal structure directly and by measuring their inferential behavior. Finally, Dr. Pavlick will conclude with results on the ambiguity of humans' linguistic inferences to highlight the challenges involved with developing prescriptivist language tasks for evaluating models of semantics. Speaker Bio: Ellie Pavlick is an Assistant Professor of Computer Science at Brown University, and an academic partner with Google AI. Her research interests include building better computational models of natural language semantics and pragmatics: how does language work, and how can we get computers to understand it the way humans do? You can learn more about her projects and interests here. IACS Seminars are free and open to the public. Visit the IACS website to stay abreast of our latest events and activities www.iacs.seas.harvard.edu.