Bridging Information-Seeking Human Gaze and Machine Reading Comprehension

Jonathan Malmaud, Roger Levy, Yevgeni Berzak

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, we collect a new eye-tracking dataset with a large number of participants engaging in a multiple choice reading comprehension task. Our analysis of this data reveals increased fixation times over parts of the text that are most relevant for answering the question. Motivated by this finding, we propose making automated reading comprehension more human-like by mimicking human information-seeking reading behavior during reading comprehension. We demonstrate that this approach leads to performance gains on multiple choice question answering in English for a state-of-the-art reading comprehension model.

Original languageEnglish
Title of host publicationCoNLL 2020 - 24th Conference on Computational Natural Language Learning, Proceedings of the Conference
EditorsRaquel Fernandez, Tal Linzen
Pages142-152
Number of pages11
ISBN (Electronic)9781952148637
DOIs
StatePublished - 2020
Externally publishedYes
Event24th Conference on Computational Natural Language Learning, CoNLL 2020 - Virtual, Online
Duration: 19 Nov 202020 Nov 2020

Publication series

NameCoNLL 2020 - 24th Conference on Computational Natural Language Learning, Proceedings of the Conference

Conference

Conference24th Conference on Computational Natural Language Learning, CoNLL 2020
CityVirtual, Online
Period19/11/2020/11/20

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Human-Computer Interaction
  • Linguistics and Language

Fingerprint

Dive into the research topics of 'Bridging Information-Seeking Human Gaze and Machine Reading Comprehension'. Together they form a unique fingerprint.

Cite this