Transformer-based Hebrew NLP models for Short Answer Scoring in Biology

Abigail Gurin Schleifer, Beata Beigman Klebanov, Moriah Ariely, Giora Alexandron

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Pre-trained large language models (PLMs) are adaptable to a wide range of downstream tasks by fine-tuning their rich contextual embeddings to the task, often without requiring much task-specific data. In this paper, we explore the use of a recently developed Hebrew PLM – alephBERT – for automated short answer grading of high school biology items. We show that the alephBERT-based system outperforms a strong CNN-based baseline, and that it generalizes unexpectedly well in a zero-shot paradigm to items on an unseen topic that address the same underlying biological concepts, opening up the possibility of automatically assessing new items without item-specific fine-tuning.

Original languageEnglish
Title of host publicationBEA 2023 - 18th Workshop on Innovative Use of NLP for Building Educational Applications, Proceedings of the Workshop
EditorsEkaterina Kochmar, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Nitin Madnani, Anais Tack, Victoria Yaneva, Zheng Yuan, Torsten Zesch
PublisherAssociation for Computational Linguistics (ACL)
Pages550-555
Number of pages6
ISBN (Electronic)9781959429807
StatePublished - 2023
Event18th Workshop on Innovative Use of NLP for Building Educational Applications, BEA 2023 - Toronto, Canada
Duration: 13 Jul 2023 → …

Publication series

NameProceedings of the Annual Meeting of the Association for Computational Linguistics

Conference

Conference18th Workshop on Innovative Use of NLP for Building Educational Applications, BEA 2023
Country/TerritoryCanada
CityToronto
Period13/07/23 → …

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Linguistics and Language
  • Language and Linguistics

Fingerprint

Dive into the research topics of 'Transformer-based Hebrew NLP models for Short Answer Scoring in Biology'. Together they form a unique fingerprint.

Cite this