A Dataset for Sentence Retrieval for Open-Ended Dialogues

Itay Harel, Hagai Taitelbaum, Idan Szpektor, Oren Kurland

نتاج البحث: فصل من :كتاب / تقرير / مؤتمرمنشور من مؤتمرمراجعة النظراء

ملخص

We address the task of sentence retrieval for open-ended dialogues. The goal is to retrieve sentences from a document corpus that contain information useful for generating the next turn in a given dialogue. Prior work on dialogue-based retrieval focused on specific types of dialogues: either conversational QA or conversational search. To address a broader scope of this task where any type of dialogue can be used, we constructed a dataset that includes open-ended dialogues from Reddit, candidate sentences from Wikipedia for each dialogue and human annotations for the sentences. We report the performance of several retrieval baselines, including neural retrieval models, over the dataset. To adapt neural models to the types of dialogues in the dataset, we explored an approach to induce a large-scale weakly supervised training data from Reddit. Using this training set significantly improved the performance over training on the MS MARCO dataset.

اللغة الأصليةالإنجليزيّة
عنوان منشور المضيفSIGIR 2022 - Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
الصفحات2960-2969
عدد الصفحات10
رقم المعيار الدولي للكتب (الإلكتروني)9781450387323
المعرِّفات الرقمية للأشياء
حالة النشرنُشِر - 6 يوليو 2022
الحدث45th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2022 - Madrid, أسبانيا
المدة: ١١ يوليو ٢٠٢٢١٥ يوليو ٢٠٢٢

سلسلة المنشورات

الاسمSIGIR 2022 - Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

!!Conference

!!Conference45th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2022
الدولة/الإقليمأسبانيا
المدينةMadrid
المدة١١/٠٧/٢٢١٥/٠٧/٢٢

All Science Journal Classification (ASJC) codes

  • !!Computer Graphics and Computer-Aided Design
  • !!Information Systems
  • !!Software

قم بذكر هذا