Overview of the TREC 2016 LiveQA Track

Eugene Agichtein; David Carmel; Dan Pelleg; Yuval Pinter; Donna Harman

Overview of the TREC 2016 LiveQA Track

Eugene Agichtein, David Carmel, Dan Pelleg, Yuval Pinter, Donna Harman

Research output: Contribution to conference › Paper › peer-review

Abstract

This is the second year that we ran the LiveQA track, reviving the popular QA track which has been frozen for several years. The track attracted significant attention from the Question Answering research community; 14 teams from around the world took the challenge of answering complex YA questions with original intent of being answered by humans. The quality of results is still below the human level, but is improving compared to previous year. The question summarization task is far from solved. Our plan is to run the LiveQA challenge next year, thus allowing the participants to further improve and extend their systems. We hope that additional teams will join this joint research effort of answering real users’ questions in real-time.

Original language	American English
State	Published - 1 Jan 2016
Externally published	Yes
Event	25th Text REtrieval Conference, TREC 2016 - Gaithersburg, United States Duration: 15 Nov 2016 → 18 Nov 2016

Conference

Conference	25th Text REtrieval Conference, TREC 2016
Country/Territory	United States
City	Gaithersburg
Period	15/11/16 → 18/11/16

All Science Journal Classification (ASJC) codes

Language and Linguistics
Computer Science Applications
Linguistics and Language

Cite this

@conference{6651cb45b7ac4046a6fe7ab2991cde88,

title = "Overview of the TREC 2016 LiveQA Track",

abstract = "This is the second year that we ran the LiveQA track, reviving the popular QA track which has been frozen for several years. The track attracted significant attention from the Question Answering research community; 14 teams from around the world took the challenge of answering complex YA questions with original intent of being answered by humans. The quality of results is still below the human level, but is improving compared to previous year. The question summarization task is far from solved. Our plan is to run the LiveQA challenge next year, thus allowing the participants to further improve and extend their systems. We hope that additional teams will join this joint research effort of answering real users{\textquoteright} questions in real-time.",

author = "Eugene Agichtein and David Carmel and Dan Pelleg and Yuval Pinter and Donna Harman",

note = "Publisher Copyright: {\textcopyright} 2016 25th Text REtrieval Conference, TREC 2016 - Proceedings. All Rights Reserved.; 25th Text REtrieval Conference, TREC 2016 ; Conference date: 15-11-2016 Through 18-11-2016",

year = "2016",

month = jan,

day = "1",

language = "American English",

}

TY - CONF

T1 - Overview of the TREC 2016 LiveQA Track

AU - Agichtein, Eugene

AU - Carmel, David

AU - Pelleg, Dan

AU - Pinter, Yuval

AU - Harman, Donna

PY - 2016/1/1

Y1 - 2016/1/1

N2 - This is the second year that we ran the LiveQA track, reviving the popular QA track which has been frozen for several years. The track attracted significant attention from the Question Answering research community; 14 teams from around the world took the challenge of answering complex YA questions with original intent of being answered by humans. The quality of results is still below the human level, but is improving compared to previous year. The question summarization task is far from solved. Our plan is to run the LiveQA challenge next year, thus allowing the participants to further improve and extend their systems. We hope that additional teams will join this joint research effort of answering real users’ questions in real-time.

AB - This is the second year that we ran the LiveQA track, reviving the popular QA track which has been frozen for several years. The track attracted significant attention from the Question Answering research community; 14 teams from around the world took the challenge of answering complex YA questions with original intent of being answered by humans. The quality of results is still below the human level, but is improving compared to previous year. The question summarization task is far from solved. Our plan is to run the LiveQA challenge next year, thus allowing the participants to further improve and extend their systems. We hope that additional teams will join this joint research effort of answering real users’ questions in real-time.

UR - http://www.scopus.com/inward/record.url?scp=85063140155&partnerID=8YFLogxK

M3 - Paper

T2 - 25th Text REtrieval Conference, TREC 2016

Y2 - 15 November 2016 through 18 November 2016

ER -

Overview of the TREC 2016 LiveQA Track

Abstract

Conference

All Science Journal Classification (ASJC) codes

Other files and links

Cite this