Performance issues and error analysis in an open-domain question answering system

Dan Moldovan; Marius Paşca; Sanda Harabagiu; Mihai Surdeanu

doi:10.1145/763693.763694

Performance issues and error analysis in an open-domain question answering system

Dan Moldovan, Marius Paşca, Sanda Harabagiu, Mihai Surdeanu

Research output: Contribution to journal › Article › peer-review

165 Scopus citations

Abstract

This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

Original language	English (US)
Pages (from-to)	133-154
Number of pages	22
Journal	ACM Transactions on Information Systems
Volume	21
Issue number	2
DOIs	https://doi.org/10.1145/763693.763694
State	Published - Apr 2003
Externally published	Yes

Keywords

Natural language applications
Performance analysis
Question answering
Text retrieval

ASJC Scopus subject areas

Information Systems
General Business, Management and Accounting
Computer Science Applications

Access to Document

10.1145/763693.763694

Cite this

@article{4ec332d2822b4c8eb0a49ebb272e5051,

title = "Performance issues and error analysis in an open-domain question answering system",

abstract = "This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.",

keywords = "Natural language applications, Performance analysis, Question answering, Text retrieval",

author = "Dan Moldovan and Marius Pa{\c s}ca and Sanda Harabagiu and Mihai Surdeanu",

year = "2003",

month = apr,

doi = "10.1145/763693.763694",

language = "English (US)",

volume = "21",

pages = "133--154",

journal = "ACM Transactions on Information Systems",

issn = "1046-8188",

publisher = "Association for Computing Machinery (ACM)",

number = "2",

}

TY - JOUR

T1 - Performance issues and error analysis in an open-domain question answering system

AU - Moldovan, Dan

AU - Paşca, Marius

AU - Harabagiu, Sanda

AU - Surdeanu, Mihai

PY - 2003/4

Y1 - 2003/4

N2 - This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

AB - This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

KW - Natural language applications

KW - Performance analysis

KW - Question answering

KW - Text retrieval

UR - http://www.scopus.com/inward/record.url?scp=2442589044&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=2442589044&partnerID=8YFLogxK

U2 - 10.1145/763693.763694

DO - 10.1145/763693.763694

M3 - Article

AN - SCOPUS:2442589044

SN - 1046-8188

VL - 21

SP - 133

EP - 154

JO - ACM Transactions on Information Systems

JF - ACM Transactions on Information Systems

IS - 2

ER -

Performance issues and error analysis in an open-domain question answering system

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this