TY - JOUR
T1 - TALP-UPC at TREC 2005
T2 - 14th Text REtrieval Conference, TREC 2005
AU - Ferrés, Daniel
AU - Kanaan, Samir
AU - Dominguez-Sal, David
AU - González, Edgar
AU - Ageno, Alicia
AU - Fuentes, Maria
AU - Rodríguez, Horacio
AU - Surdeanu, Mihai
AU - Turmo, Jordi
PY - 2005
Y1 - 2005
N2 - This paper describes the experiments of the TALPUPC group for factoid and 'other' (definitional) questions at TREC 2005 Main Question Answering (QA) task. Our current approach for factoid questions is based on a voting scheme among three QA systems: TALP-QA (our previous QA system), Sibyl (a new QA system developed at DAMA-UPC and TALP-UPC), and Aranea (a web-based data-driven approach). For defitional questions, we used two different systems: the TALP-QA Definitional system and LCSUM (a Summarization-based system). Our results for factoid questions indicate that the voting strategy improves the accuracy from 7.5% to 17.1%. While these numbers are low (due to technical problems in the Answer Extraction phase of TALPQA system) they indicate that voting is a succesful approach for performance boosting of QA systems. The answer to definitional questions is produced by selecting phrases using set of patterns associated with definitions. Its results are 17.2% of F-score in the best configuration of TALP-QA Definitional system.
AB - This paper describes the experiments of the TALPUPC group for factoid and 'other' (definitional) questions at TREC 2005 Main Question Answering (QA) task. Our current approach for factoid questions is based on a voting scheme among three QA systems: TALP-QA (our previous QA system), Sibyl (a new QA system developed at DAMA-UPC and TALP-UPC), and Aranea (a web-based data-driven approach). For defitional questions, we used two different systems: the TALP-QA Definitional system and LCSUM (a Summarization-based system). Our results for factoid questions indicate that the voting strategy improves the accuracy from 7.5% to 17.1%. While these numbers are low (due to technical problems in the Answer Extraction phase of TALPQA system) they indicate that voting is a succesful approach for performance boosting of QA systems. The answer to definitional questions is produced by selecting phrases using set of patterns associated with definitions. Its results are 17.2% of F-score in the best configuration of TALP-QA Definitional system.
UR - http://www.scopus.com/inward/record.url?scp=84873553732&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84873553732&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:84873553732
SN - 1048-776X
JO - NIST Special Publication
JF - NIST Special Publication
Y2 - 15 November 2005 through 18 November 2005
ER -