Skip to main navigation Skip to search Skip to main content

Analyzing Large Language Models' Capability in Location Prediction

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we investigate and evaluate large language models' capability in location prediction. We present experimental results with four models-FLAN-T5, FLAN-UL2, FLAN-Alpaca, and ChatGPT-in various instruction finetuning and exemplar settings. We analyze whether taking into account the context-tweets published before and after the tweet mentioning a location-is beneficial. Additionally, we conduct an ablation study to explore whether instruction modification is beneficial. Lastly, our qualitative analysis sheds light on the errors made by the best-performing model.

Original languageEnglish (US)
Title of host publication2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings
EditorsNicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
PublisherEuropean Language Resources Association (ELRA)
Pages951-958
Number of pages8
ISBN (Electronic)9782493814104
StatePublished - 2024
EventJoint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024 - Hybrid, Torino, Italy
Duration: May 20 2024May 25 2024

Publication series

Name2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC-COLING 2024 - Main Conference Proceedings

Conference

ConferenceJoint 30th International Conference on Computational Linguistics and 14th International Conference on Language Resources and Evaluation, LREC-COLING 2024
Country/TerritoryItaly
CityHybrid, Torino
Period5/20/245/25/24

Keywords

  • Large Language Models
  • Location Prediction

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computational Theory and Mathematics
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Analyzing Large Language Models' Capability in Location Prediction'. Together they form a unique fingerprint.

Cite this