Domain Adaptation in Semantic Role Labeling Using a Neural Language Model and Linguistic Resources

Quynh Thi Ngoc Do, Steven Bethard, Marie Francine Moens

Research output: Contribution to journalArticlepeer-review

10 Scopus citations


We propose a method for adapting Semantic Role Labeling (SRL) systems from a source domain to a target domain by combining a neural language model and linguistic resources to generate additional training examples. We primarily aim to improve the results of Location, Time, Manner and Direction roles. In our methodology, main words of selected predicates and arguments in the source-domain training data are replaced with words from the target domain. The replacement words are generated by a language model and then filtered by several linguistic filters (including Part-Of-Speech (POS), WordNet and Predicate constraints). In experiments on the out-of-domain CoNLL 2009 data, with the Recurrent Neural Network Language Model (RNNLM) and a well-known semantic parser from Lund University, we show enhanced recall and F1 without penalizing precision on the four targeted roles. These results improve the results of the same SRL system without using the language model and the linguistic resources, and are better than the results of the same SRL system that is trained with examples that are enriched with word embeddings. We also demonstrate the importance of using a language model and the vocabulary of the target domain when generating new training examples.

Original languageEnglish (US)
Pages (from-to)1812-1823
Number of pages12
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
Issue number11
StatePublished - Nov 1 2015
Externally publishedYes


  • Language model
  • linguistic resources
  • open domain
  • semantic role labeling

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Acoustics and Ultrasonics
  • Computational Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Domain Adaptation in Semantic Role Labeling Using a Neural Language Model and Linguistic Resources'. Together they form a unique fingerprint.

Cite this