Just a way to convert agiga data into a processors Document.

Why spend the time and resources parsing and annotating over 183 million sentences when it has already been done?

1. Java 8
2. sbt
3. A copy of the Annotated English Gigaword

import org.clulab.agiga

// build a processors.Document
val doc = agiga.toDocument("path/to/agiga/xml/ltw_eng_200705.xml.gz")

Everything is configured in the application.conf file.

1. Change the view property to "lemmas"

2. Change the inputDir property to wherever your copy of agiga is nestled on your disk

3. Change the outputDir property to wherever you want your compressed of the lemmatized English Gigaword to be written

4. (Optional) Change the nthreads property to the maximum number of threads you prefer to use for parallelization.

All that's left is to run AgigaReader:

sbt "runMain sem.AgigaReader"

• Add output options for dependencies using the DFS ordering described in "Higher-order Lexical Semantic Models for Non-factoid Answer Reranking"

1. Annotated Gigaword