New York Times Annotated Corpus

The corpus includes: over 1.8 million articles (excluding wire services articles that appeared during the covered period); over 650,000 article summaries written; over 1,500,000 articles manually tagged by library scientists with tags drawn from a normalized indexing vocabulary of people, organizations, locations and topic descriptors; over 275,000 algorithmically-tagged articles that have been hand verified by the online production staff at nytimes.com; Java tools for parsing corpus documents from .xml into a memory resident object.

As part of the New York Times' indexing procedures, most articles are manually summarized and tagged by a staff of library scientists. This collection contains over 650,000 article-summary pairs which may prove to be useful in the development and evaluation of algorithms for automated document summarization. Also, over 1.5 million documents have at least one tag.