Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Skip to content

Try the next-generation Data Catalog at catalog-beta.data.gov and help shape it with your feedback.

  • Feedback

    • Complex Document Information Processing (CDIP) dataset

    Metadata Updated: July 29, 2022

    This dataset is called the "IIT CDIP collection". "CDIP" stands for "Complex Document Information Processing" and "IIT" stands for "Illinois Institute of Technology" who originally built the dataset. The dataset consists of documents from the states' lawsuit against the tobacco industry in the 1990s. As a result of the settlement of that lawsuit (the "Master Settlement Agreement"), the companies had to make all the documents public in an archive, which currently resides at UCSF, the University of California, San Francisco.IIT used this data to build a dataset of "messy" documents that were challenging for existing systems to process. There is handwriting on the documents, stains, etc. TREC used an automatic text conversion of this dataset in the TREC Legal Track, and we also have the original TIFF scans of the documents. The dataset consists of around 7 million documents, preprocessed with 90s-era OCR, and also the original page scans in TIFF format. See contact information in this record for access to this dataset.

    Access & Use Information

    Public: This dataset is intended for public access and use. License: See this page for license information.

    Downloads & Resources

    Dates

    Metadata Created Date February 8, 2022
    Metadata Updated Date July 29, 2022
    Data Update Frequency irregular

    Metadata Source

    Harvested from NIST

    Other Data Resources

    Additional Metadata

    Resource Type Dataset
    Metadata Created Date February 8, 2022
    Metadata Updated Date July 29, 2022
    Publisher National Institute of Standards and Technology
    Maintainer
    Identifier ark:/88434/mds2-2531
    Language en
    Data Last Modified 1996-01-01 00:00:00
    Category Information Technology:Data and informatics
    Public Access Level public
    Data Update Frequency irregular
    Bureau Code 006:55
    Metadata Context https://project-open-data.cio.gov/v1.1/schema/data.json
    Schema Version https://project-open-data.cio.gov/v1.1/schema
    Catalog Describedby https://project-open-data.cio.gov/v1.1/schema/catalog.json
    Harvest Object Id 4d89501c-8ae9-47ae-9f45-897bf4b561be
    Harvest Source Id 74e175d9-66b3-4323-ac98-e2a90eeb93c0
    Harvest Source Title NIST
    Homepage URL https://data.nist.gov/od/id/mds2-2531
    License https://www.nist.gov/open/license
    Program Code 006:045
    Source Datajson Identifier True
    Source Hash f361bb2bfa85ac1f8a6a0a4fd691619c82e478fb
    Source Schema Version 1.1

    Didn't find what you're looking for? Suggest a dataset here.