Imaging · dataset · 2023
pixparse/idl-wds
Listed in Hugging Face Datasets
Dataset Card for Industry Documents Library (IDL) Dataset
Description
Summary
Industry Documents Library (IDL) is a document dataset filtered from UCSF documents library with 19 million pages kept as valid samples. Each document exists as a collection of a pdf, a tiff image with the same contents rendered, a json file containing extensive Textract OCR annotations from the idl_data project, and a .ocr file with the original, older OCR annotation. In each pdf, there may be from 1 to up… See the full description on the dataset page: huggingface.co/datasets/pixparse/idl-wds.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/pixparse/idl-wds ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/pixparse/idl-wds ↗
metadata API · from Hugging Face
Topics
- Stated by source
- image · image to text · text
- From keywords
- Computer Science & AI
- Inferred from text
- Image 75% · Optical character recognition 65%
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | pixparse/idl-wds | 12 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[method].local:method:ocr | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (65%) |
| concepts[modality].hf_modality:image | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].hf_modality:text | source · Hugging Face | connector:huggingface@1.0.0 | |
| concepts[modality].local:modality:image | enrichment · Hugging Face | keyword-concept-rules@1.0.0 | title+description (75%) |
| concepts[task].hf_task:image-to-text | source · Hugging Face | connector:huggingface@1.0.0 | /tags[task_categories:*] |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license_text | source · Hugging Face | connector:huggingface@1.0.0 | |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |