Data · dataset · 2016
HTRC Extracted Features [v.0.2] `langid`
Listed in DataCite
This archive contains the results of computing `langid` for the OCR tokens of each page in every volume of the HathiTrust HTRC Extracted Features [v.0.2] dataset.
Description
Each file is a CSV file of ISO639-1 language code and probability pairs for each page, where the filename is `[HTRC-volume-identifier].basic.json.csv`. Version 1.1.5 of `langid` was used for processing.
Warning: this archive will decompress to a ~25GB directory containing 4,805,434 files.
Links
Where it is published
- Repository landing page figshare.com/articles/dataset/HTRC_Extracted_Features_v_0_2_langid_/3382774… ↗
landing page · from DataCite
- DOI doi.org/10.6084/m9.figshare.3382774.v1 ↗
DOI / persistent id · from DataCite
Documentation and papers
Catalogue records · 2
- DataCite API api.datacite.org/dois/10.6084/m9.figshare.3382774.v1 ↗
metadata API · from DataCite
- DataCite Commons commons.datacite.org/doi.org/10.6084/m9.figshare.3382774.v1 ↗
catalogue entry · from DataCite
Topics
- Stated by source
- Computer and information sciences · Languages and literature
- From keywords
- Linguistics
- Inferred from text
- Optical character recognition 65%
Related
Provenance · 1 source records, 11 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| DataCite | 10.6084/m9.figshare.3382774.v1 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · DataCite | connector:datacite@1.0.0 | /data/attributes/rightsList |
| byte_size | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].fos:computer-and-information-sciences | source · DataCite | connector:datacite@1.0.0 | |
| concepts[field].fos:languages-and-literature | source · DataCite | connector:datacite@1.0.0 | |
| concepts[method].local:method:ocr | enrichment · DataCite | keyword-concept-rules@1.0.0 | title+description (65%) |
| created_date | source · DataCite | connector:datacite@1.0.0 | |
| description | source · DataCite | connector:datacite@1.0.0 | /data/attributes/descriptions |
| license | source · DataCite | connector:datacite@1.0.0 | /data/attributes/rightsList |
| publication_date | source · DataCite | connector:datacite@1.0.0 | /data/attributes/dates |
| title | source · DataCite | connector:datacite@1.0.0 | /data/attributes/titles/0/title |
| updated_date | source · DataCite | connector:datacite@1.0.0 |