Constarium
← Search

Data · dataset · 2026

Modern Chinese Prose Corpus

Listed in ScienceDB

This study comprises five prose subcorpora representing five major literary schools: the Beijing School, the Shanghai School, the July School, the Lotus Lake School, and Left-Wing Literature.

Description

Each subcorpus collects prose works of representative writers from the corresponding school. The raw materials were stored in TXT format across multiple subdirectories with inconsistent encodings.

Data processing was carried out using Python 3.12 scripts in a Windows 11 environment, following a unified workflow: deduplication by filename, automatic encoding detection and compatibility (UTF-8, GB18030, GBK, Big5), removal of page-number lines, elimination of Arabic numerals and special characters (while retaining common Chinese punctuation), and paragraph segmentation by blank lines with a single blank line retained between paragraphs.

Read the rest (2 more)

The five subcorpora combined comprise approximately 14.55 million effective Chinese characters and approximately 184,000 paragraphs. The specific sizes of each subcorpus are as follows: Beijing School Prose contains approximately 2.93 million characters (37,860 paragraphs); Shanghai School Prose contains approximately 1.65 million characters (23,571 paragraphs); July School Prose contains approximately 2.24 million characters (19,442 paragraphs); Lotus Lake School Prose contains approximately 2.50 million characters (39,912 paragraphs); and Left-Wing Literature Prose contains approximately 5.24 million characters (63,129 paragraphs).

All five subcorpora are processed under identical cleaning protocols, encoding handling, punctuation retention rules, and paragraph segmentation standards, ensuring a unified data foundation for cross-corpus linguistic comparisons.

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Literature in Chinese 76%
Provenance · 1 source records, 11 field assertions
SourceKeyLast seenRaw
ScienceDB10.57760/sciencedb.010jx9 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · scidb cnconnector:scidb_cn@1.0.0
concepts[field].anzsrc:field:470515enrichment · scidb cntaxonomy-embedding@1.0.0title+keywords+description (76%)
concepts[field].local:field:earth-environmentalmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:engineeringmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:humanitiesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:life-sciencesmapping · scidb cnconnector:scidb_cn@1.0.0
concepts[field].local:field:social-sciencemapping · scidb cnconnector:scidb_cn@1.0.0
descriptionsource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/description
license_textsource · scidb cnconnector:scidb_cn@1.0.0
publication_datesource · scidb cnconnector:scidb_cn@1.0.0
titlesource · scidb cnconnector:scidb_cn@1.0.0/metadata/dc/title