Dataset Reference
Overview
The corpus contains 1,535 records drawn from 323 distinct newspaper titles published across the United States between January 1880 and December 1885. Each record represents one newspaper page on which relevant material was identified through keyword search. Records are sourced from Chronicling America: Historic American Newspapers, a digital newspaper collection hosted by the Library of Congress and jointly sponsored with the National Endowment for the Humanities through the National Digital Newspaper Program (NDNP). Each record retains a persistent link to the original page image hosted on the Library of Congress.
Corpus composition
| Dimension | Value |
|---|---|
| Total records | 1,535 |
| Unique newspapers | 323 |
| Date range | 1880-01-01 to 1885-12-31 |
| Records without detected reprints | 786 |
| Records in reprint groups | 749 |
| Exported to deduplicated MALLET corpus | 1,100 |
| Exported to full MALLET corpus | 1,525 |
Records by keyword
| Keyword | Count |
|---|---|
| Chinese student | 482 |
| Chinese boy | 289 |
| Chinese children | 265 |
| Chinese girl | 227 |
| Chinese school | 168 |
| Chinese child | 81 |
| Chinese education | 23 |
Records by region
| Region | Count |
|---|---|
| West | 469 |
| South | 420 |
| Midwest | 394 |
| Northeast | 251 |
Records by year
| Year | Count |
|---|---|
| 1880 | 164 |
| 1881 | 379 |
| 1882 | 212 |
| 1883 | 200 |
| 1884 | 261 |
| 1885 | 319 |
Column Descriptions
Bibliographic metadata
Keyword
The search term used to retrieve the page. One of seven values: Chinese student, Chinese boy, Chinese girl, Chinese child, Chinese children, Chinese school, Chinese education. Tracking the search term supports analysis of how different queries shape what the corpus contains.
Date
Publication date in YYYY-MM-DD format.
Newspaper_Name
Title of the newspaper as recorded in the Chronicling America database.
Pub_City
City of publication.
Pub_State
State (or historical territory) of publication.
Coverage_Region
Additional geographic references associated with the article or newspaper, separated by vertical bars (e.g., Richland | Greenville | Columbia). Captures spatial scope beyond the publication city.
region_bin
Normalized Census region derived from publication location: West, South, Midwest, or Northeast.
Image_Number
The specific page image within the issue (e.g., Image 7).
Page_URL
Persistent link to the digitized page on the Library of Congress Chronicling America platform.
Content fields
OCR_cleaned
A cleaned excerpt containing the passage relevant to Chinese children or schooling. OCR noise has been reduced and line breaks normalized.
model_text
Version of the excerpt used as input to topic modeling. May differ slightly from OCR_cleaned due to additional preprocessing.
token_count
Approximate word count of the cleaned excerpt.
relevance_tier
Manual classification of how directly the page discusses Chinese children, schooling, or related debates. Values: core (1,426 records) or secondary (109 records).
topic_tags
Thematic tags applied during corpus review, separated by vertical bars (e.g., education|school|student). Support qualitative filtering and thematic search.
doc_id
Unique document identifier within the corpus (format: DOC_NNNNNN).
Deduplication and reprint tracking
Nineteenth-century newspapers frequently reprinted articles from other papers. These fields track duplicated material.
is_reprint
Boolean (true/false). Marks whether this record is a reprinted version of an earlier article.
is_original
Boolean. Marks the earliest known appearance of a text within a reprint chain.
reprint_count
Total number of records in the same duplicate group, including the original.
duplicate_group
Identifier linking records that share substantially similar text (e.g., REP_0374). Empty if no duplicate was detected.
sim_score
Similarity score used during fuzzy deduplication.
chain_position
Position of this record within the reprint chain (1 = earliest).
propagation_chain
Ordered list of doc_id values in the reprint chain, from original to latest reprint.
dedup_text
Normalized lowercase version of the excerpt used during deduplication processing.
model_text_deduped
Version of the text used for members of reprint groups that enter the deduplicated MALLET corpus after shared sentences are removed.
Topic modeling flags
use_for_mallet
Final selection flag for the deduplicated MALLET input corpus (yes/no). 1,107 records are marked yes; after the export script skips texts shorter than 50 characters, 1,100 documents are written to corpus_for_mallet.txt.
mallet_type
Within the deduplicated run, distinguishes records that use model_text (full) from records that use model_text_deduped (deduped).
mallet_ready_text
Final cleaned text passed to the deduplicated MALLET run.
mallet_rank
Ordering variable used when exporting the MALLET document set.
Temporal and geographic bins
month
Integer month of publication (1–12).
year_month
Year and month in YYYY-MM format. Used for time-series aggregation.
time_bin
Four-digit year as a string. Used for coarser temporal grouping.
Topic Taxonomy
The following table lists all non-noise topics identified across both model runs (S1: full corpus K25_S1; S2: deduplicated corpus K25_S2), with their thematic categories and analytic labels. Topic IDs correspond to the topic_id values used in the spatial map and dataset browser.
Chinese Educational Mission
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_17 | S2 | 0.2963 | Chinese Educational Mission |
| all_topic_24 | S1 | 0.1328 | CEM: Government Policy & Institutional Recall |
| all_topic_14 | S1 | 0.0411 | CEM: Student Lives & Personal Narratives |
| all_topic_0 | S1 | 0.0280 | CEM: Students & Cross-Cultural Marriage |
| all_topic_17 | S1 | 0.0205 | CEM: Political Controversy |
Education & Schools
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_7 | S2 | 0.1286 | Classroom Instruction |
| deduped_topic_8 | S2 | 0.1284 | Public School Admission |
| deduped_topic_13 | S2 | 0.1144 | Missionary & Church Schools |
| all_topic_3 | S1 | 0.0778 | Classroom Instruction |
| all_topic_2 | S1 | 0.0703 | Public School Admission |
| all_topic_16 | S1 | 0.0789 | Missionary & Church Schools |
| all_topic_18 | S1 | 0.0331 | Mission School Directories & Schedules |
Children & Family
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_18 | S2 | 0.2734 | Children & Family Life |
| all_topic_6 | S1 | 0.1107 | Children & Family Life |
| deduped_topic_6 | S2 | 0.0218 | Confucian Family Ethics |
| all_topic_8 | S1 | 0.0249 | Confucian Family Ethics |
| all_topic_12 | S1 | 0.0228 | Childhood Conditions & Moral Commentary |
Law, Politics & Exclusion
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_16 | S2 | 0.0763 | Criminal Cases & Court Proceedings |
| deduped_topic_24 | S2 | 0.0594 | Exclusion Legislation |
| all_topic_1 | S1 | 0.0363 | Exclusion Legislation |
| all_topic_5 | S1 | 0.0238 | Criminal Cases & Court Proceedings (Trials) |
| all_topic_19 | S1 | 0.0564 | Criminal Cases & Court Proceedings (Police) |
Violence & War
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_22 | S2 | 0.0426 | Anti-Chinese Violence |
| deduped_topic_20 | S2 | 0.0336 | Sino-French War |
| all_topic_10 | S1 | 0.0266 | Anti-Chinese Violence |
Commerce & Material Culture
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_21 | S2 | 0.0201 | East Asian Consumer Goods |
| deduped_topic_14 | S2 | 0.0327 | Social Dining & Interior Spaces |
| deduped_topic_10 | S2 | 0.0385 | Clothing & Physical Description |
| all_topic_23 | S1 | 0.0200 | East Asian Consumer Goods |
| all_topic_21 | S1 | 0.0249 | Trade in Chinese Goods & Furnishings |
Daily Life & Urban Space
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_9 | S2 | 0.1926 | Routine Press Reporting |
| deduped_topic_23 | S2 | 0.0375 | Chinatown Spatial Narratives |
| deduped_topic_0 | S2 | 0.0322 | Domestic Employment |
| all_topic_22 | S1 | 0.0172 | Domestic Employment |
Land, Migration & Labor
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_15 | S2 | 0.0694 | Hawaii & Pacific Migration |
| deduped_topic_11 | S2 | 0.0151 | Agriculture & Land Use |
| all_topic_11 | S1 | 0.0794 | Hawaii & Pacific Migration |
Culture, Perception & Acculturation
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| deduped_topic_4 | S2 | 0.0192 | Public Gatherings & Lectures |
| deduped_topic_12 | S2 | 0.0232 | Opium & Moral Degradation |
| all_topic_20 | S1 | 0.0166 | Physical Appearance & Curiosity Narratives |
| all_topic_15 | S1 | 0.0149 | Language Learning & Cultural Adjustment |
Diplomacy
| Topic ID | Run | Weight | Analytic Label |
|---|---|---|---|
| all_topic_9 | S1 | 0.0464 | Diplomacy & Ceremonial Events |
Example Record
| Field | Value |
|---|---|
| doc_id | DOC_000606 |
| Date | 1885-05-28 |
| Newspaper_Name | Baptist Courier |
| Pub_City | Greenville |
| Pub_State | South Carolina |
| region_bin | South |
| Keyword | Chinese girl |
| relevance_tier | core |
| topic_tags | child|children|general_chinese_reference|language|school |
| is_reprint | false |
| reprint_count | 1 |
| token_count | 312 |
| Page_URL | 📰 View original |
Excerpt:
Dear Children: As you have shown your interest in missions in so many ways, and especially in supporting a missionary in China, I thought a letter from one who, just a few years ago, was where you are now — in a South Carolina school — might be interesting to you. My first chapter will describe a Chinese school. As it is a Chinese school, of course they study the Chinese language…