MIRACLE

MIRACLE reconstructs the local economic histories of growth miracles, starting with South Korea. The first phase turns about two million pages of municipal statistical yearbooks, printed in mixed Hangul⁠–⁠Hanja, into the first consistent township-year economic panel for 1960–1985.

Period
1960–1985, annual
Unit
Township (읍·면), on time-consistent boundaries
Source
Municipal statistical yearbooks (통계연보), about two million pages
Pilot
Late 2026, about 400 townships along the Gyeongbu Expressway corridor
Funding
LSE and STEG
bookangseol/miracle-korea-database
Approach

Building MIRACLE involves two main challenges. The first is finding the yearbooks. No central archive holds them all, and most surviving volumes, especially the earlier ones, are scattered across county offices. The project scans surviving volumes on site at the National Archives of Korea, major libraries and county offices. The second is turning scanned pages into usable data. MIRACLE has developed an OCR pipeline that cross-checks three pretrained document-AI models against the tables' own printed totals. This keeps accuracy high at scale, and each release will report a measured error rate. A single identifier (miracle_id) follows each township through boundary changes, including the major reorganisations of 1963 and 1973.

The Korean panel is the first phase of a longer-term effort to reconstruct the local economic histories of growth miracles. Future phases would extend it along three dimensions.

Phase 1Township panel
Phase 2Further back and deeper
Phase 3Specialised records
South Korea
Phase 1UnderwayMunicipal yearbooks, 1960–1985Pilot release late 2026
Phase 2Colonial-era and census recordsLinked to the same townships, where access allows
Phase 3Firm-level recordsAnd other specialised archives
Taiwan, Singapore
Phase 2Comparable statistical archivesSet up from a few hundred hand-keyed pages
Phase 3Deeper recordsWhere access allows

Each country would move through the phases at its own pace.

  • Time depth. Link the same townships to colonial-era records, so that conditions before the growth take-off can be measured in the places where growth later happened.
  • Data depth. Add census and firm-level records where access allows, connecting places to the people and firms within them.
  • Geographic breadth. Extend the approach to other economies with comparable archives, such as Taiwan and Singapore. The pipeline needs only a few hundred hand-keyed pages to set up on a new collection, which is what makes this feasible.

These are plans rather than commitments. Each depends on access to the records and on local partners.

  • Municipal Statistical Yearbooks 통계연보 Core — digitising now
    Township-level demographics, agriculture, industry, infrastructure, public finance, and education. Published annually by county governments.
  • Forest Type Maps 임상도 Collected
    Korea Forest Service spatial archives. Shapefiles available from 조선임야분포도 (1910) and forest type maps from 1974 onward. Enables studying one of history's largest reforestation programmes.
  • New Village Survey 새마을총람 Collected
    Comprehensive village-level survey published in 1972 by the Ministry of Home Affairs (내무부). Covers all ~35,000 villages with township-level maps, distance tables, and detailed statistics on households, population, land, and infrastructure. Led and digitised by Hyunjoo Yang (Advisor, Sogang University).
  • Future archival layers (not yet in active digitisation)
  • Agricultural Extension Records Planned
    Farm-level adoption of high-yield rice varieties and extension programme participation.
  • Expressway Construction Logs Planned
    Construction timelines and route data for the Gyeongbu Expressway and subsequent motorway network.
  • Personnel Files Planned
    Local government personnel records. Bureaucratic capacity and institutional quality measures.
Data sources

MIRACLE draws on multiple archival source types. Municipal statistical yearbooks form the backbone; additional layers are planned.

통계연보

Municipal Statistical Yearbooks Core — digitising now

Township-level demographics, agriculture, industry, and public finance. Published annually by every county government.

임상도

Forest Type Maps Collected

Korea Forest Service spatial archives from 1910 and 1974 onward. Enables research on large-scale reforestation.

고속도로 공사일지

Expressway Construction Logs Planned

Construction timelines and route data for the Gyeongbu Expressway and subsequent motorway network.

새마을총람

New Village Survey Collected

Comprehensive village-level survey published in 1972 by the Ministry of Home Affairs (내무부), covering all ~35,000 villages in South Korea. Led and digitised by Hyunjoo Yang (Advisor, Sogang University).


Pipeline — Yearbook Digitisation

From archive to analysis-ready panel in seven steps.

01

Finding the yearbooks Done

No central archive holds the yearbooks. The National Archives of Korea hold a good number of volumes, but most surviving ones, especially the earlier years, are scattered across county offices. A systematic survey maps what exists, what is missing and where each volume is held.

02

Scanning on site Largely complete

Volumes are scanned on site with high-speed scanners, at county offices, the National Archives of Korea and major libraries.

03

Reading the tables Current focus

Three pretrained open document-AI models read every page, with no training on our pages. Each cell is then settled by a weighted vote. A model's weight depends on how accurately it reads that kind of content, measured against a set of hand-keyed pages.

Custom-trained pipelinee.g. Layout Parser + EffOCRPretrained readers, cross-checkedMIRACLE
How pages are readA layout detector and a character recogniser, customised to the corpusThree pretrained document-AI models read every page side by side
Setting up a new corpusLabel example layouts and characters, then trainScore candidate models on a few hundred hand-keyed pages, with no training
Where accuracy comes fromA better-trained readerDisagreement between readers, refereed by the tables' own totals
Where people spend timeLabelling training dataReviewing flagged cells and a random audit sample
Strongest whenScripts or layouts no pretrained model knows, or very large uniform collections at the lowest costVaried layouts, mixed scripts, and tables with built-in totals

Layout Parser: Shen, Zhang, Dell, Lee, Carlson & Li (2021). EffOCR: Carlson, Bryan & Dell (2024).

Structured output — 경지면적현황, 남해군 (1969)
읍면합계논 (답)밭 (전)✓
소계1모작2모작
남해8,0545,8491,2304,6192,205✓ balanced
이동10,9937,5441,1756,3693,449✓ balanced
삼동12,7857,3491,2396,1105,436✓ balanced
남면11,4706,0128575,1555,458✓ balanced
고현8,3105,6807434,9372,630✓ balanced
창선13,1737,9012,3115,5905,272✓ balanced
All township names correct. Nested headers preserved. Row-level cross-validation passed.
Source: 경지면적현황, 남해군 통계연보 (1969) — mixed Hangul⁠–⁠Hanja table with vertical headers
1農 業 ~22← Page number confusion
22 경 지 면 적 현 황← Vertical text → individual chars
3(단위 :단보)
4구분 합 게 등 게 답 1포작 2포작 전 미 합게← Nested headers flattened
5면별 8,054 5,849 1,230 4,619 2,205 444← Row-column mapping unclear
6남 해 10,993 7,544 1,175 6,369 3,449 890← Numbers may be misaligned
7설 동 11,470 6,012 857 5,155 5,458 841← '삼동' → '설동' misrecognised
8남 9,553 5,891 1,101 4,790 3,662 522← Township name truncated
9저 현 9,564 9,705 550 6,145 2,859 955← '고현' split across lines
10창 13,173 7,901 2,311 5,590 5,272← '창선' → '창' only
⚠ Vertical headers completely failed. Table structure unrecoverable.
Layout parsing failure
Nested headers flattened — column-data mapping lost
Vertical text failure
Vertical Korean split into individual characters
Cell mapping errors
Numbers detached from columns
Same source, read three times and checked against the table's own totals
  1. 01 · ReadThree readersPretrained open models, no training on our pages
  2. 02 · ReconcileWeighted voteCell by cell, weights learned from hand-keyed pages
  3. 03 · RefereeTotals checkThe reading that balances row and column totals is kept
  4. 04 · AdjudicateModel reviewPicks a reading or flags the cell, never invents a number
  5. 05 · ValidatePanel checksJumps over time, township sums against county totals, figures across publications
  6. 06 · OutputTownship panelEvery number keeps its provenance
People in the loop. Research assistants review flagged cells and a random audit sample. This gives the measured error rate and updates each reader's weight.

See structured output table above.

04

Checking the numbers Current focus

Each candidate reading is tested against the printed row and column totals, and the one that balances is kept. A frontier model reviews any remaining conflict and either picks a reading or flags the cell. It never supplies a number of its own. Panel checks then look for jumps over time, township sums that miss county totals, and figures that differ across publications. Research assistants review flagged cells and a random audit sample, which gives the measured error rate. Every number keeps its provenance.

05

Variable harmonisation Current focus

Definitions, units, and table structures changed across editions and municipalities. We build crosswalks reconciling these into consistent time series.

06

Boundary concordances Pilot complete

Two major reorganisations (1963, 1973) plus dozens of smaller changes. We construct time-consistent miracle_id identifiers.

07

Geocoding & GIS Pilot complete

Every township linked to satellite, elevation, slope, soil, and transport network data. 196 Namhae-gun villages fully geocoded.


Output

The dataset is organised into modules by domain, each a flat township-year panel. Merge across modules using Core Keys. CSV, Stata & Python, with full codebook and variable documentation.

miracle_idyearprovmunitwppophhpaddy_haschoolsroad_km
KR-48-840-0101970경남남해군남해읍28,4125,6801,245723.4
KR-48-840-0101975경남남해군남해읍25,8915,3201,198831.7
KR-48-840-0101980경남남해군남해읍22,1055,0101,152838.2
KR-47-720-0301970경북영주시풍기읍31,5506,1401,870918.6
Illustrative example — pilot data release late 2026.
ModuleDescriptionPlanned
Core Keys
miracle_id · province · municipality · township · concordances
Geographic identifiers and boundary concordances across the 1963/1973 reorganisations.2026
Demographics
population · households · age structure
Population counts, household numbers, demographic composition.2026
Agriculture
paddy area · crop output · livestock
Cultivated area, output (harmonised to metric units), livestock.2026
Industry
establishments · employment · output
Industrial establishments, manufacturing employment, sectoral output.2028
Infrastructure
roads · electricity · water · telecom
Road length, electrification, public utilities.2028
Public Finance
revenues · expenditures · transfers
Municipal revenue/expenditure, central transfers, fiscal capacity.2028
Education
schools · enrolment · teachers
School counts, enrolment, teachers, educational infrastructure.2028
Geospatial
shapefiles · centroids · boundaries
GIS boundary files with consistent township geometries.2028
Institutions
clan concentration · bureaucratic capacity
Pre-treatment institutional measures from 1930 registries and personnel files.2029

The coverage map shows the status of every yearbook by municipality and year. A public explorer for the panel itself is in development.

Pilot release, late 2026. Core Keys, Demographics and Agriculture modules for about 400 townships along the Gyeongbu Expressway corridor, in CSV, Stata and Python. Available to researchers on request. Later releases will extend coverage nationwide, and the full panel will be released as a public resource. Request access.
Yearbook collection

Of the 4,356 yearbooks expected for 1960–1985, 3,249 (75%) have been scanned. A copy of a further 709 has been located, and 398 have not been found.

경기 강원 충북 충남 전북 전남 경북 경남 제주 서울 Namhae County pilot 196 villages geocoded
Scanned or copy located: under 70% 70–79% 80–89% 90–94% 95% or more
ProvinceScannedLocatedNot foundScanned or located
Seoul2600100%
Gyeonggi489861897%
Gangwon354963393%
N. Chungcheong238432692%
S. Chungcheong327553093%
N. Jeolla304644290%
S. Jeolla4479310584%
N. Gyeongsang5351515493%
S. Gyeongsang4521218887%
Jeju770297%
All provinces3,24970939891%

One yearbook per municipality per year. Last updated October 2026. Coverage by municipality

Milestones
2023–24
Source survey across provincial archives. First OCR pilots. Namhae-gun pilot, 196 villages geocoded. Collaboration with KDI School and Sogang University begins.
2025
STEG and LSE seed funding. Systematic scanning begins. Variable harmonisation framework. Boundary concordance with the Academy of Korean Studies.
2026
Reading pipeline rebuilt around three pretrained readers checked against printed totals. 75% of yearbooks scanned by October 2026. Pilot release for the Gyeongbu Expressway corridor, about 400 townships. Hiring research associates for 2027–28.
2027–28
Planned. Scanning and reading towards national coverage. Industry, Infrastructure, Public Finance and Education modules, planned for 2028.
Research agenda

Growth miracles are usually studied as national events. Korea's transformation between 1960 and 1985 is among the best documented, yet most of the evidence on it comes from national or provincial statistics. MIRACLE's more granular data make it possible to date local change, compare places within the same province, and study mechanisms using variation that aggregates average away. Three projects using these data are under way. Further questions would require extending them back into the colonial period, into records of households and firms, and to other economies.

Current projects
Future directions

Each topic below would require one of the extensions set out in the longer-term vision. We welcome collaborators on any of them.

Related work

If you are using or interested in using MIRACLE data, or would like to work on any of these questions, we would like to hear from you. Get in touch.

People and institutions

Project Lead

BooKang Seol
Project Lead

BooKang Seol

설부강
Postdoctoral Fellow, LSE
Position
Postdoctoral Fellow, Department of International Development, London School of Economics
Education
PhD in Economics, Columbia University
Fields
Development, economic growth
Interests
Structural transformation, industrial development, market access
Email
[enable JavaScript]
CV
CV (PDF)

Advisors

Changkeun Lee
Advisor

Changkeun Lee

이창근
KDI School of Public Policy and Management
Hyunjoo Yang
Advisor

Hyunjoo Yang

양현주
Dept. of Economics, Sogang University

Research Associates

Hoyeon Byun
Research Associate

Hoyeon Byun

변호연
Ph.D. Candidate in Economics, SNU
Inhwan Park
Research Associate

Inhwan Park

박인환
Ph.D. Candidate in Economics, Sogang University
Yoorim Son
Research Associate

Yoorim Son

손유림
Master's student, Sogang University

Hiring research associates for 2027–28. Get in touch.

Collaborating institutions

KDI School of Public Policy and Management Sogang University

Funded by

London School of Economics STEG

For early access, collaboration, or questions — [enable JavaScript]