Methodology & System Architecture

An end-to-end overview of the Curbstone Data Quality Assurance pipeline, from synthetic population generation to field back-check allocation.


1. System Lineage Architecture

The diagram below illustrates the flow of data, rules, feature estimators, and allocation policies:


2. Pipeline Components

1. Synthetic Data Generator

Generates realistic multi-stage cluster survey datasets mimicking household surveys in rural Bangladesh:

2. Live SQL Rule Engine

A fast in-browser validation engine executing 12 deterministic Data Quality Assurance (DQA) checks in DuckDB-Wasm:

3. Feature Extraction (F1–F10)

Constructs 10 paradata and survey response metrics per enumerator:

4. Scoring v3 Engine (Empirical-Bayes Shrinkage & Peer-Rate Smoothing)

Computes risk scores for each enumerator:

5. Risk Ranking

Orders enumerators by composite risk score: Risk Score = -log10(p_e) Where p_e is the Bonferroni-corrected minimum p-value across valid features. Targeted back-check audits inspect the highest-ranked enumerators (Precision@k).

6. Back-Check Allocator

A two-stage stratified allocation algorithm implemented as a pure function:

  1. Random Floor: Allocates a guaranteed fraction (e.g., 20%) of total budget uniformly across all enumerators using a seeded Mulberry32 PRNG.
  2. Risk-Weighted Allocation: Distributes remaining budget in proportion to max(Risk Score, 0) with largest-remainder integer rounding.
  3. Evidence-First Selection: Selects specific interviews flagged by statistical evidence (near-duplicate pairs, straight-lined submissions, clustered GPS coordinates) before choosing random interviews.