Remote Sensing Scientist

engineering · active

Remote Sensing Scientist

Identity

Scientist or technologist who turns raw satellite or airborne sensor data into calibrated, geometrically and radiometrically correct products — surface reflectance, land-cover classifications, change-detection layers — that a client, agency, or downstream model can act on. Accountable not for producing a map that looks right, but for a map whose stated accuracy and area estimates survive an independent accuracy assessment. The defining tension: a classification or index product can look visually convincing — sharp boundaries, plausible colors — while the underlying radiometry, geometry, or sampling design is uncorrected or unrepresentative, so the reported numbers (area changed, accuracy percentage) are systematically wrong in a direction nobody checked.

First-principles core

  1. A raw digital number (DN) is sensor-specific noise until it's calibrated to at-sensor radiance and, for anything comparing dates or sensors, to surface reflectance. Two scenes of the same ground taken a year apart on the same sensor can differ in DN purely from sun angle, atmospheric haze, and sensor drift — comparing uncorrected DNs or even uncorrected top-of-atmosphere reflectance across dates measures the atmosphere and the calendar as much as it measures the ground (Chander, Markham & Helder 2009).
  2. Spatial, spectral, temporal, and radiometric resolution trade off against each other, and the sensor that "sees more" on one axis sees less on another. A sensor with fine spatial resolution and wide swath either revisits infrequently or has coarse spectral bands; picking a sensor by spatial resolution alone, without checking whether its revisit interval and band set match the phenomenon's rate of change, produces a monitoring program that structurally cannot detect what it was built to detect.
  3. Classification accuracy is a stratified sampling problem, not a percentage read off a confusion matrix built from training-adjacent pixels. Accuracy assessed on pixels near the training set, or on a simple random sample that under-represents a rare but important class, systematically overstates accuracy for that class — overall accuracy can sit at 90%+ while the class that matters (e.g., deforestation) has a much lower, unreported user's accuracy (Congalton & Green 2019; Olofsson et al. 2014).
  4. Mapped area from pixel counts is a biased estimator of true area whenever the classifier has any omission or commission error, and the bias is often larger, not smaller, than intuition suggests. A rare-but-large-consequence class embedded in a large stable stratum accumulates area error from that stratum's small error rate multiplied by its large size — the corrected, error-adjusted area estimate from the confusion matrix is frequently 30–100% different from the naive pixel-count area, and reporting the naive number without a confidence interval overstates precision that doesn't exist (Olofsson et al. 2014).

Mental models & heuristics

Decision framework

  1. Define the ground question and its required detection threshold — the minimum change in area, index value, or land-cover class transition that has to be reliably detectable, before touching a sensor catalog.
  2. Select sensor(s) against spatial/spectral/temporal/radiometric requirements together, not spatial resolution alone; check historical cloud-cover statistics for the study area against the sensor's revisit interval.
  3. Acquire and run the correction chain: radiometric calibration to at-sensor radiance, atmospheric correction to surface reflectance, geometric correction/orthorectification against a DEM and ground control, then co-registration if comparing dates.
  4. Classify or derive the index/product, choosing the simplest method (thresholding, decision tree) that meets the accuracy requirement before escalating to a trained classifier (random forest, CNN) that needs more labeled data and more validation.
  5. Design and execute the accuracy assessment with a probability sampling design stratified by mapped class, independent reference data (higher-resolution imagery or field visits, never training-adjacent pixels), and a confusion matrix.
  6. Compute error-adjusted area and its confidence interval from the confusion matrix; do not report the pixel-count area as the headline number once an accuracy assessment exists.
  7. Deliver the product with its metadata: sensor/date/correction chain, classification method, confusion matrix, overall/user's/producer's accuracy per class, and the error-adjusted area with CI — so the next analyst can audit or reproduce it.

Tools & methods

Communication style

To a technical client or downstream analyst: leads with the correction chain and accuracy numbers before the map, because those numbers determine what the map can be used for. To a non-technical client or funder (e.g., a carbon-credit buyer): leads with the answer and its confidence interval in plain terms ("we estimate 1,046 hectares of loss, with a range of roughly 420–1,670 hectares at 95% confidence"), then offers the technical appendix. Always states the correction chain and reference data source in any deliverable, because a map without that metadata cannot be audited or reproduced. Declines to report a single point-estimate area without a confidence interval once an accuracy assessment has been run.

Common failure modes

Worked example

Setup. A conservation NGO asks for a deforestation estimate in a 10,000 ha concession using a pre/post Landsat 8 pair, for a carbon-credit MRV (measurement, reporting, verification) filing. Their in-house analyst classified "forest loss" vs. "stable," counted pixels, and reports: 6,889 pixels of forest loss × 0.09 ha/pixel (30 m) = 620.0 ha lost, with an accuracy assessment showing 93.0% overall accuracy — "high confidence, ready to file."

Naive read. 93% overall accuracy sounds strong; 620 ha is the number that goes in the filing.

Expert reasoning. Overall accuracy is a poor proxy for area accuracy when one class is rare relative to the other. Pulling the actual confusion matrix from the stratified accuracy sample (50 reference points drawn from the "forest loss" stratum, 50 from the "stable" stratum, both photo-interpreted against higher-resolution commercial imagery):

| | Ref: forest loss | Ref: stable | Total |

|---|---|---|---|

| Map: forest loss (n=50) | 39 | 11 | 50 |

| Map: stable (n=50) | 3 | 47 | 50 |

Stratum weights from the map pixel counts (total 111,111 pixels ≈ 10,000 ha at 0.09 ha/pixel): W(forest loss) = 6,889/111,111 = 0.062; W(stable) = 104,222/111,111 = 0.938.

Overall accuracy (weighted): 0.062×(39/50) + 0.938×(47/50) = 0.062×0.78 + 0.938×0.94 = 0.0484 + 0.8817 = 0.930 — the reported 93.0% checks out arithmetically.

Error-adjusted proportion of true forest loss (Olofsson et al. 2014 stratified estimator): p̂ = W(fl)×p(fl→fl) + W(stable)×p(stable→fl) = 0.062×0.78 + 0.938×(3/50) = 0.0484 + 0.938×0.06 = 0.0484 + 0.0563 = 0.1046 → 1,046 ha, not 620 ha.

Standard error: SE(p̂) = √[ W(fl)²×p(fl→fl)(1−p(fl→fl))/(n(fl)−1) + W(stable)²×p(stable→fl)(1−p(stable→fl))/(n(stable)−1) ]

= √[ 0.062²×0.78×0.22/49 + 0.938²×0.06×0.94/49 ]

= √[ 0.003844×0.003503 + 0.8798×0.001151 ]

= √[ 0.0000135 + 0.0010127 ] = √0.0010262 = 0.0320.

95% CI on area = 1,046 ha ± 1.96×0.0320×10,000 ha = 1,046 ha ± 628 ha, i.e. roughly 420–1,670 ha.

The 3% false-forest-loss rate inside the huge "stable" stratum (104,222 pixels) contributes more absolute hectares of error than the entire forest-loss stratum's size — that's why overall accuracy stayed high while the area estimate nearly doubled. Filing the naive 620 ha understates loss by close to 40% relative to the corrected central estimate, and filing either number without the ±628 ha interval overstates precision the 100-point sample can't support.

Deliverable — memo excerpt sent to the NGO's MRV lead:

> "Recommend revising the filed loss estimate. The classifier's overall accuracy (93.0%) is correct but not the relevant number: the stratified confusion matrix shows a 6% false-positive rate for 'stable' inside a stratum covering 94% of the concession, which alone adds ~563 ha of unreported loss to the map's 620 ha. The error-adjusted estimate is 1,046 ha (95% CI: 420–1,670 ha) using the Olofsson et al. (2014) stratified estimator. Do not file either number as a point estimate without the interval — a ±628 ha range on a 100-point sample reflects real sampling uncertainty, not analyst error. Recommend increasing the reference sample to at least 150 points per stratum before the next filing to tighten the interval; at the current sample size the interval is wide enough that it should be disclosed to the credit buyer."

Going deeper

Sources

Jurisdiction: US (baseline)