Skip to content
Test Types & Methods

What Is Ongoing Reliability Testing (ORT)

Ongoing reliability testing (ORT) samples production units to catch reliability drift. Learn how ORT works and how to track it with TofuPilot.

JJulien Buteau
intermediate7 min readMarch 14, 2026

What Is ORT with TofuPilot

Ongoing reliability testing (ORT) pulls units from the production line at regular intervals and subjects them to stress tests. It catches reliability problems caused by process drift, supplier changes, or material variation that production tests don't detect. This guide covers how ORT works, what it catches, and how to track ORT results with TofuPilot.

Why Production Test Is Not Enough

Production tests verify that a unit works right now. They don't tell you whether it will still work in a year. A solder joint can pass ICT and FCT but crack after 200 thermal cycles. A capacitor can measure within spec but degrade under humidity.

ORT catches these problems by:

  1. Sampling units from each production lot
  2. Running stress tests (temperature, humidity, vibration, powered operation)
  3. Comparing results to the reliability baseline established during DVT

If ORT results drift from baseline, something changed in the process or supply chain.

What ORT Catches

ProblemHow It Shows Up in ORT
Solder process driftIncreased failures during thermal cycling
Component substitutionDifferent failure mode than baseline
ContaminationHumidity test failures, leakage current increase
Fixture wearMarginal contact resistance readings
Supplier quality changeShifted measurement distributions

Typical ORT Program

ParameterTypical Value
Sample size2-5 units per lot or per week
Stress profileSubset of HALT/DVT stress levels
Duration48-168 hours per sample
Functional checksBefore, during (at intervals), and after stress
Acceptance criteriaZero failures, measurements within DVT baseline

Prerequisites

  • Python 3.10+
  • OpenHTF installed (pip install openhtf)
  • TofuPilot Python SDK installed (pip install tofupilot)

Step 1: Define ORT Functional Checks

ORT functional checks run before stress, at intervals during stress, and after stress. They should match the measurements used in your DVT baseline.

ort_check.py
import openhtf as htf
from openhtf.util import units


@htf.measures(
    htf.Measurement("output_voltage_V")
    .in_range(
        minimum=4.85, maximum=5.15,
        marginal_minimum=4.9, marginal_maximum=5.1,
    )
    .with_units(units.VOLT),
    htf.Measurement("quiescent_current_uA")
    .in_range(maximum=50)
    .with_units(units.MICROAMPERE),
)
def phase_electrical(test):
    """Core electrical parameters for ORT baseline comparison."""
    test.measurements.output_voltage_V = 5.01
    test.measurements.quiescent_current_uA = 12.4


@htf.measures(
    htf.Measurement("boot_time_ms")
    .in_range(maximum=1500)
    .with_units(units.MILLISECOND),
    htf.Measurement("memory_check").equals("PASS"),
)
def phase_functional(test):
    """Functional checks to detect degradation after stress."""
    test.measurements.boot_time_ms = 980
    test.measurements.memory_check = "PASS"

Step 2: Log Each Check to TofuPilot

Run the ORT check script at each interval. Each execution creates a new run linked to the unit's serial number.

ort_check.py
from tofupilot.openhtf import TofuPilot

test = htf.Test(
    phase_electrical,
    phase_functional,
)

with TofuPilot(test):
    test.execute(test_start=lambda: input("Scan ORT sample serial: "))

Step 3: Monitor ORT Trends in TofuPilot

TofuPilot tracks ORT results alongside production test data. Open the Analytics tab to see:

  • Measurement trends per ORT sample over time
  • Baseline comparison between ORT results and DVT data
  • Marginal results flagged before they become failures
  • Control charts showing process stability across production lots

When an ORT sample shows measurements drifting toward limits, investigate before the next production lot ships. The earlier you catch process drift, the smaller the containment scope.

ORT vs Other Reliability Methods

MethodWhenUnitsGoal
HALTDesign (EVT/DVT)5-15 prototypesFind design limits
ALTPre-production (DVT)20-50 unitsPredict field life
HASSProductionEvery unitScreen latent defects
ORTProduction (ongoing)2-5 per lotMonitor reliability drift
Burn-inProductionEvery unit or sampleScreen infant mortality

ORT is the ongoing check that validates your HALT margins and HASS screens are still working. If ORT starts failing, your HASS profile may need updating, or your process needs investigation.

More Guides

Put this guide into practice