Resolution

smallest readable increment of a gauge

The smallest change a gauge can display. As a rule it should be at most 5 % of the tolerance (older rule: one tenth). Coarse resolution makes the data step-like and distorts sigma, capability and control limits.

Calculate it

Type 1 Gauge Study (Cg, Cgk): Cg, Cgk and bias test from repeated measurements of one master part.

Related terms

• MSA: measurement system analysis
• Cg and Cgk: gauge capability (type 1 study)