I'm creating a procedure to measure a resistance decade with the 8508A.

I have some doubt on the resolution for the uncertainty calculation.

Let's assume that I use the following procedure:

9.004 8508 900Z OC D6 N 4W

9.005 MATH MEM = MEM - Zero

9.006 MEMC 100 900.00Z 0.5%

Where Zero is the zero residual of the decade.

I understand that in this case Metcal will not consider the resolution of the 8508A, but it will take 0.01 as resolution. In this case I will have a much larger uncertainty.

Do there is a method to automatically take the resolution of the 8508A? Or I really have to manually calculate for every step the correct resolution and write the appropriate zeros?

## 8 comments