page 18 Model 2002
If the analog output voltage is being used in a data aquisition system, the following formulas can
be used to calculate pressure.
EXP = INT (2*V)-6
MANT = 1 + 18 *V-9*(EXP + 9)
Pressure (Torr) = Mant x 10
EXP
Therefore,
Note that the INT function simply returns to the first digit in a number.
examples:
INT (2.56) = 2
INT (9.87) = 9
Voltage to pressure conversion example:
Given V = 2.35 Volt
First calculate the exponent;
EXP = INT (2*2.35) - 6
= INT (4.7 - 6
= INT 4-6
= - 2
Next calculate the mantissa;
MANT = 1 + 18 * V - 9 (EXP +6)
= 1 + 18 * (2.35) - 9 * (2+6)
= 1 + 42.3 - 36
= 7.3
Finally the pressure is given by;
Pressure (torr) = MANT x 10
EXPEXP
EXPEXP
EXP
= 7.3 x 10
-2 -2
-2 -2
-2
Torr