HD6412320 RENESAS [Renesas Technology Corp], HD6412320 Datasheet - Page 750

• Manufacturer Part Number: HD6412320
• Description: Renesas 16-Bit Single-Chip Microcomputer H8S Family H8S-2300 Series
• Manufacturer: RENESAS [Renesas Technology Corp]

Section 16 A/D Converter (8 Analog Input Channel Version)
• Full-scale error
• Quantization error
• Nonlinearity error
• Absolute precision
Rev.6.00 Sep. 27, 2007 Page 720 of 1268
REJ09B0220-0600
The deviation of the analog input voltage value from the ideal A/D conversion characteristic
when the digital output changes from B'1111111110 to B'1111111111. (See figure 16.9.)
The deviation inherent in the A/D converter, given by 1/2 LSB. (See figure 16.8.)
The error with respect to the ideal A/D conversion characteristic between the zero voltage and
the full-scale voltage. Does not include the offset error, full-scale error, or quantization error.
The deviation between the digital value and the analog input value. Includes the offset error,
full-scale error, quantization error, and nonlinearity error.
Figure 16.8 A/D Conversion Precision Definitions (1)
Digital output
111
110
100
011
010
001
000
101
1024
1
1024
2
Ideal A/D conversion
characteristic
Quantization error
1022
1024
1023
1024
Analog
input voltage
FS