Notes on the precision of checking results
Even if the numbers in
the input of linear
integer depependence are exact and have integer relation
among them, check
results might return a non zero residual.
The reason for this is that
the precision of the linear
integer dependence algorithm is lower then the precision of checking
the result.
Try the following examples:
-
Data for linear dependence
= arctan(1), arctan(1/5), arctan(1/239) with precision = 15
and check precision = 30.
-
Data for linear dependence
= arctan(1),arctan(1/2),arctan(1/5),arctan(1/8) with precision =
15 and check precision = 30.
Back to IntegerRelations.
Agnes Szanto
Last
modified: Thu May 4 14:27:48 PDT 2000