Opened 9 years ago

Last modified 9 years ago

#690 new defect

AveragerPair::sum_xy_centered unstable

Reported by: Peter Owned by: Peter
Priority: minor Milestone: yat 0.x+
Component: statistics Version: trunk
Keywords: Cc:

Description

I have

AveragerPair ap;
ap.add(1,5);
ap.add(5,4);
ap.add(2,1);
ap.add(3,2);
ap.add(4,3);
cout << ap.sum_xy_centered() << "\n";

which gives output

-3.88578e-16

which is clearly a rounding error as I expected zero. Is it possible to increase the accuracy here?

Change History (1)

comment:1 Changed 9 years ago by Peter

Summary: AveragerPair::sum_xy_centered undstableAveragerPair::sum_xy_centered unstable
Note: See TracTickets for help on using tickets.