<-prev [Thread] next-> <-prev [Date] next->
Month Index | List Home

Re: [xsl] Rounding errors in financial app transforms

Subject: Re: [xsl] Rounding errors in financial app transforms
From: David Carlisle <davidc@xxxxxxxxx>
Date: Thu, 26 Jul 2007 14:39:40 +0100
> So the intermediate product has double the precision of the original
> arguments.

er yes exactly, but since xsd::integer/xsd:decimal are high (and in some
implementations arbitrary) precision, doubling the precision is not
exactly relevant. If you do the multiply first it _wont_ overflow it
will just eat your entire memory storing a gazillion digits (perhaps)

David


________________________________________________________________________
The Numerical Algorithms Group Ltd is a company registered in England
and Wales with company number 1249803. The registered office is:
Wilkinson House, Jordan Hill Road, Oxford OX2 8DR, United Kingdom.

This e-mail has been scanned for all viruses by Star. The service is
powered by MessageLabs. 
________________________________________________________________________
Current Thread
<- PreviousIndexNext ->
Re: [xsl] Rounding errors in financ, Justin Johansson Thread RE: [xsl] Rounding errors in financ, Michael Kay
RE: [xsl] asthetics vs convention f, Michael Kay Date Re: [xsl] Rounding errors in financ, Dimitre Novatchev
Month