Subject: RE: [xsl] Unexpected result in sum From: "Michael Kay" <mike@xxxxxxxxxxxx> Date: Sat, 10 Nov 2007 00:01:11 0000 
> Why does this not output 0.00? When formatted, I end up with $0.00. The sum is not zero because of the rounding errors that occur with floating point arithmetic. When values such as 1.11 are converted to binary floating point, a small rounding error occurs. You can avoid this (if it's significant) by using decimal arithmetic rather than floating point. Alternatively, you can round off to two decimal places after doing the summation. There's a legitimate question about whether formatnumber() when applied to a very small negative number should output 0.00 or 0.00. I assume that's how you are doing the formatting. Saxon is doing what the spec says it should do, but it seems less than ideal. This is nothing to do with negative zero, by the way. The total is not negative zero, but a small nonzero negative number, and the rules for formatnumber say that a minus sign is used when the supplied value is negative, even if the value after rounding is zero. Michael Kay http://www.saxonica.com/ > > I've read what I can find on negative zero, but can't see how > this node set and operation could produce it. > > Using Saxon 8.9 processor (internal to Oxygen.) > > Input: > <?xml version="1.0" encoding="UTF8"?> > <a> > <b>1103.86</b> > <b>1829.30</b> > <b>853.77</b> > <b>243.17</b> > <b>1.11</b> > <b>1296.66</b> > <b>588.52</b> > <b>849.25</b> > <b>1976.22</b> > </a> > > Output: > <?xml version="1.0" encoding="UTF8"?> > <a> > <sumb>2.2737367544323206E13</sumb> > <sumnodes>2.2737367544323206E13</sumnodes> > </a> > > <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform"; > version="2.0"> > <xsl:output method="xml" indent="yes"/> > > <xsl:template match="/a"> > <a> > <sumb> > <xsl:valueof select="sum(b)"/> > </sumb> > > <xsl:variable name="nodes" select="b"/> > > <sumnodes> > <xsl:valueof select="sum($nodes)"/> > </sumnodes> > </a> > </xsl:template> > </xsl:stylesheet> > > Thanks! > Angela Williams > Office: 512.344.1547 ~ Fax: 512.397.6656 > Angela.Williams@xxxxxxxxxxxxxxxxxx
Current Thread 


< Previous  Index  Next > 

Re: [xsl] Unexpected result in sum, Abel Braaksma  Thread  RE: [xsl] Unexpected result in sum, Angela Williams 
RE: [xsl] Unexpected result in sum, Angela Williams  Date  Re: [xsl] Display RSS grouped by mo, Mukul Gandhi 
Month 