Re: [xsl] Saxon Div Issue

Subject: Re: [xsl] Saxon Div Issue
From: "G. Ken Holman g.ken.holman@xxxxxxxxx" <xsl-list-service@xxxxxxxxxxxxxxxxxxxxxx>
Date: Mon, 19 Jan 2015 15:57:03 -0000
At 2015-01-19 15:46 +0000, Mailing Lists Mail daktapaal@xxxxxxxxx wrote:
I have a value 9.88 , I use the div to do an operation

Pseudo code:

var num = 9.88
var result = $num div 100

I expect 0.0988 .. I get 0.09880000000000001

I am using Saxon-EE-9.5.1-5.jar

What is happening?

What is happening is that doing the arithmetic with the binary representations of 9.88 and 100 create a result in binary that when precisely converted to decimal give you the result you see.


As Martin suggests, if you are using XSLT 2 then you can use decimal representations of your values and do arithmetic with those.

I hope this helps understand the issue.

. . . . . . Ken

--
Check our site for free XML, XSLT, XSL-FO and UBL developer resources |
Free 5-hour lecture:  http://www.CraneSoftwrights.com/links/video.htm |
Crane Softwrights Ltd.             http://www.CraneSoftwrights.com/s/ |
G. Ken Holman                    mailto:gkholman@xxxxxxxxxxxxxxxxxxxx |
Google+ profile:       http://plus.google.com/+GKenHolman-Crane/about |
Legal business disclaimers:     http://www.CraneSoftwrights.com/legal |


--- This email has been checked for viruses by Avast antivirus software. http://www.avast.com

Current Thread