Re: [xsl] How to transform a 5GB input XML document?

["Elliotte Rusty Harold elharo@xxxxxxxxxxx" <xsl-list-service@xxxxxxxxxxxxxxxxxxxxxx>]

How much memory does it use? What values have you measured? 5 GB isn't
that big in 2025. There are other ways to do this, but at 5 GB I might
just get a machine with more memory and increase the heap size a lot,
especially if it's only something you do every day or two on one
machine.

On Wed, Jan 29, 2025 at 11:45b/AM Roger L Costello costello@xxxxxxxxx
<xsl-list-service@xxxxxxxxxxxxxxxxxxxxxx> wrote:
>
> Hi Folks,
>
> My input XML document is 5GB. I need to transform the document; the
resulting output XML document will be at least that size.
>
> Have you transformed huge XML documents? How did you do it?
>
> XSLT requires the entire input XML document be loaded into memory; my
experience is the XSLT processor fails --regardless of how much heap space is
provided--with a Java out-of-memory error when given a 5GB sized input
document.
>
> Assertion: XSLT is unsuitable for transforming huge XML documents.  <-- I
hope you will tell me this assertion is false and will then explain how to use
XSLT to process huge XML documents.
>
> Did you use XML Streaming to transform huge XML documents?
>
> Did you write a Java program to process-- in a streaming fashion--the XML
document, using the SAX API?
>
> /Roger
>
>


--
Elliotte Rusty Harold
elharo@xxxxxxxxxxx