[xsl] exslt tokenize mixed content

[Richard Lewis <richardlewis@xxxxxxxxxxxxxx>]

Hi there,

I'm using libxslt's EXSLT implementation's str:tokenize() function in an 
attempt to tokenize all the words inside a particular element. What I need to 
be able to do is to have it generate a list of tokens for /all/ the character 
content from inside a mixed content element:

<xsl:template match="section">
  <xsl:variable name="words" select="str:tokenize(string(.))" />
</xsl:template>

This almost works except that using string() on a node doesn't give you any 
white space between the last character in one subelement and the next 
character following that subelement. e.g.:

<section>
  <title>Section the First</title>
  <p>The content of this section</p>
</section>

calling string on this gives you:
"Section the FirstThe content of this section"

where I need a space between "First" and "The" so that str:tokenize() will 
interpret them as separate tokens.

Any ideas?

Cheers,
Richard
-- 
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Richard Lewis
Sonic Arts Research Archive
http://www.sara.uea.ac.uk/
JID: ironchicken@xxxxxxxxxxxxxxx
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-