Subject: Re: [xsl] Data science, data analytics using XSLT streaming From: Ihe Onwuka <ihe.onwuka@xxxxxxxxx> Date: Tue, 5 Nov 2013 17:29:36 +0000 |
It would be better then to start with more accurate descriptions of what data science entails than Roger originally provided. Here are a couple. http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram and A data scientist is someone who can obtain, scrub, explore, model and interpret data, blending hacking, statistics and machine learning. Data scientists not only are adept at working with data, but appreciate data itself as a first-class product. -- Hilary Mason, chief scientist at bit.ly There is also the visualization aspect which neither of the above definitions mention but is catered to by products like Tableau. While it is definitely fun data scientists spend a good proportion of their time obtaining, labelling and scrubbing the data and that is not so fun. On Tue, Nov 5, 2013 at 4:35 PM, Wendell Piez <wapiez@xxxxxxxxxxxxxxx> wrote: > Hi, > > I agree with Andrew. These projects are fun, and XSLT pipelines are > well suited to them, because they are capable of exposing the semantic > issues and keeping syntax out of the way. This is even true when the > first step is a rendering of a non-XML format into an XML > representation, and the last step is serializing the data in a form > optimized for something else (such as your query engine of choice). > > And no, streaming is not necessary, although it can help. > > Plus, the biggest problem isn't scale anyway: it's the semantic > integrity of the data or (more likely) the lack thereof. This can be > compounded by non-technical issues such as data owners not seeing the > information they actually have because they are blinded by their > expectations of what it is "supposed" to be. > > Cheers, Wendell > > Wendell Piez | http://www.wendellpiez.com > XML | XSLT | electronic publishing > Eat Your Vegetables > _____oo_________o_o___ooooo____ooooooo_^ > > > On Tue, Nov 5, 2013 at 5:26 AM, Andrew Welch <andrew.j.welch@xxxxxxxxx> wrote: >>> XSLT streaming is all about processing large amounts of (XML-formatted) data. >>> >>> So XSLT streaming should fit in the "data science" and "data analytics" categories. >>> >>> Broad Question: Would you provide a scenario/example of doing data science/data analytics using XSLT streaming please? >> >> Typically the data is held in multiple files rather than 1 big one, so >> you don't necessarily need streaming, just a set of steps that process >> directories of xml into various intermediate formats, then into the >> final presentation view (such as a table with the data grouped, >> sorted, with counts) >> >> I've done this sort of thing a few times now and I always enjoy it. >> >> >> -- >> Andrew Welch >> http://andrewjwelch.com
Current Thread |
---|
|
<- Previous | Index | Next -> |
---|---|---|
Re: [xsl] Data science, data analyt, Wendell Piez | Thread | Re: [xsl] Data science, data analyt, Michael Kay |
Re: [xsl] Data science, data analyt, Wendell Piez | Date | Re: [xsl] Data science, data analyt, Michael Kay |
Month |