Get XML (XBRL) file from Web Server

[qqilihq]

@PBJ

Is it possible to do it with the new WebPage Retreiver or the palladian HTTP Retriever and HTML Parser?

Not really (at least not without a bunch of reverse engineering) – clicking the link performs a bunch of JavaScript code in your browser and at the end a POST request with several parameters which are generated on the fly.

For more background and a potential option see here (this was about an AngularJS-based website, but the same applies in above case):

Scraping an AngularJS Website Post Load

Thanks for the pointer @ScottF! @mpfeifer14 The HTTP Retriever (or the GET Request node) or any other techniques will just download the static HTML will thus not be of any help, as AngularJS requires a JavaScript environment, which is just available in a JavaScript-capable web browser. Without that, you’ll see the website as shown in an ancient browser without JavaScript (which means, placeholders instead of the actual content). So at the end this is not a question of the right XPaths, but the …

– Philipp