Unfortunately I cannot post this into the existing Ka-Boom thread, so we’re just starting a new one in order to keep up with the traditions!
There’s Palladian 2.5 on the update site with three new nodes:
Thanks to @wisemanleo we have improved the existing OAuth node to allow more signature methods (HMAC-SHA1, HMAC-SHA256, HMAC-SHA512, PLAINTEXT) and to allow settings additional headers. The new node replaces the previous one and is now called “OAuth 1 Signer”:
Beside that, there’s two new nodes in the “Geo” category for formatting and parsing DMS coordinates:
More Geo-related features will come soon. Stay tuned.
Palladian freely available for free KNIME versions and exclusively distributed through NodePit: Palladian — NodePit
Palladian for KNIME, version 2.6 is already available for a few days. So, high time to update this thread! There’s plenty of improvements, especially for the Geo/Location extraction nodes and the OAuth Connector node.
The old beta version of the OAuth Connector has been replaced by a new version with many fixes and detail improvements, based on the numerous of feedback we received from the community – thank you for that:
The Palladian Location Extractor received an internal overhaul, includes an improved extraction model, and allows different output modes:
We include two options for gazetteers/location databases now: GeoNames and a local one. These can be connected through the green input port:
Contact us for details if you’re interested in using the local location source.
For all changes have a look at the changelog here on NodePit:
Hi @qqilihq , at the moment, the Service field can’t accept any String variable, either from Variable Creator or String Configuration node. Here’s what I got when attempting to do so:
that’s because we do not use the “human readable” text for the services, but a technical identifier. To figure out the identifier I suggest as follows:
Configure the node to output the value of service as flow variable (that’s what the input field beside the drop down is used for, just enter sth. like service)
Open the output table and switch to the “Flow Variables” tab
Copy the value which is shown for service (e.g. for Twitter this will be com.github.scribejava.apis.TwitterApi)
Hi @qqilihq , it seems that even if I attempted to manually click on Twitter option in the dropdown menu, I still can’t get access via flow variables. Here’s how I set it up in a dummy component:
Mhhhhhh, let me have another look at this. For simplicity would you mind attaching your workflow as shown above (just for the structure - please strip out your personal key, secret)
Ahhh, now the coin has fallen (as ze Germans say).
This will indeed need some fixing in the code - currently it’s just not possible to do this via flow variables, sorry. I’ll try to have a look at it once there’s some spare time. Thanks!
At the moment I’ll leave it outside of my component then. Thanks for considering to take a look into the matter.
Meanwhile, if anyone knows how can I incorporate the Excel Reader into my component, that’ll be appreciated. I’m leaving the Excel Reader outside too, since I don’t know how to make a ‘Browse’ button as a configuration function. I don’t want to make a string configuration that asks the users to type in the directory of the file.
On another topic, @qqilihq , I hope one day you can develop an equivalent node of the OSM Map to Image for the Palladian Map Viewer, because I’m having the same issue mentioned here where I can’t integrate the image produced by Map Viewer into my component’s interactive view.
I have found this component to solve my Excel Reader browse issue, so I can integrate the reader into my component, instead of keeping it outside. Only the OAuth Node is the odd one out at the moment
I had a quick stab at the “flow variable support”. While adding support to properly supply the values at configuration time (i.e. service, api key, secret, and scope), I’m not too sure if this will be sufficient for your scenario – at the end, the user will need to click the “Authorize Access” button to run through the flow, innit? Would this be possible when wrapping the OAuth node into a meta node at all? (I’m no expert in that field).
Hi @qqilihq , you’re right on that matter. Due to the Authorize button, the OAuth node still needs to be left outside. I guess it’s okay then I wish I could give some pointers from the technical side of things, but sadly I’m not a coder.
An option might be to start the authentication flow when executing the node, but I’m not sure I like this flow UX wise. I will see if we can come up with a better solution to that, but leaving the node outside of metanodes is my suggestion for now
Thank you @qqilihq , I have learned that I didn’t need the OAuth node if the users key in their access tokens manually. I was able to use Twitter’s V2 API via the Palladian HTTP Retriever as long as I provide all the necessary tokens including bearer.
I’m sure there will be good news with an upcoming update. (not the 2.8 which we pushed today and about which I hadn’t even time yet to write about … well, tomorrow then).
A bunch of new geocoding nodes: GeoNames Geocoder, OpenCage Geocoder, and – powered by Palladian’s state-of-the-art geoextraction algorithms – the Main Location Extractor. The latter one is perfect for geocoding on a city/unit level and it can be combined with the Local Location Source and thus allows you to run your geocoding entirely locally without having to access any external APIs
Geohash nodes to convert coordinate parts to geohashes and back:
An improved ML model for the Location Extractor node
The full changelog is available here: Palladian — NodePit (and did you actually know that you can also subscribe to all changelogs on NodePit via RSS? Here’s the link: Changelog: All Products)