Help me in pulling data from this website?

[tone_n_tune]

I am trying to load data from this dashboard - https://dune.com/cryptoded/layerzero

However, I’m not seeing options to pull data using a Json API. The documentation on API is also not mentioning json endpoint - Introduction - Dune Docs

So what would be the best way for me to pull data from the above dashboard, which API that is supported in KNIME?

[mwiegand]

Hi @tone_n_tune,

since you haven’t specified what you exactly are after I checked the website and noticed it utilized graphql. You might find this example workflow of interest.

Query GraphQL API – knime

In case you could specify your request, I might be able to provide a more precise response and eventually a solution.

Best
Mike

[tone_n_tune]

@mwiegand

In case you could specify your request,

I would like to pull the data displayed in that dashboard provided in the link.

[mwiegand]

Hi @tone_n_tune,

there is a whole host of information displayed so I assume you mean the five graphs, don’t you?

The easiest way would be to extract the raw data from each link / detail page like so:

Or, properly utilizing their API, get a free API key, connect and query the examples shown above.

There is a query builder and example page which is super convenient:

Get Latest Query Result - Dune Docs

The most straight forward way to crawwling the data would be using a GET Request like so:

curl --request GET \
  --url https://api.dune.com/api/v1/query/{query_id}/results

The query ID can be found in the URL:

There is also another short cut to get the API queries using the gray button “API” to the right:

Anyways, I build a quick & dirty workflow for you. You just have to create an API key and insert that using the widget

78896 - Crawl DUNE Data from dune.com – mwiegand

Happy “kniming”
Mike

[tone_n_tune]

@mwiegand Thank you for the snippet. I was wondering if we can similarly pull data from RapidAPI.com? I am trying to query this link - Fear and greed index but not having any success. I would appreciate your help in resolving this.

[mwiegand]

Hi @tone_n_tune,

did you register and got an API token?

Best
Mike

[tone_n_tune]

@mwiegand

did you register and got an API token?

Yes, I have an API. I tried to put the API token in the String Widget of your workflow at the bottom field (“Default value”) but it did not work.

[mwiegand]

@tone_n_tune if I get it right you are trying to pull data from an entirely different API and API endpoint. You cannot expect an app-agnostic solution for api.dune.com to work on rapidapi.com.