Hi I am using the example provided in knime workflow to extract data using youtube api. But I am only able to get 50 results. How will I be able to access more results?
The API accepts a pageToken
as parameter which you can use for pagination. The pagination tokens are in the returned JSON response as nextPageToken
(and prevPageToken
):
See here for details: https://developers.google.com/youtube/v3/docs/videos/list
To get more than the returned responses, build a loop which performs the pagination as often as necessary, or until there are no more results.
PS: Afair, Palladian’s WebSearcher has the pagination already built in. Although, we do not actively maintain that node any longer, the YouTube API should be working just fine.