Query in MongoDB reader

[ravi13]

Hi!! Knime Experts & Enthusiastic.
Hope you are doing well.

I need your help to convert following query of mongodb to knime mongodb reader query.

Ex:
MSEG is table name:

Initially if you want to load just 1 million records so below is query for it,
db.mseg.find().limit(1000000)

Now if we want to load next 1 million records, below is query, it will skip initially 1 million loaded records and load next 1 million records
db.mseg.find().skip(1000000).limit(1000000)

Basically, MSEG is having more than 100 million line items, and because of heavy data in knime mongodb reader is not able to load full table at once.So i have decided to break the table into 1 million.
Now issue is how to write/execute above query in knime mongodb reader.

Thanks,

[NDekay]

Hello Ravi,

Thank you for contacting us regarding this issue.

Please note that the MongoDB Reader node can process data pulls in skip and limit sections just as you described in your pseudocode:

You may also be able to make use of the Chunk Loop Start node to pull data in chunks for your purposes.

Please let us know if you have any questions.

Thank you,
Nickolaus