I have to bring in a collection with 70 Million+ entries into KNIME from MongoDB database. We have been trying with MongoDB reader hooked with JSON to Table node. However, MongoDB reader keeps failing to read from the database. We have tried filtering the query and adding multiple such nodes. Still no luck. Is there any limit on amount of data that can be brought in using these node? Is there any better way to bring in collection with huge data into KNIME efficiently?
I would sincerely appreciate your assistance in this!!
Thanks and regards