Large Data - Database Reader Processes Query Successfully but Will Not Finish

KNIME Analytics Platform
1

I’m having an odd problem. When a database reader node runs its query, it receives roughly 70k rows (by 15 columns). The query returns this in about 30 seconds from the table. However, the reader node will not then complete, it sits at “Parsing database ResultSet…” indefinitely until it times out.

Here’s the log

2018-05-17 11:35:30,337 : DEBUG : KNIME-Worker-2 : DBReaderImpl : Database Reader : 2:104 : Executing SQL statement as executeQuery:
2018-05-17 11:35:41,645 : DEBUG : KNIME-Worker-2 : DBReaderImpl : Database Reader : 2:104 : Reading meta data from database ResultSet…
2018-05-17 11:35:41,645 : DEBUG : KNIME-Worker-2 : DBReaderImpl : Database Reader : 2:104 : Parsing database ResultSet…

Other DB nodes using the same table and same database (but with a lot fewer row results, usually <10) have no issues completing and do so without issue. DB loopers also work.

2

This may be a KNIME related slow processing issue. It took about 30 min, had to change the KNIME.ini file around but finally completed.

Is there a way to speed up KNIME in a large table query so it’s as fast as any SQL tool?

3

That most likely not KNIME problem. It could be record locking or not updated statistics on your DB as well as network issue if you use one or antivirus activity.

4