Google Sheet large sheet marked as completed but not all data loaded

KNIME Analytics Platform
1

I have noticed on several occasions I can not trust the completion status of a google sheet updater node.

  • Large load around 120k to 150k rows with about 60 to 80 columns.
  • Knime status shows complete (green)
  • Open sheet to validate and see only 90k some was loaded.
  • It is not an even number - could be 91,242 this time and 120,342 next time
  • Very sporadic and most sheets work fine. Never have a issue with small sheet

At times I will use updater to clear sheet and add first 70k rows and have another sheet do append with next set of rows over 70k. Seen the error at different row counts.

Very hard to replicate because does not happen all the time

1 Like
2

Hi @Mark_Bland,

there is a limit to any upload. I’d recommend to use a loop in conjunction with a Google Sheet Appender. Here is a nice example by @mlauber71

Best, Mike
CTO @ DataNautics GmbH - Your KNIME-Experts
Contact: info@datanautics.gmbh // datanautics.gmbh // +49(0)170-325 713 9 // Linkedin
Daten Automatisierung für Finanz-, Produktion-, IT- und Marketing-Prozesse mit KNIME

1 Like