Has anyone used "google_sheet_payload.knwf" to address Google Sheets 400 Error - Request Payload Size Exceeds the Limit 10485760 bytes?

[alabamian2]

Hi everyone,
I am seeing errors Google Sheets Appender, 400 bad request with Request Payload Size Exceeds the Limit 10485760 bytes. I found this post from @mw and @oole. I downloaded the google_sheet_ payload.knwf and it says I’m missing Table Difference Checker and proceeds to say Find missing extensions has encountered a problem. How can I use this workflow?
Thank you so much for your help!!

Google Sheets: Payload exceeds limit of 10485760 bytes

Good morning, I’m facing an issue with the Google Sheet Updater node which is pretty self explaining but I wonder how to circumvent it without separating rows into chunks, looping over them whilst the first chunk must clear and upon the second append data … basically speaking over engineering the upload. ERROR Google Sheets Updater 0:601 Execute failed: 400 Bad Request { "code" : 400, "errors" : [ { "domain" : "global", "message" : "Request payload size exceeds the limit: 1048…

[ipazin]

Hello @alabamian2,

you can use Drag&Drop functionality from KNIME Hub to install this node/extension.

Table Difference Checker

However from my understanding this node doesn’t impact workflow execution as it is last node and only does table diff check so you can use workflow as is.

Br,
Ivan

[alabamian2]

OK, thank you for your reply, @ipazin. So I just need to use this component node, Write Sheet.

And I need to replace this Missing Table Difference Checker with the new one. Should I worry about Variable Loop End (deprecated)? I see these (deprecated) ones often…should I always replace with new ones in general as best practice??

Thank you so much for your help and guidance, @ipazin. Much appreciated!!

[alabamian2]

Hhmm, it failed with this error.

ERROR Parallel Chunk End 0:3466 Execute failed: java.lang.NullPointerException

[alabamian2]

OK, replaced the Variable loop end. Now getting an error on Missing table difference checker node so trying to replace that now. learning KNIME and making progress!!

[alabamian2]

Installed Table Difference Checker and now getting this error…

ERROR Table Difference Checker 0:16:0:23 Execute failed: Expected column named ‘CLIENT_NAME’ at position 0 in test table

[alabamian2]

Reporting back…I hit the 5 million cells limit on Google Sheets. Will point to BigQuery instead. Thank you!!

[ipazin]

Hello @alabamian2,

glad to see you are learning and trying out things on your own. And indeed you are making progress

Check this topic on deprecated nodes:

[Feature] Option to take over node configuration when replacing by similar node

Hi There, when dragging and dragging & dropping i.e. a CSV, XML, Excel file into Knime it automatically configures the corresponding node. Sometimes, i.e. instead of a File Reader node, a simple file reader or another one is preferred. It might be nice, when replacing an already configured node, that some basic configuration like input / file locations or variables are kept in the configuration of the new node. This could provide a valuable shortcut speeding up workflow designs. Best Mike

Additionally here is link to KNIME docs in case you haven’t came across it. Very useful regardless of your KNIME level:

https://docs.knime.com/

Br,
Ivan