Hi alabamian2,
sorry for the late reply. If you use only a single workflow that is executed locally you can create write a CSV File in the workflow data area or if running on the server using the Relative to-> Current Workflow file system where you always append the latest running id/timestamp or whatever is available to tell you which rows have already been processed. You could then use the CSV Reader node to read the file, sort it afterwards in descending order to get the latest entry which you then convert to a variable using the Table Row to Variable node which in turn can then be used to filter the data before writing to BigQuery.
Bye
Tobias
1 Like