what is the best way or node to write 1 million records from one SQLite DB (1) into another SQLite DB (2) ?

what is the best way  or node to write 1 million records from one SQLite DB (1)  into another SQLite DB (2) ?

 

You could consider using the Database SQL Executor node, and executing something like: https://stackoverflow.com/questions/29220677/sqlite-easiest-way-to-copy-a-table-from-one-database-to-another

 

In case you need to do some processing on the data before writing, you may consider increasing the Batch Size in the Database Writer advanced tab.

thank you for your comment,

is it possible to attach sample workflow or screenshot for workflow with node configuration ?

thanks

@ibi2030 not sure if this is still active :slight_smile: but while googling I found this sample workflow that shows how this could be done.

(In case someone lands here googling the same thing in the future)

3 Likes