Hi Team,
I have a database reader node and want to insert or add that data into my redshift database table.
I am using DB writer node to insert the data but it is extremely slow.
Is there any workaround for this?
Thank you
Srinivas
Yes, the DB Loader, here
Since Redshift is a columnar store, single row inserts are incredibly slow. Bulk loading these types of databases is the best option.
Another option would be to write your data out to S3, then using a SQL Statement you can load the data from the S3 location. This would require more nodes in the workflow, but is another option you could look into.
-Jeff
3 Likes
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.