Writing to Amazon redshift database table

Hi Team,

I have a database reader node and want to insert or add that data into my redshift database table.
I am using DB writer node to insert the data but it is extremely slow.

Is there any workaround for this?

Thank you
Srinivas

Yes, the DB Loader, here

Since Redshift is a columnar store, single row inserts are incredibly slow. Bulk loading these types of databases is the best option.

Another option would be to write your data out to S3, then using a SQL Statement you can load the data from the S3 location. This would require more nodes in the workflow, but is another option you could look into.

-Jeff

3 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.