I wonder what would be the best way to get data from the Generic Webservice Client to a database? As far as I understand, there is no node that could write rows directly into the database. So, I have to dump them into a file (CSV), and use an ETL process to do this. The problem is that one of the columns may contain multi-line text, with newlines confusing the loader. I tried to replace them with spaces in the Perl Scripting node, but each time the process gets stuck at 3% without any error being thrown... Actually, in the log I can see that every line of the text from that column gets processed separately, which is completely unexpected to me. Unfortunately, there is no option to select a record separator in the CSV Writer node, instead of the newline. I would appreciate any advice on how to resolve this issue.
Data transformations with the Perl Scripting node. Fri, 10/28/2011 - 23:24 — albaruthenia. I wonder what would be the best way to get data from the Generic.
nice post thanks for the info.