Hello there!
How to set up “Row delimiter” in node “CSV to Spark”?
What type of “Row delimiter” does the node “CSV to spark” use by default? (Win or Linux)
Hi @greatvarona,
The default line separator is \n in Spark. The node does not expose an option to change this. You might use a Spark DataFrame Java Snippet (Sink) to add additional options to the CSV writer. See lineSep in the Spark documentation: CSV Files - Spark 3.3.2 Documentation
Cheers,
Sascha
1 Like
If you actually mean CSV to Spark you can configure which delimiter you want to use and other things. Otherwise you might want to further explain what you are looking for:
Also the Spark to CSV node allows for indivudual settings.
1 Like
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.