I’m having trouble reading CSV files in Google Drive; they take a very long time.
Is there a way to read CSV files from Google Drive faster?
I’ve run 5-10 CSV reader nodes directly from Google Drive, and the files are only around 10MB, or 52K per CSV file with 21 columns.
Here’s a brief explanation behind @mlauber71’s suggestion:
Google Drive operations are often slower than local storage because Google Drive relies on your internet connection and Google’s server infrastructure, whereas local storage is accessed directly from your computer’s hardware. Factors like network stability, server load, and the overall internet speed impact Google Drive’s performance, making it slower for large files or in comparison to the immediate access of local drives.