Parquet Reader issue

[frenny]

Hello Team,
I have connected to HDFS server using HDFS connector, now I am trying to read the parquet files. Resulting it into following error. It shows correctly the number of parquet files are present at the location but getting this unknow error. Kindly help.
Many thanks in advance!
Frenny

[mlauber71]

@frenny welcome to the KNIME forum. Would you be so kind and provide us with some more information about this error. There currently is not much to see. Maybe a fresh log file in debug mode covering this particular point.

Files Corrupted During File Transfer

@djarrett I could not initially find any problems. You could get rid of the vernalis error messages by installing RDKit. Could you create a LOG in DEBUG mode? Open the existing log and delete the content: [image] or delete the file from the workspace directory {workspace_directory}/.metadata/knime/knime.log activate the DEBUG level. Make sure that it would not contain any sensitive informations and remember to set it back to WARN after you are finished: [image] You might want to include f…

My first guess would be some missing permission to actually execute something on the HDFS.

[frenny]

Hello, Thank you for your reply. I am getting unknown host error:
2022-11-04 09:04:04,535 : ERROR : KNIME-Worker-8-Parquet Reader 3:2 : : Node : Parquet Reader : 3:2 : Execute failed: k8s-bigdata-1.cluster.local:50075: k8s-bigdata-1.cluster.local
java.net.UnknownHostException: k8s-bigdata-1.cluster.local:50075: k8s-bigdata-1.cluster.local
at java.base/sun.nio.ch.NioSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at java.base/sun.net.NetworkClient.doConnect(Unknown Source)
at java.base/sun.net.www.http.HttpClient.openServer(Unknown Source)
at java.base/sun.net.www.http.HttpClient.openServer(Unknown Source)
at java.base/sun.net.www.http.HttpClient.(Unknown Source)

It would be great if you can guide me in this.

Thanks,
Frenny

[mlauber71]

@frenny question is would the node work at all or not. What you initially can do is try to use a List Files node and get meta information about your parquet files. Maybe some of them are empty or have strange formats or you might have no permissions.

Then if you could access the files you might Transfer them to your local system and then try to load them into KNIME.