I've created a server side workflow which extract data from several tables in a datawarehouse and stores each individual table in a csv file on the server. When i execute this workflow it all seems to work fine, however in the folder i specified the files do not appear (when looking through the knime desktop application).
However if i browse the server folders through winscp the files are actually there! Apparently only not visible to me. What do i need to change / do to make them visible for me? I execute the workflow under my username, server side, however the results are not visible to me. Please assist.
sorry to hear you having problems. I see two possible reasons:
The repository of our server is only updating in regular intervals (configurable in the server). And only after updating you would see the files, however as you are also checked the repository, I think we are way above this time!
Another possiblity are the rights. If you are writing a file into the server it owns the right of the above workflow group. BUT the owner will become noowner. So if only grouprights are copied to the file permissions. Hence if there are no grouprights on the workflow group only administrators can see the file.
We will definitely improve this in the future, but for now you need to write into a workflow group which has a groupright, which again includes you.
Does this help? Could you try writing into a folder as above to see if this solve your issue?
I do agree i think it is a rights issue. However your proposed solution does not solve the issue or i implemented it incorrectly.
I've added my login name as a group to the complete folder structure and all the workflows in there to te able to read, write and execute workflows and files. However i still cannot see the files in the server after execution of the workflow.
I've also tried writing the file to a file with existing group rights, there i cannot see the file either.
In both cases i execute the file on the server. However if i execute the same workflow on the my client, after downloading the workfow, the files are visible to me on the server.
I've been able to create a workaround. I've executed the workflow once, on my desktop. That makes the files visible to me on the server. Afterwards if i execute the workflow on the server the files are updated through that process but still remain visible to me and are updated.
I am using a CSV writer to write the file to the server. Should i use another node for that? I cannot read the files if they are invisible. But now, once i have written them once from the desktop they are visible and remain visible when i execute the same workflow on the server.
You can use any node to write to the repository. Iris was refering to the path that you specify. Possible but discouraged is something like d:\file_path_to_repo_on_server\file.csv.
Better is to use a knime protocol such as: knime://server-mount-point/path_in_server_repo/file.csv.
If you can live with your current workaround to create those files from the client prior using the same workflow on the server then I would keep doing that. Otherwise you can add a property to your /config/knime-server.config file that reads as: com.knime.server.repository.rescan_interval=2m
That would rescan the repository every two minutes. That has some performance impact and we are working on a clean solution in the near future.
Well it feels like a workaround, so i am not completely happy i have to execute it from the desktop first. But at least it works. Your proposed solution will not work because even if i do a manual refresh or look or after a restart of the desktop version the files will not be visible. They simple are not reachable by me through the desktop.