I have various data imports I’m bringing in and not using a database, but writing deduped files as outputs to create a “master” table each day (import ‘master’ - join to last several days in the event data points changed, recent data overwriting the past, then pushing to the master table to bring in the next time). I used Alteryx for a number of years, and they had a “.yxdb” output that was essentially a compressed data structure. I would use that .yxdb as the master, and I could save it locally to my machine, or a server, etc. Does Knime have that same type of compressed file?

Hello @ebarr , KNIME equivalent to Alteryx “.yxdb” file is .table file for which you need to use Table Writer and Table Reader node. Additionally take a look at this topic: [image] Best File Types for Knime KNIME Analytics Platform Hi I am an Alteryx user looking to switch over to Knime and have some questions about file handling. In Alteryx, the best type of file for storing data in is the YXDB type file, and Alteryx does fairly well reading and writing these types of files. I noticed that in Knime, it seems that a CSV is the most common file type used for read and write. However, since I use databases with sometimes hundreds of millions of rows, storing this in a CSV is very inefficient. Also, I also noticed that the csv… Br, Ivan

Knime compressed database like Alteryx .yxdb

KNIME Analytics Platform

ipazin October 5, 2023, 9:13am 3

Hello @ebarr,

KNIME equivalent to Alteryx “.yxdb” file is .table file for which you need to use Table Writer and Table Reader node.

Additionally take a look at this topic:

Br,
Ivan

2 Likes