Local Database

Hello,

right now I am doing a lot with .Table files. What is the easiest to manage and transfer (between machines) Database. Now looking for extreme performance, just ease of integration

Thank you

Hi,
what is wrong with using .table files? They are easily portable across machines. Otherwise, maybe SQLite with the SQLite Connector mit be a good option and a real database.
Kind regards
Alexander

2 Likes

Hello,

I have 1000s of tables already and it s getting messy, you cant query them, update records etc!

H2 might be another alternative for a local SQL DB with a lot of functions

3 Likes

Hi,
do you want a central database that you can access from multiple computers, or do you want a file-based solution that you can transfer between computers manually?
Kind regards
Alexander

2 Likes

Thank you for your patience. I am working on a Knime project that collects, cleans and updates data. During the week I am working on my work Desktop and during the weekend I am on my Laptop! I keep the project on an external drive for easy portability. Now its thousands of individual table files… rather would have a file based Database!

Hi!
Then I would suggest SQLite with the SQLite Connector. It can store multiple tables in a single file and supports SQL.
Kind regards
Alexander

1 Like

Hello,

Sorry to reopen this, but SqlLite is starting to kill me as it does not really work with large volumes or multiple access at the same time. How about the local bigData enviroment? Would that be a solution?

H2 claims to have “Multi Version Concurrency” although I have not tested it myself (the KNIME driver would have to support it).

Local big data could be an option. You would have to be careful to have it in a consistant state and store the data permanently. If you want to give it a try there are several examples on the hub.

Question is if simulating big data behaviour is beneficial compared to a local database like MySQL or Postgres.

1 Like

This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.