Is there limit to the length of the JSON object in KNIME?

Hello, all.

I have a problem with converting a table to JSON by “Table to JSON” node. I try to put in it a long text and its transformations some metadata fields related to this text. But in the output cells I’ve got JSONs without metadata fields. Sometimes output cell doesn’t include some fields with text transformations. Input table doesn’t have missing values.
So, my question is there is length limit for JSON objects or not? Is it another problem for this case?


Did you try to increase the row height in the table view?

Hello, thor.
Thanks for your answer. But I guess that it’s not a problem with view. There is no object “MetaData” in the output on the screenshot in my first message. But there are such fields in input table: “MetaData.containerId” and “MetaData.actor.id”.

I’m attaching screenshots of the input and output for “Table to JSON” node, where I have excluded all fields with text and after that object “MetaData” has appeared in output JSON.


Hello, thor.

Sorry for disturbing you, but do you have any other ideas how to deal with this problem?

I’m 99% sure this is only a display problem. Your very first screenshot doesn’t show the full JSON. Try writing the results to a file and have a look there.

2 Likes

Hi @dbolshev,

As i could see, you bring a loto of files to make this process… My suggestion is to use the “chunk loop” node to break the process and release the memory and files. you can set a number of rows or block of partition with it.

Other question is about the files, they have many pages? Are all of they PDF files. this is it?

If you can try this idea, I believe that can help you.

Seeya,

Denis

Hello, thor.

You were right. I’ve put “JSON Path” node after “Table to JSON” and there are all fields in “JSON Path” dialog window.

1 Like

Hello, denisfi.

Thanks for your message. Yes, I use “Chunk loop” and take only 10 files for one iteration. There was a problem with visualization of the node output. thor was right.

2 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.