Term Document Entropy

Hi, I haven’t found any forum post for this Term Document Entropy node yet. I would like to know the reference papers / links / specific calculations behind this node as I intend to use entropy values to decide which terms to include and exclude for my topic extractor node. I have looked at the description of the node here https://nodepit.com/node/org.knime.ext.textprocessing.nodes.frequencies.entropy.EntropyNodeFactory but the info I’m looking for isn’t there.

Hi @badger101 -

Let me ask internally and I’ll see what additional info I can find.

1 Like

Hey @badger101,

the formula used to calculate the Term Document Entropy can be found here (under Entropy).

Cheers,

Julian

2 Likes