# Text Processing Filters Not Working

**URL:** <https://forum.knime.com/t/text-processing-filters-not-working/6688>\
**Category:** KNIME Extensions\
**Tags:** text-processing\
**Created:** [January 14, 2016, 8:47am UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688 "2016-01-14T08:47:29Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![sajjadhaider](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/s/b782af/32.png) [@sajjadhaider](https://forum.knime.com/u/sajjadhaider)\
**Post date:** [January 14, 2016, 8:47am UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/1 "2016-01-14T08:47:29Z")

</div>

Hi,

I have used KNIME for a long time and never had any problem with the Text Processing filters. But recently I installed 3.1 and 3.2 on different machines and in both cases the filters (Punctuation, Numbers, N-Char, etc.) are not working (the number of rows after BoW creation remain the same and nothing is removed). The depreciated filters of the previous version work but the new ones are not working. Am I the only facing this issue?

Regards,

Sajjad

---

<div class="post-metadata">

**Author:** ![kilian.thiel](https://forum-cdn.knime.com/user_avatar/forum.knime.com/kilian.thiel/32/5449_2.png) [@kilian.thiel](https://forum.knime.com/u/kilian.thiel)\
**Post date:** [January 15, 2016, 11:02am UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/2 "2016-01-15T11:02:27Z")

</div>

Hi Sajjad,

with version 3.1 all preprocessing nodes of the Textprocessing extension have changed. The old nodes are still available for backwards compatibility as "deprecated" nodes. However, the new nodes do not support BoW filtering anymore. The filtering is applied directly on the documents. The reason for this is, that this direct filtering of documents is much faster than the filtering of a BoW. Direct filtering means, that the terms that are filtered, are filtered directly in the document itself.

This means, that you need to apply the filters before creating the BoW, e.g. Strings To Docs-\>Stop Word Filter-\>Number Filter-\> .... Filter-\>Bag of Words Creator

This will result in a BoW containing only non filtered terms.

Cheers, Kilian

---

<div class="post-metadata">

**Author:** ![sajjadhaider](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/s/b782af/32.png) [@sajjadhaider](https://forum.knime.com/u/sajjadhaider)\
**Post date:** [March 22, 2016, 8:32am UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/3 "2016-03-22T08:32:15Z")

</div>

Thanks Kilian,

The sequence works as you have suggested but I have this feeling that the "stop word filter" node, when used with the provided list, is not working. I have provided different words in a text file but none of them is removed.&nbsp;

Regards,

Sajjad

---

<div class="post-metadata">

**Author:** ![kilian.thiel](https://forum-cdn.knime.com/user_avatar/forum.knime.com/kilian.thiel/32/5449_2.png) [@kilian.thiel](https://forum.knime.com/u/kilian.thiel)\
**Post date:** [April 5, 2016, 7:33pm UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/4 "2016-04-05T19:33:36Z")

</div>

Hi,

at 1. April we released a noew version. Please update to that version (3.1.2) and try this out again. Custom stop word files can be used in the stop wod filtr node, which also support the knime:// protocl now. Make sure that the words to filter out have not been set unmodifiable before by a tagger node. You can als ignore this unmodifiable flag in the filter node.

Cheers, Kilian

---

<div class="post-metadata">

**Author:** ![alkopop79](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/a/71c47a/32.png) [@alkopop79](https://forum.knime.com/u/alkopop79)\
**Post date:** [May 21, 2018, 11:45am UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/5 "2018-05-21T11:45:26Z")

</div>

I have the exact same problem. None of the filters work at all. That despite copying an example file’s pre-processing part. Nothing has been removed: numbers, stop words, punctuation, nothing. Not even the regex filter does anything. The pre-processing bit starts with a string-to-document node and ends in the the BoW node. What am I doing wrong???[ENRON\_dateset 2.knar.knwf](https://forum-cdn.knime.com/uploads/default/original/2X/8/84ec2df19f325132f9c41d216c22af78a8c275c7.knwf) (32.4 KB)

---

<div class="post-metadata">

**Author:** ![InsilicoConsulting](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/i/50afbb/32.png) [@InsilicoConsulting](https://forum.knime.com/u/InsilicoConsulting)\
**Post date:** [May 21, 2018, 12:10pm UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/6 "2018-05-21T12:10:41Z")

</div>

Me too, especially the stop words filter. Does not work with either inbuilt or external list

---

<div class="post-metadata">

**Author:** ![julian.bunzel](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/j/35a633/32.png) [@julian.bunzel](https://forum.knime.com/u/julian.bunzel)\
**Post date:** [May 24, 2018, 2:46pm UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/7 "2018-05-24T14:46:46Z")

</div>

Hey @alkopop79, @InsilicoConsulting,

> [@alkopop79](#):
>
> I have the exact same problem. None of the filters work at all. That despite copying an example file’s pre-processing part. Nothing has been removed: numbers, stop words, punctuation, nothing. Not even the regex filter does anything. The pre-processing bit starts with a string-to-document node and ends in the the BoW node. What am I doing wrong???

The preprocessing pipeline you have used creates a new column called _Preprocessed Documents_, but the **Bag Of Words Creator** node still uses the initial unfiltered _Documents_ column to create the bag of words. Open the node dialog of the **Bag of Words Creator** node and select the _Preprocessed Documents_ column as document column. Then it should work.

> [@InsilicoConsulting](#):
>
> Me too, especially the stop words filter. Does not work with either inbuilt or external list

Can you provide an example? Maybe it is the same problem @alkopop79 has. Please have a look at the node configurations / node dialogs to check if you have selected the correct document column for preprocessing and bag of words creation.

Cheers,

Julian

---

<div class="post-metadata">

**Author:** ![alkopop79](https://forum-cdn.knime.com/letter_avatar_proxy/v4/letter/a/71c47a/32.png) [@alkopop79](https://forum.knime.com/u/alkopop79)\
**Post date:** [May 24, 2018, 5:37pm UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/8 "2018-05-24T17:37:39Z")

</div>

Thank you! Changing the order of nodes helped in the end.

---

<div class="post-metadata">

**Author:** ![system](https://forum-cdn.knime.com/uploads/default/original/1X/ab3ccf34482a0329361734a18199390177204f15.png) [@system](https://forum.knime.com/u/system)\
**Post date:** [June 2, 2023, 9:45pm UTC](https://forum.knime.com/t/text-processing-filters-not-working/6688/9 "2023-06-02T21:45:27Z")

</div>

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.
