Tokenization of German Language

anon33357744 · April 29, 2018, 7:26pm

Hey Community,

is there no Tokenizer for German Language?
I found only English word tokenizers.

Thanks and regards,
Canan

ScottF · April 30, 2018, 2:47pm

There is an OpenNLP German WordTokenizer available as well. I’m not sure why it wouldn’t be showing up for you. Do you have the latest version of the Text Processing extensions installed?

anon33357744 · April 30, 2018, 2:51pm

Hey Scott,

thank you
I found the tokenizer…but first i had to download the extensions.

Kind regards,
Canan