Hi all, I was trying to filter data records that contain any Asian characters and later on use a translator on them…I tried with Python Script with exact same code as what I do in Spyder, which works in Spyder but not in the Python Script in KNIME. [image] here is the code: output_table_1 = input_table_1.copy() def contain_chinese(check_str): for ch in check_str: if ‘\u4e00’ <= ch <= ‘\u9fa5’: return True return False def contain_korean(check_str): for ch in check_str: if ‘\uac00’ <= ch <= ‘\ud7a3’: return True return False def contain_japanese(check_str): for ch in check_str: if ‘\u0800’ <= ch <= ‘\u4e00’: return True return False output_table_1 = output_table_1[output_table_1[‘Customer Name’].apply(lambda x : contain_chinese(x))] And I also tried using regular expression but it doesn’t seems to work well neither… here (example for Japanese), it would give me results that totally does not contain Japanese characters: ^.([\u0800-\u4e00]). [image] Therefore I end by with filtering out all latin characters with this Rule Engine Row Filter but it would still give me latin characters here is what I put and i chose exclude TRUE matches: $Customer Name$ MATCHES “^[a-zA-Z0-9_?@&.,，~()（）^:;/=+~'’ àáâãäåæçèéêëìíîïðñòóôõöøùúûüýþÿ-]+” => TRUE [image] If anyone can give some advice, it would be really appreciated! Thank you in advance!

Filtering out Chinese, Korean, Japanese, Thai characters with Python Script Node or Rule Engine using regular expression

mlauber71 February 8, 2023, 11:07pm 2

@xli you might want to check if you will have to double escape the Unicode codes.

There are several other threads and examples about RegEx that might help.