# Concise means of removing redundant data within unique identifier

**URL:** <https://forum.knime.com/t/concise-means-of-removing-redundant-data-within-unique-identifier/27686>\
**Category:** KNIME Analytics Platform\
**Created:** [September 28, 2020, 6:05pm UTC](https://forum.knime.com/t/concise-means-of-removing-redundant-data-within-unique-identifier/27686 "2020-09-28T18:05:12Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![mlauber71](https://forum-cdn.knime.com/user_avatar/forum.knime.com/mlauber71/32/73590_2.png) [@mlauber71](https://forum.knime.com/u/mlauber71)\
**Post date:** [September 28, 2020, 6:45pm UTC](https://forum.knime.com/t/concise-means-of-removing-redundant-data-within-unique-identifier/27686/2 "2020-09-28T18:45:25Z")

</div>

To be honest I do not fully grasp what you want to do. Maybe an example workflow that demonstrates your full challenge without giving away any secrets might alosnhelp.

Concerning duplicates, question is if the use of a rank Id might help like in this example:

> [@School of duplicates - and how to deal with them](https://forum.knime.com/t/school-of-duplicates-and-how-to-deal-with-them/24164/2):
>
> As an addition you could use the FIRST\_VALUE and LAST\_VALUE function to get additional information in one step. In this demonstration the SQL server is Hive (KNIME Local Big Data) since neither H2 nor SQLite seemingly would provide such a feature. @webstar initiated this [question](https://forum.knime.com/t/replace-simplify-row-values-to-eliminate-duplicates/24121/9) - thanks. SELECT `t2`.\* -- mark the Top row per ID ad the chosen one ... , CASE WHEN `t2`.`rank_id` =1 THEN 'chosen' ELSE 'duplicate' END AS `duplicate-type-classifier` FROM -- start t2 ( SELECT \* -- al…

Also the corresponding article and sample workflow could give you some inspiration, maybe.

---

_[View the full topic](https://forum.knime.com/t/concise-means-of-removing-redundant-data-within-unique-identifier/27686)._