I have a scenario where I need to remove duplicates from flat file using a combination of two fields. Can anyone help me with this scenario?
Concatenate the fields in a mapping to a destination profile with enforce unique on the concatenated field.
Do another mapping to get rid of the concatenated field again.
Thanks, That worked.
You can also refer this discussion where I have used a function which can take any combination of keys and then drop duplicates.
Retrieving data ...