AnsweredAssumed Answered

Duplicate rows getting filtered out at map shape

Question asked by cstaikos220972 on Dec 12, 2016
Latest reply on Nov 10, 2017 by stevenlintermans

Hello,

 

I have set up the following process:

 

1) Start shape: Disk Connetor. Pull .csv file from disk (atom running locally)

2) Map shape (flat file profile to JSON profile)

3) Notify shape

4) Other connector shape

 

When running my process in test mode the following happens:

 

  1. If the rows in my CSV file are all different:
    1. Map shape "shape source data" tab shows a document containing all of the data (3 unique rows)
    2. Notify shape "shape source data" tab shows 3 documents - one for each row
  2. If the rows in my CSV are all the same:
    1. Map shape "shape source data" tab shows a document containing all of the data (3 of the same row)
    2. Notify shape "shape source data" tab shows 1 document

 

It seems that duplicates are being trimmed out of my data unintentionally. Our use case is such that duplicates will occur and we need to pass them through the process as with any other data.

 

Is there a setting to disable this? 

 

Thank you,

Outcomes