Lets say, I have 10 millions records to process in a file.
For validation we are using
1) Group by using Data Shape
2) Then using flow control
3) Then we are using Business shape to check count based on some logic defined in grouping
4) Then checking count in decision shape and so on....
We are using 4 custom scripts and based on logic we are setting document properties and then we are using business shape.
So difference between two options is option 1 is processing each line record at a time where as in option 2 we are processing all records through 4 scripts.
Which option is preferable with respect to performance considering I have 10 million records to process?