I have a process A which returns 5000 personal records in JSON format. For every record retrieved I need to use an ID to get more details from another system by calling process B and passing the ID. There is over 100,000 records available as a source to process B.
What is the best way to accomplish this?
I believe loading data from process B into document cache is not really suitable due to the size (over 100,000 records).
I tried to Split the document in process A and call process B. I'm using the Process Route to call process B. This however does not produce desired results since only one same record is returned.
I had to add the Flow Control after the Split and then call process B. This brings correct results but it is SLOW.