want to preload a cache with a bunch of values to use as a lookup. I only want to run it once per run. Not once per document. Only the command shape has that option. This will be from a connector call from NetSuite.
There are several options on how to accomplish this. Here is one:
You can do the following in the branch that you only want to execute once.
Here I have left the Message shape empty. This will create a new empty document for each document coming in.
I then do use a Data Process shape setup as follows:
This will take all of the blank documents that we created and combine them into a single document.
Now anything you place after this Data Process shape will only be executed once.
Couldn't you create a branch before your netsuite call? Say something like...
While this might work one thing to keep in mind with this option is that you might be limiting your ability to re-run processes from Process Reporting. Since the Start Shape is not a connector then anytime you run or re-run this it is going to execute the query to get data as opposed to using the same data that was retrieved in the execution that you are re-running.
If you want to execute that branch only once, you can combine the data using 'Message shape'.
So that branch will be executed only once unless you using a 'Flow Control' before the message shape.
I am not sure this will help you.
yes, i just realized that's what I need.
I forgot about that check box! That would simplify the answer I provided.
If you don't actually need values from the current data to perform your lookup you might consider leaving the message shape blank in order to improve performance.
As most are saying, you can use Combine Document Data Process
In the above process, I queried the DB and load into the cache to be able to do a lookup on the next steps per document that I received from FTP. In the Data Process step, I used Combine Documents with profile set to "None".
Retrieving data ...