Boomi Buzz: Blogs & Events
Boomi Training & Certification
About the Community
to create and rate content, and to follow, bookmark, and share content with other members.
how to implement data polling in dell boomi ?
Question asked by
on Aug 1, 2014
on Aug 6, 2014 by YashveerKohli5131
Data polling need to be implemented
No one else has this question
Mark as assumed answered
This content has been marked as final.
Show 6 comments
(Required, will not be published)
Aug 1, 2014 12:20 PM
I think we are going to need additional information Yashveer. If you want Boomi to poll a data source periodically, you would simply establish a process execution schedule whereby the process would be executed automatically at set times (e.g., once every hour).
Process Schedule documentation:
Would this address the need?
1 person found this helpful
Aug 4, 2014 1:21 AM
it's database polling.
Aug 4, 2014 9:34 AM
You are a man of few words :-)
So, does scheduling a process to query (poll) the database on a periodic basis, address your need?
Typically you are polling based on a transaction date-timestamp (give me all transactions with a date-time greater than the last time I executed the process). Or, you have an integration-status attribute in the database that you query against, and then update.
1 person found this helpful
Aug 5, 2014 3:43 AM
Richard, my query is that .. . through java code i have to invoke a webservice(boomi process) whenever there is any change in the database.
So, by doing some changes in the database, webservice is getting invoked, which means the code is working fine but i am not able to fetch the key values like table name, row id, row operation and also not able to update the destination table name in the database, hope you understand my query :)
i have also attached the url of the process:
Aug 5, 2014 7:26 PM
It is not entirely clear what your ultimate goal is, but I do like the real-time nature of your approach. That is, your integration processing is triggered by database update/insert events as they actually happen, versus polling the database 24/7 looking for potential updates. There are many Boomi integration processes that run every minute of the day looking for updates. That is 1440 process executions per day, over half a million per year. I guess if you can guarantee that there is at least 1 update every minuter or so, that is a decent approach. But if long periods of time go by without any updates, it is not so elegant. When you used the word "polling" this is what I thought you meant (repeatedly polling (
) of the database to see if any updates had occured). But I digress.
I see that you are calling the web service with a request that looks something like this:
<?xml version='1.0' encoding='UTF-8'?>
By the way, here is how you embed parameters in a message to see what the current data looks like:
The format of therequest is not appropriate for getting at the information you need. This is not really structured XML in that there is only one element. The data items you want to get out of this are RowId and possibly RowOperation. If you can change the format, it really should look more like the following:
If you are stuck with the 'RequestName' format you have, you will have to fiddle around to extract the two data elements you need. You will have to play around with String functions, custom scripting or something.
Once you have the ROWID value, you can query the database using that ROWID as a parameter.
Refer to documentation and training video regarding database operations:
To add parameters to a database profile:
3 people found this helpful
Aug 6, 2014 5:50 AM
thanks Richard for your support :)
Retrieving data ...
Parse JSON in Groovy Data Execution Step
how to set a default empty array element on Target JSON profile in a map
How to build a process to convert any file format be it .txt, .xml,.json, .csv into any other format as per the requirement for e.g. .csv, .txt, .json, .xml?
Need multiple outputs from a single sql lookup
Has anyone ever uploaded a file into Salesforce ContentVersion?