Problem
We schedule aggregations to automatically load new data on the source into Identity Now on a regular basis. If the source supports delta aggregation, we prefer using that option to lower the aggregation times and minimize load on the system. But, there are times when the system demands a full source aggregation to be run to pick up certain changes else the account in IDN remains unchanged. Example: OU Moves or Account deletions are only processed during full source aggregations.
When delta aggregation is Enabled in Source configuration, all the scheduled aggregation by default will run as deltas, there is no option to specify an additional full aggregation run on a different schedule.
Solution
To handle this problem, I came up with a workflow that will trigger an additional full source aggregation on schedule.
Configuration Steps
- Create a Personal Access Token (PAT) to call the Identity Now Rest APIs from the workflow.
- Create a Workflow with a Scheduled Trigger
- Create a HTTP Request Action to Disable Delta Aggregation in Source Configuration
- Create a HTTP Request Action to Run the Full Source Aggregation (Optimization flag optional)
- Create n HTTP Request Action to Enable Delta Aggregation in Source Configuration
Workflow
JSON
Here is the workflow script you can use. Please update the HTTP steps to your environment URL and credentials, also update the Source IDs and aggregation schedule trigger as per your needs. You can disable optimization in the HTTP request action for full aggregation if required.
FullSourceAggregation20231108.json (3.9 KB)