# Web Services source and filters in the API calls

**URL:** <https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823>\
**Category:** SHF Discussion and Questions\
**Tags:** aggregation, apis, identity-security-cloud\
**Created:** [October 30, 2025, 8:27pm UTC](https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823 "2025-10-30T20:27:55Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![swcoleman](https://avatars.discourse-cdn.com/v4/letter/s/76d3ee/32.png) [@swcoleman](https://developer.sailpoint.com/discuss/u/swcoleman)\
**Post date:** [October 30, 2025, 8:27pm UTC](https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823/1 "2025-10-30T20:27:55Z")

</div>

We have a Web Services Source set up to pull identity data from MDStaff for credentialed providers. There are currently over 63,000 accounts in that system. The vast majority of those accounts don’t change but we are pulling all of them in everyday when we aggregate. Aggregations are taking about 8 hours to pull all of the data. The documentation says that we can filter on a last updated field but don’t know how to insert dates into the API call.

This is an example API call from the documentation.  
{  
“source”: “Demographic”,  
“fields”: [  
“FormattedNameWithDegree”,  
“LastUpdated”,  
“ProviderID”  
],  
“filter”: {  
“LastUpdated”: [  
{“type”: “between”, “values”: [“12/31/2021”, “01/01/2022”]},  
{“type”: “in”, “values”: [null]}  
]  
},  
“sort”: [{“LastUpdated”: “desc”}, {“FormattedNameWithDegree”: “asc”}],  
“settings”: {  
“IncludeArchivedProviders”: false,  
“IncludeApplicants”: false  
},  
“resultsperpage”:10,  
“page”:1  
}

What i want to do instead of hard coding dates is have it do something like this

```auto
    {"type": "between", "values": ["today-2 days", "today"]},

```

so it’s only pulling in changes between today-2 days and today. That way we are only pulling changes from the last 2 days and if there is a failure in a API call I should get the data on the next call.

Any pointers on how to accomplish this?

---

<div class="post-metadata">

**Author:** ![jrossicare](https://avatars.discourse-cdn.com/v4/letter/j/a698b9/32.png) [@jrossicare](https://developer.sailpoint.com/discuss/u/jrossicare)\
**Post date:** [October 31, 2025, 12:46am UTC](https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823/2 "2025-10-31T00:46:25Z")

</div>

You should be able to create an HTTP Operation of type ‘Account Delta Aggregation’ and then in Connection Settings, enable Delta Aggregation

---

<div class="post-metadata">

**Author:** ![swcoleman](https://avatars.discourse-cdn.com/v4/letter/s/76d3ee/32.png) [@swcoleman](https://developer.sailpoint.com/discuss/u/swcoleman)\
**Post date:** [November 4, 2025, 1:33pm UTC](https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823/3 "2025-11-04T13:33:17Z")

</div>

Jason can you provide a little more detail?

---

<div class="post-metadata">

**Author:** ![jrossicare](https://avatars.discourse-cdn.com/v4/letter/j/a698b9/32.png) [@jrossicare](https://developer.sailpoint.com/discuss/u/jrossicare)\
**Post date:** [November 4, 2025, 10:16pm UTC](https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823/4 "2025-11-04T22:16:46Z")

</div>

Hi Scott,

See [Account Delta Aggregation](https://documentation.sailpoint.com/connectors/webservices/help/integrating_webservices/xml_delta_aggregation.html)

You could duplicate your current account aggregation HTTP Operation, then change Operation Type to be ‘Account Delta Aggregation’ then update your GET URL (or body) to get the right date range.

Do you know the URL or exact request you need to get the delta from your endpoint source?

If you need to do something more complicated to set the URL or body for delta aggregation, then create a Web Service Before Operation rule, and attach it to this operation.

---

<div class="post-metadata">

**Author:** ![system](https://global.discourse-cdn.com/sailpoint/original/2X/f/f2136700ed5e3703e0b85e02f6be799dacca7735.png) [@system](https://developer.sailpoint.com/discuss/u/system)\
**Post date:** [January 3, 2026, 10:16pm UTC](https://developer.sailpoint.com/discuss/t/web-services-source-and-filters-in-the-api-calls/186823/5 "2026-01-03T22:16:51Z")

</div>

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.