AWS Group Aggregation: 10 Hours to complete [Performance Issue]

IdentityIQ (IIQ) IIQ Discussion and Questions
1

IIQ Version: 8.4p1

Problem Details: I have integrated AWS with SailPoint IdentityIQ (IIQ) using IAM User authentication. During aggregation of approximately 150,000 groups into IIQ, the process currently takes around 10 hours to complete. Interestingly, when running the connector in debug mode, the aggregation time is reduced to about 5 hours. By comparison, aggregating a similar number of groups from Active Directory (AD) takes only about 30 minutes.

Troubleshooting Steps Taken: We have already considered several possible solutions, including:

  • Partitioning
  • Delta Aggregation

Request: I’m looking for any additional insights or recommendations that might help troubleshoot this performance issue, especially why the aggregation time is halved when running in debug mode.

Additionally, I am open to exploring other potential solutions beyond what we’ve already considered. Any suggestions or leads would be greatly appreciated.

2

Basic question, do you really need 150K Groups, If not, why don’t you look into building filters to aggregate only Groups you need.

Did you consider this already ?

3

Hi @MVKR7T,

Yes, lets say I need the whole 150K, what could be the possible ways to improve the performance in your opinion. Also any any insights into why connector debug is outperforming aggregation tasks by a huge margin?