Identityiq 8.4 got corrupted, | Next step or best option to recover

Hello Developer,

I feeling my sailpoint environment got corrupted due to being inactive for more then 30+ days. Now I am seeing the error in multiple places like Application connector failing again and again, ( such as AD, azure ad, Oracle)
workflow are not getting triggered. ( Rapid Setup Joiner and Leaver )
Provisioning and de-provisioning of account is not working. ( manage user access )

I tried coping the workflow in the environment by other environment, even tried by creating new event to check about workflows.

with all the above issue, seems like the sailpoint identityiq 8.4 got corrupted,
or am I missing any settign to be configured or be checked before considering the environment as corrupted.

now my question is what are the option which can be consider to bring back the sailpoint identityiq 8.4

and does sailpoint suggest any option for us.

Thanks in advance for your answers. I want to resolve the corrupted enviroment.

Thanks,
Md Riyazuddin

Hi @RiyazuddinM

I’m sorry to hear about the troubles you’re experiencing with your SailPoint environment. Here are several steps and checks you can consider to potentially resolve the issues:

  1. Check Service Status: Ensure that all necessary services for SailPoint IdentityIQ are running. Sometimes services may not start automatically after a system reboot or may have stopped unexpectedly.
  2. Examine Logs: Look at the application logs for any error messages or warnings that occurred around the time the issues began. This can provide clues about what might be going wrong.
  3. Database Integrity: Check the database integrity as corruption in the database could lead to the issues you described. You might need to look at restoring from a backup if there are indications of corruption.

As first of all I would suggest to restart tomcat - maybe is there any issue regarding javaheap space or smth like that :slight_smile:

It would be helpful if you can share some logs.

2 Likes

I agree that it would be good to know a little more about your environment.

  • Is this a Personal Test/Dev/Sandbox Environment or a Production Environment?
  • Have you restarted the application servers that IIQ is running on, and verified that all of the services are running again?
  • Is the IQ Service running and at the same or compatible version as IIQ?
  • What are the error messages that you are seeing from the connectors?
  • What error messages appear in the Advance Analytics → Syslog section?
  • What are the Error messages you are seeing in the log files?
  • Have you confirmed that there have been no changes to the Network or Server configurations outside of SailPoint IIQ that could cause the issue?

You will need to provide more information before someone can offer solutions, since we only have enough information to know you have an issue, and suggest ways get log and/or debug.

1 Like

Hi @gmilunich,

Below are the details about my environment.

It’s a Production Environment.

Yes I have tried restarting the server,

Yes that running, and its compatible with the version

Sometime, I am getting connection time out message.

No, error in the syslog.

I will attached the full log find.

Yes, I have confirmed with the network parameter, Network parameter are working fine, I have tested again by telnet and ping.

please suggest me what should I do. with this issue.

I am facing very challenging issue, since this is stopping the sailpoint to be in the business.

Please let me know if need any more information

Thanks
Md Riyazuddin

Hi @abartkowski ,

Yes, I have check about it,
still please do suggest a brief so that I can re-check incase if I missed any step in it.

I have attached the logs.
I have debugging it by using the logs but no luck,
Please have a look at log and suggest me

how to check the database integrity is corrupted from the database side,
are there any steps where I can check for the above.

Please let me know If any more information is needed.

Thanks
Md Riyazuddin

If this is a Production issue, I recommend that you reach out to SailPoint Customer Support, or your SailPoint Partner if you have one to help get this resolved, as this forum is not intended to diagnose Production issues within any sort of standard time frame.

To help keep things moving, I have some follow up questions for you:

  • Can you log into SailPoint and view Identities and application details from the UI? Can you see the tasks and view the results of your aggregations there since the issue? If you can log in and view those, then the DB is likely NOT corrupt. It is possibly that the application configuration may have changed or been miss configured.
  • You mentioned that you are seeing timeout messages. Are these when doing test connection and showing up on the application or task results page, or are they Browser timeout errors that you are seeing. Both of these would lead me to guess there is a network or load balancer change that should be investigated first.
  • Have you turned up the logging to Debug or Trace and done testing at those levels? If so, did any errors appear?
  • What Debugging or Testing have you done to try and solve this issue so far? You did not provide many details for this, so we do not know what you have ruled out already.
  • Can you pick one connector to focus on your initial debugging, such as AD or Oracle? When try the debugging for that one so we can better assist with answers. Likely if they are related, fixing one will fix the others.
  • When did this issue start happening? Do you have logs back to the last time it was working?

One final thought, related to the first point about contacting Customer Service since this is a Production issue. The members of this forum are, for the most part, NOT SailPoint employees, but rather other users of the software. While collectively we can help answer your questions if we have time and knowledge, it is not required of us. If you need a solution in the fastest possible manner, this may not be the best avenue for it.

Hello @gmilunich

Yes, I will reach out to sailpoint customer support.

below are the response for the questions,

Yes, I can login into the sailpoint and also view the identities or application details from the UI.
yes, I can see the tasks and the result.
account aggregation error was only related to the connection time out.
Okay, if DB is not likely corrupt. even I have recheck every configuration but workflow are not getting invoke.

please provide me some inputs where I can check the configurations.

Yes, I am getting error on both the side while test connection and in task result.
I will check with the network team about it and reconfirm on it.

I have enable that, and I was to detect that workflow are not getting triggered.
values are coming are null.

I will try to look into the other thing which you have mention

Thanks @gmilunich your response will be very helpful to me.

Thanks,
Md Riyazuddin

Test Connection is the most basic process in the system, so if that is failing, then something in your configuration, or between your IIQ instance and the Source Application is causing it to not complete the connection. Firewalls, network changes, load balancer changes, DNS changes, Credential changes, port changes, etc are all things to be checked.

Additionally, you may be able to check connections between systems outside of IIQ if you have other utilities that can connect to those systems. There can be security concerns/policies for Production Servers, so check with your organization before installing anyhting new.

Can you expand on what is coming in NULL? Are the workflows getting triggered with Null Values and not running? Do you get any log messages from the workflows that indicate that they have started? Are these built in workflows you are looking at, or custom workflows from your organization?

@RiyazuddinM Please verify also that if those logs are from your production server that you have sanitized them to remove any user PII and other identifiable information. I would recommend checking the logs on your other posts too for these.

1 Like

Hi @gmilunich ,

Sure Geoff, I will take of sanitizing the files before uploading them into community.
Sure, shall check for the logs how other did share it here

Yes I have check them and its working.
its like sometime its getting failed but most of the time its getting failed and sometimes its successful

I will share the sanitized log with you, I am unable to locate the issue point.

Thanks,
Md Riyazuddin

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.