File Upload Utility

CoLab Community Tools
,
85

I am receiving below “Connection Timeout” in our env, what are the parameters that I will need to check to resolve the issue. Please advise.

Command used=> java -jar FileUploadUtility.jar --url https://xx.identitynow.com --clientId xx --clientSecret xx --file D:\sailpoint\xx -R

Scope of PAT used in jar file=> sp:scopes:all

<
java.net.SocketTimeoutException: Connect timed out
at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:546)
at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597)
at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:333)
at java.base/java.net.Socket.connect(Socket.java:648)
        at okhttp3.internal.platform.Platform.connectSocket(Platform.java:130)
        at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:263)
        at okhttp3.internal.connection.RealConnection.connect(RealConnection.java:183)
        at okhttp3.internal.connection.ExchangeFinder.findConnection(ExchangeFinder.java:224)
        at okhttp3.internal.connection.ExchangeFinder.findHealthyConnection(ExchangeFinder.java:108)
        at okhttp3.internal.connection.ExchangeFinder.find(ExchangeFinder.java:88)
        at okhttp3.internal.connection.Transmitter.newExchange(Transmitter.java:169)
        at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:41)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:117)
        at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:94)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:117)
        at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
        at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:88)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
        at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:117)
        at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:229)
        at okhttp3.RealCall.execute(RealCall.java:81)
        at retrofit2.OkHttpCall.execute(OkHttpCall.java:207)
        at sailpoint.service.SailPointService.createSession(SailPointService.java:110)
        at sailpoint.utils.FileUploadUtility.call(FileUploadUtility.java:235)
        at sailpoint.utils.FileUploadUtility.main(FileUploadUtility.java:145)/>
86

From Troubleshooting section on Timeouts:

Timeouts are usually an indication that File Upload Utility is attempting to communicate with the SailPoint Cloud and not getting a response. Usually, this due to network security controls, such as firewalls, preventing the communication. Work with your network teams to make sure you can reach the SailPoint Cloud, and if necessary, adjust Timeout Configurations or even leverage Proxy Configurations if so required.

Hope this helps!

2 Likes
87

Did we get the powershell script that has been used in this video?

88

Hi Shantha,
Are you referring the the script that was used in Krish’s livestream last week? If yes, he’s in the process of submitting it to the CoLab :slight_smile:

1 Like
89

Got help from Support - it’s literally just replacing the current .jar file with the new .jar - no commands actually need run. You can get the new version from the Current Release link at the top of this page.

2 Likes
91

I understand that UTF-8 (Unicode) is the supported character code for multibyte data(account entitlement), is that correct?
In Japan, there are still cases where other character encodings such as Shift JIS are used, but after converting to UTF-8, it is necessary to use it, right?

92

Does anyone know if the File Upload Utility is compatible with AWS Corretto OpenJDK (OpenJDK Download - Corretto - AWS)?

94

It is! I actually develop and test File Upload Utility against that version of OpenJDK.

2 Likes
95

Hi @anon50892160 - Good question. File Upload Utility itself doesn’t process the file or check for encodings, it just transports it to the cloud via API. I am not sure what all the API validates, before it is handed to the delimited file connector for parsing. The delimited file connector defaults to UTF-8 encoding, but I think theres a setting which can override this. Just keep in mind the data that goes back to ISC’s data stores is in fact UTF-8; so if you read in a different encoding it will be ‘cast’ to our default (expected) encoding. If this isn’t re-encoded correctly this could look like spurious characters, which is why we recommend UTF-8 encoding as theres no room for error. Hope this helps!

96

Neils project is really good, and it is also cross platform(linux/windows/mac). But in navigate I heard from a few customers that would like similar functionality that you are asking about. Also, they were looking for a method could follow to easily migrate the IIQ beanshell delimited files to ISC. I was able to spend a week with a test tenant to create a project that I believe will provide most of this functionality. Sato, with a bit of scripting, this project has a feature that you might be able to use to do the processing you are needing.
GitHub - jhyderjhyder/IdentityNow_AutoLoader: IdentityNow ISC AutoLoader for Delimited Files. The project needs some testing with large files. But because you can write a PowerShell script to pre-process the file, then you can validate the format or even rewrite it. If you find defects or enhancements, you would like to see please let me know. Also, this project will run as a windows service, so I think it would be easier to support for many users. If it gets traction/demand in the community, then I will work with SailPoint to add it to the colab.

2 Likes
97

Any update for the error code 503? We have been getting it recently. Not sure what is the reason. Can someone share the details?

98

I love this idea. Great work @JedHyder!

1 Like
99

I encourage you to do this so you can earn some Ambassador points from your work!

100

Hi Neil,

I’m also getting error 500 with message “An internal fault occurred.” while using version 4.1.0. Did you manage to find a solution for Minh? I tried replicating the issue using Postman but the request was successful, so I’m not sure what the cause of the is.

Regards,
Bhekamandla

101

Hi,

If I recall, there was a small error in the input file. There was a double quote on one of the fields.

I use Visual Studio Code w/ lint extension to check the csv file to make sure it correct.

102

Was there any solution for this error?

103

Connection resets are usually a network device, proxy, or firewall disconnecting your attempted connection to the cloud. I would seek advice with your network administrators from where this is being run. Most organizations require proxy configuration (which file upload utility supports).