Partitioning in WS source

Identity Security Cloud (ISC) ISC Discussion and Questions
,
1

I am trying partitioning(static one) for web service source and looks like documentation is not much helpful. It seems like it is copy pasted from iiq guide.
Has anyone tried partitioning in idn. I am looking for json version of xml pasted in documentation: Partitioning

<entry key="partitions">
 <value>
  <List>
   <Partition name="Partition 1">
   <Attributes>
     <Map>
      <entry key="costCenter" value="CC-AA"/>
     </Map>
   </Attributes>
   </Partition>
   <Partition name="Partition 2">
   <Attributes>
     <Map>
      <entry key="costCenter" value="CC-AAZY"/>
     </Map>
   </Attributes>
   </Partition>
  </List>
  </value>
</entry>

I can see partitions is list but not sure how json gets built after that.

I can think of these json

{
    "partitions": [
        {"partition 1": {"costCenter":"123"},"partition 2":{"costCenter":"345"}}
    ]
}

but some kind of confirmation would be helpful in case anyone has tried this.

2

Looks like that config gives below error:

sailpoint.connector.ConnectorException: Attribute partitions must contain sailpoint.object.Partition records, found: sailpoint.tools.xml.PersistentHashMap

Not sure how to create partition record in json.

I see it’s mentioned we can run both normal and partitioned aggregation from UI but that does not seem to be the case.

image
image2812×196 154 KB

3

@colin_mckibben @philip-ellis .

4

Sorry Chirag, I don’t have any experience with partitioning. I have forwarded your question internally to see if anyone else has.

5

I can create ES ticket but wanted to make sure document gets changed for idn. Let me know if ES ticket is necessary for this.

1 Like
6

Hi Chirag,
This is in discussion with IDN team, how to update partition object via v3 api. Accordingly, we can update document or support this configuration via v3 API, till now we dont have resolution.

If you are using Webservice source and to unblock you, can you try using dynamic partitioning (Using get Partition endpoint) >

1 Like
7

Hey @pratikkumar_kadhi I am not sure how dynamic partitioning will fit in my requirements but I have simple requirement where we have 10 K users so I want 2 threads to be running in parallel. One would get first 5K users and another one next set of 5K users.

8

@colin_mckibben was anyone ever able to use this feature , It is still poorly documented.

1 Like