Non English characters

[Manju22 (Manjuladevi Manickam)]

Hi,

I want to move the identity to error state if the first name or last name has non-English characters . We have already transformed the firstname identity attribute using decomposeDiacriticalMarks. But the attribute remains empty after the transform.

What is the method for me to be notified about it? How can I set them to an error identity?

[RAKRHEEM (Rakesh Bhati)]

Hi Manju,
Thank you for posting your question. Can you please elaborate as to attribute remains empty ? Is the transform not transforming the non English characters ?

TRY the below transform
{
“id”: “********************”,
“name”: “Remove spaces and decompose diacritical marks”,
“type”: “replaceAll”,
“attributes”: {
“table”: {
“\s+”: “”
},
“input”: {
“type”: “decomposeDiacriticalMarks”,
“attributes”: {
“input”: {
“attributes”: {
“sourceName”: “Non-Employee”,
“attributeName”: “lastName”
},
“type”: “accountAttribute”
}
}
}
},
“internal”: false
}

Here’s what has been modified:

• In the table attribute of the replaceAll transform, the key has been changed from " " to "\\s+". This regex expression "\\s+" matches one or more whitespace characters, including spaces, tabs, and line breaks. It will replace all occurrences of whitespace characters with an empty string, effectively removing them.
• The input attribute remains the same, using the decomposeDiacriticalMarks transform to decompose the diacritical marks from the input lastName attribute.

With these changes, the transform should remove all spaces and decompose the diacritical marks from the input lastName attribute without encountering the regex expression error.

You can also add what all ascii character are there in table with the corresponding replacement and it should work. Let us know if you still face issue after adding this transform

[Manju22 (Manjuladevi Manickam)]

Thanks for your explanation. But my input looks like “一鸣 柳” or “Симона Проданова”. After “decomposeDiacriticalMarks” transform, output is empty..

    {
        "name": "PPD decomposeDiacriticalMarks FN Transform",
        "type": "decomposeDiacriticalMarks",
        "attributes": {
            "input": {
                "attributes": {
                    "input": {
                        "attributes": {
                            "id": "FN Transform"
                        },
                        "type": "reference"
                    },
                    "regex": "[^a-zA-Z0-9-]",
                    "replacement": ""
                },
                "type": "replace"
            }
        },
        "internal": false
    },

[RAKRHEEM (Rakesh Bhati)]

Hi Manju,
Can you try this code and see if it fixes your issue ?

{
“attributes”: {
“input”: {
“attributes”: {
“sourceName”: “Source”,
“attributeName”: “chineseAttribute”
},
“type”: “accountAttribute”
},
“value”: “#set($chineseChars = $input)\n\n#set($convertedChars = "")\n#foreach($char in $chineseChars.toCharArray())\n #if($char >= 19968 && $char <= 40895)\n #set($unicodeHex = $esc.java.String.format("\\u%04x", $char))\n #set($convertedChars = $convertedChars + $unicodeHex)\n #else\n #set($convertedChars = $convertedChars + $char)\n #end\n#end\n\n$convertedChars”
},
“type”: “static”,
“name”: “Chinese Character Transform”,
“id”: “chineseCharacterTransform”
}

[KevinHarrington]

You could create an “Error” lifecycle state and have your transform that calculates LifeCycle state place identities in the “Error” state if they meet certain criteria. Then enable notifications on that lifecycle state to go to administrators, or some address directly.

In order to check it, I’d do something like the following, but you’ll have to figure out what makes sense with your calculations:

{
	"attributes":{
		"LastName":{
			"attributes":{
				"sourceName":"Your HR Source Here",
				"attributeName":"LAST_NAME"
			},
			"type":"accountAttribute"
		},
		"LastNameEscaped":{
			"attributes":{
				"input":{
					"attributes":{
						"sourceName":"Your HR Source Here",
						"attributeName":"LAST_NAME"
					},
					"type":"accountAttribute"
				},
				"regex":"[^a-zA-Z]",
				"replacement":""
			},
			"type":"replace"
		}
		"value":"#if($LastName == $LastNameEscaped)No Error${else}Error#{end}"
	},
	"type":"static"
}