About upserting assets by ID

This operation uses the integration framework to upsert assets to Collibra DGC. Because of that, you can make multiple calls to the REST API of Collibra DGC during the execution of that function.

Upsert assets by external entity id splits input assets into one collection with assets that have been previously synchronized using upsert and another collection with assets that are synchronized for the first time. After the split, two imports are done to create or update assets accordingly. Because of that, the function is not atomic.

Additional calls can be made to retrieve required information, for example, checking if upserted assets were previously synchronized or finding IDs of related assets. The number of API calls does not depend on the number of assets that are upserted.

The operation is idempotent, so performing multiple upserts with the same data will yield the same result.

Each upserted asset has to have the same structure (same 'keys' defined) because of the import operation being used. By using DataWeave transform to produce the data as input for the upsert assets operation, the structure is guaranteed to be the same for all assets.

To view the full mapping structure for Collibra resources when using the Transform Message component:
  1. In the Anypoint Studio main menu, click WindowPreferences.
  2. In the Preferences window, select Anypoint Studio → DataWeave.
  3. In the DataWeave pane, set the Level of recursion to 10 if it has a lower value.
  4. Click Apply and Close.