Share via

Purview Data Map SHIR scan of MySQL database

RIchard Wardrobe 0 Reputation points
2025-12-11T00:21:06.1566667+00:00

Hi

Running Purview DataMap to an onprem SHIR server with the ability to communicate to all the needed Microsoft services via the internet. The SHIR version is 5.51.93651.1, and all the diagnositcs pass.

When setting up the Scan of a MySQL database (onprem) the scan is queued and talks with the SHIR server, but eventually errors out with this error.

Looks like the SHIR application on the host is expecting a specific key name that isn't present in the downloaded JSON. Unfortunately, I cannot see the downloaded JSON.

I have followed the https://dori-uw-1.kuma-moon.com/en-us/purview/register-scan-mysql and can confirm all prerequisites are installed JDK 11 and C++ Redistributable V14

I have uploaded the logs to Microsoft 05d1e4eb-f0f1-493e-a0a5-c4b64febe4fd

Any thoughts?

The given key was not present in the dictionary.

Exception:'Type=System.Collections.Generic.KeyNotFoundException,Message=The given key was not present in the dictionary.,Source=mscorlib,StackTrace= at System.ThrowHelper.ThrowKeyNotFoundException()

at System.Collections.Generic.Dictionary`2.get_Item(TKey key)

at Microsoft.DataTransfer.Execution.DataScan.MySqlHelper.ExtractMySqlScanTargetInfo(IReadOnlyDictionary`2 connectionInfo, Boolean checkConnection, String hybridRuntimeConnectionPropertiesJson, ManagedIdentityConnectionParameters managedIdentityConnectionParameters, String uriPathFromDataSet, String datasetJson)

at Microsoft.DataTransfer.Execution.DataScan.MySqlHelper.ExtractScanTargetInfo(IExecutorLogger logger, Guid runId, Guid activityId, String connectorType, IReadOnlyDictionary`2 connectionInfo, Boolean checkConnection, String hybridRuntimeConnectionPropertiesJson, ManagedIdentityConnectionParameters managedIdentityConnectionParameters, LinkedService scanTargetDataSet, String datasetJson)

at Microsoft.DataTransfer.Execution.DataScan.DataScanExecutorHelper.<ExtractScanTargetInfoAsync>d__3.MoveNext(),'

Job ID: 98bc3c49-3dbf-4607-84de-0c11f6783240

Log ID: Error

User's image

Microsoft Security | Microsoft Purview
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Pilladi Padma Sai Manisha 575 Reputation points Microsoft External Staff Moderator
    2025-12-11T00:39:29.1266667+00:00

    Hey RIchard Wardrobe,

    It sounds like you're encountering a frustrating issue with your Purview Data Map scan of your on-prem MySQL database. The error message you received, stating that "the given key was not present in the dictionary," suggests that there's a problem with the expected data structure during the scan process.

    Here are a few things you can try to resolve this:

    1. Check Configuration: Ensure that the configuration of the self-hosted integration runtime (SHIR) is correct. Make sure that the SHIR is set up and is properly communicating with your database and the Purview service.
    2. Authentication: Since MySQL supports Basic Authentication, double-check that the username and password in the credentials used for the scan are correct. Ensure that the credentials you provided have sufficient permissions to access the databases you're trying to scan.
    3. Update SHIR: Since you're running version 5.51.93651.1 of the SHIR, verify if there's a newer version available. Occasionally, odd issues can be resolved simply by updating to the latest version of the software. You can download the latest version from the Download Center.
    4. Memory Settings: Make sure that the maximum memory available on your machine for the SHIR is sufficient. It's recommended to have about 1GB of memory for every 1000 tables in the MySQL database.
    5. Log Examination: While you mentioned you've uploaded logs to Microsoft, if possible, look for any additional error details leading up to the specific error in your environment logs. Specific warnings or messages prior to the error might provide additional context.
    6. Private Endpoint Configuration: If you are using private endpoints, confirm that network settings and firewall rules permit the necessary access. This includes ensuring that your SHIR can communicate effectively with both the Purview service and your MySQL instance.
    7. Consult Microsoft Documentation: Given that you followed the documentation at https://dori-uw-1.kuma-moon.com/en-us/purview/register-scan-mysql, make sure to revisit the prerequisites and steps to verify there aren’t any overlooked configurations.

    Follow-Up Questions:

    To assist you better, could you provide more details on:

    1. Have there been any recent changes to your network configuration or database permissions that might impact the scan?
    2. Are only specific tables in your MySQL database causing the issue, or is this happening with all of them?
    3. Can you confirm if the SHIR service account has the necessary permissions to access your databases?
    4. Have you run any diagnostic tests from the Purview interface to check connectivity or configuration issues?

    I hope this helps you get closer to a resolution! Good luck, and let me know if you have any other questions!

    Reference Documentation:

    Feel free to reach out if you have more questions!

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.