Share via


Responsible AI FAQs for Document analysis with Copilot (preview)

Important

Some or all of this functionality is available as part of a preview release. The content and the functionality are subject to change.

Note

This feature is included in Microsoft Sustainability Manager Premium.

What does it mean to analyze documents with Copilot?

Document analysis is a generative AI tool powered by Azure OpenAI. It allows you to upload ESG-related documents to Microsoft Sustainability Manager and ask questions related to them in natural language.

What can document analysis do?

Document analysis helps you quickly extract information from long-form environmental, social, and governance (ESG) documents. You can select between one and five documents to analyze together. You can delete documents from Sustainability Manager at any time.

What are the intended uses of document analysis?

Document analysis is designed to help sustainability practitioners extract key information from ESG documents by using natural language. Examples of these documents are sustainability reports or calculation guidance documentation.

How was Copilot evaluated? What metrics are used to measure performance?

A red team thoroughly evaluated Copilot, testing for common risks such as violence, self-harm, sexual content, and hate and fairness. In addition, extensive grounded response testing measured Copilot’s performance. This testing assesses accuracy and the extent to which responses are grounded in reference data by testing for coverage of intended uses.

What are the limitations of document analysis? How can users minimize the impact of its limitations when using the system?

You can analyze up to five documents at a time. Additionally, the system supports only three file types: PDF, DOCX, and TXT. Finally, Copilot can only recognize and search text. The system doesn't support any images contained within the document.

What operational factors and settings allow for effective and responsible use of document analysis?

You can turn Copilot on and off through the Power Apps admin settings. Copilot includes the following disclosure messaging, plus the ability to give feedback:

  • "AI-generated content might be incorrect."
  • "Make sure AI-generated content is accurate and appropriate before using."
  • "All users can access files. Anyone chatting with Copilot can access uploaded file content, regardless of file permissions or access controls."