Generative answers node “Search only selected sources” still uses unselected sources

David Wong 46 Reputation points
2025-12-11T23:54:25.39+00:00

Hi,

Issue: In a Generative answers node I set “Search only selected sources” and chose only an Excel table/file (stored in SharePoint, upload as unstructured source). The agent also has a SharePoint site added at the agent level, but it is not selected in the node. Replies still include or cite content from that SharePoint site.

Also, my agent:

  • Use classic orchestration (no AI)
  • Did not enable "Allow the AI to use its own general knowledge"
Microsoft Copilot | Microsoft 365 Copilot | Development
{count} votes

1 answer

Sort by: Most helpful
  1. Q&A Assist
    2025-12-11T23:54:36.5966667+00:00
    AI generated content. This question contains an answer created with AI from Q&A Assist. Learn more

    In your scenario, it seems that even though you have set the option "Search only selected sources" in the Generative answers node and selected only the Excel table/file, the agent is still returning content from the SharePoint site that is added at the agent level. This behavior can occur due to the following reasons:

    1. Classic Orchestration: Since you are using classic orchestration, the agent may have limitations on how it processes knowledge sources. In classic orchestration, the number of knowledge sources the agent can search is limited, and it may not fully respect the selection made in the node if it has access to other sources.
    2. Agent-Level Settings: The SharePoint site being added at the agent level might still allow the agent to reference that content, even if it is not selected in the node. The settings at the agent level can override node-specific settings in some cases.
    3. Caching or Delays: Sometimes, changes made in the configuration may take time to propagate, or there may be caching issues that cause the agent to return results from previously accessed sources.

    To resolve this issue, you may want to:

    • Double-check the configuration of your Generative answers node and ensure that the settings are correctly applied.
    • Consider removing the SharePoint site from the agent level if it is not needed, or adjusting the configuration to ensure it does not interfere with the node settings.
    • Test the agent after making changes to see if the behavior persists.

    If the problem continues, you may need to reach out to your administrator or consult the documentation for further troubleshooting steps regarding knowledge source management in Microsoft Copilot.


    References:

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.