A Copilot Studio agent uses Classic mode with generative answers enabled and a company SharePoint site as the knowledge source. During testing, the developer notices that when a user asks a question completely outside the SharePoint content — such as asking about the weather — the agent generates a plausible but fabricated answer using its built-in AI knowledge rather than returning 'I don't know.' How should the developer prevent the agent from generating answers outside its authorized knowledge source?
Select an answer to reveal the explanation.
Short Explanation and Infographic
The 'use general knowledge' toggle is the bouncer at the door — with it on, the AI's world knowledge sneaks in alongside your approved content. Turn it off and the AI can only answer from what's in the knowledge source you gave it, keeping the agent inside its lane.
Full explanation below image
Full Explanation
In Copilot Studio's generative answers configuration, there is a setting that controls whether the AI can supplement knowledge source content with its own built-in general knowledge. When this setting is enabled (it may be labeled 'Allow the AI to use its own general knowledge,' 'Use Azure OpenAI knowledge,' or similar depending on the Copilot Studio version), the agent can generate answers about topics not covered by the configured knowledge sources — which causes the fabrication issue described.
Disabling this toggle constrains the generative answers model to only produce responses grounded in the configured knowledge sources (SharePoint in this case). If the SharePoint content does not contain relevant information for a query, the generative answers node returns 'no answer found,' which then triggers the configured fallback behavior rather than hallucinating an answer.
Option A is incorrect because disabling generative answers entirely is an overreaction that removes a valuable capability. The correct fix is a configuration toggle, not removal of the feature. Pre-built topics alone cannot cover all HR or company knowledge questions.
Option B is incorrect because Orchestration mode does not automatically restrict answers to configured knowledge sources only. Orchestration mode determines how topics and actions are selected; the general knowledge restriction is a separate configuration on the generative answers node that applies in both modes.
Option D is incorrect because building a content moderation topic to intercept off-topic questions is complex, fragile, and incomplete. It requires the developer to enumerate what constitutes 'off-topic,' which is impossible to do comprehensively. The correct solution is a single configuration toggle on the knowledge grounding setting.
Exam tip: The 'allow general knowledge' toggle is a key data governance control for enterprise agents. Know that turning it off forces the agent to ground all answers in the configured knowledge sources, preventing hallucination of out-of-scope content.