Perform human-in-the-loop tasks for agentic workflows (20-25%)

GH-700 · 71 questions

• A procurement lead uses an agentic workflow that drafted a vendor renewal, flagged a 12% price increase, and paused for human review with clause-level comments enabled and audit logging on. Policy requires no auto-acceptance over 5% and every revision to be tracked. Which approval response should the lead give to handle the agentic workflow's request for interaction on this renewal?
• A program manager launched an agentic workflow that drafts release notes from 40 merged pull requests while the team watches progress live. Mid-run it flags two ambiguous customer-facing changes and pauses for guidance before continuing. Which human-in-the-loop interaction best steers the running agentic workflow to completion?
• A fintech product manager uses Copilot to draft payment validation logic, must keep customer data out of prompts, and requires a teammate to approve every AI suggestion before merge. Which human-review safeguard best addresses Copilot security considerations for sensitive code?
• A program manager uses an agent to draft customer refund decisions from order history, warranty terms, and sentiment. Refunds over $500 need finance approval, fraud signals appear occasionally, and customers can appeal. Which critical decision point requires mandatory human judgment before the agent acts?
• A support operations team runs an agent that can search help articles, update tickets, and issue refunds through connected tools. Policy requires human approval for refunds over $50 and review when external actions occur. Which escalation path based on tool usage best satisfies the review policy?
• An operations lead at a 300-person furniture retailer must update 900 live product listings with new sustainability labels. Errors risk supplier fines, the team wants to review the mapping logic once before any bulk edit, and they do not want to approve each listing individually. Which agent work mode best fits this need for upfront validation with efficient execution?
• A project coordinator monitors a live agentic workflow migrating 800 knowledge articles that is currently summarizing drafts, with a stakeholder asking to clarify tone mid-run without losing progress or restarting the job. Which in-run interaction should the coordinator use to guide the agentic workflow while it is running?
• A business analyst designs an agent that reads invoices, files expenses, and refunds customers up to $500 automatically. Finance requires a manager to approve larger refunds and any external payment tool use. Which escalation design best controls risk based on tool usage?
• A product manager receives an agent request to delete 400 stale customer records, with attached evidence showing 40 are still under legal hold. Which response to the interaction request best handles this approval, rejection, or revision decision?
• A product manager must update 15 legacy docs in GitHub, some edits are low-risk formatting, but several sections change customer-facing API commitments requiring careful wording. She wants speed with control. Which agent work mode should she choose for this validation practice?
• A product manager supervises an agentic workflow that enriches 500 CRM records overnight, but at 3 a.m. it halts with authentication errors on the CRM step after a token rotation. The remaining steps are queued and sales needs data by 9 a.m. Which human-in-the-loop response best resolves this agentic workflow failure?
• You are an operations lead at an 80-person payments company where analysts use GitHub Copilot to draft automations that touch transaction records. Company policy forbids secrets in prompts or code, and auditors require documented human validation of AI assistance. Suggestions sometimes include insecure patterns despite built-in filters. Which human-review practice best addresses GitHub Copilot security considerations?
• A support lead deploys an agent with rights to search orders, issue refunds, and email customers. A misconfigured tool once refunded the wrong account. Which escalation path based on tool usage should be designed for safe validation?
• A finance analyst receives an agentic workflow request to approve a vendor payment file before it posts. The attached summary shows a mismatched total, missing purchase order, and imminent due date pressure. Which response to the approval request best handles the interaction correctly?
• A technical project manager designs human review for a Copilot agent that touches customer data, third-party APIs, and production configs. Security wants minimal exposure, auditability, and secret safety. Which security consideration best shapes the human-review design?
• A program manager is watching a Copilot coding agent mid-run migrate a billing export job, with live progress, partial edits, and a confirmation request before deleting legacy fields, and she must steer it without losing context or forcing a restart. Which in-run interaction with the agentic workflow best preserves continuity while steering the outcome?
• You are a program manager watching a Copilot coding agent run that started bulk-editing billing config files after misreading a ticket, with commits already appearing on its branch and checks still queued. Policy requires no further automated writes and a clean audit trail. Which stop control halts the running agentic workflow safely?
• A business analyst owns a nightly agentic workflow that categorizes support tickets. It failed with a missing label error, the run log names the step, and policy requires the fix to be reviewed. Which interaction to resolve the agentic workflow failure best satisfies audit and recovery needs?
• A product manager's documentation agent failed halfway, citing missing Confluence pages and halting before updating the changelog, with logs showing two access errors and an incomplete draft pull request. Which interaction with the agentic workflow to resolve failures restores progress safely?
• An operations lead runs an agentic workflow that pauses before publishing customer-facing release notes, asking for confirm, edit, or stop due to accuracy and compliance rules. A pending request cites an unapproved feature. Which response to the interaction request for approval, rejection, or revision best meets controls?
• A technical project manager launched an agentic workflow that is mid-run migrating 300 help-center articles, and stakeholders just clarified that API examples must stay in Python. The run cannot restart without losing an hour. Which interaction should the manager use to interact with an agentic workflow while it is running?
• A business analyst owns review for Copilot-drafted Terraform for a demo portal seeded with sample customer records. Policy requires reviewers to catch leaked secrets, insecure defaults, and over-permissive access before merge. Which human-review control best addresses Copilot security considerations?
• A program manager is demoing to executives when an agentic workflow starts posting duplicate status updates to a customer-visible issue every minute. The run is still active, the noise must stop immediately, and the team needs to diagnose afterward. Which method to stop a running agentic workflow best balances immediacy and later review?
• You supervise an agent that drafts supplier contracts from approved templates, with requirements for exact clause order, no invented penalties, and manager sign-off on deviations. Legal reports a draft with reordered clauses and a new fee. Which supervision practice ensures the agentic workflow meets stated requirements?
• Maya, an operations lead, gets a paused agentic workflow asking to publish an AI-drafted pricing page. One discount lacks source verification, policy requires a recorded decision with reasons, and the agent must be able to revise. Which approval response best handles the agentic interaction request?
• You launched an agentic workflow to migrate 150 help-center articles. Mid-run you notice it is mislabeling HIPAA-related pages and you want to steer it without losing progress. The run shows live logs, pause, and feedback controls. How should you interact with the agentic workflow while it is running?
• A program manager owns an agentic workflow that failed overnight while creating onboarding issues because a required HR template file was renamed, blocking 30 new hires. The file path is now known. Which interaction should the manager use to interact with agentic workflows to resolve failures?
• You oversee a hiring-summary agent that must cite interview notes, avoid inventing skills, and flag low-confidence cases for recruiter review. A batch of summaries looks polished but lacks citations and confidence labels. Which output review discipline validates the agentic workflow results before sharing?
• A program manager is watching a Copilot coding agent that is stuck repeatedly pushing failing commits to a release pull request, consuming runs and blocking review. The team needs the run halted immediately without losing history for audit. Which stop control should the manager use to stop an agentic workflow that is running?
• A product manager supervises an agentic workflow that triages 300 weekly support tickets. Requirements are respond within 4 hours, include one help-center link, and never auto-close VIP accounts. Early runs look fast but a VIP was closed without a link. Which supervision check best confirms the agentic workflow meets requirements?
• A business analyst launched an agentic triage workflow on a 400-issue backlog that starts re-labeling and commenting on customer-reported bugs incorrectly. The run is still active, stakeholders are watching the repository, and the analyst must halt further changes immediately without losing the log. Which control should the analyst use to stop an agentic workflow that is running?
• A release manager's documentation agent failed overnight: it stopped after a renamed API spec file, blocking release notes for a 12-team launch with a morning deadline. Logs show file-not-found errors. Which interaction best resolves the failure in the agentic workflow?
• A finance analyst launched an invoice-triage agent that pauses to request approval before posting to the ledger. The run is waiting, the queue is growing, and she must guide it without losing progress. Which in-run interaction should the analyst use to guide the running agentic workflow?
• A product operations lead oversees an agentic workflow that drafts weekly release notes from merged pull requests and closed issues for a mobile app with strict marketing claims review. Drafts sometimes invent features or omit fixes. Which supervision practice ensures that agentic workflows meet requirements for accuracy before publishing?
• A program manager uses an agentic workflow to draft customer release notes from 60 merged pull requests and linked issues. Drafts read well but mention features not shipped and omit a breaking API change. Which review practice best validates agentic workflow outputs before publishing?
• A product manager supervises a deployed triage agent that labels incoming GitHub issues overnight and assigns owners. Stakeholders report missed SLAs, duplicate labels, and unexplained reassignments this week. Which supervision practice should the manager use to monitor agentic workflow runs and restore reliable triage?
• A program manager notices a coding agent stuck in a loop during business hours: it keeps pushing unwanted commits to a shared feature branch, triggering CI costs and confusing reviewers. The run shows no completion. Which action best stops the agentic workflow that is running?
• A support operations lead owns a triage agent that failed overnight on malformed tickets, blocking the queue. She has error logs, a few bad ticket examples, and permission to retry. Which interaction should she use to resolve failures in the agentic workflow?
• A business analyst receives an agent-generated migration plan that proposes database schema changes and revised timelines for a retail checkout system. Before sharing with engineering, accuracy and risk must be confirmed. Which review method should the analyst use to review agentic workflow outputs?
• A program manager pilots an agent that triages 200 support issues weekly, must apply only approved labels, link a related incident, and post a confidence score for human review. Early runs skip links and use free-form labels. Which supervision practice should the manager implement to ensure that agentic workflows meet requirements?
• A finance manager oversees an agentic workflow that extracts data from 500 vendor invoices nightly. Leadership needs proof of reliability, early warning of failures, and audit trails. Console output looks fine but errors hide until month-end. Which approach best monitors agentic workflow runs over time?
• A program manager at a mid-size logistics firm designs an agent that summarizes vendor proposals, scores them against budget rules, sends acceptance emails to winners, and archives contracts in GitHub. Finance requires accountability for spend and legal risk. Which critical decision point requires human judgment and validation?
• You are a program manager overseeing a nightly agentic workflow that triages support issues, labels them, and drafts replies across 200 tickets. Leadership requires proof the run completed, how long steps took, and where failures occurred. Which monitoring approach should you use to supervise agentic workflow runs effectively?
• A procurement supervisor pilots an agentic workflow that creates purchase orders from approved requisitions for a 500-person manufacturer. Finance requires quantities to match requisitions, vendors to be on the approved list, and totals to stay within budget, while operations wants faster cycle times. Which supervision practice best ensures that agentic workflows meet requirements?
• A program manager is piloting a coding agent that started opening pull requests against the wrong branch and consuming Actions minutes. The run is still active in GitHub. Which control should the manager use first to stop an agentic workflow that is running?
• A business analyst supervises a Copilot coding agent that drafted release notes, updated API docs, and proposed database migration scripts for a fintech app. Compliance requires accuracy, safe SQL, and no leaked secrets before merging to main. Which practice best reviews agentic workflow outputs for accuracy and safety?
• A fintech product manager is designing an agentic workflow that reads customer complaints, issues refunds under $50, updates billing records, and notifies regulators when fraud is suspected. Compliance requires auditability and no autonomous legal or financial commitments. Which decision point should the manager designate as requiring mandatory human judgment and approval?
• A program manager must modernize 40 legacy onboarding docs: the agent must propose a new structure, get stakeholder sign-off, then migrate content across repositories with team visibility. Accuracy matters, but constant prompts would stall delivery. Which agent execution mode should the manager select to balance control and momentum for this migration?
• A business analyst must let an agent draft vendor contract redlines from legal playbooks. Policy demands a human approves strategy before drafting, but the analyst wants hands-off drafting once the plan is approved to save time. Which agent work mode best balances oversight and efficiency?
• A delivery manager oversees an agent that migrates support tickets into GitHub issues nightly and must prove each issue has correct labels and no sensitive data. Which supervision practice best ensures that agentic workflows meet requirements?
• A hiring manager pilots an agent to screen engineering applications in GitHub Issues, summarize portfolios, schedule interviews, and send rejection messages for 300 applicants. False rejections create legal and fairness risks, while scheduling is low risk. Which human review design identifies critical decision points where human judgment is required?
• A support operations manager uses an agentic workflow to summarize 500 tickets weekly, flagging churn risk and required follow-ups. Two summaries misquoted refund amounts and missed SLA breaches. Which review practice best validates agentic workflow outputs before stakeholders act?
• A technical project manager oversees three Copilot coding agents refactoring payment services overnight with required checks, strict file boundaries, and a morning deadline. She must catch stalls, policy violations, and failed tests early. Which supervision approach best monitors agentic workflow runs during execution?
• A program manager introduces an agent to draft vendor contracts, approve production database deletions, and publish customer-facing release notes for a healthcare platform. Legal, data-loss, and reputational risks differ sharply. Which approach best identifies critical decision points where human judgment is required?
• A business operations team runs an agent that can read tickets, query order databases, issue refunds, and post public status updates. Leadership wants automation for routine reads but strict human control when financial or external communication tools are used. Which escalation path should the analyst design based on tool usage?
• A logistics coordinator oversees an agentic workflow that nightly reconciles shipment records across two systems and posts exceptions. Last week two runs silently stalled and one posted duplicate exceptions. Which monitoring approach best tracks agentic workflow runs in production?
• A product manager receives an agent-generated migration plan with code edits and a summary, and must decide if it is safe to merge. The plan touches payments logic. Which practice best guides review of agentic workflow outputs?
• A support operations lead deploys an agent that refunds orders via connected billing tools. Low-value refunds can auto-process, but high-value refunds and repeated tool errors need finance review. Which escalation path design based on tool usage best ensures control?
• A solo consultant must refactor a fragile billing module with no tests, strict compliance, and a client demo in two days. She wants speed but must prevent unreviewed destructive changes. Which execution mode should she choose for how the agent will perform work?
• A program manager supervises an hourly agentic workflow that syncs supplier inventory via API and opens issues on mismatches. Leadership needs early detection of stalled, failed, or degraded runs without reading code. Which monitoring practice best tracks agentic workflow run health?
• A program manager must automate a vendor contract migration affecting billing in 200 repositories. Legal requires review of the migration plan before any file changes, but then wants the agent to execute approved steps without constant prompts. Which agent work mode best balances required upfront approval with efficient execution for this migration?
• A support ops team pilots an agent that refunds orders, updates billing records, and closes tickets from chat requests, with strict limits on financial loss and audit needs. Where should human judgment be required as a critical decision point for validation?
• A business analyst designs human review for AI-drafted release notes that may include code snippets and customer names. Policy requires no sensitive data leakage and clear accountability for published content. Which security consideration should shape GitHub Copilot human-review design for this workflow?
• A business analyst designs human review for a Copilot agent that drafts release notes and suggests database migration scripts from production schema samples. Reviewers must catch insecure code, leaked secrets, and over-permissive suggestions. Which security consideration should shape the human-review design for GitHub Copilot output?
• A program team lets a support agent draft refunds and update billing records in GitHub-connected systems. Routine cases run smoothly, but high-value refunds and repeated tool failures need oversight. Which escalation path based on tool usage should the designer configure for human review?
• A program manager oversees an agentic workflow that requests approval to merge a pricing-page update. The diff adds an unapproved discount and lacks legal sign-off required by policy. How should the manager respond to this request for interaction from the agentic workflow?
• A technical project manager oversees an agentic workflow that pauses on its Actions run page to request approval before publishing updated help-center articles, and the bot pings her in GitHub when legal wording changes need revision. She must keep an audit trail while unblocking writers. How should she respond to requests for interaction from the agentic workflow?
• A business analyst must clean 500 rows of CRM data where rules are unclear, errors could break billing, and the manager wants to learn the agent's plan before any bulk edits. Which agent working mode best balances learning and safety for this task?
• A product manager designs an agentic workflow that drafts vendor contracts, approves payments up to $50,000, and notifies suppliers automatically, with finance policy requiring accountability for spend and legal exposure. Which design choice best identifies critical decision points where human judgment is required?
• A business analyst designs human review for AI-generated release summaries that pull from private GitHub repositories containing customer data. Reviewers must catch leaks and insecure suggestions before publishing. Which Copilot security consideration should shape the human-review design?
• A finance operations team lets an agent process invoices with read, draft, and refund tools: low-risk reads can run freely, but any refund call above $500 must pause for controller approval with full context. Which escalation design best configures tool-based human review for this invoice agent?