Operational Efficiency and Optimization for GenAI Applications

AIP-C01 · 24 questions

• A city finance office wants lower 311-bot spend and clearer chargeback by department. Which operational efficiency approach best combines usage visibility with direct cost control?
• A county parks FAQ bot mostly answers simple hours and closure questions, but still calls the most expensive foundation model for every request. Which cost-efficiency change best fits that workload?
• A transit authority must summarize overnight incident reports where near-real-time replies are not required. Which resource-efficiency strategy best improves throughput and cost for that GenAI workload?
• A public-health chatbot sees many near-identical outbreak FAQ questions that still trigger fresh foundation-model calls. Which optimization best reduces unnecessary invocations?
• A clerk RAG assistant retrieves large ordinance packets, and token spend rises because generation includes lengthy low-value context. Which efficiency practice best reduces tokens while preserving useful citations?
• A housing chatbot team must choose among Amazon Bedrock foundation models under a fixed monthly budget. Which evaluation approach best supports that municipal selection decision?
• A water utility’s GenAI ops console sees predictable morning peaks when field supervisors open shift briefings. Which capacity approach best balances cost and readiness for that pattern?
• A parks visitor kiosk repeatedly receives identical exhibit questions from different guests. Which caching pattern best avoids redundant foundation-model calls for those exact repeats?
• A city permitting assistant must feel responsive at the counter while fee tables change only nightly. Which performance design best balances latency and cost?
• A county runs both live 311 chat and overnight research summarization on Amazon Bedrock. Which model-selection practice best optimizes performance for the live path?
• A transit RAG path is slow when riders ask about stop disruptions because retrieval dominates end-to-end time. Which optimization focus best improves foundation-model augmentation performance?
• A public-health workflow must both translate and summarize the same outbreak bulletin before staff review. The steps do not depend on each other’s outputs. Which performance pattern best reduces wall-clock time?
• A clerk team uses one Bedrock application for creative outreach drafts and for deterministic fee answers. Which performance and quality configuration practice best matches those different needs?
• A housing platform considers adding a reranker stage before generation and must know whether quality gains justify extra latency. Which optimization practice should the team use?
• A water operations API feels slow, and engineers disagree whether prompt assembly, retrieval, or foundation-model completion dominates. Which practice best drives latency reduction?
• A 311 GenAI service scales only on CPU utilization, yet outages still occur during token-burst traffic when CPUs look moderate. Which autoscaling improvement best fits GenAI traffic patterns?
• A parks festival weekend drives sudden spikes in exhibit-assistant traffic and foundation-model throttling appears. Which performance control best manages throughput during those spikes?
• An emergency-management dashboard must prove GenAI answer time meets published board SLAs after each release. Which practice best supports that performance goal?
• A city SRE team already watches HTTP 5xx rates but lacks insight into GenAI-specific health for the resident assistant. Which monitoring approach best closes that gap?
• A county must forensically review a bad permitting answer to see the exact prompt and model response. Which monitoring capability best supports that analysis?
• After a transit authority ships a new multi-tool agent, overnight token spend jumps in irregular bursts. Which monitoring practice best helps SREs catch that GenAI cost anomaly early?
• A public-health multi-agent outbreak Q&A stack feels slow, and leaders need to know which tool call in the chain is the bottleneck. Which monitoring approach gives the most actionable visibility?
• A clerk platform’s ordinance RAG answers grow sluggish as the corpus expands. What operational practice best keeps the vector store healthy for foundation-model augmentation?
• After a housing-authority prompt edit, staff worry answers drifted even though classic uptime metrics look fine. Which GenAI-specific observability practice best detects that consistency problem?