Implement machine learning model lifecycle and operations

AI-300 · 56 questions

• A permits office wants each model experiment run to record parameters and metrics inside Azure Machine Learning for later comparison. Which capability should they configure?
• A public-health team must choose among MLflow-tracked runs for a disease-outbreak early-warning model by comparing AUC and recall. What should they do?
• A transit authority wants to explore many candidate algorithms quickly for next-day ridership prediction before committing to a hand-tuned pipeline. Which Azure Machine Learning approach fits best?
• A housing authority must keep AutoML within interpretable model classes so fair-housing review boards can explain decisions. How should AutoML be configured?
• A city data scientist needs to prototype feature ideas for an illegal-dumping classifier before the team builds a production training pipeline. Which approach is most appropriate for that early stage?
• A water utility wants systematic search over hyperparameters for a leak-detection model instead of overnight hand-tuning. What should the MLOps engineer configure?
• A fire-district team needs to run a smoke-plume estimation training script on Azure Machine Learning with arguments captured for audit. Which approach should they use?
• A county assessor must train a large imagery model that no longer fits practical single-node GPU limits. What should the team use in Azure Machine Learning?
• A 311 operations group needs data-prep, train, and evaluate steps to run as a repeatable nightly refresh rather than ad hoc notebook clicks. What should they implement?
• A parks department wants to decide which tree-canopy classifier generalizes better on holdout wards by reviewing two training jobs together. What should they do?
• A clerk's office wants scikit-learn training scripts to record metrics automatically in MLflow so interns are not responsible for manual screenshots. What should they enable?
• A municipal fraud unit wants AutoML to handle messy grant-application tables while preserving careful train and validation splits. Which practice should guide the AutoML run?
• A school-district energy team documented thermostat setpoint model assumptions in an Azure ML notebook and now needs governed training for production. What should they do next?
• A transit MLOps engineer needs to search learning rate and tree depth for a delay-classification model without hand-picking every trial. Which Azure ML approach should they configure?
• A public-works crew wants its forecasting model trained by a reusable unit that wraps the training script inside municipal pipelines. What should they use?
• A regional emergency ops center finds its wildfire-risk CNN exceeds single-GPU memory during training. What should the MLOps team do?
• A city revenue office retrains a delinquency-risk model every quarter and wants the same orchestration each cycle. Which pattern should they implement?
• A library consortium must confirm which data asset version produced the winning catalog-tagging model before approving it. What should reviewers examine?
• A courts analytics pilot needs fairness measures recorded with accuracy for pretrial risk experiments. How should the team capture those measures in Azure ML?
• A sanitation department wants many hyperparameter trials for a route-optimization model but must control Azure spend. Which sweep practice should they apply?
• A permits MLOps lead selected a winning experiment run and needs it available for controlled production promotion. What should they do in Azure Machine Learning?
• A public-health team wants scoring to pull the same features used at training time for an outbreak early-warning model. What should they package with the model artifact?
• A transit authority is ready to promote a ridership model into the registry but must check responsible AI concerns first. What should they do before promotion?
• A housing authority retired an eligibility-scoring model and must prevent accidental redeployment. Which lifecycle action should they take?
• A city fraud team is registering grant-screening model v3 while grant season still may require a fast return to v2. How should versions be handled?
• A water utility is registering a quality-prediction MLflow model and needs reliable scoring contracts for downstream systems. What should registration include?
• A county assessor is promoting a valuation-assist model and governance requires evidence of fairness and error analysis. What should accompany the promotion ticket?
• A 311 team must ensure production enrichment uses the same feature store retrieval path the registered model expects. What should the registered model reference?
• A parks department ends a failed tree-canopy experiment but auditors may still need the model history. What is the appropriate registry action?
• A clerk's office requires clear promotion states before any endpoint deploy of registered models. Which practice should their MLOps runbook enforce?
• A fire district's responsible AI evaluation shows disparate error rates across neighborhoods for a candidate dispatch-aid model. What should the promotion decision be?
• A school-district MLOps runbook needs batch scoring to stay consistent with training features for an enrollment model. How should artifacts be packaged?
• A city needs instant permit-risk scores while clerks enter applications at the counter. Which deployment option should MLOps choose?
• A transit authority must score next-day ridership for all routes overnight without interactive latency requirements. Which endpoint pattern fits?
• A public-health team is about to cut over clinic traffic to a new online endpoint. What should they do first?
• A housing authority online endpoint returns HTTP 429 responses during peak voucher-application hours. What is the most likely operational issue to address?
• A water utility wants to release a new SCADA-derived scoring model version with limited blast radius. Which release strategy should they use?
• A 311 platform swaps in a new triage model and latency SLOs start failing. What should the MLOps team do first to protect residents?
• A courts analytics unit needs a document-risk classifier in production without babysitting unmanaged virtual machines. Which deployment approach fits best?
• A parks mobile app fails scoring because the endpoint environment is missing a geospatial dependency. How should ops isolate the fault?
• A county revenue office wants to cut over a new parcel-scoring batch endpoint safely. What progressive practice should they use?
• A fire-district dispatch aid model must stay responsive during incident spikes. Which online endpoint capability should they configure?
• A library catalog-tagging service must catch broken request payloads before go-live. What should endpoint tests verify?
• A city MLOps policy covers progressive rollout of resident-facing scores. What operational readiness item is required before traffic shifts?
• After a permits intake form redesign, feature distributions shift and the live model’s inputs no longer resemble training. What should monitoring detect?
• A transit ridership model is live and delayed-trip labels arrive each week. What should the team track in production?
• A public-health outbreak model must warn leadership when quality falls. Which monitoring control fits?
• A housing authority agrees that statistical drift beyond a set distance should refresh the eligibility model. What should they configure?
• A water-quality scoring service sees drift signals and must decide whether to retrain. What analysis should happen first?
• A 311 classifier dashboard shows rising latency and falling F1 after ticket categories change. What monitoring insight does this illustrate?
• A courts risk model’s drift panels must respect sealed-case constraints. How should monitors be configured?
• A parks visitation model breaches the municipal endpoint error-rate SLO. Which alert type should fire for on-call?
• A school-district enrollment forecaster only learns true fall headcount months later. How should production quality be monitored?
• A fire-district aid model receives drift alerts but unstable automatic updates would be dangerous. What retrain policy fits?
• A city open-data MLOps team needs drift detection that auditors can defend. What should they document?
• A clerk’s office must approve model promotions using production evidence. Which practice supports that governance?