A county clerk's records agent handles sealed court filings and must satisfy a data-residency requirement that keeps this data within infrastructure the county directly controls. The team is deciding between a SaaS Gemini LLM call and a self-hosted open-source model. Which factor should drive the decision?
Select an answer to reveal the explanation.
Short Explanation
Think of it like sealed court records that legally can't leave the courthouse basement — it doesn't matter how good the archive across town is if the law says the records stay put. A self-hosted model keeps that data inside infrastructure the county actually controls, which is what the residency requirement demands, regardless of how capable the SaaS alternative might otherwise be.
Full Explanation
Choosing between a SaaS-delivered proprietary LLM and a self-hosted open-source model is often a security and compliance decision before it's a capability decision, and a data-residency requirement on sealed filings is a hard constraint that a SaaS call to an external provider's infrastructure cannot satisfy, no matter how capable that model is.
Optimizing for benchmark performance treats this as a pure capability trade-off and ignores the residency constraint entirely, which is the actual binding requirement in the scenario. Optimizing for integration simplicity treats engineering convenience as the deciding factor when the county's actual constraint is legal and regulatory, not developer effort. Optimizing for per-call cost similarly substitutes a secondary consideration for the requirement that actually governs the decision, since a cheaper option that violates residency isn't a viable option at all.
Scope note: self-hosting to satisfy residency introduces its own operational burden — infrastructure management, model updates, and scaling become the county's responsibility rather than a vendor's. Operational check: confirm the self-hosted deployment's actual network path and storage location before certifying that sealed filing data never leaves county-controlled infrastructure.