A city wants ML inference for permit-image checks but lacks staff t…

Question

A city wants ML inference for permit-image checks but lacks staff to build and operate GPU clusters. Which design best delegates that complexity?

Accepted Answer

Delegate complex ML inference hosting to a managed AWS service so the city avoids building and operating its own GPU clusters. — GPU clusters are a specialty shop most cities do not need to run. Point the permit checker at a managed AWS inference service and skip the rack, the drivers, and the 2 a.m. GPU tickets.

Answer

Purchase and rack dedicated GPU servers in each branch office for local training and inference.

Answer

Require every planner to train models on personal laptops overnight.

Answer

Store model weights only in email attachments with no hosting platform.

A city wants ML inference for permit-image checks but lacks staff to build and operate GPU clusters. Which design best delegates that complexity?

Short Explanation

Full Explanation