End-to-end real-time scoring latency includes:

E2E latency = auth + features + model + network + postprocess — not matmul alone.