Under a banking-style model risk program, how should a production L…

Question

Under a banking-style model risk program, how should a production LLM used for research summarization be treated?

Accepted Answer

As a model/system in inventory with use-case tiering, validation proportionate to impact, ongoing monitoring, and change control. — LLMs in production research are models/systems — inventory, tier, validate, monitor, change-control them.

Answer

As non-model technology that never needs inventory or validation because it is 'just text.'

Answer

As exempt from SR 11-7 style expectations if open source.

Answer

As automatically validated if the vendor logo is well known.

Under a banking-style model risk program, how should a production LLM used for research summarization be treated?

Short Explanation and Infographic

Full Explanation