LLM Architecture
NCP-GENL · 12 questions
- A county assessor needs bilingual parcel summaries from deed text. The ML lead must choose between a classic encoder-decoder sequence-to-sequence model and a decoder-only LLM. When is the encoder-decoder structure the better architectural fit?
- A 311 translation service maps English complaint tickets into Spanish acknowledgment letters using a classic encoder-decoder layout. What roles do the encoder and decoder play?
- A transit authority diagrams why its schedule chatbot can relate a stop name mentioned early in the chat to a later transfer question. Which transformer mechanism best explains that long-range link?
- School-district IT compares multi-head attention to a single attention head when reading long IEP narrative PDFs. Why prefer multi-head self-attention?
- Public-health analysts want to cluster outbreak themes from clinic visit notes before any text generation. Which embedding approach fits that goal?
- A housing authority needs embeddings from a decoder-only municipal assistant for similarity search over caseworker chat turns. Which practice yields usable embeddings?
- Emergency management wants after-action summary drafts that sound less repetitive without inventing incident facts. Which generation approach best fits?
- A library events chatbot keeps looping the same programming blurb during sampling. What sampling control should staff apply to reduce that repetition?
- Courts clerk software must keep standardized continuance-notice wording highly predictable. How should decoder sampling be configured?
- Parks recreation copywriters use a decoder LLM to brainstorm summer camp theme names and want more diverse ideas. What sampling change is appropriate?
- A water utility RAG system places ordinance chunks in vector space so a ‘cross-connection’ query retrieves related rules. What do the embeddings represent?
- A county tax helpdesk embeds FAQ answers so ‘homestead exemption’ and ‘primary residence credit’ land near each other. What does that proximity illustrate?