Prompt Engineering for Effective Software Testing
CT-GenAI · 83 questions
- A county recycling-pickup app needs weekend-overflow test ideas. One prompt begins “act as a test automation engineer,” and another begins “act as a test manager.” Which prompt component sets the persona, tone, and responsibilities for the model?
- A volunteer fire-hall roster story is pasted into a prompt, but overnight mutual-aid and radio-dead zones are never mentioned. Which prompt component supplies the test-object background the model needs to determine relevant test conditions?
- A school-lunch allergy board prompt describes the cafeteria well but never says “list testable acceptance criteria.” Which prompt component is the clear, imperative directive that states the task and its requirements?
- A bicycle-share dock map prompt asks for boundary cases but attaches neither the user story nor the existing case table. Which prompt component is the artefact the model must use — such as user stories, acceptance criteria, screenshots, code, existing cases, or output examples?
- A community-clinic booking prompt says “draft cases” but never notes that after-hours slots are staff-only. Which prompt component captures restrictions or special considerations that say how instructions should be applied to the input?
- A farmers-market stall-lottery tester receives a chatty paragraph when the suite needs a three-column case table. Which prompt component defines the expected format, structure, or characteristics of the response?
- A municipal snow-plow router prompt includes context, instruction, a street list, constraints, and a table format, but no persona. The draft reads like a press release. Which missing component most likely caused the perspective drift?
- A public-pool lane-booking prompt names the tester role, says “write conditions,” pastes the story, limits cases to members, and asks for a bullet list — but never states that the object is a shared outdoor pool with weather closures. Which missing component most likely sent the conditions off-target?
- An animal-shelter adoption prompt includes role, kennel background, the story, a “no live-animal photos in output” limit, and a JSON shape — but never says whether to produce conditions, cases, or data. Which missing component left the task unstated?
- A youth-soccer registration prompt is fully structured except it never attaches the age-band story or last season’s case list. The model invents a generic sign-up form. Which missing component most likely caused the generic testware?
- A library makerspace-booking prompt asks for cases on laser-cutter slot rules but never states “do not invent paid add-ons; minors need a guardian field.” Which missing component most likely caused house limits to be ignored?
- A transit-pass refill kiosk tester wants keyword steps, but the prompt never says “one keyword per line.” The model returns a narrative. Which missing component most likely made the reply unusable downstream?
- A food-coop membership prompt appears as six labeled blocks: “you are a tester,” “this is the produce-share desk,” “draft conditions,” the pasted story, “no medical data,” and “table with id / condition / priority.” Which mapping correctly names all six official prompt-structure components?
- A city-park picnic-permit lead calls the six-part layout (role, context, instruction, input data, constraints, output format) “few-shot prompting.” Which statement best separates prompt structure from prompting techniques?
- A museum audio-guide checkout tester attaches a GUI wireframe and a snippet of the checkout function. A colleague argues those attachments are “context,” not input. Where do screenshots and code belong in the six-component structure?
- A senior-center meal-route tester splits work into “find ambiguities, then rewrite acceptance criteria, then list conditions,” and a person checks each reply before the next ask. Which prompting technique is being used?
- A dog-park day-pass tester pastes three worked story→Gherkin pairs before asking for a fourth. Which prompting technique is this?
- A wastewater lab sample-log tester asks for equivalence-partition conditions from a story and includes no sample row. Which prompting technique is this?
- A community-college waitlist tester includes exactly one house-style case, then a new story. Which prompting technique is this?
- A little-league field-lights tester is unsure how to ask for a risk-ordered condition list and first says “write me the prompt I should use.” Which prompting technique is this?
- A public-housing work-order tester pastes four example cases in one ask. A colleague instead runs “extract rules, then draft cases” as two checked steps. How do these techniques differ?
- A compost-drop weekend tester asks the model to propose a better prompt. Another tester adds two sample defect-report rows to the ask. How do these techniques differ?
- A blood-drive appointment tester first asks the model to draft a prompt, inserts two house examples into that draft, then splits “data then cases” with a check in between. Which statement best describes this approach?
- A town-hall livestream-caption tool is configured once with “you are a software-testing assistant; stay formal; do not speculate.” Every later ask inherits that stance. Which prompt type is this?
- An ice-rink skate-rental tester types a new question each turn, such as “list conditions for the late-fee story.” Which prompt type is this changing, visible ask?
- A community-kitchen reservation chatbot must always act as a shared-kitchen tester and must never invent allergen claims. Where should those standing role, context, and constraint instructions live?
- A boat-ramp launch-permit tester keeps hidden house rules fixed. For this ask they want a case table with id, step, and expected result. Where should that task and output-format instruction go?
- An after-school bus-tracker assistant has a standing system rule to stay ISTQB-aligned and avoid speculation, plus today’s user ask to summarize last night’s failed runs. How does the LLM typically use those prompts?
- A municipal cemetery-plot map chatbot shows testers only a message box. A new hire wants to rewrite the hidden “formal testing assistant” block from that box. What should the candidate recognize?
- A city-bike repair-stand team wants every GenAI session to stay concise and avoid invented part numbers, and they also need one ask that lists boundary values for the torque field. How should those instructions be assigned?
- A public-wifi guest-voucher story says vouchers “expire soon” with no clock, duration, or timezone. Which GenAI analysis ask should the tester choose next?
- A watershed rain-gauge user story is testable but has no condition list yet. Which GenAI prompt goal best fits test analysis?
- A community-radio pledge desk has likelihood and impact notes comparing refund conditions with thank-you-email conditions. Which GenAI analysis ask is most appropriate?
- A county recycling-pickup release has twelve user stories and a backlog of test conditions. Which GenAI analysis ask best supports coverage analysis?
- A school-lunch allergy field is a numeric serving-size with clear minimum and maximum edges. Which GenAI analysis ask fits that condition?
- A bicycle-share dock kiosk provides a user story plus a GUI wireframe. Which GenAI analysis ask is most appropriate for that multimodal basis?
- A community-clinic booking story will be refined across three GenAI asks—ambiguities, then testability, then completeness—with a tester correcting each reply. Which approach should the candidate select?
- A farmers-market stall-lottery tester feeds only the epic title into GenAI and asks for prioritized conditions and coverage. What should the candidate recognize and do?
- A municipal snow-plow story already has test conditions. Which GenAI design ask should the tester choose?
- A community-clinic booking tester needs extreme appointment combinations without using last week’s real patient rows. Which GenAI design ask is appropriate?
- A public-pool lane-booking team has a reviewed case table and needs keyword or framework steps next. Which GenAI ask fits?
- An animal-shelter adoption suite has dependencies (create animal before adopt) and limited evening staff. Which GenAI ask best supports execution planning?
- A youth-soccer registration desk already writes Given–When–Then scenarios. Which prompting approach best emits matching conditions and cases for a new story in that house format?
- A library makerspace-booking tester wants functional cases from acceptance criteria, then a coverage table, then a better prompt for end-to-end procedures. Which approach should they select?
- A transit-pass refill suite was reordered by an LLM using risk plus dependencies. What should the tester do before the night run?
- A food-coop membership GUI already has a keyword library (Login, JoinShare, PayDues). Which GenAI regression ask best fits implementing automated scripts?
- A city-park picnic-permit release changed only the rain-date rule. Which GenAI regression ask best focuses the suite?
- A museum audio-guide checkout button id changed and an API login field was renamed. Which GenAI regression ask addresses that minor drift?
- A senior-center meal-route nightly suite just finished in CI. Which GenAI regression ask is most appropriate next?
- A dog-park day-pass run failed on the late-renewal path. Which GenAI ask best supports enhanced defect reporting?
- A wastewater lab sample-log team maintains two automated suites: one GUI suite that fails when page locators shift after a redesign, and one API suite that fails when the JSON response schema changes. Which GenAI-assisted regression approach best matches each suite?
- A little-league field-lights pipeline runs the full regression suite on every merge, and the suite grows with each sprint. Why is this situation a strong fit for GenAI-assisted creation, maintenance, and optimization of regression tests?
- A community-college waitlist regression log is messy: mixed pass/fail rows, duplicate symptoms, and outdated known issues. Which GenAI prompting approach best supports analyzing that report?
- A public-housing work-order project is slipping exit criteria, and the test manager has fresh monitoring data on progress, defects, and coverage. Which GenAI prompt best supports test monitoring?
- A compost-drop weekend run is behind schedule, and the weigh-station story just grew in scope. Which GenAI prompt best supports test control?
- A blood-drive appointment release is closing, and leadership wants a clear test-completion view for the next cycle. Which GenAI use best fits?
- A town-hall livestream-caption test manager needs non-testers to understand progress before tonight’s broadcast. Which GenAI prompt best helps?
- An ice-rink skate-rental team already stores comments, logs, and counts in their test-management tool. They want GenAI help with monitoring. What should the monitoring prompt primarily do?
- A community-kitchen reservation lead asks, “Are we still on the quality plan?” Which GenAI ask is the best fit?
- A boat-ramp launch-permit dashboard shows coverage flat while severity-1 defects are rising. What should the team’s next GenAI ask prioritize?
- A municipal cemetery-plot map analysis must move from ambiguity findings to testability notes to completeness checks, with a person signing off after each hop. Which prompting technique should the tester select?
- A city-bike repair-stand team must emit the same keyword-driven script shape about fifty times for similar repair flows. Which prompting technique is the best primary fit?
- An after-school bus-tracker tester has never asked an LLM to cluster anomalies in a messy completion log and does not know how to phrase a good prompt. Which technique should they select first?
- A public-wifi guest-voucher tester lets the model propose a prompt, adds two house examples to lock the pattern, then splits extract-rules / draft-cases / check-coverage with a review between hops. Which approach does this illustrate?
- A watershed rain-gauge team has no accepted sample of a flood-alert condition list and does not want to invent fake examples that would mis-train the format. Which technique should they select?
- A community-radio pledge desk has exactly one blessed defect-report template and a new failure to describe. Which prompting technique is the best fit?
- On one morning a park-permit team faces three asks: (1) risk-ordered conditions with a check after each factor, (2) twenty Gherkin twins in the house style, and (3) a completion narrative they have never prompted before. Which technique mapping is correct?
- A food-coop membership tester uses few-shot prompts filled with grocery-website examples to perform a first-time, multi-step coverage analysis of a produce-share rule. What is the best assessment of that choice?
- A county recycling-pickup tester compares GenAI-generated cases to an expert-written reference set and the specified requirements. Which quality metric is the tester primarily assessing?
- A volunteer fire-hall roster tool uses GenAI to flag “anomalies” in last night’s run, but many flags are not real defects. Which quality metric is most directly suffering?
- A school-lunch allergy data class has both valid and invalid partitions, but a GenAI-generated pack covers only the valid band and misses the invalid one. Which metric best names this gap?
- A bicycle-share dock model writes polished test cases for a paid highway transponder program the city does not operate. Which quality metric is most clearly failing?
- A community-clinic booking pack repeats the happy path eight times and never books the last slot of the day. Which quality metric is most clearly weak?
- A farmers-market stall-lottery script pack looks neat in review, yet half the scripts fail to start because of syntax or output-format errors. Which metric names this problem?
- A municipal snow-plow lead wants a single stopwatch reading from one lucky GenAI generation to prove time savings. What is the soundest response regarding metrics?
- A public-pool lane-booking tester starts with a thin prompt, gets a weak case pack, then adds the member/guest glossary and tightens the verbs before regenerating. Which refinement practice is this?
- An animal-shelter adoption pair writes two prompt versions—one asking for a table, one for numbered steps—and scores both on the same predefined metrics. Which practice are they using?
- A youth-soccer registration pack invents a waitlist the user story never granted. The tester catalogs that miss and rewrites the prompt to stay inside the story. Which refinement practice is illustrated?
- Library makerspace testers say generated procedures skip tool-safety checks they always perform, so the prompt is updated to require that detail level. Which refinement practice is this?
- A transit-pass refill prompt grew into a page of background and the cases became generic; a shorter, sharper version recovered the kiosk edge cases. Which refinement practice does this illustrate?
- A food-coop membership squad holds a weekly prompt-evaluation hour and stores winning prompts in a shared library so the next tester avoids last month’s misses. Which practice is this?
- A city-park picnic-permit pack scores well on execution success rate but poorly on diversity. What should the tester’s next refinement prioritize?
- A museum audio-guide tester runs one prompt, likes the tone, and wants to freeze it without comparison or further review. What should happen instead?