Series 1 · Cybersecurity

The Ransomware Weekend

Q16Four modelsSix blind pairingsMaterial-outcome scoring

Why this result mattered

Qwen 3.8 win

The principal comparison placed Qwen 3.8 and Claude under concealed A/B labels.

Answer A concludes that participant-data acquisition is already reasonably likely but postpones the formal determination for up to 10 days, improperly shifting the notification clocks. Answer B directs Alderpoint to document that determination promptly and proceed on the existing evidence, avoiding delayed individual notices and, if the resident threshold is met, a late regulator filing.

Benchmark materials

Prompt and sealed key

The key is an audit reference. It was not shown to the contestant systems and did not determine the comparative verdict.

Read the original matter prompt

Question 16: The Ransomware Weekend

Your role

You are outside counsel to Alderpoint Benefits, a benefits-administration firm, called in Saturday morning after a Friday-night ransomware attack. A company sale is scheduled to sign in three weeks. Advise on the next 72 hours and the next 45 days.

Governing law

  1. Notice of a breach of security must be given to affected individuals without unreasonable delay, and no later than 45 days after determination that a breach occurred, when unauthorized acquisition of personal information creates a reasonable likelihood of harm. Personal information includes name plus Social Security number, financial account, or medical information.

  2. Notice to the state regulator is required within 72 hours of determining that a breach affects 500 or more residents.

  3. Encryption of data at rest is a safe harbor only if the encryption key was not compromised.

  4. "Acquisition" includes exfiltration shown by direct evidence or by a reasonable likelihood inferred from access, staging, or transfer indicators. Mere encryption of files by an attacker, without indicators of access or transfer, does not by itself constitute acquisition.

  5. A forensic report is protected work product only if prepared primarily because of anticipated litigation. Reports prepared in the ordinary course of incident response, or serving dual business purposes such as remediation and customer assurance, are ordinarily discoverable even if counsel retained the examiner.

  6. Paying a ransom is not itself unlawful unless payment is made to a sanctioned person or jurisdiction. A payer must screen the recipient and may face strict liability for payments to sanctioned parties.

  7. A party anticipating litigation must preserve evidence, including affected systems and logs, subject to reasonable operational needs.

  8. Contractual and common-law duties may require a service provider to notify business customers whose data it processes, separate from statutory individual notice.

Facts

Friday 11:40 p.m.: ransomware encrypted a majority of Alderpoint's file servers. A ransom note demands $1.9 million and claims exfiltration of "2 TB of your files," with a "proof pack" of 40 files posted to a leak-site link. The proof pack includes an HR spreadsheet containing names and Social Security numbers of Alderpoint's 3,100 employees, and several client contract PDFs.

Alderpoint administers benefits for 240 employer clients, holding participant data for roughly 1.9 million individuals: names, Social Security numbers, dates of birth, and health-plan enrollment records. That participant database sits on a segmented server that was not encrypted by the attack. Firewall logs show 9 GB of outbound transfer to a foreign IP address between 10:05 and 11:20 p.m. Friday. The logs do not identify which files moved. The participant database's audit log shows a query session of unusual size at 10:12 p.m. from a compromised administrator account.

Before counsel was engaged, Alderpoint's system administrator wiped and reimaged six infected servers "to get people working," destroying their local logs. Backups exist for four of the six.

The CEO's draft customer email states: "We experienced a brief encryption event. There is no evidence any customer data was accessed." The CEO also wants the forensic firm, which Alderpoint has used for routine security assessments for years, to "run the investigation like always and copy the IT team."

The acquisition agreement's diligence certificate, to be signed in three weeks, requires disclosure of "any security incident reasonably likely to result in material liability." The cyber insurer's policy requires notice "as soon as practicable" and written consent before any ransom payment, and designates panel counsel and panel forensics.

The board asks: whether and when individuals, regulators, and clients must be notified; whether to negotiate or pay; whether the CEO's email can go out; and how to structure the investigation.

Assignment

Analyze:

  • Whether "acquisition" has occurred or is reasonably likely for the employee spreadsheet and, separately, for the participant database, and what that means for each notification clock.
  • When each clock starts, what "determination" means on these facts, and the sequencing of regulator, individual, client, and insurer notices over the next 72 hours and 45 days.
  • Who must send participant notices, Alderpoint or its employer clients, under the supplied service-provider rule and typical contractual allocation, and how to manage 240 clients without chaos.
  • The CEO's draft email: each statement's accuracy and the liability created by sending it. Redraft the two sentences so they are accurate and defensible.
  • Structuring the forensic engagement for protection under the supplied work-product rule, given the firm's routine prior role, and whether the insurer's panel requirements change the answer.
  • The ransom decision: lawful preconditions, screening, insurer consent, and what payment does and does not buy given the leak-site posting.
  • The server reimaging: preservation consequences and immediate remediation.
  • Disclosure to the acquirer under the diligence certificate, and timing relative to signing.
  • A 72-hour action list in priority order.


Read the sealed key

Q16 key (Ransomware Weekend)

  1. Employee spreadsheet: acquisition is established (posted on the leak site); the individual-notice and, on the numbers, regulator clocks run from determination, which on these facts is now, not weeks away. Missed: statutory deadlines blown at step one.
  2. Participant database: not encrypted by the attack, but the 9 GB egress plus the unusual 10:12 p.m. query session from a compromised administrator account creates a reasonable likelihood of acquisition; treat notification as presumptively required while forensics runs, and document the determination timeline. The CEO's "no evidence of access" framing is contradicted by the logs. Missed: a 1.9 million-person notice obligation is wished away.
  3. Who notifies participants: the employer clients are the owners of that data; Alderpoint's duties run through contract and the service-provider rule to notify the clients promptly so their clocks can be met; build a client-notification operation (template notice, coordinated timeline, dedicated contact) rather than 240 improvisations. Missed: the clients' statutory violations become Alderpoint's liabilities.
  4. Sequencing: insurer notice immediately (consent and panel provisions), regulator within 72 hours of determination for the employee population, client notifications now, individual notices within the 45-day outer bound and faster. Missed: the insurer or regulator learns late and coverage or credibility is lost.
  5. The CEO email cannot go out: "brief encryption event" and "no evidence any customer data was accessed" are both false or misleading on the current record; the defensible redraft acknowledges an ongoing investigation, confirmed employee-data exposure, and possible client-data involvement, and promises dated updates. Missed: a fraud-and-estoppel exhibit is self-created.
  6. Forensics: the routine firm operating "like always," copying IT, fails the primarily-because-of-litigation standard; engage panel forensics under a new counsel-directed engagement scoped to litigation advice, route reporting through counsel, and keep remediation workstreams separate. Missed: the central investigative record becomes discoverable.
  7. Ransom: payment is lawful only after sanctions screening and insurer written consent, and given the leak-site posting it buys deletion promises, not containment; treat as a business decision with documented screening, not a legal fix. Missed: strict-liability sanctions exposure or wasted millions.
  8. Reimaged servers: document the loss, preserve the four backups and all remaining logs and firewall data immediately, and stop further remediation-by-destruction. Missed: spoliation compounds the breach.
  9. Acquirer: the incident is squarely within the diligence certificate; disclose before signing with the investigation status and notification plan. Missed: fraud exposure attaches to the sale itself.
Blind evaluation record

Direct judge report

The report below is preserved from the Qwen 3.8 versus Claude verdict record.

Read the preserved judge report
ANSWER B IS MATERIALLY BETTER.

Basis. Answer A concludes that participant-data acquisition is already reasonably likely but postpones the formal determination for up to 10 days, improperly shifting the notification clocks. Answer B directs Alderpoint to document that determination promptly and proceed on the existing evidence, avoiding delayed individual notices and, if the resident threshold is met, a late regulator filing.

Proof.
Exact difference: A says the participant determination should occur around day 10 and measures notices from then; B treats acquisition as reasonably likely now and calls for determination within 24–48 hours.
Different conduct: A’s reader calendars participant deadlines from approximately day 10, while B’s reader begins the clocks immediately or after only urgent verification.
Concrete consequence: A’s approach can delay participant notice by about 10 days and place any required regulator filing outside 72 hours of the already-supported determination.
Record support: The compromised administrator’s unusual bulk query occurred during the documented 9 GB outbound transfer, satisfying the supplied inference rule without requiring a final forensic report.
Material magnitude: Incorrectly shifting statutory clocks affects notice compliance for potentially 1.9 million participants and creates regulatory exposure for Alderpoint.
Likelihood: A expressly instructs management to use the later determination date, so a rational incident team would build its compliance calendar around it.
No safe neutralization by ordinary verification: Correcting A requires rejecting its stated clock analysis and re-deriving when the participant determination legally occurred.

[A] rejected: “The 2 TB claim is false” — record lacks evidence that the identified 9 GB transfer captured every possible exfiltration channel or period.
[A] rejected: Alderpoint’s individual-notice duty is “not delegable” — record lacks a rule identifying the statutory sender or the applicable contractual allocations.
[B] rejected: redraft stating that Alderpoint is still assessing whether “client” data was accessed — record contradicts this with client contract PDFs in the posted proof pack.

Failed candidates.
Participant-notice sender allocation — concrete consequence failed because the governing contracts were not supplied.
CEO-email redraft difference — no safe-neutralization failed because the confirmed client-document posting is apparent from the record.
Ransom posture and the 2 TB assertion — concrete consequence failed because no supported payment or bargaining outcome follows.
Employee determination timing — concrete consequence failed because both answers require prompt confirmation and notice within the applicable deadlines.

Hard stop. Because Answer A postponed the participant-breach determination despite concluding acquisition was already reasonably likely, the reader would likely calendar notices from approximately day 10 instead of from the presently supported determination, causing Alderpoint and affected participants to experience delayed statutory notice and potential deadline violations.
Complete comparison record

All six pairings

Every pair of the four model answers was judged independently under the same evaluation instrument.

Open the six head-to-head results
PairingResultWhy it matteredRecord
Qwen 3.8 27B vs Claude Opus 5Qwen 3.8 winAnswer A concludes that participant-data acquisition is already reasonably likely but postpones the formal determination for up to 10 days, improperly shifting the notification clocks.Judge record
Qwen 3.8 27B vs DeepSeek V4-Flash-0731Functional tieBoth answers put Alderpoint on the same material path: treat employee acquisition as confirmed and participant acquisition as reasonably likely, preserve evidence, notify the insurer and clients promptly, track statutory notices, reject the CEO’s email, condition any ransom payment on screening and insurer…Judge record
Qwen 3.8 27B vs Qwen 3.5 27BFunctional tieBoth answers direct Alderpoint to treat employee acquisition as confirmed and participant acquisition as reasonably likely; preserve evidence, notify the insurer and clients, prepare statutory notices, reject the CEO’s draft, bifurcate forensic work, condition ransom payment, and disclose to the acquirer…Judge record
DeepSeek V4-Flash-0731 vs Claude Opus 5DeepSeek winAnswer A postpones the participant-breach determination for at least 10 days even though the compromised-account query and contemporaneous outbound transfer already establish a reasonable likelihood of acquisition.Judge record
DeepSeek V4-Flash-0731 vs Qwen 3.5 27BFunctional tieBoth answers put Alderpoint on the same material path: preserve evidence, contain the incident, engage counsel-directed forensics, notify the insurer, treat both datasets as acquired, coordinate client and individual notices, reject the CEO’s draft, defer ransom payment pending screening and consent, and…Judge record
Qwen 3.5 27B vs Claude Opus 5Qwen 3.5 winAnswer A concludes that participant-data acquisition is reasonably likely now but postpones “determination” for up to 10 days and regulator notice until as late as day 13. Answer B treats the determination as made now and directs filing within 72 hours, preserving the statutory deadline. Exact difference.Judge record
Rejected-point diagnostic

Judge-attributed rejected points for this matter across all six pairings:

Qwen 3.8 27B3
DeepSeek V4-Flash-07313
Claude Opus 58
Qwen 3.5 27B6

This is a review-burden diagnostic, not a universal hallucination measure.

Available reasoning traces