Series 2 · Class settlements

The Settlement Notice That Does Not Add Up

Q58Four modelsSix blind pairingsMaterial-outcome scoring

Why this result mattered

Functional tie

The principal comparison placed Qwen 3.8 and Claude under concealed A/B labels.

Both answers stop transmission, correct the net fund to $3,500,000, the point value to $350, Maya Ortiz’s estimate to $2,100, and the release’s scope and period. Both preserve the accurate tax and procedure paragraphs and correctly conclude that no renewed decision period is required because no notice was distributed.

Benchmark materials

Prompt and sealed key

The key is an audit reference. It was not shown to the contestant systems and did not determine the comparative verdict.

Read the original matter prompt

Question 58: The Settlement Notice That Does Not Add Up

Your role

You are neutral settlement counsel reviewing a proposed class notice before distribution. The settlement administrator plans to transmit it tomorrow. Audit the notice, quantify every material error, and provide corrected language without changing provisions that are already accurate.

Governing law

Assume the following settlement-notice rules apply:

  1. A class notice must state the gross fund, proposed deductions, estimated net fund, allocation method, release, exclusion procedure, objection procedure, and hearing information accurately and in language an ordinary class member can understand.

  2. Arithmetic in the notice must match the executed settlement agreement. Estimated individual awards must use the agreement's allocation formula and the administrator's current point total.

  3. A notice may explain that estimates can change because of participation, court rulings, or record corrections, but it may not use that qualification to excuse a known mathematical error.

  4. The release description must not be broader than the executed release. It must identify the released claims, factual predicate, and covered period with enough precision to permit an informed exclusion decision.

  5. Proposed attorney fees, costs, administration expenses, service awards, and government allocations remain subject to court approval and must be identified separately.

  6. Tax treatment must be described as an estimate rather than individualized tax advice. A correct tax statement need not be rewritten merely because another part of the notice is defective.

  7. If a material notice error is discovered before transmission, distribution must be stopped and the notice corrected. If a materially misleading notice has already been distributed, a corrected notice and a reasonable renewed decision period are required.

  8. Review-and-correct work should preserve accurate language and change only what is materially wrong, incomplete, or misleading.

Settlement agreement

The executed agreement provides:

  • Gross settlement fund: $5,400,000.
  • Proposed attorney fees: $1,350,000.
  • Litigation costs: up to $110,000.
  • Administration expenses: $140,000.
  • Three proposed service awards totaling $30,000.
  • Payment to the Workplace Standards Agency: $270,000.
  • The balance is the net class fund.
  • The administrator has calculated 10,000 total allocation points across 6,200 class members.
  • Each class member receives the net class fund divided by 10,000, multiplied by that member's points.
  • Maya Ortiz has six points.
  • Awards are estimated as 50 percent wages and 50 percent statutory amounts, subject to final payroll treatment.

The release covers only wage-statement and off-clock-work claims based on the factual allegations in the complaint, accruing from January 1, 2022 through June 30, 2025. It excludes discrimination, harassment, retaliation, workers' compensation, vested-benefit, and post-June 30, 2025 claims.

The exclusion deadline is October 2. Objections must be filed by the same date. The fairness hearing is November 13. Those dates and the listed submission addresses are correct.

Proposed notice

The proposed notice states:

Settlement amount and deductions. Defendant will pay $5,400,000. After proposed attorney fees of $1,350,000, costs of $110,000, administration expenses of $140,000, and service awards of $30,000, approximately $3,770,000 will remain for class members. All deductions require court approval.

How your payment is calculated. The administrator identified 10,000 points. Each point is currently worth approximately $377. Maya Ortiz has six points, so her estimated payment is $2,262 before required withholding. Estimates may change.

Release. Unless you exclude yourself, you will release Defendant and related persons from all claims, known or unknown, arising from your employment through the date the court finally approves the settlement.

Taxes. The parties currently estimate that one-half of each award will be treated as wages and one-half as statutory amounts. This is not tax advice.

Your choices. You may do nothing, exclude yourself by October 2, or object by October 2. The court will hold the fairness hearing on November 13 at the location stated below.

The administrator has uploaded the file but has not sent, emailed, or mailed any notice.

Assignment

Review and correct:

  • Every deduction and the actual net class fund.
  • The correct value per allocation point.
  • Maya Ortiz's correct estimated payment.
  • The release description, including claims and covered period.
  • Whether the tax and procedure paragraphs require changes.
  • Whether distribution must be stopped or any renewed notice period is required.
  • Provide replacement language for each defective paragraph, ready to insert, while leaving accurate provisions alone.


Read the sealed key

Q58 key (Settlement Notice Audit)

  1. The omitted $270,000 agency payment must be included. Net class fund is $5,400,000 minus $1,350,000, $110,000, $140,000, $30,000, and $270,000, which equals $3,500,000. Missed: the notice overstates money available to class members by $270,000.
  2. Point value is $3,500,000 divided by 10,000, or $350 per point, not $377. Missed: every individual estimate is inflated by $27 per point.
  3. Maya's six-point estimate is 6 times $350, or $2,100, not $2,262. The error is $162. Missed: she makes an exclusion or objection decision using a materially overstated payment.
  4. The release paragraph is materially overbroad. It must be limited to wage-statement and off-clock claims based on the complaint's factual allegations from January 1, 2022 through June 30, 2025, and state that discrimination, harassment, retaliation, workers' compensation, vested-benefit, and later claims are excluded. Missed: members believe they surrender unrelated and future rights.
  5. Replacement fund paragraph: “Defendant will pay $5,400,000. Subject to court approval, proposed deductions are $1,350,000 in attorney fees, up to $110,000 in costs, $140,000 in administration expenses, $30,000 in service awards, and $270,000 to the Workplace Standards Agency. The estimated net class fund is $3,500,000.” Missed: the corrected figure is not tied visibly to every deduction.
  6. Replacement allocation paragraph: “The administrator identified 10,000 allocation points. The current estimated value is $350 per point. Maya Ortiz has six points, so her estimated payment is $2,100 before required withholding. Estimates may change if records or court-approved deductions change.” Missed: the qualification is used without fixing known arithmetic.
  7. Replacement release paragraph should track the narrow language in point 4. The tax paragraph and choices paragraph are accurate and should remain unchanged. Missed: correct provisions are unnecessarily redesigned or a material release error remains.
  8. Stop tomorrow's transmission and replace the three defective paragraphs. Because no notice has been distributed, no supplemental notice or renewed period is required. Missed: a preventable material error is mailed and triggers correction cost and delay.
Blind evaluation record

Direct judge report

The report below is preserved from the Qwen 3.8 versus Claude verdict record.

Read the preserved judge report
TIE, FUNCTIONALLY EQUIVALENT.

Basis. Both answers stop transmission, correct the net fund to $3,500,000, the point value to $350, Maya Ortiz’s estimate to $2,100, and the release’s scope and period. Both preserve the accurate tax and procedure paragraphs and correctly conclude that no renewed decision period is required because no notice was distributed.

[A] rejected: withholding applies only to the wage portion — record lacks a definitive withholding rule and makes payroll treatment subject to final determination.
[A] rejected: optional signed-request and objection mechanics — record lacks those procedural requirements.

Failed candidate: A’s added withholding allocation — no safe neutralization failed; ordinary verification removes it without changing the corrected notice’s material path.
Failed candidate: A’s optional exclusion and objection mechanics — no safe neutralization failed; the unsupported optional language is rejected.
Failed candidate: A’s additional timing caveat and administrator safeguards — different conduct failed; both answers already require stopping the current transmission and replacing the defective file.
Failed candidate: A’s more detailed explanation of possible estimate changes — different conduct failed; both answers produce the same corrected calculations and distribution decision.

Hard stop. The required sentence cannot be completed with a concrete, record-supported consequence.
Complete comparison record

All six pairings

Every pair of the four model answers was judged independently under the same evaluation instrument.

Open the six head-to-head results
PairingResultWhy it matteredRecord
Qwen 3.8 27B vs Claude Opus 5Functional tieBoth answers stop transmission, correct the net fund to $3,500,000, the point value to $350, Maya Ortiz’s estimate to $2,100, and the release’s scope and period. Both preserve the accurate tax and procedure paragraphs and correctly conclude that no renewed decision period is required because no notice was…Judge record
Qwen 3.8 27B vs DeepSeek V4-Flash-0731Functional tieBoth answers direct the administrator to stop transmission, correct the same fund, allocation, payment, and release errors, preserve the accurate tax and procedure language, and transmit without a renewed decision period.Judge record
Qwen 3.8 27B vs Qwen 3.5 27BFunctional tieBoth answers direct the administrator to halt transmission, correct the fund to $3,500,000, use $350 per point and $2,100 for Maya, narrow the release, retain the accurate tax and procedure language, and provide no renewed period.Judge record
DeepSeek V4-Flash-0731 vs Claude Opus 5Functional tieBoth answers stop distribution, correct the omitted $270,000 agency allocation, use a $3,500,000 estimated net fund, calculate $350 per point and $2,100 for Ortiz, narrow the release to the executed terms, preserve the accurate tax and procedure language, and require no renewed period.Judge record
DeepSeek V4-Flash-0731 vs Qwen 3.5 27BFunctional tieBoth answers direct the administrator to stop transmission, add the omitted $270,000 agency payment, correct the net fund to $3,500,000, the point value to $350, and Maya Ortiz’s estimate to $2,100, and replace the overbroad release with the agreement’s claims and period.Judge record
Qwen 3.5 27B vs Claude Opus 5Functional tieBoth answers direct the administrator to stop distribution, correct the omitted $270,000 agency payment, state the $3,500,000 net fund, use $350 per point and $2,100 for Ortiz, narrow the release, preserve the tax and procedure paragraphs, and proceed without a renewed period because nothing was distributed.Judge record
Rejected-point diagnostic

Judge-attributed rejected points for this matter across all six pairings:

Qwen 3.8 27B0
DeepSeek V4-Flash-07310
Claude Opus 58
Qwen 3.5 27B5

This is a review-burden diagnostic, not a universal hallucination measure.

Available reasoning traces