Why this result mattered
Functional tie
The principal comparison placed Qwen 3.8 and Claude under concealed A/B labels.
Both answers direct Norvale to reject Sales’s concerted features and adopt a prospective, public-ad-only policy with no retailer assent, negotiated exceptions, enforcement assurances, complaint-policing system, or transaction-price controls. After ordinary verification of the noted inconsistencies and overstatement, both readers reach the same materially correct and safe implementation path.
Fast audit
Open the underlying record
These links open all four answers, the principal blind judgment, original prompt, and sealed key.
Prompt and sealed key
The key is an audit reference. It was not shown to the contestant systems and did not determine the comparative verdict.
Read the original matter prompt
Question 53: The Resale Price Policy
Your role
You represent Norvale Audio, a manufacturer of premium home speakers in the fictional Republic of Aven. Norvale wants to reduce discounting by online retailers. Design a lawful policy under the supplied rule-of-reason framework without turning unilateral conduct into an agreement.
Governing law
Assume the following Aven competition rules apply:
A manufacturer may unilaterally announce resale conditions and independently decide whether to continue supplying a retailer that does not follow them. Unilateral conduct does not require retailer assent.
A resale-price agreement may arise when the manufacturer seeks or receives retailer promises, negotiates price adherence, invites collective enforcement, gives assurances that competitors will comply, or uses coercion to obtain assent.
A signed acknowledgment may confirm receipt only. Language promising compliance, accepting obligations, or requesting approval creates agreement evidence.
Resale-price restraints are judged under the rule of reason. Relevant facts include market power, market coverage, barriers to entry, retailer or manufacturer cartels, price effects, service promotion, free riding, product launch needs, and less restrictive alternatives.
A minimum advertised-price policy regulates public advertising, not the final confidential sale price, unless its language or enforcement reaches the transaction price.
A manufacturer may monitor public prices and advertising through independent data. Retailer complaints may be received, but the manufacturer must not solicit complaints as a policing system, disclose one retailer's future pricing to another, or promise enforcement for a complainant's benefit.
Policy exceptions must be objective and administered independently. Negotiated exceptions conditioned on retailer agreement may support concerted action.
Termination decisions should be documented as unilateral and based on preannounced criteria. Threats to punish one retailer unless another raises price create agreement and cartel risk.
Accurate service and brand-protection rationales are relevant, but labels do not save a policy implemented as an agreement.
Facts
Norvale has an 18 percent share of premium home-speaker sales. The next four manufacturers have shares of 16, 14, 11, and 9 percent. Entry has occurred twice in three years. Norvale sells through 120 retailers, and no retailer has more than 7 percent of national sales.
Norvale funds in-store demonstrations, installer training, and a 60-day return program. Management believes some online sellers free ride on those services and then discount. Internal analysis predicts that a controlled policy may preserve demonstrations, but it does not quantify a price increase.
Sales proposes this program:
- A minimum advertised price 8 percent below list price.
- A prohibition on advertising lower prices, while retailers remain free to set the confidential checkout price.
- First violation: 30-day loss of promotional funds. Second violation within 12 months: 60-day supply suspension. Third: account termination.
- Objective exceptions for discontinued products and manufacturer-authorized promotions.
Sales also proposes requiring each retailer to sign, "We agree to comply with Norvale's pricing requirements." Regional managers want to negotiate exceptions, tell compliant dealers that Norvale will "make everyone hold the line," and ask retailers to report competitors' discounting. One large dealer says it will support Norvale only if Norvale guarantees enforcement against every rival.
The chief executive instead considers a policy announced in writing, effective prospectively, with a receipt-only acknowledgment, independent public-ad monitoring, no retailer promises, no discussion of rivals' future prices, and unilateral enforcement.
Assignment
Counsel Norvale on:
- Whether the proposed minimum advertised-price design reaches advertising or resale price.
- How unilateral policy differs from an agreement.
- The signed-language, negotiated-exception, guarantee, and retailer-reporting risks.
- Rule-of-reason risk using the supplied shares, entry, retailer structure, and service rationale.
- Objective exception and enforcement design.
- Internal training, complaint handling, monitoring, and documentation.
- Whether Norvale should adopt, modify, or abandon the policy.
- Final policy language and implementation steps sufficient to keep the program unilateral without claiming that risk is zero.
Read the sealed key
Q53 key (Resale Price Policy)
- The written design is a minimum advertised-price policy if it truly governs public ads and leaves confidential checkout price free. Enforcement may not reach actual resale price through practice. Missed: a label masks transaction-price control.
- Delete the compliance promise. Use a receipt-only acknowledgment stating no agreement is requested or accepted and Norvale will act independently. Missed: unilateral policy becomes written assent.
- Ban negotiated adherence, promises that everyone will hold the line, guarantees to the large dealer, and retailer policing of rivals. Receive unsolicited complaints without discussing future enforcement or rival pricing, then verify independently. Missed: dealer pressure becomes concerted action or a retailer cartel.
- The 18 percent share, dispersed retailers, recent entry, and service investments reduce rule-of-reason risk and support a free-riding rationale, but do not make risk zero. Missed: counsel either declares per se illegality or immunity.
- Use objective discontinued-product and authorized-promotion exceptions, centralized approvals, public-price monitoring, graduated preannounced consequences, and independent documentation for each supply decision. Missed: discretionary exceptions create negotiations and favoritism evidence.
- Train sales not to seek promises, coordinate dealers, or threaten one retailer for another. Separate complaint intake from decision-makers and preserve rationale records. Missed: lawful text is implemented unlawfully.
- Adopt the modified unilateral MAP policy prospectively, not the sales version. If business insists on retailer guarantees or negotiated price adherence, abandon the program. Missed: Norvale accepts agreement risk to gain an assurance the unilateral framework forbids.
Direct judge report
The report below is preserved from the Qwen 3.8 versus Claude verdict record.
Read the preserved judge report
Basis. Both answers direct Norvale to reject Sales’s concerted features and adopt a prospective, public-ad-only policy with no retailer assent, negotiated exceptions, enforcement assurances, complaint-policing system, or transaction-price controls. After ordinary verification of the noted inconsistencies and overstatement, both readers reach the same materially correct and safe implementation path.
A rejected: “Norvale cannot raise market prices” — record supports limited market power, not categorical inability.
B rejected: monitoring “publicly visible shopping-cart prices” — internally inconsistent with B’s exclusion of checkout prices and the supplied rule protecting confidential transaction prices.
B rejected: Norvale “may unilaterally decide to resume supply” — internally inconsistent with B’s preannounced enforcement matrix and prohibition on ad hoc waivers.
Failed candidate: Cart-price monitoring — no safe neutralization by ordinary verification failed.
Failed candidate: Discretionary supply resumption — no safe neutralization by ordinary verification failed.
Failed candidate: Three-day versus five-day cure period — concrete consequence failed.
Failed candidate: A’s broader objective exceptions and implementation controls — likelihood failed.
Failed candidate: Optional requested receipt versus no requested signature — concrete consequence failed.
Failed candidate: Different rule-of-reason confidence formulations — different conduct failed.
Hard stop. The sentence cannot be completed with a concrete, record-supported consequence.
All six pairings
Every pair of the four model answers was judged independently under the same evaluation instrument.
Open the six head-to-head results
| Pairing | Result | Why it mattered | Record |
|---|---|---|---|
| Qwen 3.8 27B vs Claude Opus 5 | Functional tie | Both answers direct Norvale to reject Sales’s concerted features and adopt a prospective, public-ad-only policy with no retailer assent, negotiated exceptions, enforcement assurances, complaint-policing system, or transaction-price controls. | Judge record |
| Qwen 3.8 27B vs DeepSeek V4-Flash-0731 | Functional tie | Both answers direct Norvale to reject Sales’s concerted features and adopt a prospective, advertising-only unilateral MAP policy with no retailer assent, negotiated exceptions, enforcement assurances, complaint-based policing, or transaction-price monitoring. | Judge record |
| Qwen 3.8 27B vs Qwen 3.5 27B | Functional tie | Both readers would reject Sales’ agreement-creating features and implement a prospective, advertising-only MAP policy with objective exceptions, independent monitoring, no retailer assurances or solicited reporting, and unilateral documented enforcement. | Judge record |
| DeepSeek V4-Flash-0731 vs Claude Opus 5 | Functional tie | Both answers direct Norvale to adopt a prospective, advertising-only unilateral MAP policy while rejecting retailer promises, negotiated exceptions, enforcement guarantees, solicited reporting, and transaction-price policing. | Judge record |
| DeepSeek V4-Flash-0731 vs Qwen 3.5 27B | Functional tie | Both answers place Norvale on the same material path: adopt a prospective unilateral MAP policy limited to public advertising, reject retailer assent and enforcement assurances, use objective exceptions and independent monitoring, and document unilateral enforcement. | Judge record |
| Qwen 3.5 27B vs Claude Opus 5 | Functional tie | Both answers put Norvale on the same material path: adopt a prospective advertising-only MAP policy, seek no assent, reject guarantees and negotiated exceptions, use independent monitoring, and enforce objective criteria unilaterally. | Judge record |
Rejected-point diagnostic
Judge-attributed rejected points for this matter across all six pairings:
| Qwen 3.8 27B | 2 |
|---|---|
| DeepSeek V4-Flash-0731 | 6 |
| Claude Opus 5 | 2 |
| Qwen 3.5 27B | 8 |
This is a review-burden diagnostic, not a universal hallucination measure.