All submissions
Seeded reference · score fixed

Naive prompt scorecard

Full Stack Ecommerce Checkout Web App: authored results demonstrate the scoring narrative under fixed reference conditions, not a fresh provider-backed run.

Open problem
Reference conditions · OpenAI AI SDK v6 · gpt-5.4-mini

Naive prompt

Build an ecommerce checkout web app with cart items, quantity changes, promo code, totals, and confirmation. Make it look nice.

+4
reference round · 66/100
3/10 hidden · 1 stroke
Public tests
5/5
Hidden tests
3/10
  • Displays cart items, prices, and quantitiespublic

    Cart table is visible and scannable.

    pass
  • Allows quantity changespublic

    Increment and decrement controls are present.

    pass
  • Shows subtotal, shipping, tax, discount, and totalpublic

    Order summary includes expected rows.

    pass
  • Accepts promo codespublic

    Promo input and apply action are present.

    pass
  • Shows order confirmationpublic

    Checkout reaches a success state.

    pass
  • Integer cents mathhidden

    Avoids floating-point totals and tax drift.

    fail
  • Promo normalizationhidden

    Trims codes and handles case-insensitive matches.

    fail
  • Invalid code errorhidden

    Bad codes produce clear, recoverable feedback.

    pass
  • Discount floorhidden

    Discounts cannot push payable total below zero.

    fail
  • Shipping threshold orderhidden

    Free shipping uses the specified subtotal-before-discount rule.

    fail
  • Out-of-stock blockhidden

    Unavailable line items prevent checkout.

    fail
  • Double-submit preventionhidden

    Repeated clicks cannot create duplicate orders.

    fail
  • Quantity boundarieshidden

    Quantities cannot go negative, zero accidentally, or above stock.

    fail
  • Loading and error stateshidden

    Async states are visible and buttons disable while pending.

    pass
  • Mobile usability and accessibilityhidden

    Core controls work on small screens with labels and keyboard affordances.

    pass
Happy-path checkout
seeded checkout scenario · shared reference schematic
Checkout
PROMO15
Canvas Totex1
Field Notebookx2
USB-C Dockx3
Subtotal$152.00
Discount-$22.80
Total$140.18

Seeded reference: a complete-looking checkout with most hidden ecommerce behavior left unspecified.

Failure categories
Money mathPromo normalizationInventory safetyDouble-submitQuantity bounds

Reference scenario record

fixed scoring narrative

Authored fixture conditions only. No provider, sandbox, builder, or Playwright job was freshly executed for this scorecard.

  1. Seeded fixture
    documented
    Authored reference scenario for comparing naive, structured, and domain-expert specifications.
  2. Builder condition
    documented
    Fixed narrative condition: OpenAI gpt-5.4-mini. No builder call was made for this fixture.
  3. Sandbox condition
    documented
    Fixed narrative condition: Daytona isolation. No sandbox was provisioned for this fixture.
  4. Behavior expectations
    documented
    Expected outcomes map to stored EvalSpec categories; Playwright was not run for this fixture.
  5. Reference score
    documented
    The authored score demonstrates the scoring narrative under these fixed conditions.