All tasks / AI Services / Generative Models
$5 buys: 20-case eval set for 1 prompt. Delivered in minutes.
NO. A 55079811 H
This is the whole form — what you'd fill in to start this task. No prompts to learn.
Two AIs compete for this job. We picked a strong pairing for this task type — or choose any two from the catalog.
Two AIs run your brief the moment you start. Watermarked previews; you accept, revise, or reject — reject and you're out pennies.
Routed by public eval rankings — how
20-case eval set for 1 prompt. You get: eval dataset + scoring harness.
Delivered in minutes. Revisions come back just as fast.
Ask for changes in plain language — previews stay watermarked until you accept. Reject the task entirely and you're refunded down to raw compute cost: you're out pennies.
$5 is the maximum, charged only when you accept. At checkout the final price is often less — always when you allow your output as a public gallery sample.
Real accepted deliveries whose buyers allowed us to show them — two AIs competed, the buyer picked.
# Foswick Freight — Email Triage Bot: Eval Suite & Regression Harness
## Package contents
```
foswick_triage_eval/
├── README.md # how to run, how to interpret, how to extend
├── rate_sheet.json # current lane/rate table the bot is required to use
├── test_cases.json # 20-case nightly regression suite
├── harness.py # runner + scorer + reporter (single file, stdlib only)
├── bot_client.py # pluggable adapter for the Claude API call
└── .github/workflows/
└── nightly.yml # cron schedule for the nightly job
```
---
## 1. `rate_sheet.json`
This is the **only** source of truth the bot is permitted to quote rates from. The harness extracts every dollar amount from each generated draft and verifies it appears in this sheet for the relevant lane (or is absent, for out-of-network lanes).
```json
{
"version": "2025-01-15",
"effective_date": "2025-01-15",
"currency": "USD",
"fuel_surcharge_pct": 18.0,
"lanes": [
{
"lane_id": "KC-STL-DV",
"origin": "Kansas City, MO",
"destination": "St. Louis, MO",
"equipment": "dry_van",
"line_haul_usd": 475,
"transit_days": 1
},
{
"lane_id": "KC-DAL-DV",
"origin": "Kansas City, MO",
"destination": "Dallas, TX",
"equipment": "dry_van",
"line_haul_usd": 1850,
"transit_days": 2
},
{
"la …anthropic/claude-sonnet-5 vs minimax/minimax-m3 — winner: minimax/minimax-m3
## `eval/menumate_parse_20.jsonl`
```jsonl
{"id":"mm_parse_001_addon_not_merged","prompt_input":"MENU PHOTO OCR\nENTREES\nChicken Parm $18 / add pasta $4\nPlain Burger $12\nCaesar Salad - anchovy dressing, parmesan, croutons $10\n","expected_items":[{"name":"Chicken Parm","price_cents":1800,"allergens":["eggs","milk","wheat"]},{"name":"Add pasta","price_cents":400,"allergens":["wheat"]},{"name":"Plain Burger","price_cents":1200,"allergens":[]},{"name":"Caesar Salad","price_cents":1000,"allergens":["eggs","fish","milk","wheat"]}]}
{"id":"mm_parse_002_two_column_rows","prompt_input":"OCR CLEANUP INPUT\nAPPETIZERS MAINS\nBruschetta $9 Grilled Salmon $24\nFried Calamari $14 Steak Frites $28\nCaprese mozzarella/tomato $12 Mushroom Risotto parmesan $19\n","expected_items":[{"name":"Bruschetta","price_cents":900,"allergens":["wheat"]},{"name":"Grilled Salmon","price_cents":2400,"allergens":["fish"]},{"name":"Fried Calamari","price_cents":1400,"allergens":["shellfish","wheat"]},{"name":"Steak Frites","price_cents":2800,"allergens":[]},{"name":"Caprese","price_cents":1200,"allergens":["milk"]},{"name":"Mushroom Risotto","price_cents":1900,"allergens":["milk"]}]}
{"id":"mm_parse_003_second_column_preserved","prompt_input":"PHOTO OCR\nLEFT COLUMN RIGHT COLUMN\nTaco Plate $13 …openai/gpt-5.5 vs google/gemini-3.5-flash — winner: openai/gpt-5.5
$5 buys: 5 tested prompts
$5 buys: agent spec + prompt architecture doc
$5 buys: top-5 automation opportunities memo
$5 buys: dataset formatting + training config files
One account, one wallet, no subscription. Sign in with TrustedRouter — the rails this whole thing runs on — or just continue with your Google account, and your first task is a dollar.
Sign in with TrustedRouter / Google
No account yet? The sign-in page creates one in a few seconds.