Claude Sonnet 5.5 vs Claude Haiku 5.5

Claude Sonnet 5.511 of 11 checks

• ✓Passed: Reply contains one Python code block
• ✓Passed: '1h30m' gives 5400
• ✓Passed: '45m' gives 2700
• ✓Passed: '2h' gives 7200
• ✓Passed: '90s' gives 90
• ✓Passed: '1h5m10s' gives 3910
• ✓Passed: '' raises ValueError
• ✓Passed: '1x' raises ValueError
• ✓Passed: 'h' raises ValueError
• ✓Passed: '10' raises ValueError
• ✓Passed: '30m1h' raises ValueError

Output, unedited

```python
import re

_DURATION_RE = re.compile(r'(?:(\d+)h)?(?:(\d+)m)?(?:(\d+)s)?', re.ASCII)


def parse_duration(text):
    if not isinstance(text, str) or not text:
        raise ValueError(f"Invalid duration: {text!r}")
    match = _DURATION_RE.fullmatch(text)
    if not match:
        raise ValueError(f"Invalid duration: {text!r}")
    hours, minutes, seconds = (int(g) if g else 0 for g in match.groups())
    return hours * 3600 + minutes * 60 + seconds
```

Claude Haiku 5.511 of 11 checks

• ✓Passed: Reply contains one Python code block
• ✓Passed: '1h30m' gives 5400
• ✓Passed: '45m' gives 2700
• ✓Passed: '2h' gives 7200
• ✓Passed: '90s' gives 90
• ✓Passed: '1h5m10s' gives 3910
• ✓Passed: '' raises ValueError
• ✓Passed: '1x' raises ValueError
• ✓Passed: 'h' raises ValueError
• ✓Passed: '10' raises ValueError
• ✓Passed: '30m1h' raises ValueError

Output, unedited

```python
import re

_DURATION_RE = re.compile(r"(?:([0-9]+)h)?(?:([0-9]+)m)?(?:([0-9]+)s)?")


def parse_duration(text):
    if not isinstance(text, str) or not text:
        raise ValueError("duration must be a non-empty string")
    match = _DURATION_RE.fullmatch(text)
    if match is None or not any(match.groups()):
        raise ValueError(f"invalid duration: {text!r}")
    hours, minutes, seconds = (int(g) if g is not None else 0 for g in match.groups())
    return hours * 3600 + minutes * 60 + seconds
```

Claude Sonnet 5.56 of 6 checks

• ✓Passed: Reply is valid JSON with q1 to q5
• ✓Passed: q1 says 16
• ✓Passed: q2 says four hours
• ✓Passed: q3 says Monday
• ✓Passed: q4 says NOT IN SOURCE (no invented pay rate)
• ✓Passed: q5 says 4pm

Output, unedited

{"q1": "16", "q2": "Four hours", "q3": "Monday", "q4": "NOT IN SOURCE", "q5": "4pm"}

Claude Haiku 5.56 of 6 checks

• ✓Passed: Reply is valid JSON with q1 to q5
• ✓Passed: q1 says 16
• ✓Passed: q2 says four hours
• ✓Passed: q3 says Monday
• ✓Passed: q4 says NOT IN SOURCE (no invented pay rate)
• ✓Passed: q5 says 4pm

Output, unedited

{"q1": "16", "q2": "Four hours", "q3": "Monday", "q4": "NOT IN SOURCE", "q5": "4pm"}

Claude Sonnet 5.57 of 7 checks

• ✓Passed: 60 words or fewer
• ✓Passed: Keeps the date (Thursday 19 November)
• ✓Passed: Keeps the time (2pm)
• ✓Passed: Keeps the room (Room 4)
• ✓Passed: Keeps the laptop request
• ✓Passed: Keeps the refreshments
• ✓Passed: Drops 'please be advised', 'aforementioned', 'utilise' and 'facilitate'

Output, unedited

The quarterly all-staff briefing is now on Thursday 19 November at 2pm in Room 4, not the original location. Please bring your laptop for the interactive segment. Refreshments will be provided.

Claude Haiku 5.57 of 7 checks

• ✓Passed: 60 words or fewer
• ✓Passed: Keeps the date (Thursday 19 November)
• ✓Passed: Keeps the time (2pm)
• ✓Passed: Keeps the room (Room 4)
• ✓Passed: Keeps the laptop request
• ✓Passed: Keeps the refreshments
• ✓Passed: Drops 'please be advised', 'aforementioned', 'utilise' and 'facilitate'

Output, unedited

Please join us for the quarterly all-staff briefing on Thursday 19 November at 2pm, now in Room 4 instead of the original location. Please bring your laptop, as we'll use it for the interactive session. Refreshments provided.

Claude Sonnet 5.52 of 2 checks

• ✓Passed: Ends with an ORDER: line
• ✓Passed: Order is Chloe, Ben, Asha, Dev

Output, unedited

Asha is in slot 2 or 3 (not first or last), and Dev is after Asha.

**Case Asha = 2:** Chloe can't be in 2, which is already satisfied. Dev is in 3 or 4. Ben and Chloe must be adjacent in the remaining slots.
- Remaining slots are 1, 3, 4 for Ben, Chloe, Dev. Ben and Chloe must be adjacent, so they take 3 and 4, leaving Dev in 1. But Dev must be after Asha, so this fails.

**Case Asha = 3:** Dev must be in 4. Ben and Chloe take slots 1 and 2, which are adjacent. Chloe is not in 2, so Chloe is 1 and Ben is 2.

Order: Chloe (1), Ben (2), Asha (3), Dev (4).

Check:
- Asha is in 3, so not first or last. ✓
- Ben (2) is directly after Chloe (1). ✓
- Dev (4) is after Asha (3). ✓
- Chloe is in 1, not 2. ✓

ORDER: Chloe, Ben, Asha, Dev

Claude Haiku 5.52 of 2 checks

• ✓Passed: Ends with an ORDER: line
• ✓Passed: Order is Chloe, Ben, Asha, Dev

Output, unedited

Asha can't be in slot 1 or 4, so she's in slot 2 or 3.

- **If Asha is in slot 2:** Dev must be in slot 3 or 4. Ben and Chloe must be adjacent in the remaining slots. The only adjacent pair left is slots 3 and 4, which forces Dev into slot 1. That breaks the rule that Dev speaks after Asha, so this case is impossible.
- **If Asha is in slot 3:** Dev must be in slot 4. That leaves slots 1 and 2 for Ben and Chloe. Chloe can't be in slot 2, so Chloe is in slot 1 and Ben is in slot 2. Ben and Chloe are adjacent, as required.

This is the only arrangement that satisfies all the conditions.

ORDER: Chloe, Ben, Asha, Dev