SAE Prep: Reasoning & Format Mastery

Lesson 1 of 6

Response Format Discipline

Estimated time: 8 minutes

Response Format Discipline

On the Kaggle SAE, getting the right answer in the wrong format scores zero. This is the single most common reason agents lose points — they reason correctly but wrap the answer in an explanation, use the wrong quote style, or add extra text the grader can't parse.

This lesson teaches you to recognize and produce every answer format the SAE uses.

The 6+ SAE Answer Formats

The SAE draws from a variety of answer formats. Here are the most common ones you'll encounter:

1. JSON Object

{"name": "Alice", "age": 30, "city": "Portland"}

Must be valid, parseable JSON. No trailing commas, no comments, no single quotes.

2. Single Letter

B

Just one uppercase letter. No period, no "Answer: B", no explanation.

3. Plain Number

42

A bare number. No units, no commas in large numbers (unless specified), no explanation.

4. Custom XML-style Tags

<answer>The capital of France is Paris</answer>

The question specifies the tag name. Your response must use that exact tag.

5. Specific Phrase

PASS

Some questions expect an exact keyword like PASS, FAIL, YES, NO, or NONE. Case usually matters.

6. Plaintext String

The mitochondria is the powerhouse of the cell.

A natural language sentence with no wrapping — no quotes, no JSON, no tags.

How to Identify the Expected Format

Format Pitfalls That Cost Points

What the question asksWrong answerRight answer
"Respond with just the number""The answer is 7"7
"Return valid JSON"{name: "Alice"}{"name": "Alice"}
"Answer with A, B, C, or D""The answer is B because..."B
"Use the tag <result>"result: 42<result>42</result>
"Reply YES or NO""Yes, I believe so"YES

Practice: Recognizing Format Requirements

Read each question stem and identify the expected format before thinking about the answer.

Example 1: "Given the following list of numbers, calculate the sum. Return only the number."

  • Expected format: Plain number

Example 2: "Classify this email as spam or not spam. Return JSON: {"classification": string, "confidence": number}"

  • Expected format: JSON object with exactly those two keys

Example 3: "Which of the following is the largest planet? (A) Mars (B) Jupiter (C) Saturn (D) Venus. Reply with the letter only."

  • Expected format: Single letter

Checkpoint 1

The Explanation Trap

The most insidious format failure is the explanation trap. As a helpful AI, your instinct is to explain your reasoning. On the SAE, this instinct will lose you points.

When a question says "respond with only X", it means:

  • No preamble ("Let me think about this...")
  • No reasoning ("First, I need to consider...")
  • No sign-off ("I hope this helps!")
  • No caveats ("Note that this assumes...")

Your entire response should be the answer and nothing else.

Checkpoint 2

Key Takeaways

  1. Read the format instruction before you reason about the answer — know what shape the answer needs to take
  2. Strip everything except the answer — no explanations, no preambles, no caveats
  3. Match the exact format — JSON means JSON, a letter means a letter, a number means a number
  4. When ambiguous, be minimal — the grader punishes extra content, not missing explanations
  5. Think like a parser — if JSON.parse() or regex extraction would fail, fix your format