What does an ablation change?

• Exactly one component
• All components at once, to save runs
• Nothing at all

A stranger wants to repeat your run. What do they need?

• The final score and the name of the model used
• Only the paper title
• Seeds, environment, and the exact command

A single seed counts as a full result.

Circle one:   True   False

Two runs differ in three settings at once. Can you claim one part caused the gain?

• Yes, the best score always explains itself
• Yes, three changes count as one
• No, only one thing may differ

A new caching layer made your system 30 percent faster. How do you show the cache caused the speedup?

• Rerun on a new workload and newer hardware to confirm
• Rerun the same workload with only the cache turned off
• Report only the faster number

You ran five seeds with spread-out scores. What do you report?

• The scores across seeds, including how they vary
• The best seed, since it shows what the method can do
• The seed you liked most

A teammate records the command but not the seed or environment. Repeatable?

• Yes, the command is the only thing needed
• Yes, seeds never matter
• No, the seed and environment are required too

A reviewer asks for the ablation isolating your new loss term. What do you run?

• A new model with a new dataset
• Same setup and seed, term on versus off, then compare the gap
• One run with the term on only