
Fine-tuning moved F1 from 0.71 to 0.89. The remaining errors are almost all sarcasm.
Data
2,000 reviews, labelled twice, disagreements resolved by a third reader.
Labelling guidelines mattered more than model size.
What fine-tuning bought us over a strong baseline, and where it still fails.

Fine-tuning moved F1 from 0.71 to 0.89. The remaining errors are almost all sarcasm.
2,000 reviews, labelled twice, disagreements resolved by a third reader.
Labelling guidelines mattered more than model size.