proverbIT

1Experiment design and data validation, 2Infrastructure, 3Annotation

Abstract

proverbIT is a dataset of italian proverbs with some completion alternatives.

Dataset Description

Evaluation

Leaderboard

Rank Model1 Accuracy % Thinking

Detailed Response Statistics

Model A) Assonant B) Synonym C) Inverse D) Obvious None

Interesting CoTs

Reasoning

Video