PipelineScore
← Back to leaderboard
huggingface

SmolLM2 1.7B

Released Context 8.192Ksmollm2-1-7b
PipelineScore
0.0DRIP

Category breakdown

Score per category, normalized 0–100 against the v1 anchor.

Code
0.0
Reason
0.0
Write
0.0
Tool Use
0.0
RAG
0.0
Speed
0.0

Strengths

Code0.0
Reason0.0
Write0.0

Sample tasks

A taste of what the test pack measures. Full prompts are private and rotated daily.

CodeDifficulty 1code-fib-1

Fibonacci function

Write a Python `fib(n)` returning the nth Fibonacci number, O(n).

ReasonDifficulty 1reason-math-1

Train meeting time

Two trains, opposite directions, given speeds and start times — when do they meet?

WriteDifficulty 1write-tagline-1

Five distinct taglines

Write 5 one-line taglines for a benchmark tool. <=10 words each, no numbering.

Tool UseDifficulty 2tool-schema-1

OpenAPI param selection

Given an OpenAPI schema with limit/offset/sort, fill JSON for 'next 50, recent first.'

RAGDifficulty 2rag-grounding-1

Refuses to fabricate

Context lacks the answer — does the model fabricate or correctly say it can't?

Compare with