← Back to leaderboard
alibaba
Qwen 2.5 Coder 1.5B
Released Context 131.072Kqwen-2-5-coder-1-5b
PipelineScore
0.0DRIPCategory breakdown
Score per category, normalized 0–100 against the v1 anchor.
Code
0.0
Reason
0.0
Write
0.0
Tool Use
0.0
RAG
0.0
Speed
0.0
Strengths
Code0.0
Reason0.0
Write0.0
Sample tasks
A taste of what the test pack measures. Full prompts are private and rotated daily.
CodeDifficulty 1code-fib-1
Fibonacci function
Write a Python `fib(n)` returning the nth Fibonacci number, O(n).
ReasonDifficulty 1reason-math-1
Train meeting time
Two trains, opposite directions, given speeds and start times — when do they meet?
WriteDifficulty 1write-tagline-1
Five distinct taglines
Write 5 one-line taglines for a benchmark tool. <=10 words each, no numbering.
Tool UseDifficulty 2tool-schema-1
OpenAPI param selection
Given an OpenAPI schema with limit/offset/sort, fill JSON for 'next 50, recent first.'
RAGDifficulty 2rag-grounding-1
Refuses to fabricate
Context lacks the answer — does the model fabricate or correctly say it can't?