← Back to leaderboard
local
gemma4:31b-it-q4_K_M
Released Context 0Kgemma4-31b-it-q4_k_m
PipelineScore
0.0DRIPAn even spread: no standout, no liability (0 to 0 across all five categories). Best-fit profile: Balanced.
Category breakdown
Score per category, normalized 0–100 against the v1 anchor.
Code
0.0
Reason
0.0
Tool Use
0.0
RAG
0.0
Speed
0.0
Strengths
Code0.0
Reason0.0
Tool Use0.0
Sample tasks
A taste of what the test pack measures. Full prompts are private and rotated daily.
CodeDifficulty 1code-fib-1
Fibonacci function
Write a Python `fib(n)` returning the nth Fibonacci number, O(n).
ReasonDifficulty 1reason-math-1
Train meeting time
Two trains, opposite directions, given speeds and start times — when do they meet?
RAGDifficulty 2rag-extract-1
Extract metrics to JSON
From the context, extract net sales, operating margin, and free cash flow as a JSON object. Numbers only.
Tool UseDifficulty 2tool-schema-1
OpenAPI param selection
Given an OpenAPI schema with limit/offset/sort, fill JSON for 'next 50, recent first.'
RAGDifficulty 2rag-grounding-1
Refuses to fabricate
Context lacks the answer — does the model fabricate or correctly say it can't?