← Back to leaderboard
local
Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp
Released Context 0Kswift-1.5-qwen3.8-27b-gsq-rco-iq2_s-mtp
PipelineScore
84.5MAINLINERanked #15 of 31 models · 52nd percentileRAG is the headline (100.0); throughput is the soft spot (49.3). Best-fit profile: Agentic.
Category breakdown
Score per category, normalized 0–100 against the v1 anchor.
Code
87.5
Reason
90.0
Tool Use
87.5
RAG
100.0
Speed
49.3
Strengths
RAG100.0
Reason90.0
Code87.5
Sample tasks
A taste of what the test pack measures. Full prompts are private and rotated daily.
CodeDifficulty 1code-fib-1
Fibonacci function
Write a Python `fib(n)` returning the nth Fibonacci number, O(n).
ReasonDifficulty 1reason-math-1
Train meeting time
Two trains, opposite directions, given speeds and start times — when do they meet?
RAGDifficulty 2rag-extract-1
Extract metrics to JSON
From the context, extract net sales, operating margin, and free cash flow as a JSON object. Numbers only.
Tool UseDifficulty 2tool-schema-1
OpenAPI param selection
Given an OpenAPI schema with limit/offset/sort, fill JSON for 'next 50, recent first.'
RAGDifficulty 2rag-grounding-1
Refuses to fabricate
Context lacks the answer — does the model fabricate or correctly say it can't?
Compare with
Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp vs unsloth/gpt-oss-20b-GGUFSwift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp vs gpt-oss-20b-GGUFSwift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp vs openai/gpt-oss-20bSwift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp vs gpt-oss:latestSwift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_S-mtp vs ornith-1.5-35b-a3b