PipelineScore
โ† Back to user leaderboard
User profile

mac-stack

21 runsFirst seen 2026-04-11Avg 71.5
Best PipelineScore
86.0MAINLINE
Total tokens112.0KAcross every task this user has run
Avg latency1491msPer task, across all submissions
Tasks run52521 submissions x ~25 tasks
Rigs used14Distinct hardware tags

Category signature

Average score per category across all 21 runs.

Code
71.0
Reason
71.6
Write
72.2
Tool Use
72.7
RAG
73.7
Speed
68.1

Hardware mix

Rigs this user benchmarked on.

rtx-4080-16gb-offload3 (14%)
rtx-3090-24gb2 (10%)
4x-rtx-30902 (10%)
rtx-3080-10gb2 (10%)
rtx-4090-24gb2 (10%)
m3-pro-36gb2 (10%)
dgx-h1001 (5%)
m3-ultra-256gb1 (5%)
a6000-48gb1 (5%)
cloud-api1 (5%)
m2-ultra-192gb1 (5%)
rtx-3060-12gb1 (5%)
ryzen-7950x-cpu-only1 (5%)
m3-air-16gb1 (5%)

Provider mix

Where they spend their tokens.

alibaba3 (14%)
deepseek2 (10%)
meta2 (10%)
community2 (10%)
internlm2 (10%)
microsoft2 (10%)
bigcode2 (10%)
ibm2 (10%)
zhipu1 (5%)
mistral1 (5%)
google1 (5%)
xai1 (5%)

Models tried

Best score per model. Click a model to see its full page.

#ModelBest ScoreTier
1DeepSeek R1 671B-A37B86.0MAINLINE
2Qwen 2.5 Coder 32B81.8MAINLINE
3Qwen 2.5 32B Instruct81.0MAINLINE
4Llama 3.3 70B Instruct76.9MAINLINE
5Qwen 3 32B Instruct76.3MAINLINE
6Magnum V4 72B75.3MAINLINE
7GLM 4 Plus74.8FEEDER
8Devstral Small 24B74.5FEEDER
9InternLM 2.5 20B Chat73.0FEEDER
10L3 70B Euryale72.4FEEDER
11Phi 4 14B71.3FEEDER
12Phi 3.5 MoE 42B69.7FEEDER
13DeepSeek R1 Distill Llama 8B69.5FEEDER
14StarCoder2 15B69.2FEEDER
15Gemma 2 9B IT66.8FEEDER
16Grok-1 314B66.6FEEDER
17Granite 3.1 8B Instruct65.6FEEDER
18Code Llama 34B Instruct63.6FEEDER
19Granite 3.1 2B Instruct48.8TAP

All submissions

Every run, ordered by score.

#ModelScoreTier
1DeepSeek R1 671B-A37B86.0MAINLINE
2Qwen 2.5 Coder 32B81.8MAINLINE
3Qwen 2.5 32B Instruct81.0MAINLINE
4Llama 3.3 70B Instruct76.9MAINLINE
5Qwen 3 32B Instruct76.3MAINLINE
6Magnum V4 72B75.3MAINLINE
7GLM 4 Plus74.8FEEDER
8Devstral Small 24B74.5FEEDER
9InternLM 2.5 20B Chat73.0FEEDER
10L3 70B Euryale72.4FEEDER
11Phi 4 14B71.3FEEDER
12InternLM 2.5 20B Chat70.2FEEDER
13Phi 3.5 MoE 42B69.7FEEDER
14DeepSeek R1 Distill Llama 8B69.5FEEDER
15StarCoder2 15B69.2FEEDER
16StarCoder2 15B67.8FEEDER
17Gemma 2 9B IT66.8FEEDER
18Grok-1 314B66.6FEEDER
19Granite 3.1 8B Instruct65.6FEEDER
20Code Llama 34B Instruct63.6FEEDER
21Granite 3.1 2B Instruct48.8TAP