User profile

rig-tester

15 runsFirst seen 2026-04-16Avg 69.2

Best PipelineScore

86.6MAINLINE

on DeepSeek R1 671B-A37B

Total tokens83.7KAcross every task this user has run

Avg latency1307msPer task, across all submissions

Tasks run37515 submissions x ~25 tasks

Rigs used13Distinct hardware tags

Category signature

Average score per category across all 15 runs.

Code

69.3

Reason

69.1

Write

71.3

Tool Use

71.2

RAG

68.0

Speed

65.4

Hardware mix

Rigs this user benchmarked on.

m2-ultra-192gb2 (13%)

m2-pro-16gb2 (13%)

rtx-4080-16gb-offload1 (7%)

a100-80gb1 (7%)

m3-ultra-256gb1 (7%)

rtx-3080-10gb1 (7%)

rtx-4090-24gb1 (7%)

m3-max-128gb1 (7%)

macbook-pro-m3-pro-18gb1 (7%)

rtx-4070-12gb1 (7%)

m3-air-16gb1 (7%)

snapdragon-x-elite-32gb1 (7%)

m1-air-8gb1 (7%)

Provider mix

Where they spend their tokens.

deepseek5 (33%)

microsoft2 (13%)

nous1 (7%)

moonshot1 (7%)

mistral1 (7%)

alibaba1 (7%)

google1 (7%)

cohere1 (7%)

meta1 (7%)

huggingface1 (7%)

Models tried

Best score per model. Click a model to see its full page.

#	Model	Provider	Best Score	Tier	Achieved
1	DeepSeek R1 671B-A37B	deepseek	86.6	MAINLINE	2026-05-02
2	DeepSeek R1 Distill Qwen 32B	deepseek	82.3	MAINLINE	2026-04-18
3	Hermes 3 Llama 3.1 70B	nous	79.7	MAINLINE	2026-04-19
4	Kimi K2 Instruct	moonshot	77.0	MAINLINE	2026-04-23
5	DeepSeek V2.5	deepseek	76.6	MAINLINE	2026-04-18
6	DeepSeek R1 Distill Llama 8B	deepseek	74.6	FEEDER	2026-04-24
7	Codestral 22B	mistral	74.6	FEEDER	2026-04-20
8	DeepSeek Coder V2 16B	deepseek	74.1	FEEDER	2026-05-09
9	Qwen 2.5 14B Instruct	alibaba	72.7	FEEDER	2026-05-08
10	Gemma 3 12B IT	google	68.7	FEEDER	2026-05-04
11	Phi 3 Small 7B	microsoft	64.8	FEEDER	2026-04-20
12	Aya 23 8B	cohere	58.9	TAP	2026-04-23
13	Llama 3.2 3B Instruct	meta	52.8	TAP	2026-04-16
14	Phi 3 Mini 3.8B	microsoft	52.4	TAP	2026-04-27
15	SmolLM2 1.7B	huggingface	41.9	TAP	2026-05-09

All submissions

Every run, ordered by score.

#	Model	Hardware	Score	Tier	Code	Reason	Write	Tool Use	RAG	Speed	Tokens	Avg ms	Date
1	DeepSeek R1 671B-A37B	m2-ultra-192gb	86.6	MAINLINE	90.7	84.2	91.3	92.7	83.1	73.3	5.7K	2927	2026-05-02
2	DeepSeek R1 Distill Qwen 32B	rtx-4080-16gb-offload	82.3	MAINLINE	85.6	80.5	86.6	80.8	79.3	78.1	5.7K	1628	2026-04-18
3	Hermes 3 Llama 3.1 70B	a100-80gb	79.7	MAINLINE	83.7	81.5	76.6	78.0	73.8	79.8	5.3K	906	2026-04-19
4	Kimi K2 Instruct	m3-ultra-256gb	77.0	MAINLINE	71.8	76.1	83.5	81.8	81.8	70.9	5.2K	3041	2026-04-23
5	DeepSeek V2.5	m2-ultra-192gb	76.6	MAINLINE	76.9	76.0	78.8	81.9	73.5	70.9	5.8K	3032	2026-04-18
6	DeepSeek R1 Distill Llama 8B	rtx-3080-10gb	74.6	FEEDER	72.9	72.4	79.1	78.9	73.9	72.0	6.4K	811	2026-04-24
7	Codestral 22B	rtx-4090-24gb	74.6	FEEDER	79.0	71.2	73.8	77.0	76.2	68.2	5.6K	1495	2026-04-20
8	DeepSeek Coder V2 16B	m3-max-128gb	74.1	FEEDER	73.9	72.9	74.6	78.3	75.6	69.4	5.1K	1542	2026-05-09
9	Qwen 2.5 14B Instruct	m2-pro-16gb	72.7	FEEDER	69.1	73.4	78.5	71.0	70.4	75.7	5.9K	800	2026-05-08
10	Gemma 3 12B IT	macbook-pro-m3-pro-18gb	68.7	FEEDER	67.0	67.2	69.3	74.5	67.1	68.0	5.7K	770	2026-05-04
11	Phi 3 Small 7B	rtx-4070-12gb	64.8	FEEDER	62.9	62.3	66.7	70.3	66.7	62.2	5.6K	812	2026-04-20
12	Aya 23 8B	m2-pro-16gb	58.9	TAP	57.5	64.1	54.6	63.1	56.4	56.2	5.3K	758	2026-04-23
13	Llama 3.2 3B Instruct	m3-air-16gb	52.8	TAP	51.6	58.6	58.6	48.9	48.3	48.3	5.8K	358	2026-04-16
14	Phi 3 Mini 3.8B	snapdragon-x-elite-32gb	52.4	TAP	52.7	54.9	53.3	50.7	49.1	52.0	4.9K	365	2026-04-27
15	SmolLM2 1.7B	m1-air-8gb	41.9	TAP	44.3	41.1	43.9	40.0	44.6	35.8	5.4K	366	2026-05-09