PipelineScore
← Back to leaderboard
Head-to-head

StarCoder2 3B vs DeepSeek V3 671B-A37B

DeepSeek V3 671B-A37B wins+34.7 pts (+73%)on the balanced composite.
bigcode
StarCoder2 3B
47.3TAP
deepseek
Winner
DeepSeek V3 671B-A37B
82.0MAINLINE

Category-by-category

Higher bar wins each row.

StarCoder2 3B
Category
DeepSeek V3 671B-A37B
-33.647.7
Code
81.3+33.6
-36.246.0
Reason
82.3+36.2
-34.649.6
Tool Use
84.3+34.6
-34.750.4
RAG
85.1+34.7
-36.043.7
Speed
79.7+36.0
StarCoder2 3B
Provider
bigcode
Released
2024-02-28
Context
16.384K
Lab
Community
DeepSeek V3 671B-A37B
Provider
deepseek
Released
2024-12-26
Context
128K
Lab
Community
StarCoder2 3B vs DeepSeek V3 671B-A37B · PipelineScore