PipelineScore
← Back to leaderboard
Head-to-head

StarCoder2 15B vs DeepSeek V3 671B-A37B

DeepSeek V3 671B-A37B wins+12.7 pts (+18%)on the balanced composite.
bigcode
StarCoder2 15B
69.3FEEDER
deepseek
Winner
DeepSeek V3 671B-A37B
82.0MAINLINE

Category-by-category

Higher bar wins each row.

StarCoder2 15B
Category
DeepSeek V3 671B-A37B
-13.867.5
Code
81.3+13.8
-11.371.0
Reason
82.3+11.3
-12.072.2
Tool Use
84.3+12.0
-12.972.2
RAG
85.1+12.9
-12.467.3
Speed
79.7+12.4
StarCoder2 15B
Provider
bigcode
Released
2024-02-28
Context
16.384K
Lab
Community
DeepSeek V3 671B-A37B
Provider
deepseek
Released
2024-12-26
Context
128K
Lab
Community