PipelineScore
← Back to leaderboard
Head-to-head

Hermes 3 Llama 3.1 8B vs DeepSeek Coder V2 236B

DeepSeek Coder V2 236B wins+17.8 pts (+26%)on the balanced composite.
nous
Hermes 3 Llama 3.1 8B
67.2FEEDER
deepseek
Winner
DeepSeek Coder V2 236B
85.0MAINLINE

Category-by-category

Higher bar wins each row.

Hermes 3 Llama 3.1 8B
Category
DeepSeek Coder V2 236B
-22.065.3
Code
87.2+22.0
-13.270.5
Reason
83.7+13.2
-19.065.8
Tool Use
84.8+19.0
-21.667.4
RAG
89.0+21.6
-20.568.2
Speed
88.7+20.5
Hermes 3 Llama 3.1 8B
Provider
nous
Released
2024-08-16
Context
128K
Lab
Community
DeepSeek Coder V2 236B
Provider
deepseek
Released
2024-06-17
Context
163.84K
Lab
Community