PipelineScore
← Back to leaderboard
Head-to-head

Hermes 3 Llama 3.1 70B vs DeepSeek V3 671B-A37B

DeepSeek V3 671B-A37B wins+3.9 pts (+5%)on the balanced composite.
nous
Hermes 3 Llama 3.1 70B
78.1MAINLINE
deepseek
Winner
DeepSeek V3 671B-A37B
82.0MAINLINE

Category-by-category

Higher bar wins each row.

Hermes 3 Llama 3.1 70B
Category
DeepSeek V3 671B-A37B
-0.580.8
Code
81.3+0.5
-1.580.7
Reason
82.3+1.5
-5.578.7
Tool Use
84.3+5.5
-4.980.2
RAG
85.1+4.9
-6.773.0
Speed
79.7+6.7
Hermes 3 Llama 3.1 70B
Provider
nous
Released
2024-08-16
Context
128K
Lab
Community
DeepSeek V3 671B-A37B
Provider
deepseek
Released
2024-12-26
Context
128K
Lab
Community