CCRL 40/4
Downloads and Statistics
December 7, 2019
Testing summary:
Total: 2'143'600 games
played by 2'509 programs
29100 CPU days (X2 4600+)

White wins: 830'432 (38.7%)
Black wins: 670'629 (31.3%)
Draws: 642'539 (30.0%)
White score: 53.7%

Custom engine selection

Comparing 7 engines!
7 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on December 7, 2019 with Bayeselo based on 2'143'600 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 12.3 MCTS 64-bit 4CPU3412+15−1550.8%−4.151.0%1420 
100.0%
 Komodo 13.01 MCTS 64-bit3359+17−1766.2%−111.738.9%1233
69.3%
 Komodo 13.2.5 MCTS 64-bit3353+17−1758.7%−53.453.8%1058
99.4%
 Komodo 12.3 MCTS 64-bit3325+13−1359.0%−58.242.9%1886
99.9%
 Komodo 12.2.2 MCTS 64-bit3289+17−1759.5%−61.543.2%1108
100.0%
 Komodo 12.1.1 MCTS 64-bit3094+18−1852.7%−17.436.0%1037
100.0%
 Komodo 12 MCTS 64-bit3045+23−2348.9%+7.042.8%572
 

Results matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3412       
2Komodo 13.01 MCTS 64-bit3359       
3Komodo 13.2.5 MCTS 64-bit3353       
4Komodo 12.3 MCTS 64-bit3325       
5Komodo 12.2.2 MCTS 64-bit3289       
6Komodo 12.1.1 MCTS 64-bit3094       
7Komodo 12 MCTS 64-bit3045       
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3412 100.0100.0100.0100.0100.0100.0
2Komodo 13.01 MCTS 64-bit33590.0 69.399.9100.0100.0100.0
3Komodo 13.2.5 MCTS 64-bit33530.030.7 99.4100.0100.0100.0
4Komodo 12.3 MCTS 64-bit33250.00.10.6 99.9100.0100.0
5Komodo 12.2.2 MCTS 64-bit32890.00.00.00.1 100.0100.0
6Komodo 12.1.1 MCTS 64-bit30940.00.00.00.00.0 100.0
7Komodo 12 MCTS 64-bit30450.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3412 000000
2Komodo 13.01 MCTS 64-bit33590 113622831205354162
3Komodo 13.2.5 MCTS 64-bit335301136 123363700
4Komodo 12.3 MCTS 64-bit3325022831233 2026313162
5Komodo 12.2.2 MCTS 64-bit3289012056372026 511270
6Komodo 12.1.1 MCTS 64-bit309403540313511 786
7Komodo 12 MCTS 64-bit304501620162270786 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567
1Komodo 12.3 MCTS 64-bit 4CPU3412 0.00.00.00.00.00.0
2Komodo 13.01 MCTS 64-bit33590.0 49.673.251.515.69.0
3Komodo 13.2.5 MCTS 64-bit33530.049.6 41.929.40.00.0
4Komodo 12.3 MCTS 64-bit33250.073.241.9 67.710.76.6
5Komodo 12.2.2 MCTS 64-bit32890.051.529.467.7 23.816.1
6Komodo 12.1.1 MCTS 64-bit30940.015.60.010.723.8 48.9
7Komodo 12 MCTS 64-bit30450.09.00.06.616.148.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 32 common opponents

Custom engine selection
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
Komodo
12
MCTS
64-bit
Stockfish 10 64-bit3491 28%
18/64
30%
19.5/64
20%
19.5/100
   
Houdini 6 64-bit3444 30%
19/64
34%
22/64
30%
29.5/99
23%
14.5/64
  
Fire 7.1 64-bit3338 52%
33/64
55%
35/64
52%
52/100
39%
25/64
  
Ethereal 11.50 64-bit3322 54%
27/50
56%
36/64
    
Ethereal 11.25 64-bit3305 59%
38/64
 48%
48.5/100
   
Xiphos 0.5 64-bit3305 58%
37/64
 53%
26.5/50
   
Ethereal 11.00 64-bit3302   55%
54.5/99
45%
28.5/64
  
Laser 1.7 64-bit3271 59%
38/64
66%
42.5/64
62%
40/64
   
Shredder 13 64-bit3270 61%
39/64
68%
43.5/64
56%
55/98
49%
31/63
  
Booot 6.3.1 64-bit3256 75%
48/64
62%
39/63
60%
59.5/99
58%
36.5/63
  
Fizbo 2 64-bit3248 77%
49/64
59%
38/64
58%
57.5/99
49%
31.5/64
  
Andscacs 0.95 64-bit3234 66%
42/64
71%
45/63
76%
48.5/64
   
Xiphos 0.4 64-bit3227   64%
63.5/100
61%
30.5/50
  
RofChade 2.1 64-bit3216 73%
46.5/64
 67%
33.5/50
   
Schooner 2.0.34 64-bit3192 69%
44/64
 80%
80.5/100
64%
32/50
  
Laser 1.6 64-bit3188   75%
75/100
73%
36.5/50
  
Chiron 4 64-bit3164 81%
52/64
 78%
78/100
72%
36/50
30%
19/63
44%
8/18
Critter 1.6a 64-bit3158 81%
52/64
 74%
73.5/100
70%
35/50
 31%
5.5/18
Fritz 15 64-bit3146   74%
74.5/100
74%
37/50
  
NirvanaChess 2.4 64-bit3130 85%
54.5/64
 74%
74.5/100
74%
37/50
51%
25.5/50
44%
8/18
NameEloKomodo
12.3
MCTS
64-bit
4CPU
Komodo
13.01
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
Komodo
12
MCTS
64-bit
Nemorino 5.00 64-bit3116 82%
51.5/63
  83%
40/48
44%
22/50
 
Texel 1.07 64-bit3113    76%
38/50
42%
21/50
22%
4/18
Hannibal 1.7 64-bit3110    79%
39.5/50
53%
26.5/50
44%
8/18
Laser 1.5 64-bit3095     47%
23.5/50
56%
10/18
Protector 1.9.0 64-bit3085     52%
26/50
50%
9/18
Senpai 2.0 64-bit3084     44%
22/50
36%
6.5/18
iCE 3.0 64-bit3081     62%
31/50
36%
6.5/18
Nemorino 4.00 64-bit3067     55%
27.5/50
50%
9/18
Xiphos 0.2 64-bit3062     63%
31.5/50
50%
9/18
Arasan 20.5 64-bit3059     54%
61/113
36%
11.5/32
SmarThink 1.98 64-bit3039     75%
37.5/50
61%
11/18
Naum 4.6 64-bit3032     48%
31/64
55%
17.5/32
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on December 7, 2019