CCRL 40/40
Downloads and Statistics
July 7, 2018
Testing summary:
Total: 860'187 games
played by 2'216 programs
120427 CPU days (X2 4600+)

White wins: 295'917 (34.4%)
Black wins: 218'884 (25.4%)
Draws: 345'386 (40.2%)
White score: 54.5%

Custom engine selection

Comparing 10 engines!
10 selected engines played 40 games with each other

CCRL 40/40 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 40 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 15 minutes on a modern Intel CPU.
Computed on July 7, 2018 with Bayeselo based on 860'187 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 7.1 64-bit 4CPU3321+21−2163.0%−82.855.5%690 
96.6%
 Fire 6.1 64-bit 4CPU3296+18−1848.5%+7.358.4%940
96.6%
 Fire 5 64-bit 4CPU3272+18−1846.9%+18.162.5%867
81.3%
 Fire 7.1 64-bit3260+18−1758.1%−53.255.5%983
100.0%
 Fire 6.1 64-bit3206+12−1252.9%−17.255.5%2084
62.4%
 Fire 4 64-bit 4CPU3203+12−1346.5%+22.359.7%1885
99.6%
 Fire 5 64-bit3176+13−1351.2%−4.858.3%1862
96.8%
 Fire 3.0 64-bit 4CPU3155+17−1749.5%+2.358.2%948
73.7%
 Fire 4 64-bit3148+11−1052.7%−17.657.0%2807
100.0%
 Fire 3.0 64-bit3081+14−1450.1%−1.157.2%1483
 

Results matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321          
2Fire 6.1 64-bit 4CPU3296          
3Fire 5 64-bit 4CPU3272          
4Fire 7.1 64-bit3260    20.5 − 19.5
+4−3=33
−48
     
5Fire 6.1 64-bit3206   19.5 − 20.5
+3−4=33
+48
      
6Fire 4 64-bit 4CPU3203          
7Fire 5 64-bit3176          
8Fire 3.0 64-bit 4CPU3155          
9Fire 4 64-bit3148          
10Fire 3.0 64-bit3081          
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321 96.6100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 6.1 64-bit 4CPU32963.4 96.699.6100.0100.0100.0100.0100.0100.0
3Fire 5 64-bit 4CPU32720.03.4 81.3100.0100.0100.0100.0100.0100.0
4Fire 7.1 64-bit32600.00.418.7 100.0100.0100.0100.0100.0100.0
5Fire 6.1 64-bit32060.00.00.00.0 62.4100.0100.0100.0100.0
6Fire 4 64-bit 4CPU32030.00.00.00.037.6 99.6100.0100.0100.0
7Fire 5 64-bit31760.00.00.00.00.00.4 96.8100.0100.0
8Fire 3.0 64-bit 4CPU31550.00.00.00.00.00.03.2 73.7100.0
9Fire 4 64-bit31480.00.00.00.00.00.00.026.3 100.0
10Fire 3.0 64-bit30810.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321 98943080172160961249292
2Fire 6.1 64-bit 4CPU3296989 850174244355881928484
3Fire 5 64-bit 4CPU3272430850 072649020000
4Fire 7.1 64-bit3260801740 195108580420318
5Fire 6.1 64-bit3206172244721951 020940859440
6Fire 4 64-bit 4CPU320316035564900 082600
7Fire 5 64-bit31769688085820940 02034620
8Fire 3.0 64-bit 4CPU3155124192200008260 00
9Fire 4 64-bit314892840420859020340 1542
10Fire 3.0 64-bit308192840318440062001542 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3321 60.727.64.86.26.23.87.62.64.2
2Fire 6.1 64-bit 4CPU329660.7 47.09.08.112.63.110.22.23.5
3Fire 5 64-bit 4CPU327227.647.0 0.02.423.60.011.00.00.0
4Fire 7.1 64-bit32604.89.00.0 63.60.030.20.011.112.9
5Fire 6.1 64-bit32066.28.12.463.6 0.053.10.017.612.3
6Fire 4 64-bit 4CPU32036.212.623.60.00.0 0.029.20.00.0
7Fire 5 64-bit31763.83.10.030.253.10.0 0.043.618.5
8Fire 3.0 64-bit 4CPU31557.610.211.00.00.029.20.0 0.00.0
9Fire 4 64-bit31482.62.20.011.117.60.043.60.0 35.9
10Fire 3.0 64-bit30814.23.50.012.912.30.018.50.035.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 99 common opponents

Custom engine selection
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Stockfish 9 64-bit 4CPU344228%
11/40
27%
13.5/50
        
SugaR XPrO 1.4 64-bit 4CPU341839%
15.5/40
34%
17/50
        
SugaR XPrO 1.2 64-bit 4CPU3407 27%
8.5/32
25%
8/32
       
Komodo 12 64-bit 4CPU340635%
14/40
33%
16.5/50
        
Houdini 6 64-bit 4CPU340542%
8.5/20
27%
9/33
33%
19/57
       
Komodo 11.2 64-bit 4CPU3400 32%
10.5/33
32%
21.5/68
       
Stockfish 8 64-bit 4CPU3385 35%
11/31
28%
10/36
  25%
8.5/34
    
Stockfish 9 64-bit3380 39%
15.5/40
 30%
18.5/62
21%
10/48
     
SugaR XPrO 1.4 64-bit3374   30%
18/61
23%
13.5/58
     
Komodo 10.1 64-bit 4CPU3368  23%
7/30
  28%
9.5/34
    
Komodo 10.2 64-bit 4CPU3361  50%
2/4
  29%
9.5/33
    
Houdini 6 64-bit3344   36%
21.5/60
24%
15.5/64
     
Komodo 11.2 64-bit3323   46%
18.5/40
35%
18/52
 26%
15.5/60
   
Komodo 12 64-bit3320   38%
22.5/60
29%
15/52
     
Houdini 6 Tactical 64-bit3317   35%
14/40
27%
13.5/50
     
SugaR XPrO 1.2 64-bit3317    29%
16.5/56
 24%
14/58
   
MateFinder 9 64-bit3316   36%
14.5/40
27%
8/30
     
Komodo 10.4 64-bit3307      32%
24/76
 29%
15/52
 
Houdini 5.01 64-bit3303    38%
19.5/52
 22%
18/80
   
Stockfish 8 64-bit3303    28%
15.5/56
 32%
34/105
 28%
14.5/52
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Komodo 10.2 64-bit3293      31%
19.5/62
 28%
14.5/52
 
Deep Shredder 13 64-bit 4CPU329060%
24/40
47%
15/32
45%
17/38
  50%
1/2
    
Komodo 8 64-bit 4CPU3290     30%
10.5/35
 34%
17/50
  
Fizbo 2 64-bit 4CPU328455%
22/40
50%
16/32
        
Stockfish 5 64-bit 4CPU3273     39%
13.5/35
 26%
20/77
  
Komodo 10.3 64-bit3272      41%
21.5/52
 33%
17/52
 
Fizbo 1.9 64-bit 4CPU3262 59%
19.5/33
44%
14/32
       
Andscacs 0.93 64-bit 4CPU324864%
25.5/40
55%
17.5/32
        
Houdini 4 64-bit 4CPU324765%
13/20
    45%
33.5/75
 29%
10/34
  
Houdini 4 Tactical 64-bit 4CPU3236     50%
2/4
 37%
12.5/34
  
Andscacs 0.88 64-bit 4CPU3228  62%
2.5/4
  100%
1/1
    
Booot 6.2 64-bit 4CPU322569%
27.5/40
62%
20/32
59%
19/32
       
Komodo 8 64-bit3206      50%
2/4
 36%
17/47
29%
11.5/40
Fritz 16 64-bit 4CPU320370%
28/40
66%
33/50
        
Shredder 13 64-bit3201   62%
25/40
56%
35/62
 48%
40.5/84
 32%
16.5/52
 
Chiron 4 64-bit 4CPU319968%
27/40
62%
20/32
66%
21/32
       
Stockfish 5 64-bit3195        36%
16/44
30%
28/92
NirvanaChess 2.4 64-bit 4CPU318974%
29.5/40
61%
19.5/32
64%
20.5/32
 59%
23.5/40
     
Fizbo 2 64-bit3188   63%
26.5/42
54%
37.5/70
     
Gull 3 64-bit 4CPU318668%
27/40
62%
20/32
60%
21.5/36
  52%
28/54
 42%
12.5/30
  
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Fizbo 1.8 64-bit 4CPU3185  88%
3.5/4
  54%
19.5/36
    
Gull 2.8b 64-bit 4CPU3183     51%
21.5/42
 50%
1/2
  
Equinox 3.20 64-bit 4CPU3181 69%
22/32
70%
22.5/32
  55%
39.5/72
 44%
14/32
  
Fizbo 1.9 64-bit3178    54%
41.5/77
 51%
43.5/86
   
Booot 6.1 64-bit 4CPU3173  60%
21.5/36
  25%
0.5/2
    
Andscacs 0.93 64-bit3172   67%
27.5/41
57%
39/68
     
Houdini 4 64-bit3170        47%
31/66
27%
12/44
Equinox 3.30 64-bit 4CPU3167 50%
0.5/1
75%
3/4
  55%
23/42
    
Fritz 15 64-bit 4CPU3167  68%
24.5/36
  56%
22.5/40
    
Critter 1.6a 64-bit 4CPU3164 64%
20.5/32
64%
23/36
  61%
54/88
 50%
17/34
  
Hannibal 1.7 64-bit 4CPU3160  68%
24.5/36
  62%
28.5/46
    
NirvanaChess 2.3 64-bit 4CPU3158  62%
2.5/4
  61%
22/36
    
Bouquet 1.8 64-bit 4CPU3154     61%
36.5/60
 49%
16.5/34
  
Rybka 4.1 64-bit 4CPU3149     56%
9/16
 39%
12.5/32
  
Booot 6.2 64-bit3145   69%
27.5/40
62%
42/68
 54%
38/71
   
Andscacs 0.91 64-bit3143    62%
33/53
 62%
39.5/64
   
Protector 1.9.0 64-bit 4CPU3143 100%
1/1
   50%
11.5/23
    
DeepSaros 4.1.6 64-bit 4CPU3132     50%
1/2
 75%
1.5/2
  
BlackMamba 2.0 64-bit 4CPU3127     60%
21.5/36
 57%
19.5/34
  
Roc 0.7 64-bit3121   100%
2/2
61%
41.5/68
 58%
38.5/66
   
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Gull 3 64-bit3120   75%
30/40
58%
30/52
 58%
40.5/70
 53%
51/97
46%
37/80
Houdini 1.5a 64-bit3119      50%
2/4
 56%
18/32
45%
4.5/10
Fizbo 1.8 64-bit3116      61%
40.5/66
 51%
28.5/56
 
Andscacs 0.88 64-bit3114      62%
38.5/62
 62%
32/52
 
Chiron 4 64-bit3112   74%
29.5/40
62%
32/52
 62%
42/68
   
Strelka 5.5 64-bit310686%
34.5/40
83%
26.5/32
 78%
31/40
69%
36/52
 61%
34/56
 54%
28/52
41%
21.5/52
NirvanaChess 2.4 64-bit3105   80%
33/41
66%
45/68
 61%
35.5/58
   
Critter 1.6a 64-bit3103   76%
30.5/40
66%
34.5/52
 53%
29.5/56
 55%
38.5/70
44%
29/66
Fritz 16 64-bit3100   71%
28.5/40
67%
40/60
     
Naum 4.6 64-bit 4CPU3099     67%
4/6
 56%
18/32
  
Equinox 3.20 64-bit3098    63%
33/52
 60%
31/52
 63%
19/30
46%
15.5/34
Fritz 15 64-bit3098      58%
30/52
 57%
28.5/50
 
Hannibal 1.7 64-bit3084   75%
1.5/2
78%
12.5/16
 65%
43.5/67
 60%
24/40
 
Rybka 4.1 64-bit3081        59%
23.5/40
53%
24.5/46
Booot 6.1 64-bit3079      55%
6/11
 55%
5.5/10
 
Rybka 4 64-bit3079    76%
39.5/52
 72%
37.5/52
 56%
31.5/56
 
Xiphos 0.3 64-bit3079   75%
1.5/2
  69%
5.5/8
   
Bouquet 1.8 64-bit3077      67%
35/52
 59%
40/68
51%
40/78
NirvanaChess 2.3 64-bit3076      73%
11/15
 54%
19.5/36
 
Texel 1.07 64-bit3076   88%
37/42
77%
18.5/24
     
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Laser 1.5 64-bit3072   70%
28/40
75%
21/28
     
Sting SF 4.7 64-bit3067        62%
21/34
53%
18/34
Protector 1.9.0 64-bit3063    50%
2/4
 60%
9/15
 64%
36/56
 
BlackMamba 2.0 64-bit3058        66%
46.5/70
52%
33.5/64
Texel 1.06 64-bit3044      77%
11.5/15
 75%
13.5/18
 
Sting SF 8.5 64-bit3042    75%
3/4
 50%
0.5/1
   
iCE 3.0 64-bit3042    88%
3.5/4
 78%
12.5/16
 58%
15/26
 
Deep Fritz 14 64-bit 1CPU3021        66%
21/32
65%
19.5/30
Chiron 2 64-bit3016        67%
20/30
58%
21/36
Naum 4.6 64-bit3015        76%
38/50
60%
20.5/34
Protector 1.7.0 64-bit3012        75%
3/4
74%
25/34
SmarThink 1.96 64-bit3008      75%
1.5/2
 75%
3/4
 
Sting SF 7.3 64-bit3008      94%
7.5/8
 75%
3/4
 
Hannibal 1.4b 64-bit3003        88%
3.5/4
57%
32/56
SmarThink 1.97 64-bit2997    75%
3/4
 80%
4/5
   
Senpai 1.0 64-bit2963        88%
3.5/4
71%
32.5/46
Andscacs 0.80 64-bit2962        88%
3.5/4
60%
6/10
Hakkapeliitta 3.0 64-bit2955      75%
3/4
 69%
5.5/8
 
SmarThink 1.70 64-bit2919        100%
4/4
75%
3/4
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on July 7, 2018