CCRL 40/15
Downloads and Statistics
April 18, 2021
Testing summary:
Total: 1'237'253 games
played by 2'822 programs

White wins: 424'164 (34.3%)
Black wins: 311'650 (25.2%)
Draws: 501'439 (40.5%)
White score: 54.5%

Custom engine selection

Comparing 12 engines!
12 selected engines played 40 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on April 18, 2021 with Bayeselo based on 1'237'253 games
Please refer to the "about" page for comments on engine inclusion

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 8 64-bit 4CPU3387+17−1748.6%+11.966.4%896 
100.0%
 Fire 8 64-bit3328+17−1744.4%+39.458.9%996
76.8%
 Fire 7.1 64-bit 4CPU3320+11−1048.6%+9.361.0%2672
99.9%
 Fire 6.1 64-bit 4CPU3285+18−1848.5%+7.958.4%940
95.6%
 Fire 5 64-bit 4CPU3263+18−1846.9%+18.262.5%867
69.4%
 Fire 7.1 64-bit3258+7−848.5%+8.959.2%5961
100.0%
 Fire 6.1 64-bit3202+12−1253.0%−18.155.5%2104
72.4%
 Fire 4 64-bit 4CPU3197+13−1346.5%+21.759.7%1885
99.2%
 Fire 5 64-bit3173+13−1351.3%−6.058.2%1874
98.4%
 Fire 3.0 64-bit 4CPU3148+17−1749.5%+3.058.2%948
66.5%
 Fire 4 64-bit3144+10−1152.7%−17.457.0%2807
100.0%
 Fire 3.0 64-bit3078+14−1450.1%−1.757.2%1483
 

Results matrix

Custom engine selection
#NameElo123456789101112
1Fire 8 64-bit 4CPU3387            
2Fire 8 64-bit3328            
3Fire 7.1 64-bit 4CPU3320            
4Fire 6.1 64-bit 4CPU3285            
5Fire 5 64-bit 4CPU3263            
6Fire 7.1 64-bit3258      20.5 − 19.5
+4−3=33
−50
     
7Fire 6.1 64-bit3202     19.5 − 20.5
+3−4=33
+50
      
8Fire 4 64-bit 4CPU3197            
9Fire 5 64-bit3173            
10Fire 3.0 64-bit 4CPU3148            
11Fire 4 64-bit3144            
12Fire 3.0 64-bit3078            
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo123456789101112
1Fire 8 64-bit 4CPU3387 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 8 64-bit33280.0 76.899.9100.0100.0100.0100.0100.0100.0100.0100.0
3Fire 7.1 64-bit 4CPU33200.023.2 99.9100.0100.0100.0100.0100.0100.0100.0100.0
4Fire 6.1 64-bit 4CPU32850.00.10.1 95.699.6100.0100.0100.0100.0100.0100.0
5Fire 5 64-bit 4CPU32630.00.00.04.4 69.4100.0100.0100.0100.0100.0100.0
6Fire 7.1 64-bit32580.00.00.00.430.6 100.0100.0100.0100.0100.0100.0
7Fire 6.1 64-bit32020.00.00.00.00.00.0 72.4100.0100.0100.0100.0
8Fire 4 64-bit 4CPU31970.00.00.00.00.00.027.6 99.2100.0100.0100.0
9Fire 5 64-bit31730.00.00.00.00.00.00.00.8 98.4100.0100.0
10Fire 3.0 64-bit 4CPU31480.00.00.00.00.00.00.00.01.6 66.5100.0
11Fire 4 64-bit31440.00.00.00.00.00.00.00.00.033.5 100.0
12Fire 3.0 64-bit30780.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo123456789101112
1Fire 8 64-bit 4CPU3387 104104087111174000000
2Fire 8 64-bit3328104 000164711600000
3Fire 7.1 64-bit 4CPU332010400 102447680172160961249292
4Fire 6.1 64-bit 4CPU32858701024 850186244355881928484
5Fire 5 64-bit 4CPU32631110476850 072649020000
6Fire 7.1 64-bit32581741647801860 218009190644360
7Fire 6.1 64-bit32020116172244722180 020940859440
8Fire 4 64-bit 4CPU31970016035564900 082600
9Fire 5 64-bit3173009688091920940 02034620
10Fire 3.0 64-bit 4CPU314800124192200008260 00
11Fire 4 64-bit31440092840644859020340 1542
12Fire 3.0 64-bit30780092840360440062001542 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo123456789101112
1Fire 8 64-bit 4CPU3387 5.529.14.76.32.50.00.00.00.00.00.0
2Fire 8 64-bit33285.5 0.00.00.023.73.70.00.00.00.00.0
3Fire 7.1 64-bit 4CPU332029.10.0 28.313.50.93.63.52.13.41.72.2
4Fire 6.1 64-bit 4CPU32854.70.028.3 47.02.78.012.63.110.22.23.5
5Fire 5 64-bit 4CPU32636.30.013.547.0 0.02.423.60.011.00.00.0
6Fire 7.1 64-bit32582.523.70.92.70.0 27.00.011.70.07.34.8
7Fire 6.1 64-bit32020.03.73.68.02.427.0 0.052.60.017.512.3
8Fire 4 64-bit 4CPU31970.00.03.512.623.60.00.0 0.029.20.00.0
9Fire 5 64-bit31730.00.02.13.10.011.752.60.0 0.043.518.5
10Fire 3.0 64-bit 4CPU31480.00.03.410.211.00.00.029.20.0 0.00.0
11Fire 4 64-bit31440.00.01.72.20.07.317.50.043.50.0 35.9
12Fire 3.0 64-bit30780.00.02.23.50.04.812.30.018.50.035.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 129 common opponents

Custom engine selection
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Stockfish 2021-01-11 64-bit 4CPU355121%
11.5/54
 12%
6/50
         
Fat Fritz 2 (in SF) 64-bit 4CPU352523%
12.5/54
 14%
4.5/32
         
Stockfish 2021-01-11 64-bit3520 25%
13/52
   12%
6.5/52
      
Fat Fritz 2 (in SF) 64-bit3509 21%
11/52
   12%
6.5/52
      
Dragon by Komodo 64-bit 4CPU349734%
18.5/54
 16%
5/32
         
SugaR AI 1.00 64-bit3493 20%
10.5/52
   19%
10/52
      
ShashChess 15.0 64-bit3485 26%
14/54
   16%
8.5/52
      
Dragon by Komodo 64-bit3472 32%
16.5/52
   15%
8/52
      
Stockfish 9 64-bit 4CPU3429  28%
11/40
27%
13.5/50
        
SugaR XPrO 1.4 64-bit 4CPU3408  39%
15.5/40
34%
17/50
        
Houdini 6 64-bit 4CPU339849%
26.5/54
 38%
12/32
27%
9/33
33%
19/57
       
SugaR XPrO 1.2 64-bit 4CPU3397   27%
8.5/32
25%
8/32
       
SlowChess Blitz 2.5 64-bit 4CPU339650%
27/54
 44%
14/32
         
Komodo 12 64-bit 4CPU3393  35%
14/40
33%
16.5/50
        
Ethereal 12.75 64-bit 4CPU339251%
27.5/54
 38%
11.5/30
         
Komodo 11.2 64-bit 4CPU3390   32%
10.5/33
32%
21.5/68
       
Nemorino 6.00 64-bit 4CPU338447%
24.5/52
 45%
14.5/32
         
Stockfish 8 64-bit 4CPU3376   35%
11/31
28%
10/36
  25%
8.5/34
    
SugaR XPrO 1.4 64-bit3366     30%
18/61
23%
13.5/58
     
Stockfish 9 64-bit3365   39%
15.5/40
 30%
22/74
21%
10/48
     
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Igel 2.9.0 64-bit 4CPU336155%
28.5/52
 46%
17.5/38
         
Komodo 10.1 64-bit 4CPU3361    23%
7/30
  28%
9.5/34
    
RubiChess 2.0 64-bit 4CPU335746%
23/50
 48%
15.5/32
         
Komodo 10.2 64-bit 4CPU3353    50%
2/4
  29%
9.5/33
    
Nemorino 6.00 64-bit334351%
26.5/52
51%
26.5/52
   38%
20/52
      
Houdini 6 64-bit3335 48%
25/52
   37%
27.5/74
24%
15.5/64
     
Lc0 0.27.0 w703810 64-bit 4CPU333560%
21.5/36
    46%
15.5/34
      
Xiphos 0.6 64-bit 4CPU333066%
34.5/52
 50%
16/32
         
SlowChess Blitz 2.5 64-bit3329 45%
25/56
   37%
19/52
      
Komodo 11.3.1 64-bit3322     38%
19.5/52
30%
15.5/52
     
Ethereal 12.75 64-bit3320 57%
32/56
   43%
22.5/52
      
Komodo 11.2 64-bit3319     46%
18.5/40
35%
18/52
 26%
15.5/60
   
Komodo 12 64-bit3314     38%
25/65
29%
15/52
     
Houdini 6 Tactical 64-bit3312     35%
14/40
27%
13.5/50
     
MateFinder 9 64-bit3312     36%
14.5/40
27%
8/30
     
SugaR XPrO 1.2 64-bit3312      29%
16.5/56
 24%
14/58
   
RofChade 2.3 64-bit 4CPU331168%
35.5/52
 55%
17.5/32
         
Komodo 10.4 64-bit3304        32%
24/76
 29%
15/52
 
Pedone 3.0 64-bit 4CPU330465%
34/52
 56%
18/32
         
Stockfish 8 64-bit3300      28%
15.5/56
 32%
34/105
 28%
14.5/52
 
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Houdini 5.01 64-bit3299      38%
19.5/52
 22%
18/80
   
Komodo 10.2 64-bit3289        31%
19.5/62
 28%
14.5/52
 
Nemorino 6.05 64-bit3289 62%
36/58
   46%
24/52
      
Komodo 8 64-bit 4CPU3283       30%
10.5/35
 34%
17/50
  
Deep Shredder 13 64-bit 4CPU3277  61%
34/56
47%
15/32
45%
17/38
  50%
1/2
    
RubiChess 2.0 NN-375bd 64-bit3277 59%
33/56
   51%
26/51
      
Igel 2.9.0 64-bit3272 57%
32/56
   51%
26.5/52
      
Fizbo 2 64-bit 4CPU3270  55%
25.5/46
50%
16/32
        
Komodo 10.3 64-bit3268        41%
21.5/52
 33%
17/52
 
Stockfish 5 64-bit 4CPU3268       39%
13.5/35
 26%
20/77
  
Komodo 10 64-bit3259     50%
26/52
    29%
15.5/54
 
Fizbo 1.9 64-bit 4CPU3253   59%
19.5/33
44%
14/32
       
Xiphos 0.6 64-bit3253 67%
37.5/56
   49%
35.5/72
      
Pedone 3.0 64-bit3244 55%
28.5/52
   56%
29/52
      
Houdini 4 64-bit 4CPU3240  65%
13/20
    45%
33.5/75
 29%
10/34
  
RofChade 2.3 64-bit3240 65%
36.5/56
   53%
32/60
      
Booot 6.4 64-bit3238 50%
1/2
   58%
39/67
      
Andscacs 0.93 64-bit 4CPU3237  64%
25.5/40
55%
17.5/32
        
Houdini 4 Tactical 64-bit 4CPU3229       50%
2/4
 37%
12.5/34
  
Booot 6.2 64-bit 4CPU3215  69%
27.5/40
62%
20/32
59%
19/32
       
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Andscacs 0.88 64-bit 4CPU3211    62%
2.5/4
  100%
1/1
    
Komodo 8 64-bit3203        50%
2/4
 36%
17/47
29%
11.5/40
Shredder 13 64-bit3198     63%
35.5/56
56%
35/62
 48%
40.5/84
 32%
16.5/52
 
Fizbo 2 64-bit3196     63%
53.5/85
54%
37.5/70
     
Stockfish 5 64-bit3191          36%
16/44
30%
28/92
Fritz 16 64-bit 4CPU3190  70%
28/40
66%
33/50
        
Chiron 4 64-bit 4CPU3188  68%
28/41
62%
20/32
66%
21/32
       
Gull 3 64-bit 4CPU3179  68%
27/40
62%
20/32
60%
21.5/36
  52%
28/54
 42%
12.5/30
  
Fizbo 1.8 64-bit 4CPU3178    88%
3.5/4
  54%
19.5/36
    
NirvanaChess 2.4 64-bit 4CPU3178  74%
29.5/40
61%
19.5/32
64%
20.5/32
 59%
23.5/40
     
Gull 2.8b 64-bit 4CPU3177       51%
21.5/42
 50%
1/2
  
Fizbo 1.9 64-bit3174      54%
41.5/77
 51%
43.5/86
   
Equinox 3.20 64-bit 4CPU3172   69%
22/32
70%
22.5/32
  55%
39.5/72
 44%
14/32
  
Andscacs 0.93 64-bit3169     67%
28/42
57%
39/68
     
Booot 6.1 64-bit 4CPU3166    60%
21.5/36
  25%
0.5/2
    
Houdini 4 64-bit3166          47%
31/66
27%
12/44
Equinox 3.30 64-bit 4CPU3160   50%
0.5/1
75%
3/4
  55%
23/42
    
Fritz 15 64-bit 4CPU3160    68%
24.5/36
  56%
22.5/40
    
Critter 1.6a 64-bit 4CPU3157   64%
20.5/32
64%
23/36
  61%
54/88
 50%
17/34
  
Hannibal 1.7 64-bit 4CPU3153    68%
24.5/36
  62%
28.5/46
    
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
NirvanaChess 2.3 64-bit 4CPU3151    62%
2.5/4
  61%
22/36
    
Bouquet 1.8 64-bit 4CPU3148       61%
36.5/60
 49%
16.5/34
  
Rybka 4.1 64-bit 4CPU3143       56%
9/16
 39%
12.5/32
  
Booot 6.2 64-bit3142     69%
27.5/40
62%
42/68
 54%
38/71
   
Andscacs 0.91 64-bit3139      62%
33/53
 62%
39.5/64
   
Protector 1.9.0 64-bit 4CPU3137   100%
1/1
   50%
11.5/23
    
DeepSaros 4.1.6 64-bit 4CPU3126       50%
1/2
 75%
1.5/2
  
BlackMamba 2.0 64-bit 4CPU3121       60%
21.5/36
 57%
19.5/34
  
Gull 3 64-bit3118     75%
30/40
58%
30/52
 58%
40.5/70
 53%
51/97
46%
37/80
Roc 0.7 64-bit3114     88%
3.5/4
61%
41.5/68
 58%
38.5/66
   
Chiron 4 64-bit3113     74%
29.5/40
62%
32/52
 62%
42/68
   
Fizbo 1.8 64-bit3112        61%
40.5/66
 51%
28.5/56
 
Andscacs 0.88 64-bit3110        62%
38.5/62
 62%
32/52
 
Houdini 1.5a 64-bit3109     80%
41.5/52
  50%
2/4
 56%
18/32
45%
4.5/10
Strelka 5.5 64-bit3102  86%
34.5/40
83%
26.5/32
 78%
31/40
69%
36/52
 61%
34/56
 54%
28/52
41%
21.5/52
Fritz 16 64-bit3100     70%
31.5/45
67%
40/60
     
Critter 1.6a 64-bit3099     76%
30.5/40
66%
34.5/52
 53%
29.5/56
 55%
38.5/70
44%
29/66
NirvanaChess 2.4 64-bit3099     79%
41/52
66%
45/68
 61%
35.5/58
   
Equinox 3.20 64-bit3094      63%
33/52
 60%
31/52
 63%
19/30
46%
15.5/34
Naum 4.6 64-bit 4CPU3094       67%
4/6
 56%
18/32
  
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Fritz 15 64-bit3092        58%
30/52
 57%
28.5/50
 
Xiphos 0.3 64-bit3091     88%
3.5/4
  75%
15/20
   
Hannibal 1.7 64-bit3079     75%
3/4
78%
12.5/16
 65%
43.5/67
 60%
24/40
 
Booot 6.1 64-bit3076        55%
6/11
 55%
5.5/10
 
Rybka 4.1 64-bit3076     62%
2.5/4
    59%
23.5/40
53%
24.5/46
Rybka 4 64-bit3075      76%
39.5/52
 72%
37.5/52
 56%
31.5/56
 
Bouquet 1.8 64-bit3073        67%
35/52
 59%
40/68
51%
40/78
Texel 1.07 64-bit3073     88%
38.5/44
77%
18.5/24
     
Laser 1.5 64-bit3071     70%
28/40
75%
21/28
     
NirvanaChess 2.3 64-bit3071        73%
11/15
 54%
19.5/36
 
Sting SF 4.7 64-bit3063          62%
21/34
53%
18/34
Protector 1.9.0 64-bit3057      50%
2/4
 60%
9/15
 64%
36/56
 
BlackMamba 2.0 64-bit3055          66%
46.5/70
52%
33.5/64
Texel 1.06 64-bit3040        77%
11.5/15
 75%
13.5/18
 
iCE 3.0 64-bit3040      88%
3.5/4
 78%
12.5/16
 58%
15/26
 
Sting SF 8.5 64-bit3039      75%
3/4
 50%
0.5/1
   
Deep Fritz 14 64-bit 1CPU3017          66%
21/32
65%
19.5/30
Chiron 2 64-bit3014          67%
20/30
58%
21/36
Naum 4.6 64-bit3009          76%
38/50
60%
20.5/34
Protector 1.7.0 64-bit3009          75%
3/4
74%
25/34
NameEloFire
8
64-bit
4CPU
Fire
8
64-bit
Fire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
SmarThink 1.96 64-bit3005        75%
1.5/2
 75%
3/4
 
Sting SF 7.3 64-bit3002        94%
7.5/8
 75%
3/4
 
Hannibal 1.4b 64-bit3000          88%
3.5/4
57%
32/56
SmarThink 1.97 64-bit2994      75%
3/4
 80%
4/5
   
Andscacs 0.80 64-bit2960          88%
3.5/4
60%
6/10
Senpai 1.0 64-bit2960          88%
3.5/4
71%
32.5/46
Hakkapeliitta 3.0 64-bit2953        75%
3/4
 69%
5.5/8
 
Deep Sjeng c't 20102940     100%
2/2
75%
1.5/2
     
SmarThink 1.70 64-bit2917          100%
4/4
75%
3/4
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on April 18, 2021