CCRL 40/15
Downloads and Statistics
January 24, 2021
Testing summary:
Total: 1'209'412 games
played by 2'772 programs

White wins: 415'904 (34.4%)
Black wins: 306'459 (25.3%)
Draws: 487'049 (40.3%)
White score: 54.5%

Custom engine selection

Comparing 10 engines!
10 selected engines played 40 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on January 24, 2021 with Bayeselo based on 1'209'412 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Fire 7.1 64-bit 4CPU3323+11−1150.6%−4.662.2%2422 
100.0%
 Fire 6.1 64-bit 4CPU3287+18−1848.5%+7.558.4%940
95.6%
 Fire 5 64-bit 4CPU3265+18−1846.9%+17.862.5%867
75.2%
 Fire 7.1 64-bit3257+8−749.4%+2.959.6%5562
100.0%
 Fire 6.1 64-bit3203+12−1253.0%−18.855.5%2104
69.7%
 Fire 4 64-bit 4CPU3198+13−1346.5%+21.859.7%1885
99.3%
 Fire 5 64-bit3174+12−1251.3%−6.758.2%1874
98.2%
 Fire 3.0 64-bit 4CPU3149+17−1749.5%+3.058.2%948
68.7%
 Fire 4 64-bit3144+11−1052.7%−17.057.0%2807
100.0%
 Fire 3.0 64-bit3078+14−1450.1%−1.557.2%1483
 

Results matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3323          
2Fire 6.1 64-bit 4CPU3287          
3Fire 5 64-bit 4CPU3265          
4Fire 7.1 64-bit3257    20.5 − 19.5
+4−3=33
−48
     
5Fire 6.1 64-bit3203   19.5 − 20.5
+3−4=33
+48
      
6Fire 4 64-bit 4CPU3198          
7Fire 5 64-bit3174          
8Fire 3.0 64-bit 4CPU3149          
9Fire 4 64-bit3144          
10Fire 3.0 64-bit3078          
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3323 100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Fire 6.1 64-bit 4CPU32870.0 95.699.8100.0100.0100.0100.0100.0100.0
3Fire 5 64-bit 4CPU32650.04.4 75.2100.0100.0100.0100.0100.0100.0
4Fire 7.1 64-bit32570.00.224.8 100.0100.0100.0100.0100.0100.0
5Fire 6.1 64-bit32030.00.00.00.0 69.7100.0100.0100.0100.0
6Fire 4 64-bit 4CPU31980.00.00.00.030.3 99.3100.0100.0100.0
7Fire 5 64-bit31740.00.00.00.00.00.7 98.2100.0100.0
8Fire 3.0 64-bit 4CPU31490.00.00.00.00.00.01.8 68.7100.0
9Fire 4 64-bit31440.00.00.00.00.00.00.031.3 100.0
10Fire 3.0 64-bit30780.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3323 102447680172160961249292
2Fire 6.1 64-bit 4CPU32871024 850186244355881928484
3Fire 5 64-bit 4CPU3265476850 072649020000
4Fire 7.1 64-bit3257801860 218009190644360
5Fire 6.1 64-bit3203172244722180 020940859440
6Fire 4 64-bit 4CPU319816035564900 082600
7Fire 5 64-bit31749688091920940 02034620
8Fire 3.0 64-bit 4CPU3149124192200008260 00
9Fire 4 64-bit314492840644859020340 1542
10Fire 3.0 64-bit307892840360440062001542 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910
1Fire 7.1 64-bit 4CPU3323 30.514.51.03.83.72.23.71.82.4
2Fire 6.1 64-bit 4CPU328730.5 47.02.98.012.63.110.22.23.5
3Fire 5 64-bit 4CPU326514.547.0 0.02.423.60.011.00.00.0
4Fire 7.1 64-bit32571.02.90.0 28.40.012.40.07.75.1
5Fire 6.1 64-bit32033.88.02.428.4 0.052.60.017.512.3
6Fire 4 64-bit 4CPU31983.712.623.60.00.0 0.029.20.00.0
7Fire 5 64-bit31742.23.10.012.452.60.0 0.043.518.5
8Fire 3.0 64-bit 4CPU31493.710.211.00.00.029.20.0 0.00.0
9Fire 4 64-bit31441.82.20.07.717.50.043.50.0 35.9
10Fire 3.0 64-bit30782.43.50.05.112.30.018.50.035.9 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 102 common opponents

Custom engine selection
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Stockfish 9 64-bit 4CPU343128%
11/40
27%
13.5/50
        
SugaR XPrO 1.4 64-bit 4CPU341039%
15.5/40
34%
17/50
        
Houdini 6 64-bit 4CPU340138%
12/32
27%
9/33
33%
19/57
       
SugaR XPrO 1.2 64-bit 4CPU3399 27%
8.5/32
25%
8/32
       
Komodo 12 64-bit 4CPU339435%
14/40
33%
16.5/50
        
Komodo 11.2 64-bit 4CPU3392 32%
10.5/33
32%
21.5/68
       
Stockfish 8 64-bit 4CPU3378 35%
11/31
28%
10/36
  25%
8.5/34
    
SugaR XPrO 1.4 64-bit3366   30%
18/61
23%
13.5/58
     
Stockfish 9 64-bit3365 39%
15.5/40
 30%
22/74
21%
10/48
     
Komodo 10.1 64-bit 4CPU3362  23%
7/30
  28%
9.5/34
    
Komodo 10.2 64-bit 4CPU3354  50%
2/4
  29%
9.5/33
    
Houdini 6 64-bit3336   37%
27.5/74
24%
15.5/64
     
Komodo 11.3.1 64-bit3322   38%
19.5/52
30%
15.5/52
     
Komodo 11.2 64-bit3320   46%
18.5/40
35%
18/52
 26%
15.5/60
   
Komodo 12 64-bit3315   38%
25/65
29%
15/52
     
Houdini 6 Tactical 64-bit3313   35%
14/40
27%
13.5/50
     
SugaR XPrO 1.2 64-bit3313    29%
16.5/56
 24%
14/58
   
MateFinder 9 64-bit3312   36%
14.5/40
27%
8/30
     
Komodo 10.4 64-bit3304      32%
24/76
 29%
15/52
 
Stockfish 8 64-bit3300    28%
15.5/56
 32%
34/105
 28%
14.5/52
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Houdini 5.01 64-bit3299    38%
19.5/52
 22%
18/80
   
Komodo 10.2 64-bit3289      31%
19.5/62
 28%
14.5/52
 
Komodo 8 64-bit 4CPU3284     30%
10.5/35
 34%
17/50
  
Deep Shredder 13 64-bit 4CPU327961%
34/56
47%
15/32
45%
17/38
  50%
1/2
    
Fizbo 2 64-bit 4CPU327355%
25.5/46
50%
16/32
        
Stockfish 5 64-bit 4CPU3269     39%
13.5/35
 26%
20/77
  
Komodo 10.3 64-bit3268      41%
21.5/52
 33%
17/52
 
Komodo 10 64-bit3260   50%
26/52
    29%
15.5/54
 
Fizbo 1.9 64-bit 4CPU3254 59%
19.5/33
44%
14/32
       
Houdini 4 64-bit 4CPU324165%
13/20
    45%
33.5/75
 29%
10/34
  
Andscacs 0.93 64-bit 4CPU323964%
25.5/40
55%
17.5/32
        
Houdini 4 Tactical 64-bit 4CPU3230     50%
2/4
 37%
12.5/34
  
Booot 6.2 64-bit 4CPU321669%
27.5/40
62%
20/32
59%
19/32
       
Andscacs 0.88 64-bit 4CPU3212  62%
2.5/4
  100%
1/1
    
Komodo 8 64-bit3204      50%
2/4
 36%
17/47
29%
11.5/40
Shredder 13 64-bit3199   63%
35.5/56
56%
35/62
 48%
40.5/84
 32%
16.5/52
 
Fizbo 2 64-bit3196   63%
53.5/85
54%
37.5/70
     
Fritz 16 64-bit 4CPU319270%
28/40
66%
33/50
        
Stockfish 5 64-bit3192        36%
16/44
30%
28/92
Chiron 4 64-bit 4CPU318968%
28/41
62%
20/32
66%
21/32
       
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Gull 3 64-bit 4CPU318068%
27/40
62%
20/32
60%
21.5/36
  52%
28/54
 42%
12.5/30
  
NirvanaChess 2.4 64-bit 4CPU318074%
29.5/40
61%
19.5/32
64%
20.5/32
 59%
23.5/40
     
Fizbo 1.8 64-bit 4CPU3179  88%
3.5/4
  54%
19.5/36
    
Gull 2.8b 64-bit 4CPU3178     51%
21.5/42
 50%
1/2
  
Fizbo 1.9 64-bit3174    54%
41.5/77
 51%
43.5/86
   
Equinox 3.20 64-bit 4CPU3173 69%
22/32
70%
22.5/32
  55%
39.5/72
 44%
14/32
  
Andscacs 0.93 64-bit3169   67%
28/42
57%
39/68
     
Booot 6.1 64-bit 4CPU3167  60%
21.5/36
  25%
0.5/2
    
Houdini 4 64-bit3167        47%
31/66
27%
12/44
Equinox 3.30 64-bit 4CPU3161 50%
0.5/1
75%
3/4
  55%
23/42
    
Fritz 15 64-bit 4CPU3161  68%
24.5/36
  56%
22.5/40
    
Critter 1.6a 64-bit 4CPU3159 64%
20.5/32
64%
23/36
  61%
54/88
 50%
17/34
  
Hannibal 1.7 64-bit 4CPU3155  68%
24.5/36
  62%
28.5/46
    
NirvanaChess 2.3 64-bit 4CPU3152  62%
2.5/4
  61%
22/36
    
Bouquet 1.8 64-bit 4CPU3149     61%
36.5/60
 49%
16.5/34
  
Rybka 4.1 64-bit 4CPU3144     56%
9/16
 39%
12.5/32
  
Booot 6.2 64-bit3142   69%
27.5/40
62%
42/68
 54%
38/71
   
Andscacs 0.91 64-bit3139    62%
33/53
 62%
39.5/64
   
Protector 1.9.0 64-bit 4CPU3138 100%
1/1
   50%
11.5/23
    
DeepSaros 4.1.6 64-bit 4CPU3127     50%
1/2
 75%
1.5/2
  
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
BlackMamba 2.0 64-bit 4CPU3122     60%
21.5/36
 57%
19.5/34
  
Gull 3 64-bit3118   75%
30/40
58%
30/52
 58%
40.5/70
 53%
51/97
46%
37/80
Chiron 4 64-bit3114   74%
29.5/40
62%
32/52
 62%
42/68
   
Roc 0.7 64-bit3114   88%
3.5/4
61%
41.5/68
 58%
38.5/66
   
Fizbo 1.8 64-bit3113      61%
40.5/66
 51%
28.5/56
 
Andscacs 0.88 64-bit3111      62%
38.5/62
 62%
32/52
 
Houdini 1.5a 64-bit3109   80%
41.5/52
  50%
2/4
 56%
18/32
45%
4.5/10
Strelka 5.5 64-bit310386%
34.5/40
83%
26.5/32
 78%
31/40
69%
36/52
 61%
34/56
 54%
28/52
41%
21.5/52
Fritz 16 64-bit3100   70%
31.5/45
67%
40/60
     
Critter 1.6a 64-bit3099   76%
30.5/40
66%
34.5/52
 53%
29.5/56
 55%
38.5/70
44%
29/66
NirvanaChess 2.4 64-bit3099   79%
41/52
66%
45/68
 61%
35.5/58
   
Naum 4.6 64-bit 4CPU3095     67%
4/6
 56%
18/32
  
Equinox 3.20 64-bit3094    63%
33/52
 60%
31/52
 63%
19/30
46%
15.5/34
Fritz 15 64-bit3093      58%
30/52
 57%
28.5/50
 
Xiphos 0.3 64-bit3091   88%
3.5/4
  75%
15/20
   
Hannibal 1.7 64-bit3079   75%
3/4
78%
12.5/16
 65%
43.5/67
 60%
24/40
 
Rybka 4.1 64-bit3077   62%
2.5/4
    59%
23.5/40
53%
24.5/46
Booot 6.1 64-bit3076      55%
6/11
 55%
5.5/10
 
Rybka 4 64-bit3075    76%
39.5/52
 72%
37.5/52
 56%
31.5/56
 
Texel 1.07 64-bit3074   88%
38.5/44
77%
18.5/24
     
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Bouquet 1.8 64-bit3073      67%
35/52
 59%
40/68
51%
40/78
Laser 1.5 64-bit3071   70%
28/40
75%
21/28
     
NirvanaChess 2.3 64-bit3071      73%
11/15
 54%
19.5/36
 
Sting SF 4.7 64-bit3064        62%
21/34
53%
18/34
Protector 1.9.0 64-bit3057    50%
2/4
 60%
9/15
 64%
36/56
 
BlackMamba 2.0 64-bit3055        66%
46.5/70
52%
33.5/64
Texel 1.06 64-bit3041      77%
11.5/15
 75%
13.5/18
 
iCE 3.0 64-bit3040    88%
3.5/4
 78%
12.5/16
 58%
15/26
 
Sting SF 8.5 64-bit3039    75%
3/4
 50%
0.5/1
   
Deep Fritz 14 64-bit 1CPU3017        66%
21/32
65%
19.5/30
Chiron 2 64-bit3014        67%
20/30
58%
21/36
Naum 4.6 64-bit3011        76%
38/50
60%
20.5/34
Protector 1.7.0 64-bit3009        75%
3/4
74%
25/34
SmarThink 1.96 64-bit3005      75%
1.5/2
 75%
3/4
 
Sting SF 7.3 64-bit3003      94%
7.5/8
 75%
3/4
 
Hannibal 1.4b 64-bit3000        88%
3.5/4
57%
32/56
SmarThink 1.97 64-bit2994    75%
3/4
 80%
4/5
   
Andscacs 0.80 64-bit2960        88%
3.5/4
60%
6/10
Senpai 1.0 64-bit2960        88%
3.5/4
71%
32.5/46
Hakkapeliitta 3.0 64-bit2953      75%
3/4
 69%
5.5/8
 
NameEloFire
7.1
64-bit
4CPU
Fire
6.1
64-bit
4CPU
Fire
5
64-bit
4CPU
Fire
7.1
64-bit
Fire
6.1
64-bit
Fire
4
64-bit
4CPU
Fire
5
64-bit
Fire
3.0
64-bit
4CPU
Fire
4
64-bit
Fire
3.0
64-bit
Deep Sjeng c't 20102940   100%
2/2
75%
1.5/2
     
SmarThink 1.70 64-bit2917        100%
4/4
75%
3/4
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on January 24, 2021