CCRL 40/15
Downloads and Statistics
August 1, 2020
Testing summary:
Total: 1'166'106 games
played by 2'690 programs

White wins: 402'287 (34.5%)
Black wins: 297'247 (25.5%)
Draws: 466'572 (40.0%)
White score: 54.5%

Custom engine selection

Comparing 11 engines!
11 selected engines played 0 games with each other

CCRL 40/15 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on August 1, 2020 with Bayeselo based on 1'166'106 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 200 games or more. Normal font - less than 200 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Komodo 13.2.5 MCTS 64-bit 4CPU3364+20−2053.3%−18.070.8%682 
100.0%
 Komodo 13.3 MCTS 64-bit3294+21−2151.2%−6.963.0%649
51.2%
 Komodo 12.3 MCTS 64-bit 4CPU3293+22−2247.0%+18.655.0%604
56.6%
 Komodo 14 MCTS 64-bit3291+22−2243.4%+40.859.4%577
80.8%
 Komodo 13.2.5 MCTS 64-bit3278+16−1646.1%+24.861.4%1114
55.9%
 Komodo 13.01 MCTS 64-bit3277+18−1752.2%−12.563.2%904
50.5%
 Komodo 12.2.2 MCTS 64-bit 4CPU3276+23−2353.9%−23.655.4%560
99.9%
 Komodo 12.3 MCTS 64-bit3234+14−1450.4%−2.854.6%1616
97.8%
 Komodo 12.2.2 MCTS 64-bit3213+16−1662.4%−83.645.3%1350
99.6%
 Komodo 12.1.1 MCTS 64-bit 4CPU3182+16−1649.9%−1.349.3%1142
100.0%
 Komodo 12.1.1 MCTS 64-bit3080+15−1546.9%+23.939.9%1430
 

Results matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3364           
2Komodo 13.3 MCTS 64-bit3294           
3Komodo 12.3 MCTS 64-bit 4CPU3293           
4Komodo 14 MCTS 64-bit3291           
5Komodo 13.2.5 MCTS 64-bit3278           
6Komodo 13.01 MCTS 64-bit3277           
7Komodo 12.2.2 MCTS 64-bit 4CPU3276           
8Komodo 12.3 MCTS 64-bit3234           
9Komodo 12.2.2 MCTS 64-bit3213           
10Komodo 12.1.1 MCTS 64-bit 4CPU3182           
11Komodo 12.1.1 MCTS 64-bit3080           
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3364 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Komodo 13.3 MCTS 64-bit32940.0 51.258.587.989.386.0100.0100.0100.0100.0
3Komodo 12.3 MCTS 64-bit 4CPU32930.048.8 56.684.686.785.4100.0100.0100.0100.0
4Komodo 14 MCTS 64-bit32910.041.543.4 80.883.080.0100.0100.0100.0100.0
5Komodo 13.2.5 MCTS 64-bit32780.012.115.419.2 55.955.4100.0100.0100.0100.0
6Komodo 13.01 MCTS 64-bit32770.010.713.317.044.1 50.5100.0100.0100.0100.0
7Komodo 12.2.2 MCTS 64-bit 4CPU32760.014.014.620.044.649.5 99.9100.0100.0100.0
8Komodo 12.3 MCTS 64-bit32340.00.00.00.00.00.00.1 97.8100.0100.0
9Komodo 12.2.2 MCTS 64-bit32130.00.00.00.00.00.00.02.2 99.6100.0
10Komodo 12.1.1 MCTS 64-bit 4CPU31820.00.00.00.00.00.00.00.00.4 100.0
11Komodo 12.1.1 MCTS 64-bit30800.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3364 0428000216002360
2Komodo 13.3 MCTS 64-bit32940 0791946312923481840184
3Komodo 12.3 MCTS 64-bit 4CPU32934280 00072006240062
4Komodo 14 MCTS 64-bit329107910 7631683613296096
5Komodo 13.2.5 MCTS 64-bit327809460763 1040928925820368
6Komodo 13.01 MCTS 64-bit3277031201681040 9213465820368
7Komodo 12.2.2 MCTS 64-bit 4CPU327621692720369292 120240670240
8Komodo 12.3 MCTS 64-bit3234034801328921346120 11920690
9Komodo 12.2.2 MCTS 64-bit3213018462965825822401192 1701200
10Komodo 12.1.1 MCTS 64-bit 4CPU318223604000006700170 440
11Komodo 12.1.1 MCTS 64-bit3080018462963683682406901200440 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo1234567891011
1Komodo 13.2.5 MCTS 64-bit 4CPU3364 0.033.30.00.00.017.40.00.012.90.0
2Komodo 13.3 MCTS 64-bit32940.0 0.064.553.720.17.615.49.20.08.9
3Komodo 12.3 MCTS 64-bit 4CPU329333.30.0 0.00.00.061.90.03.222.93.0
4Komodo 14 MCTS 64-bit32910.064.50.0 45.111.33.26.05.00.04.8
5Komodo 13.2.5 MCTS 64-bit32780.053.70.045.1 51.55.532.723.60.014.5
6Komodo 13.01 MCTS 64-bit32770.020.10.011.351.5 6.353.425.80.015.8
7Komodo 12.2.2 MCTS 64-bit 4CPU327617.47.661.93.25.56.3 5.512.639.412.1
8Komodo 12.3 MCTS 64-bit32340.015.40.06.032.753.45.5 40.20.022.7
9Komodo 12.2.2 MCTS 64-bit32130.09.23.25.023.625.812.640.2 6.843.2
10Komodo 12.1.1 MCTS 64-bit 4CPU318212.90.022.90.00.00.039.40.06.8 17.1
11Komodo 12.1.1 MCTS 64-bit30800.08.93.04.814.515.812.122.743.217.1 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 61 common opponents

Custom engine selection
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Stockfish 2019-10-09 64-bit 4CPU349433%
10.5/32
 30%
3/10
        
ShashChess 8.0 64-bit 4CPU344533%
10.5/32
 28%
9/32
        
Stockfish 2019-12-10 64-bit3442 28%
14.5/52
 19%
10/52
18%
11/60
      
Stockfish 11 64-bit3433 24%
12.5/52
 25%
3/12
27%
14.5/54
      
SugaR XPro NN 1.0 64-bit3420   27%
14/52
23%
12/52
      
ShashChess 11.0 64-bit3402   30%
15.5/52
29%
15/52
      
Houdini 6 64-bit 4CPU339944%
14/32
 28%
14.5/52
        
Stockfish 10 64-bit3387    25%
13/52
35%
18/52
 20%
11.5/58
19%
13/70
  
SugaR 1.6.1 64-bit3381     39%
20.5/52
 25%
19.5/78
   
SugaR XPrO 1.4 64-bit3367       29%
15/52
  16%
6.5/40
Stockfish 9 64-bit3366      28%
11/40
 32%
13/40
20%
10/50
11%
4.5/40
ShashChess 8.0 64-bit3364    38%
20/52
39%
20.5/52
 29%
15/52
   
Komodo 13.3 64-bit3354 38%
20/52
 44%
23/52
38%
20/52
      
Houdini 6 64-bit3339 41%
21.5/52
 33%
4/12
39%
20.5/52
42%
22/52
28%
11/40
33%
27/82
26%
10.5/40
 9%
3.5/40
Fire 7.1 64-bit 4CPU332362%
20/32
 40%
17/42
   42%
17/40
  26%
13/50
 
Komodo 12.2.2 64-bit3323       35%
18/52
28%
11/40
  
Houdini 6 Tactical 64-bit3314         25%
12.5/50
16%
6.5/40
MateFinder 9 64-bit3313         30%
15/50
15%
6/40
Ethereal 11.00 64-bit 4CPU3298  48%
12.5/26
   46%
18.5/40
    
Ethereal 12.25 64-bit3294 49%
24.5/50
 50%
29/58
       
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Laser 1.7 64-bit 4CPU328659%
19/32
 58%
18.5/32
        
Deep Shredder 13 64-bit 4CPU327955%
17.5/32
 44%
7/16
   46%
18.5/40
  31%
15.5/50
 
Fizbo 2 64-bit 4CPU327469%
22/32
 39%
12.5/32
   44%
17.5/40
  36%
14.5/40
 
Ethereal 12.00 64-bit3265 56%
29/52
 50%
6/12
50%
26/52
      
Andscacs 0.94 64-bit 4CPU3262  60%
14.5/24
   52%
21/40
    
Booot 6.3.1 64-bit 4CPU3262  62%
18.5/30
   64%
25.5/40
    
Fire 7.1 64-bit3257 63%
33/52
 60%
12/20
63%
33/52
51%
26.5/52
 52%
30/58
51%
20.5/40
 28%
11/40
Xiphos 0.6 64-bit3253 60%
31/52
 55%
11.5/21
58%
30/52
      
Xiphos 0.4 64-bit 4CPU3250  71%
17/24
   64%
25.5/40
    
RofChade 2.3 64-bit3239 59%
30.5/52
 58%
35/60
       
Ethereal 11.25 64-bit3237     54%
28/52
 53%
30.5/58
   
Booot 6.4 64-bit3236 54%
34/63
 60%
12/20
       
Xiphos 0.5 64-bit3230     57%
29.5/52
 53%
27.5/52
   
Ethereal 11.00 64-bit3223       58%
30/52
49%
19.5/40
  
Laser 1.6 64-bit 4CPU3217  60%
14.5/24
   59%
23.5/40
    
Laser 1.7 64-bit3207 65%
34/52
 67%
8/12
61%
31.5/52
68%
35.5/52
 57%
29.5/52
   
RofChade 2.202 64-bit3206    61%
31.5/52
66%
34.5/52
     
Schooner 2.2 64-bit3205 69%
36/52
 75%
9/12
62%
32/52
      
Defenchess 2.2 64-bit3202   75%
9/12
64%
33.5/52
61%
31.5/52
     
Booot 6.3.1 64-bit3200    64%
33.5/52
62%
32.5/52
 54%
31.5/58
56%
22.5/40
  
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Shredder 13 64-bit3200    68%
35.5/52
63%
33/52
 53%
31/58
56%
22.5/40
 34%
13.5/40
Fizbo 2 64-bit3197    62%
32.5/52
59%
30.5/52
 63%
36.5/58
45%
18/40
 40%
16/40
Fritz 16 64-bit 4CPU3192  69%
16.5/24
   71%
28.5/40
  56%
28/50
 
Chiron 4 64-bit 4CPU3189  58%
14/24
   66%
26.5/40
  55%
16.5/30
 
Andscacs 0.95 64-bit3182     63%
33/52
 59%
34/58
   
Gull 3 64-bit 4CPU3180      69%
27.5/40
  54%
21.5/40
 
Andscacs 0.93 64-bit3170       60%
31/52
  31%
12.5/40
Xiphos 0.4 64-bit3145       59%
30.5/52
60%
24/40
  
Laser 1.6 64-bit3130       67%
35/52
66%
26.5/40
  
Gull 3 64-bit3119       67%
35/52
65%
26/40
 40%
16/40
Chiron 4 64-bit3114        58%
23/40
 42%
17/40
Strelka 5.5 64-bit3103  82%
18/22
   76%
30.5/40
 62%
25/40
64%
25.5/40
40%
16/40
Fritz 16 64-bit3101        74%
29.5/40
 45%
18/40
NirvanaChess 2.4 64-bit3101        59%
23.5/40
 48%
19/40
Nemorino 5.00 64-bit3086       76%
39.5/52
65%
26/40
  
Texel 1.07 64-bit3075        75%
30/40
 62%
25/40
Senpai 2.0 64-bit3033        81%
32.5/40
 48%
19/40
SmarThink 1.98 64-bit3026        69%
27.5/40
 64%
25.5/40
Sting SF 9.9 64-bit3010         80%
40/50
62%
25/40
Defenchess 1.1f 64-bit2997        78%
31/40
 58%
23/40
NameEloKomodo
13.2.5
MCTS
64-bit
4CPU
Komodo
13.3
MCTS
64-bit
Komodo
12.3
MCTS
64-bit
4CPU
Komodo
14
MCTS
64-bit
Komodo
13.2.5
MCTS
64-bit
Komodo
13.01
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
4CPU
Komodo
12.3
MCTS
64-bit
Komodo
12.2.2
MCTS
64-bit
Komodo
12.1.1
MCTS
64-bit
4CPU
Komodo
12.1.1
MCTS
64-bit
Wasp 3.0 64-bit2984        82%
33/40
 69%
27.5/40
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on August 1, 2020