CCRL 40/4
Downloads and Statistics
December 14, 2019
Testing summary:
Total: 2'147'837 games
played by 2'515 programs
29208 CPU days (X2 4600+)

White wins: 831'895 (38.7%)
Black wins: 671'656 (31.3%)
Draws: 644'286 (30.0%)
White score: 53.7%

Custom engine selection

Comparing 16 engines!
16 selected engines played 0 games with each other

CCRL 40/4 Rating List — Custom engine selection (Quote)

Ponder off, General book (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz), about 1.5 minutes on a modern CPU.
Computed on December 14, 2019 with Bayeselo based on 2'147'837 games

Color legend: Commercial, Free, Open source, Private.
Bold font - tested with 300 games or more. Normal font - less than 300 games.

RankNameRatingScoreAverage
Opponent
DrawsGamesLOS
Elo+
1Lc0 0.23.1 w42850 RTX20803619+17−1765.2%−94.262.7%1005 
96.8%
 Lc0 0.22.0 w49921 RTX20803598+15−1563.8%−82.565.5%1292
100.0%
 Lc0 0.21.1 JH.T6.532 GTX10503486+17−1659.2%−58.452.4%1100
83.9%
 Lc0 0.21.1 w41800 GTX10503474+17−1755.7%−37.151.2%1000
97.5%
 Lc0 0.20.2 w32930 GTX10503452+14−1459.2%−60.348.4%1600
96.6%
 Lc0 0.20.1 w36089 GTX980Ti3426+25−2461.9%−74.355.7%490
100.0%
 Lc0 0.20.1 w36089 OpenCL GTX980Ti3318+26−2645.2%+30.554.4%439
100.0%
 Lc0 0.20.1 w36089 64-bit2797+20−1955.1%−41.124.6%982
81.9%
 Lc0 0.21.0 w32930 64-bit2756+80−9412.8%+319.913.4%82
89.2%
 Lc0 0.20.2 w32930 64-bit2679+80−9018.8%+239.021.9%64
94.7%
 Leela Chess 0.10 w483 64-bit2607+22−2248.6%+10.624.3%725
100.0%
 Leela Chess 0.10 w323 64-bit2537+23−2257.2%−55.320.8%754
100.0%
 Leela Chess 0.10 w272 64-bit2308+33−3256.1%−46.819.7%350
94.4%
 Leela Chess 0.9 w272 64-bit2271+33−3251.3%−9.617.9%352
96.2%
 Leela Chess 0.7 w187 64-bit2235+22−2263.3%−104.318.9%814
100.0%
 Leela Chess 0.5 w123 64-bit1963+32−3246.9%+25.017.7%373
 

Results matrix

Custom engine selection
#NameElo12345678910111213141516
1Lc0 0.23.1 w42850 RTX20803619                
2Lc0 0.22.0 w49921 RTX20803598                
3Lc0 0.21.1 JH.T6.532 GTX10503486                
4Lc0 0.21.1 w41800 GTX10503474                
5Lc0 0.20.2 w32930 GTX10503452                
6Lc0 0.20.1 w36089 GTX980Ti3426                
7Lc0 0.20.1 w36089 OpenCL GTX980Ti3318                
8Lc0 0.20.1 w36089 64-bit2797                
9Lc0 0.21.0 w32930 64-bit2756                
10Lc0 0.20.2 w32930 64-bit2679                
11Leela Chess 0.10 w483 64-bit2607                
12Leela Chess 0.10 w323 64-bit2537                
13Leela Chess 0.10 w272 64-bit2308                
14Leela Chess 0.9 w272 64-bit2271                
15Leela Chess 0.7 w187 64-bit2235                
16Leela Chess 0.5 w123 64-bit1963                
Performance color legend:
(Only pairs with at least 30 games)
-120 -100 -80 -60 -40 -20 0 20 40 60 80 100 120

LOS matrix

Custom engine selection
#NameElo12345678910111213141516
1Lc0 0.23.1 w42850 RTX20803619 96.8100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
2Lc0 0.22.0 w49921 RTX208035983.2 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
3Lc0 0.21.1 JH.T6.532 GTX105034860.00.0 83.999.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
4Lc0 0.21.1 w41800 GTX105034740.00.016.1 97.599.9100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
5Lc0 0.20.2 w32930 GTX105034520.00.00.12.5 96.6100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
6Lc0 0.20.1 w36089 GTX980Ti34260.00.00.00.13.4 100.0100.0100.0100.0100.0100.0100.0100.0100.0100.0
7Lc0 0.20.1 w36089 OpenCL GTX980Ti33180.00.00.00.00.00.0 100.0100.0100.0100.0100.0100.0100.0100.0100.0
8Lc0 0.20.1 w36089 64-bit27970.00.00.00.00.00.00.0 81.999.6100.0100.0100.0100.0100.0100.0
9Lc0 0.21.0 w32930 64-bit27560.00.00.00.00.00.00.018.1 89.299.9100.0100.0100.0100.0100.0
10Lc0 0.20.2 w32930 64-bit26790.00.00.00.00.00.00.00.410.8 94.799.9100.0100.0100.0100.0
11Leela Chess 0.10 w483 64-bit26070.00.00.00.00.00.00.00.00.15.3 100.0100.0100.0100.0100.0
12Leela Chess 0.10 w323 64-bit25370.00.00.00.00.00.00.00.00.00.10.0 100.0100.0100.0100.0
13Leela Chess 0.10 w272 64-bit23080.00.00.00.00.00.00.00.00.00.00.00.0 94.4100.0100.0
14Leela Chess 0.9 w272 64-bit22710.00.00.00.00.00.00.00.00.00.00.00.05.6 96.2100.0
15Leela Chess 0.7 w187 64-bit22350.00.00.00.00.00.00.00.00.00.00.00.00.03.8 100.0
16Leela Chess 0.5 w123 64-bit19630.00.00.00.00.00.00.00.00.00.00.00.00.00.00.0 
LOS color legend:
0 10 20 30 40 50 60 70 80 90 100

Number of connecting games matrix

Custom engine selection
#NameElo12345678910111213141516
1Lc0 0.23.1 w42850 RTX20803619 121520120120100000000000
2Lc0 0.22.0 w49921 RTX208035981215 77977977900000000000
3Lc0 0.21.1 JH.T6.532 GTX10503486201779 20002200620591000000000
4Lc0 0.21.1 w41800 GTX105034742017792000 2000620591000000000
5Lc0 0.20.2 w32930 GTX1050345220177922002000 620591000000000
6Lc0 0.20.1 w36089 GTX980Ti342600620620620 879000000000
7Lc0 0.20.1 w36089 OpenCL GTX980Ti331800591591591879 000000000
8Lc0 0.20.1 w36089 64-bit27970000000 0025300000
9Lc0 0.21.0 w32930 64-bit275600000000 64000000
10Lc0 0.20.2 w32930 64-bit26790000000064 000000
11Leela Chess 0.10 w483 64-bit2607000000025300 00000
12Leela Chess 0.10 w323 64-bit253700000000000 0000
13Leela Chess 0.10 w272 64-bit2308000000000000 7021850
14Leela Chess 0.9 w272 64-bit2271000000000000702 1850
15Leela Chess 0.7 w187 64-bit2235000000000000185185 352
16Leela Chess 0.5 w123 64-bit196300000000000000352 
Number of connecting games color legend:
0 200 400 600 800 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000

Percentage of connecting games matrix

Custom engine selection
#NameElo12345678910111213141516
1Lc0 0.23.1 w42850 RTX20803619 52.99.510.07.70.00.00.00.00.00.00.00.00.00.00.0
2Lc0 0.22.0 w49921 RTX2080359852.9 32.634.026.90.00.00.00.00.00.00.00.00.00.00.0
3Lc0 0.21.1 JH.T6.532 GTX105034869.532.6 95.281.539.038.40.00.00.00.00.00.00.00.00.0
4Lc0 0.21.1 w41800 GTX1050347410.034.095.2 76.941.641.10.00.00.00.00.00.00.00.00.0
5Lc0 0.20.2 w32930 GTX105034527.726.981.576.9 29.729.00.00.00.00.00.00.00.00.00.0
6Lc0 0.20.1 w36089 GTX980Ti34260.00.039.041.629.7 94.60.00.00.00.00.00.00.00.00.0
7Lc0 0.20.1 w36089 OpenCL GTX980Ti33180.00.038.441.129.094.6 0.00.00.00.00.00.00.00.00.0
8Lc0 0.20.1 w36089 64-bit27970.00.00.00.00.00.00.0 0.00.014.80.00.00.00.00.0
9Lc0 0.21.0 w32930 64-bit27560.00.00.00.00.00.00.00.0 43.80.00.00.00.00.00.0
10Lc0 0.20.2 w32930 64-bit26790.00.00.00.00.00.00.00.043.8 0.00.00.00.00.00.0
11Leela Chess 0.10 w483 64-bit26070.00.00.00.00.00.00.014.80.00.0 0.00.00.00.00.0
12Leela Chess 0.10 w323 64-bit25370.00.00.00.00.00.00.00.00.00.00.0 0.00.00.00.0
13Leela Chess 0.10 w272 64-bit23080.00.00.00.00.00.00.00.00.00.00.00.0 100.015.90.0
14Leela Chess 0.9 w272 64-bit22710.00.00.00.00.00.00.00.00.00.00.00.0100.0 15.90.0
15Leela Chess 0.7 w187 64-bit22350.00.00.00.00.00.00.00.00.00.00.00.015.915.9 29.7
16Leela Chess 0.5 w123 64-bit19630.00.00.00.00.00.00.00.00.00.00.00.00.00.029.7 
Percentage of connecting games color legend:
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Score with 43 common opponents

Custom engine selection
NameEloLc0
0.23.1
w42850
RTX2080
Lc0
0.22.0
w49921
RTX2080
Lc0
0.21.1
JH.T6.532
GTX1050
Lc0
0.21.1
w41800
GTX1050
Lc0
0.20.2
w32930
GTX1050
Lc0
0.20.1
w36089
GTX980Ti
Lc0
0.20.1
w36089
OpenCL
GTX980Ti
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.0
w32930
64-bit
Lc0
0.20.2
w32930
64-bit
Leela
Chess
0.10
w483
64-bit
Leela
Chess
0.10
w323
64-bit
Leela
Chess
0.10
w272
64-bit
Leela
Chess
0.9
w272
64-bit
Leela
Chess
0.7
w187
64-bit
Leela
Chess
0.5
w123
64-bit
Leelenstein 11.1 RTX2080362049%
50/102
48%
28/58
              
Fat Fritz w266 RTX2080361052%
53/101
52%
42/81
              
Stockfish 2019-10-09 64-bit 4CPU360755%
55.5/101
52%
30/58
              
Allie 0.5 nn49921 RTX2080356165%
64/98
55%
33/60
              
Stoofvlees II a13 RTX2080355563%
63.5/101
54%
49/90
              
Stockfish 10 64-bit 4CPU3549 59%
94.5/160
40%
39.5/100
40%
40/100
32%
32.5/100
           
Houdini 6 64-bit 4CPU351869%
70/101
63%
99.5/159
48%
47.5/100
44%
44/100
46%
46/100
           
Stockfish 10 64-bit3490  52%
51.5/100
47%
47/100
48%
48.5/100
37%
20.5/55
24%
12/49
         
Komodo 12.3 64-bit 4CPU3488  53%
53/100
51%
51/100
46%
45.5/100
           
Houdini 6 64-bit3444  60%
59.5/100
54%
54/100
55%
55/100
53%
29/55
39%
19/49
         
Fire 7.1 64-bit 4CPU3426 76%
121/160
58%
58/100
64%
63.5/100
54%
54.5/100
           
Komodo 11.3.1 64-bit3419  63%
63/100
56%
56.5/100
62%
62/100
           
Komodo 13.01 64-bit3401     55%
30.5/55
42%
22/52
         
Ethereal 11.25 64-bit 4CPU3392  64%
64.5/100
59%
59/100
54%
54/100
           
Fritz 17 64-bit 4CPU338781%
81.5/101
76%
26.5/35
              
Fire 7.1 64-bit3338  73%
73/100
68%
68.5/100
62%
62/100
66%
36.5/55
42%
20.5/49
         
Andscacs 0.95 64-bit 4CPU3335  70%
70/100
 72%
71.5/100
           
Stoofvlees II a10 GTX980Ti3317     59%
32.5/55
44%
40/91
         
Xiphos 0.5 64-bit3305  72%
71.5/100
74%
73.5/100
66%
65.5/100
71%
39/55
51%
25.5/50
         
Laser 1.7 64-bit3271     77%
42.5/55
55%
27.5/50
         
NameEloLc0
0.23.1
w42850
RTX2080
Lc0
0.22.0
w49921
RTX2080
Lc0
0.21.1
JH.T6.532
GTX1050
Lc0
0.21.1
w41800
GTX1050
Lc0
0.20.2
w32930
GTX1050
Lc0
0.20.1
w36089
GTX980Ti
Lc0
0.20.1
w36089
OpenCL
GTX980Ti
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.0
w32930
64-bit
Lc0
0.20.2
w32930
64-bit
Leela
Chess
0.10
w483
64-bit
Leela
Chess
0.10
w323
64-bit
Leela
Chess
0.10
w272
64-bit
Leela
Chess
0.9
w272
64-bit
Leela
Chess
0.7
w187
64-bit
Leela
Chess
0.5
w123
64-bit
Fizbo 2 64-bit3248     70%
38.5/55
65%
32/49
         
Pirarucu 2.9.5 64-bit2985        19%
6/32
19%
6/32
      
Colossus 2008b2641       73%
22.5/31
  56%
18/32
     
Cyrano 0.6b17 64-bit2641       67%
21.5/32
  48%
15.5/32
     
Sjakk 2.2 64-bit2638       67%
21.5/32
  52%
15.5/30
     
WyldChess 1.51 64-bit2630       61%
19.5/32
  47%
15/32
     
Galjoen 0.38 64-bit2319            39%
12.5/32
44%
14/32
  
Absolute Zero 2.4.7.2 64-bit2317            70%
22.5/32
70%
22.5/32
  
Aice 0.99.22315            56%
17.5/31
48%
15.5/32
  
Sungorus 1.4 64-bit2313            52%
16.5/32
52%
16.5/32
  
Napoleon 1.8 64-bit2250            42%
13/31
38%
12/32
  
Robocide 20170718 64-bit2236            59%
19/32
50%
16/32
45%
13/29
 
Anechka 0.082235            61%
19.5/32
47%
15/32
35%
10.5/30
 
GopherCheck 0.2.3 64-bit2235            53%
17/32
38%
12/32
  
AliChess 4.252229            47%
15/32
55%
17.5/32
57%
17/30
 
CT800 1.20 64-bit2218            70%
22.5/32
75%
24/32
  
FireFly 2.7.0 64-bit2208            67%
21.5/32
48%
15.5/32
  
Vice 1.0 64-bit2042              71%
20.5/29
33%
10.5/32
Jabba 1.0 64-bit2036              75%
22.5/30
39%
12.5/32
Snowy 0.2 64-bit1988              78%
19.5/25
41%
12/29
NameEloLc0
0.23.1
w42850
RTX2080
Lc0
0.22.0
w49921
RTX2080
Lc0
0.21.1
JH.T6.532
GTX1050
Lc0
0.21.1
w41800
GTX1050
Lc0
0.20.2
w32930
GTX1050
Lc0
0.20.1
w36089
GTX980Ti
Lc0
0.20.1
w36089
OpenCL
GTX980Ti
Lc0
0.20.1
w36089
64-bit
Lc0
0.21.0
w32930
64-bit
Lc0
0.20.2
w32930
64-bit
Leela
Chess
0.10
w483
64-bit
Leela
Chess
0.10
w323
64-bit
Leela
Chess
0.10
w272
64-bit
Leela
Chess
0.9
w272
64-bit
Leela
Chess
0.7
w187
64-bit
Leela
Chess
0.5
w123
64-bit
Embla 1.0.1 64-bit1987              85%
25.5/30
47%
14.5/31
Hedgehog 1.8041969              84%
24.5/29
60%
18.5/31
Etude 0.1.21953              72%
16.5/23
47%
14.5/31
Score color legend:
(Only pairs with at least 30 games)
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100%

Alter engine selection



Alter output selection

Rating list
Testing profile
  (Step: , Numbers: )

Results table
Performance table
Score table
LOS table
Proportion of draws
Number of games
Number of connecting games
Percentage of connecting games
Score with common opponents
Score with all opponents
Performance with common opponents
Performance with all opponents
LOS with common opponents
LOS with all opponents

Maximum size of cross-tables (from 2 to 100):
Limit crosstables to engines in Elo range: to
Match length (Minimum number of games to highlight with color):

Cross-tables show only best version of each engine
Sort cross-tables by:   Rating   Name
Highlight diagonal of cells wide. (0 to highlight everything)

Reference rating list:
Recalibrate:
  No recalibration (reference and current list are compared as they are)
  Recalibrate reference list to current one using selected engines only
  Recalibrate reference list to current one using all common engines
  Recalibrate current list to reference using selected engines only
  Recalibrate current list to reference using all common engines


Created in 2005-2013 by CCRL team
Last games added on December 14, 2019