Not logged inRybka Chess Community Forum
Up Topic The Rybka Lounge / Computer Chess / Rating a Chess Game
1 2 Previous Next  
- - By jackwelb (*) Date 2010-03-27 14:43
Ever since I began playing chess I have wanted to know "How well did I play?"  Not just an overall rating after many games, but a rating for a single game or even a single move.  Having not found such a program after 40 years, I decided to write my own.

The attached program creates the report at the end of this post.  The program is 64-bit and will only run on a Windows 64-bit operating system.  I'll compile a 32-bit program at a later time if there is interest.  Please read the ReadMe.txt file for further requirements (& information) before running this program.

I hope a few brave people will try the program and offer some constructive criticism.  The program is not very user-friendly at the moment and requires the free StockFish chess engine (1.6 or higher) to perform as intended.  Other engines may work, but it is likely the Elo values will be distorted.

Enjoy!

                                      CHESS GAME REPORT

Game scored at a 1800 Elo skill level.

                             ----------- WHITE ------------     ----------- BLACK ------------

GAME ELO                                 1879                               1732

AVERAGE ERROR FOR GAME       Expected    Actual    Rating       Expected    Actual    Rating
                               0.22       0.20      0.02          0.25       0.27     -0.02

MOVE RANKING                 Rank    No.     %     Avg Err      Rank    No.     %     Avg Err
                             Best    22     46      0.00        Best    17     36      0.00
                             2nd     14     29      0.26        2nd      7     15      0.22
                             3rd      4      8      0.38        3rd      5     11      0.39
                             4th      3      6      0.30        4th      3      6      0.23
                             5th                    0.00        5th      2      4      1.25
                             6th      1      2      0.12        6th      2      4      0.57
                             7th                    0.00        7th      2      4      0.23
                             8th      1      2      1.30        8th      1      2      0.32
                             9th                    0.00        9th      1      2      1.19
                             10+      3      6      1.39        10+      7     15      0.70

BEST MOVES                   Move        Exp   Act   Rating     Move        Exp   Act   Rating
                             42. Rc7     0.67  0.00   0.67      27..Bf2     1.03  0.00   1.03
                             17. Qxf5    0.52  0.00   0.52      51..Rbb8    0.93  0.26   0.53
                             29. Nc4     0.36  0.00   0.36      22..Qe7     0.52  0.00   0.52
                             37. Bg1     0.46  0.10   0.33      29..Bd4     0.34  0.00   0.34
                             21. Qb3     0.31  0.00   0.31      18..Qc7     0.32  0.00   0.32

WORST MOVES                  Move        Exp   Act   Rating     Move        Exp   Act   Rating
                             30. Be3     0.29  1.89  -1.25      31..b5      0.09  2.93  -2.62
                             26. Nd2     0.58  2.17  -1.00      23..Na6     0.56  2.30  -1.12
                             22. Kh1     0.00  1.01  -1.00      15..d6      0.10  1.12  -0.92
                             36. Qd2     0.09  0.52  -0.40      46..Nc5     0.26  1.22  -0.77
                             16. Nc4     0.08  0.36  -0.26      14..Qe7     0.29  0.97  -0.53

MOST CHALLENGING POSITIONS   Move        Exp   Act   Rating     Move        Exp   Act   Rating
                             15.         1.11  1.30  -0.09      27...       1.03  0.00   1.03
                             42.         0.67  0.00   0.67      51...       0.93  0.26   0.53
                             25.         0.63  0.45   0.12      40...       0.75  0.40   0.25
                             24.         0.60  0.72  -0.07      30...       0.74  0.36   0.28
                             26.         0.58  2.17  -1.00      41...       0.63  1.19  -0.35

White        PS   WP  Exp   Act   Rating  Elo      Black        PS   WP  Exp   Act   Rating  Elo
1. d4       0.00  50  0.00  0.00   0.00      0     1..Nf6      0.00  50  0.00  0.00   0.00      0
2. Nf3      0.00  50  0.00  0.00   0.00      0     2..e6       0.00  50  0.00  0.00   0.00      0
3. g3       0.00  50  0.00  0.00   0.00      0     3..b6       0.00  50  0.00  0.00   0.00      0
4. c4       0.00  50  0.00  0.00   0.00      0     4..Bb7     -0.04  49  0.00  0.00   0.00      0
5. Bg2     -0.08  48  0.12  0.12   0.00   1798     5..Be7     -0.24  45  0.35  0.34   0.01   1950
6. O-O      0.24  55  0.07  0.00   0.07   2633     6..O-O     -0.24  45  0.19  0.00   0.19   2633
7. Nc3      0.24  55  0.14  0.00   0.14   2633     7..Ne4     -0.28  44  0.18  0.03   0.15   2633
8. Qc2      0.28  56  0.19  0.00   0.19   2633     8..f5      -0.76  34  0.12  0.38  -0.23     48
9. Rd1      0.32  57  0.27  0.33  -0.05   1612     9..c5      -1.05  29  0.13  0.55  -0.38      2
10. d5       0.72  65  0.19  0.19   0.00   1813    10..Nxc3    -0.72  35  0.15  0.00   0.15   2633
11. Qxc3     0.28  56  0.26  0.34  -0.07    273    11..Bf6     -0.28  44  0.13  0.00   0.13   2633
12. Qc2      0.28  56  0.06  0.00   0.06   2633    12..exd5    -0.28  44  0.10  0.00   0.10   2633
13. cxd5     0.28  56  0.14  0.00   0.14   2633    13..Na6     -0.36  43  0.26  0.06   0.18   2633
14. Bf4      0.08  52  0.38  0.26   0.09   2462    14..Qe7     -1.13  28  0.29  0.97  -0.53      0
15. Ne5     -0.08  48  1.11  1.30  -0.09   1660    15..d6      -0.96  31  0.10  1.12  -0.92     14
16. Nc4      0.44  59  0.08  0.36  -0.26    331    16..Rad8    -0.44  41  0.14  0.00   0.14   1845
17. Qxf5     0.44  59  0.52  0.00   0.52   2633    17..Bc8     -1.09  29  0.22  0.45  -0.19   1668
18. Qe4      0.84  67  0.13  0.14  -0.01   2149    18..Qc7     -0.84  33  0.32  0.00   0.32   2633
19. Rab1     0.24  55  0.34  0.48  -0.10     17    19..Bd4     -1.25  26  0.54  0.81  -0.18    998
20. Qd3      0.96  69  0.35  0.15   0.18   2359    20..Nb4     -1.53  22  0.36  0.29   0.06   2189
21. Qb3      1.53  78  0.31  0.00   0.31   2035    21..Bxf2+   -1.57  22  0.20  0.02   0.18   2633
22. Kh1      0.28  56  0.00  1.01  -1.00      0    22..Qe7     -0.28  44  0.52  0.00   0.52   2633
23. e4       0.00  50  0.18  0.28  -0.08   1525    23..Na6     -2.30  15  0.56  2.30  -1.12    344
24. Rf1      0.92  68  0.60  0.72  -0.07   1636    24..Bd4     -0.92  32  0.05  0.00   0.05    760
25. a3       0.32  57  0.63  0.45   0.12   2008    25..Nc7     -0.80  34  0.22  0.36  -0.11   1581
26. Nd2     -0.76  34  0.58  2.17  -1.00   1008    26..Ba6      0.48  60  0.38  0.19   0.16   2436
27. Rfe1    -1.01  30  0.24  0.36  -0.10    849    27..Bf2      1.01  70  1.03  0.00   1.03   2633
28. Rec1    -1.09  29  0.09  0.04   0.04   2633    28..Kh8      0.32  57  0.33  0.58  -0.19   1564
29. Nc4     -0.32  43  0.36  0.00   0.36   2633    29..Bd4      0.32  57  0.34  0.00   0.34   2633
30. Be3     -2.82  12  0.29  1.89  -1.25      0    30..Bxc4     1.81  81  0.74  0.36   0.28   1941
31. Rxc4    -1.81  19  0.05  0.00   0.05    156    31..b5      -0.40  42  0.09  2.93  -2.62      7
32. Rxd4     0.40  58  0.05  0.00   0.05   1144    32..cxd4    -0.40  42  0.04  0.00   0.04     99
33. Bxd4     0.40  58  0.04  0.00   0.04    626    33..a6      -0.68  36  0.08  0.20  -0.11     34
34. Qc3      0.52  61  0.23  0.11   0.11   2633    34..b4      -1.01  30  0.18  0.32  -0.12   1163
35. Qxb4     1.01  70  0.18  0.00   0.18    977    35..Rb8     -1.01  30  0.09  0.00   0.09   2633
36. Qd2      0.32  57  0.09  0.52  -0.40   1344    36..Nb5     -0.32  43  0.14  0.00   0.14   2633
37. Bg1      0.20  54  0.46  0.10   0.33   2561    37..Nxa3    -0.20  46  0.21  0.00   0.21   2633
38. Ra1      0.04  51  0.09  0.15  -0.06   1347    38..Nc4     -0.04  49  0.03  0.00   0.03    156
39. Qc3     -0.20  46  0.30  0.25   0.04   2254    39..Nxb2     0.00  50  0.20  0.20   0.00   1921
40. Rxa6     0.00  50  0.24  0.00   0.24   2596    40..Rfc8    -0.40  42  0.75  0.40   0.25   2121
41. Rc6      0.40  58  0.25  0.00   0.25   1599    41..Rf8     -2.06  17  0.63  1.19  -0.35      1
42. Rc7      2.06  83  0.67  0.00   0.67   2113    42..Na4     -2.66  12  0.22  0.20   0.02   2010
43. Qc6      2.66  88  0.14  0.00   0.14   1617    43..Qe8     -2.66  12  0.16  0.00   0.16   2633
44. Qxd6     2.66  88  0.10  0.00   0.10    371    44..Rf6     -3.35   9  0.20  0.19   0.01   2345
45. Qd7      2.34  85  0.22  0.30  -0.07     18    45..Qxd7    -2.34  15  0.15  0.00   0.15    562
46. Rxd7     2.34  85  0.00  0.00   0.00      9    46..Nc5     -6.42   3  0.26  1.22  -0.77      0
47. Bxc5     6.42  97  0.03  0.00   0.03    104    47..Rb1+    -6.54   3  0.09  0.02   0.08   2633
48. Bg1      6.54  97  0.02  0.00   0.02      5    48..Rf8     -7.55   2  0.14  0.13   0.01   1949
49. h3       6.66  97  0.10  0.12  -0.02      7    49..h6      -8.32   2  0.09  0.22  -0.11      0
50. e5       8.32  98  0.13  0.00   0.13   2633    50..Rb5    -10.74   1  0.10  0.26  -0.15    671
51. e6      10.74  99  0.22  0.00   0.22   2633    51..Rbb8   -13.85   1  0.93  0.26   0.53   2438
52. Bd4     11.31  99  0.26  0.21   0.05   2295
Attachment: ReadMe.txt (4k)
Attachment: ChessGameReport.exe (53k)
Parent - - By Felix Kling (Gold) Date 2010-03-27 14:47
could you do your test with this game:

1. d4 d5 2. c4 c6 3. Nf3 Nf6 4. Nc3 e6 5. Bg5 Nbd7 6. e4 Qa5 7. Bd2 dxe4 8.
Nxe4 Qc7 9. Nxf6+ Nxf6 10. c5 Be7 11. Bc4 Nd5 12. O-O O-O 13. Re1 Rd8 14. Qc2
Bf6 15. Bg5 Qe7 16. Bxf6 Qxf6 17. a3 Ne7 18. Rad1 g6 19. Ne5 Bd7 20. Re3 Be8
21. Rf3 Qg7 22. Qe4 Nd5 23. Ba2 b5 24. Qe2 a5 25. h4 Ra7 26. h5 g5 27. Bxd5
Rxd5 28. Ng4 Kh8 29. Nf6 Rd8 30. h6 Qxh6 31. Qe5 Qg7 32. Rh3 Rd5 33. Rxh7+ Qxh7
34. Nxd5+ f6 35. Nxf6 Qc2 36. Nxe8+ Kg8 37. Qxg5+ Kf8 38. Rc1 Qxb2 39. Nd6 b4
40. Re1 Qc3 41. Rxe6 Qa1+ 42. Kh2 1-0

I'm a bit sceptical about the precision that could be achieved with such tests, but the tendency should be about right...
Parent - - By jackwelb (*) Date 2010-03-27 15:34

> I'm a bit sceptical about the precision that could be achieved with such tests


I would tend to agree.  The most appropriate use of this program would be to compare performances in your own games.  Which performance was better/worse?  Which game was more difficult/easy?  Did I play badly or did my opponent play much better?

I should also say this program works best with players under 2400 Elo.  Higher levels could be achieved, but would require lengthy processing time (>8 hrs) with the program in its' current state.

Anyway, here is your game scored at 2000 Elo and a Max Depth of 12 (of course greater depth = greater accuracy).  I scored this game from move 1, but would recommend starting after book moves.

                                      CHESS GAME REPORT

Game scored at a 2000 Elo skill level.

                             ----------- WHITE ------------     ----------- BLACK ------------

GAME ELO                                 2338                               1504

AVERAGE ERROR FOR GAME       Expected    Actual    Rating       Expected    Actual    Rating
                               0.16       0.12      0.04          0.17       0.19     -0.02

MOVE RANKING                 Rank    No.     %     Avg Err      Rank    No.     %     Avg Err
                             Best    14     33      0.00        Best     9     22      0.00
                             2nd     11     26      0.11        2nd     11     27      0.10
                             3rd      4     10      0.11        3rd      3      7      0.47
                             4th      3      7      0.20        4th      6     15      0.23
                             5th      2      5      0.37        5th      2      5      0.32
                             6th      1      2      0.40        6th      2      5      0.47
                             7th                    0.00        7th                    0.00
                             8th      1      2      0.14        8th      1      2      0.33
                             9th                    0.00        9th      3      7      0.19
                             10+      6     14      0.25        10+      4     10      0.48

BEST MOVES                   Move        Exp   Act   Rating     Move        Exp   Act   Rating
                             30. h6      0.56  0.00   0.56      20..Be8     0.30  0.05   0.25
                             27. Bxd5    0.29  0.00   0.29       7..dxe4    0.21  0.00   0.21
                              3. Nf3     0.36  0.07   0.27      41..Qa1+    0.19  0.00   0.19
                             28. Ng4     0.22  0.00   0.22      24..a5      0.15  0.00   0.15
                             18. Rad1    0.21  0.00   0.21       9..Nxf6    0.14  0.00   0.14

WORST MOVES                  Move        Exp   Act   Rating     Move        Exp   Act   Rating
                             40. Re1     0.33  0.73  -0.30       6..Qa5     0.16  0.88  -0.62
                              6. e4      0.14  0.40  -0.23      32..Rd5     0.35  1.13  -0.58
                             15. Bg5     0.19  0.45  -0.22      39..b4      0.64  1.47  -0.51
                              5. Bg5     0.42  0.60  -0.12       2..c6      0.22  0.57  -0.29
                             11. Bc4     0.11  0.23  -0.10      26..g5      0.19  0.37  -0.15

MOST CHALLENGING POSITIONS   Move        Exp   Act   Rating     Move        Exp   Act   Rating
                             30.         0.56  0.00   0.56      39...       0.64  1.47  -0.51
                              5.         0.42  0.60  -0.12       5...       0.53  0.40   0.09
                              3.         0.36  0.07   0.27      28...       0.46  0.38   0.06
                             40.         0.33  0.73  -0.30      32...       0.35  1.13  -0.58
                             32.         0.32  0.21   0.09      20...       0.30  0.05   0.25

White        PS   WP  Exp   Act   Rating  Elo      Black        PS   WP  Exp   Act   Rating  Elo
1. d4       0.12  53  0.24  0.25  -0.01    790     1..d5      -0.32  43  0.17  0.18  -0.01    650
2. c4       0.12  53  0.19  0.18   0.01   1209     2..c6      -0.76  33  0.22  0.57  -0.29     30
3. Nf3      0.64  64  0.36  0.07   0.27   2633     3..Nf6     -0.76  33  0.15  0.07   0.07   2633
4. Nc3      0.48  61  0.22  0.19   0.03   2140     4..e6      -0.60  37  0.16  0.08   0.07   2633
5. Bg5      0.00  50  0.42  0.60  -0.12   1423     5..Nbd7    -0.40  41  0.53  0.40   0.09   2332
6. e4       0.00  50  0.14  0.40  -0.23   1188     6..Qa5     -0.88  31  0.16  0.88  -0.62     58
7. Bd2      0.56  62  0.12  0.21  -0.08   1306     7..dxe4    -0.56  38  0.21  0.00   0.21   2633
8. Nxe4     0.56  62  0.06  0.00   0.06    265     8..Qc7     -0.80  33  0.16  0.15   0.01   2485
9. Nxf6+    0.64  64  0.15  0.10   0.05   2419     9..Nxf6    -0.64  36  0.14  0.00   0.14     33
10. c5       0.44  60  0.12  0.14  -0.02   1782    10..Be7     -0.52  38  0.17  0.06   0.11   2633
11. Bc4      0.24  55  0.11  0.23  -0.10   1358    11..Nd5     -0.60  37  0.19  0.29  -0.08    372
12. O-O      0.60  63  0.06  0.00   0.06   2633    12..O-O     -0.60  37  0.13  0.00   0.13   2633
13. Re1      0.40  59  0.08  0.14  -0.06   1018    13..Rd8     -0.72  34  0.23  0.23   0.00   2454
14. Qc2      0.64  64  0.13  0.05   0.07   2633    14..Bf6     -1.09  27  0.14  0.27  -0.12     21
15. Bg5      0.44  60  0.19  0.45  -0.22     44    15..Qe7     -0.64  36  0.16  0.14   0.02   2098
16. Bxf6     0.64  64  0.10  0.00   0.10   2633    16..Qxf6    -0.64  36  0.05  0.00   0.05    232
17. a3       0.44  60  0.12  0.14  -0.02   1185    17..Ne7     -0.60  37  0.10  0.11  -0.01   1505
18. Rad1     0.60  63  0.21  0.00   0.21   2633    18..g6      -0.84  32  0.17  0.15   0.01   2141
19. Ne5      0.80  67  0.06  0.02   0.04   2633    19..Bd7     -1.01  29  0.06  0.12  -0.05     14
20. Re3      0.76  67  0.08  0.14  -0.06      1    20..Be8     -0.84  32  0.30  0.05   0.25   2633
21. Rf3      0.60  63  0.11  0.15  -0.04   1728    21..Qg7     -0.96  30  0.07  0.22  -0.14    319
22. Qe4      0.80  67  0.30  0.09   0.20   2573    22..Nd5     -1.01  29  0.08  0.12  -0.03   1871
23. Ba2      0.88  69  0.26  0.07   0.17   2627    23..b5      -1.13  27  0.09  0.13  -0.04    959
24. Qe2      0.92  70  0.08  0.11  -0.02   1256    24..a5      -0.92  30  0.15  0.00   0.15   2633
25. h4       0.84  68  0.06  0.04   0.02   2633    25..Ra7     -1.45  22  0.27  0.33  -0.05   1299
26. h5       1.41  78  0.19  0.02   0.17   2633    26..g5      -2.30  14  0.19  0.37  -0.15   1216
27. Bxd5     2.30  86  0.29  0.00   0.29   2260    27..Rxd5    -2.74  11  0.18  0.13   0.04   2117
28. Ng4      2.74  89  0.22  0.00   0.22   2469    28..Kh8     -4.16   6  0.46  0.38   0.06   2257
29. Nf6      3.59  93  0.22  0.12   0.09   2318    29..Rd8     -3.71   7  0.09  0.03   0.06   2633
30. h6       3.71  93  0.56  0.00   0.56   2633    30..Qxh6    -3.71   7  0.01  0.00   0.01    129
31. Qe5      3.71  93  0.15  0.00   0.15   2633    31..Qg7     -3.71   7  0.06  0.00   0.06    369
32. Rh3      2.90  90  0.32  0.21   0.09   2519    32..Rd5     -7.31   2  0.35  1.13  -0.58     28
33. Rxh7+    7.31  98  0.13  0.00   0.13   1634    33..Qxh7    -7.31   2  0.00  0.00   0.00   2633
34. Nxd5+    7.31  98  0.00  0.00   0.00     55    34..f6      -7.79   2  0.03  0.06  -0.03      3
35. Nxf6     7.79  98  0.03  0.00   0.03    760    35..Qc2     -9.77   1  0.27  0.23   0.03   2203
36. Nxe8+    9.77  99  0.11  0.00   0.11   2525    36..Kg8    -11.67   1  0.06  0.18  -0.11      0
37. Qxg5+   11.67  99  0.11  0.00   0.11   2633    37..Kf8    -12.72   1  0.11  0.08   0.03   2172
38. Rc1     10.46  99  0.14  0.20  -0.05   1397    38..Qxb2   -10.66   1  0.04  0.02   0.02   2633
39. Nd6      9.13  98  0.13  0.15  -0.02   1567    39..b4     -24.04   0  0.64  1.47  -0.51      0
40. Re1     13.49  99  0.33  0.73  -0.30     61    40..Qc3    -18.22   0  0.27  0.33  -0.04      0
41. Rxe6    16.48  99  0.08  0.10  -0.02   2595    41..Qa1+   -16.48   1  0.19  0.00   0.19   2633
42. Kh2     16.48  99  0.00  0.00   0.00      0
Parent - - By bballplayer (**) Date 2010-03-27 15:59
I tried this and posted only the moves in a txt document (I renamed it to .pgn) and program gave error message: Error reading pgn file.  Can you post a example of something it does read?
Parent - By jackwelb (*) Date 2010-03-27 18:37
It reads this.

[Event "It (open)"]
[Site "Wroclaw (Poland)"]
[Date "2008.06.26"]
[Round "8"]
[White "Morzywolek Pawel (POL)"]
[Black "Malec Sebastian (POL)"]
[Result "1-0"]
[ECO "B30"]
[WhiteElo "1808"]
[BlackElo "1771"]
[PlyCount "59"]
[EventDate "2008.??.??"]

1. e4 c5 2. Nf3 Nc6 3. c3 Nf6 4. Bd3 d6 5. O-O g6 6. Bc2 Bg7 7. d4 cxd4 8. cxd4
Bg4 9. Be3 O-O 10. Nc3 a6 11. h3 Bxf3 12. Qxf3 Rc8 13. Rac1 b5 14. Qd1 Nd7 15.
Qd2 Nb6 16. b3 e6 17. f4 f5 18. d5 Bxc3 19. Qxc3 exd5 20. exf5 gxf5 21. Rf3 Ne5
22. Rg3+ Ng6 23. Qd4 Rc6 24. Rg5 Qc8 25. Qd2 Qe6 26. Re1 d4 27. Bf2 Qd5 28. h4
d3 29. Bxd3 Nd7 30. Bc4 1-0
Parent - By hood (**) Date 2010-04-02 11:15
It will be the revelation if checked. I think big money can go with.
That can be nice training tool.
Parent - - By Uri Blass (*****) Date 2010-03-27 15:57
I do not have 64 bits

can you test these 3 games?(all of them from a tournament that I played this year at time control 90+30)
I consider the first game as my worst game in this year.

I saw that my opponent played the exchange variation against the french in a previous game so decided to play the french against him.

He knew that I saw him playing the exchange variation so he surprised me by 2.Qe2 inspite of not knowing theory after this move and I only knew that 2...e5 is a theory move.

[Event "120'/40+60'/20+30'"]
[Site "?"]
[Date "2010.02.07"]
[Round "?"]
[White "Victor freidles"]
[Black "Uri Blass"]
[Result "*"]
[ECO "C00"]
[Annotator "so k"]
[PlyCount "47"]
[TimeControl "40/7200:20/3600:1800"]

{256MB, Perfect 15.ctg, URI-AMD} 1. e4 e6 2. Qe2 e5 3. Nc3 Nc6 4. Nf3 Nf6 5. d4
exd4 6. e5 Ng4 7. Nd5 Bc5 8. Qe4 h5 9. h3 Nh6 10. Bg5 Be7 11. Nxe7 Nxe7 12.
Nxd4 c6 13. O-O-O Qa5 14. Bc4 d5 15. exd6 Qxg5+ 16. f4 Qf6 17. dxe7 Qxe7 18.
Nxc6 bxc6 19. Qxc6+ Kf8 20. Qxa8 Qc7 21. Ba6 Ke7 22. Bxc8 Rxc8 23. Qe4+ Kf8 24.
Rd2 *

[Event "120'/40+60'/20+30'"]
[Site "?"]
[Date "2010.02.28"]
[Round "?"]
[White "Alon elchanati"]
[Black "Uri Blass, agur"]
[Result "*"]
[ECO "C22"]
[Annotator ",agur"]
[PlyCount "76"]
[TimeControl "40/7200:20/3600:1800"]

{64MB, Rybka3.ctg, URI-AMD} 1. e4 e5 2. d4 exd4 3. Qxd4 Nc6 4. Qe3 Nf6 5. e5
Nd5 6. Qe4 Nb6 7. Nc3 Be7 8. Nf3 O-O 9. Bd3 g6 10. Bh6 Re8 11. O-O-O Bf6 12.
Qf4 Nxe5 13. Ne4 Nd5 14. Nxf6+ Qxf6 15. Qg3 Nb4 16. Nxe5 Rxe5 17. Bf4 Nxd3+ 18.
Rxd3 Rb5 19. Re1 Qxb2+ 20. Kd1 Qb1+ 21. Bc1 d6 22. Re8+ Kg7 23. Kd2 Rc5 24. c3
Qxa2+ 25. Ke1 Bg4 26. Re7 Qc2 27. Qf4 Re5+ 28. Rxe5 Qxd3 29. Qh6+ Kg8 30. f3
Qxc3+ 31. Kf2 Qxe5 32. fxg4 Re8 33. Qd2 Qxh2 34. Bb2 Qh4+ 35. Kf3 Qe7 36. Kf2
a5 37. Qd4 Qe2+ 38. Kg3 Qe3+ *

[Event "120'/40+60'/20+30'"]
[Site "?"]
[Date "2010.03.02"]
[Round "?"]
[White "Uri Blass"]
[Black "zvi sharzbarad"]
[Result "*"]
[ECO "C62"]
[Annotator ",agur"]
[PlyCount "143"]
[TimeControl "40/7200:20/3600:1800"]

{128MB, CompMaster Beta 3.0.ctg, URI-AMD} 1. e4 e5 2. Nf3 Nc6 3. Nc3 d6 4.
d4 Bg4 5. Bb5 exd4 6. Qxd4 a6 7. Bxc6+ bxc6 8. Bg5 f6 9. Bf4 Ne7 10. O-O-O Ng6
11. Bg3 Be7 12. h3 Be6 13. Qa4 Bd7 14. Qc4 Ne5 15. Nxe5 fxe5 16. f4 exf4 17.
Bxf4 Bf6 18. e5 dxe5 19. Rhe1 Qe7 20. Ne4 Qe6 21. Qxe6+ Bxe6 22. Nxf6+ gxf6 23.
Bxe5 fxe5 24. Rxe5 Ke7 25. Rde1 Kd6 26. Rxe6+ Kc5 27. R1e5+ Kb6 28. Rh5 Rhf8
29. Rxh7 Rf1+ 30. Kd2 Rd8+ 31. Kc3 Rf2 32. Rhh6 Rxg2 33. Rxc6+ Kb7 34. Kb3 Rg3+
35. Rc3 Rg5 36. a4 Rd7 37. h4 Rg4 38. Rc4 Rg3+ 39. c3 Rg2 40. Rb4+ Ka7 41. Rh8
c5 42. Rbb8 Rg4 43. a5 Rxh4 44. Ra8+ Kb7 45. Rxh4 Kxa8 46. Rh5 Rb7+ 47. Kc2 Rc7
48. Rh6 Ka7 49. Rb6 c4 50. b4 cxb3+ 51. Kxb3 Rc5 52. Kb4 Rg5 53. c4 Rg1 54. Rh6
Rb1+ 55. Kc5 Rg1 56. Kc6 Rg4 57. c5 Rg1 58. Kd6 Rd1+ 59. Kc7 Ra1 60. c6 Rxa5
61. Kd6 Ra1 62. Rh7+ Kb6 63. Rb7+ Ka5 64. Kd7 Rd1+ 65. Kc8 Ka4 66. c7 a5 67.
Rb6 Rc1 68. Kb7 Rxc7+ 69. Kxc7 Ka3 70. Kc6 a4 71. Kb5 Kb3 72. Ka5+ *
Parent - - By jackwelb (*) Date 2010-03-27 19:40
I have compiled a 32-bit version which is now attached to the first post.  For the program to read the pgn file, all commentary must be removed.  This means

> {256MB, Perfect 15.ctg, URI-AMD} 1. e4 e6 2. Qe2 e5 3. Nc3 Nc6 4. Nf3 Nf6 5. d4


will not work.

> 1. e4 e6 2. Qe2 e5 3. Nc3 Nc6 4. Nf3 Nf6 5. d4


This will work.  Also only one game in the pgn file.

I suggest the following settings for "Max Depth" based on user Elo.
<2000 Elo - Depth 12
<2250 Elo - Depth 13
<2400 Elo - Depth 14
<2500 Elo - Depth 15
Parent - - By bballplayer (**) Date 2010-03-27 19:55
When I try to use the program (I used the game that you posted), I got the following message:
"See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.ComponentModel.Win32Exception: The system cannot find the path specified
   at System.Diagnostics.Process.StartWithCreateProcess(ProcessStartInfo startInfo)
   at ChessGameReport.Form1.RunChessEngine()
   at ChessGameReport.Form1.btnStart_Click(Object sender, EventArgs e)
   at System.Windows.Forms.Control.OnClick(EventArgs e)
   at System.Windows.Forms.Button.OnMouseUp(MouseEventArgs mevent)
   at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
   at System.Windows.Forms.Control.WndProc(Message& m)
   at System.Windows.Forms.ButtonBase.WndProc(Message& m)
   at System.Windows.Forms.Button.WndProc(Message& m)
   at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
   at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)

************** Loaded Assemblies **************
mscorlib
    Assembly Version: 2.0.0.0
    Win32 Version: 2.0.50727.3603 (GDR.050727-3600)
    CodeBase: file:///d:/WINDOWS/Microsoft.NET/Framework64/v2.0.50727/mscorlib.dll
----------------------------------------
ChessGameReport
    Assembly Version: 1.0.0.0
    Win32 Version: 1.0.0.0
    CodeBase: file:///D:/Documents%20and%20Settings/Administrator/Desktop/ChessGameReport.exe
----------------------------------------
Microsoft.VisualBasic
    Assembly Version: 8.0.0.0
    Win32 Version: 8.0.50727.3053 (netfxsp.050727-3000)
    CodeBase: file:///D:/WINDOWS/assembly/GAC_MSIL/Microsoft.VisualBasic/8.0.0.0__b03f5f7f11d50a3a/Microsoft.VisualBasic.dll
----------------------------------------
System
    Assembly Version: 2.0.0.0
    Win32 Version: 2.0.50727.3053 (netfxsp.050727-3000)
    CodeBase: file:///D:/WINDOWS/assembly/GAC_MSIL/System/2.0.0.0__b77a5c561934e089/System.dll
----------------------------------------
System.Windows.Forms
    Assembly Version: 2.0.0.0
    Win32 Version: 2.0.50727.3053 (netfxsp.050727-3000)
    CodeBase: file:///D:/WINDOWS/assembly/GAC_MSIL/System.Windows.Forms/2.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
----------------------------------------
System.Drawing
    Assembly Version: 2.0.0.0
    Win32 Version: 2.0.50727.3053 (netfxsp.050727-3000)
    CodeBase: file:///D:/WINDOWS/assembly/GAC_MSIL/System.Drawing/2.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
----------------------------------------
System.Runtime.Remoting
    Assembly Version: 2.0.0.0
    Win32 Version: 2.0.50727.3053 (netfxsp.050727-3000)
    CodeBase: file:///D:/WINDOWS/assembly/GAC_MSIL/System.Runtime.Remoting/2.0.0.0__b77a5c561934e089/System.Runtime.Remoting.dll
----------------------------------------
Accessibility
    Assembly Version: 2.0.0.0
    Win32 Version: 2.0.50727.3053 (netfxsp.050727-3000)
    CodeBase: file:///D:/WINDOWS/assembly/GAC_MSIL/Accessibility/2.0.0.0__b03f5f7f11d50a3a/Accessibility.dll
----------------------------------------

************** JIT Debugging **************
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.

For example:

<configuration>
    <system.windows.forms jitDebugging="true" />
</configuration>

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box."
Parent - By Vempele (Silver) Date 2010-03-27 20:05
Invalid Stockfish path.
Parent - - By Uly (Gold) Date 2010-03-27 20:54
Can you try this game's white player just for interest?

1. e4 c5 2. b4 cxb4 3. Nf3 Nf6 4. e5 Nd5 5. a3 e6 6. axb4 Bxb4 7. Na3 Nc6
8. c4 Nde7 9. Nc2 O-O 10. Nxb4 Nxb4 11. Ba3 Nec6 12. Qb1 a5 13. Bd3 f5 14.
Be2 d5 15. exd6 Qxd6 16. d4 Bd7 17. Qb2 Be8 18. O-O Bh5 19. Rfd1 Rae8 20.
Rd2 b6 21. Rad1 Re7 22. h3 h6 23. Qb3 Rc8 24. Bb2 Nd8 25. g4 fxg4 26. Ne5
Be8 27. d5 exd5 28. Bxg4 Ndc6 29. Bxc8 Nxe5 30. Bxe5 Rxe5 31. cxd5 Bf7 32.
Be6 Bxe6 33. dxe6 Qxe6 34. Rd8+ Kh7 35. Qxe6 Rxe6 36. R8d6 Re4 37. Rxb6 a4
38. Ra1 Nd5 39. Rb7 h5 40. Kg2 Rd4 41. Ra7 Nc3 42. Rc1 Nd5 43. Rc6 Nf4+ 44.
Kg3 a3 45. Rcc7 Ne6 46. Re7 Rd6 47. Rxa3 Kh6 48. Rea7 Nc5 49. f3 Rg6+ 50.
Kf2 Rd6 51. h4 Nd3+ 52. Kg2 Rg6+ 53. Kh2 Nc5 54. Rc3 Ne6 55. Ra5 Nf4 56.
Rf5 Ne2 57. Rcc5 Ra6 58. Rxh5+ Kg6 59. Rhg5+ Kh6 60. Rc8 g6 61. Rgc5 Ra4
62. Rc4 Ra3 63. R4c7 g5 64. Rc6+ Kg7 65. R8c7+ Kf8 66. Rh6 Kg8 67. Re6 Kf8
68. Rxe2 g4 69. fxg4 Ra4 70. h5 Ra8 71. h6 Kg8 72. Ree7 Kf8 73. Rg7 Ra2+
74. Kg3 Ra3+ 75. Kh4 Re3 76. h7 Rh3+ 77. Kxh3 Ke8 78. h8=Q# 1-0

(I think white played at some 3600 ELO, so it's interesting to see how a white player playing those moves in a casual game would rate)
Parent - By NATIONAL12 (Gold) Date 2010-03-27 21:59
cant we just forget this disaster,however whites ELO on this game is def over 3400 imo.
Parent - By jackwelb (*) Date 2010-03-27 22:58
Trying to rate a 3600 ELO game with a 3100 ELO engine seems a rather foolish exercise.  Much like a 2300 ELO player trying to advise Magnus Carlsen.  This program will only give good information for ELO's under 2500 and so-so info up to 2700.  Perhaps with Rybka 4 and further development I can get good info up to 2900 ELO.
The program's focus is to rate human moves and games (excluding book moves which are better rated with good opening book) and to provide information which is not available from other chess software.  This project is at an early stage and now needs more than just my input.   Is there interest in the information this program provides?  I have enjoyed the development thus far but my programming skills are limited.  I was thrilled to get 4 instances of Stockfish running at the same time from within the program!  It would be great if someday this program's functions were incorporated into Aquarium.
Parent - By Highendman (****) Date 2010-03-27 23:12
Thx :)
Parent - - By Banned for Life (Gold) Date 2010-03-28 00:26
Too bad he won't take up the challenge. The program would probably conclude that HEM was a lucky patzer! :-D
Parent - By Uly (Gold) Date 2010-03-28 04:54
Yeah, I didn't provide the game to make fun of the program, but because I'm interested in the output, I still hope he gives it.
Parent - - By Geomusic (*****) Date 2010-03-28 07:11
3600 elo? how?
Parent - By Uly (Gold) Date 2010-03-28 08:22

> 3600 elo? how?


http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?pid=215125

Anyway, I mean 3600 on a CCRL scale, where Rybka 3 at 40/40 time controls and generic book is already at 3234 elo.
Parent - - By M ANSARI (*****) Date 2010-03-28 07:34
Naum has a nice tendency to keep pieces on the board for as long as possible when it has a spacial advantage.  That is something you see only in very top level GM games.  Most would prefer to bail out with a winning advantage out of the position and quickly exchange pieces to get a clean cut winning endgame.  I have to admit it looks silly though sometimes ... as in this game you posted, where the simple RxB and then Ne7+ would have caused an immediate resignation.  In the middle game though, keeping pieces on board when you opponent is struggling for space can really be devastating ... the more they struggle the deeper the hole they dig themselves into.
Parent - - By Geomusic (*****) Date 2010-03-28 08:13
I'm having a problem with the program just running stockfish continually. How long does an analysis of a game last? Is there a way to change this time?
Parent - - By Geomusic (*****) Date 2010-03-28 09:31
ok I figured it out. so far I maxed out on a standard game the ELO on depth 10 and elo = 2000 now Ill analyze it at d 15 and 2500
Parent - By Geomusic (*****) Date 2010-03-28 19:25
Ive only got it to work with 1 game so far the rest cause exceptions
Parent - - By Olympus (*) Date 2010-03-30 19:13
I'm using the 32-bit version, and i can't get it to work. When i click the "Create Game Report" button, i get a message that the program is not responding!!
Parent - - By jackwelb (*) Date 2010-03-30 22:27
I have updated the program and readme file in the first post (added some error checking & program will now read a commented pgn file).  Please download both and follow the new instructions in the readme file.  If you have any problems, please send a message to email address in the readme file.  I appreciate your feedback.
Parent - - By Yoav Dothan (**) Date 2010-04-01 09:58
I tried a game of mine (24 moves) on the 32bit version - it took about 2 hours and rated it 2467 which is way more than I should get...

At least I got a hint of the time needed - at depth 12.
Parent - - By Banned for Life (Gold) Date 2010-04-02 00:26
Congratulations! You should quit your job and start working to get your GM title! :-)
Parent - - By Geomusic (*****) Date 2010-04-02 01:27
I get anywhere from 1200 to 2000 myself LOL
Parent - - By ssace (**) Date 2010-04-02 02:00
lol...so 1200 normal and 2000 after about 4 beers :)
Parent - By Geomusic (*****) Date 2010-04-02 02:28
my motivational factor or beer factor yes :)
Parent - - By hood (**) Date 2010-04-02 07:03
Thankx.

That is nice program, i have been waiting for it.
I can not test it, i am using 32 b OS. :-(

I hope for 32b version.

rgds hood
Parent - By hood (**) Date 2010-04-02 11:14
I got 32b hopefully. thanks.
Parent - - By deka (****) Date 2010-04-02 11:17
Your program is very interesting, although the concept of being able to ascertain one's playing level with the precision of 1 elo point on the basis of 20-30 moves only is a nonsense.

Here's a challenge to you: see how your program rates both sides in these games and what the average elo performance is.
The average elo of the players is 2003 and the performance of these games according to the methods explained here http://web.zone.ee/chessanalysis/study%20on%20chess%20strength.pdf is about 1980.
Attachment: 1980.pgn (7k)
Parent - - By jackwelb (*) Date 2010-04-02 16:43

> being able to ascertain one's playing level with the precision of 1 elo point on the basis of 20-30 moves only is a nonsense


I completely agree.  The goal of the program is to determine your performance in that one game.  For an overall rating, the average score over many games would be needed.

I will definitely look at the other information you provided.  Thank you for the link.  I am still in the process of tuning the ELO ratings to be comparable to FIDE.  When this has been accomplished, I will take up your challenge.
Parent - By deka (****) Date 2010-04-02 17:10

>I completely agree.  The goal of the program is to determine your performance in that one game.  For an overall rating, the average score over many games would be needed.


I clarify: whatever performance based only a couple of tens moves can by no means been ascertained with the 1 elo precision.
Parent - - By jackwelb (*) Date 2010-04-09 20:16
I ran the 7 games with the latest version of my program (w/Stockfish 1.6) and the average ELO was 1990.  The individual performances ranged from 1469 to 2618.  The report for the 7 games is attached.
Attachment: GameReport1990.txt (58k)
Parent - - By deka (****) Date 2010-04-09 21:25
Thank you! :) Although one thing bugs; you knew it was around 2000 and chose the elo level correspondingly. Now, try now to run these games at other elo skill levels too to ensure the current result wasn't too biased. Normally you don't know what elo skill level to choose. Anyway the fact that one must choose an elo skill beforehand is a big flaw.
Parent - - By jackwelb (*) Date 2010-04-10 14:55
The Game ELO (& move ELO) are calculated based on the data supplied by Stockfish.  The user supplied Skill Level is only used as a starting point.  For example: a game is examined at a starting point of 2000 ELO.  If "actual errors" are greater than "expected errors", then the game is re-examined at a lower ELO (expected errors increase as ELO decreases; actual errors are constant).  This process continues until expected errors equal actual errors.  Essentially we are looking for the intersection of two equations.  Where we start looking does not matter.

The user defined Skill Level is used as a basis for the calculation of expected errors (each move & game average) and is also a factor in calculating winning percentage.  The reason for examining a game by ELO is that positions which challenge a 1500 player are not the same as the positions which challenge a 2500 player.  This is why we have chess problems of varying degrees of difficulty.

Examining a game at your skill level allows a more personal rating of moves.  For example: in two different positions there is a chance to gain a knight.  Both positions are scored the same (+3.00).  In position A, the knight is captured in 2 moves.  In position B, the knight is captured in 7 moves.  A low level player sees the necessary move in position A but not in position B.  For this player, position A has a low expected error and B has a high expected error.  The player is forgiven for making an error in position B, but not position A.

We have all had moves marked as a blunder by the 3200 level of computer scoring.  We look at the position and exclaim "There is no way I would ever see that move!"  Now there is a method of scoring where we will more likely say "Man, I should have seen that move!"

Forgive errors you could not expect to see -- punish errors you should have seen -- that is level based scoring.
Parent - By deka (****) Date 2010-04-10 15:40
Okay, very good.

Although you said your program works best with players under 2400, it would nevertheless be interesting to see how well is it able to estimate performances over 2700 and more. It would also improve the attractiveness of your program if it were able to quantify higher play quality. So would you analyze Carlsen's games at Nanjing 2008 where his official TPR was 3001 and my own estimation so far 2970?
This figure is not definitive, I'm going to improve the methods I use, and it may change the results significantly.
Parent - - By Hetman (*****) Date 2010-04-02 14:29
Thanks for the program but... It needs me to install .NET Framework why and what for.
Is it possible to bypass that ?
rgds Hetman
Parent - - By jackwelb (*) Date 2010-04-02 16:23
I wrote the program using Microsoft's Visual Basic.NET and therefore the requirement of Microsoft's Framework.  I am not aware of any possible bypass.  Perhaps someone more programming experience can answer that question.
Parent - By Hetman (*****) Date 2010-04-02 16:54
Thanks.

It needs the version 2.0.1.....  by the way.
Parent - - By Vempele (Silver) Date 2010-04-02 16:29

> Is it possible to bypass that ?


I guess you could use Mono for Windows.
Parent - By Hetman (*****) Date 2010-04-02 16:55
thanks, i will try.
Parent - - By dcorbit (***) Date 2010-04-02 21:19
Suggestion:
Instead of hard-wiring the chess engine name as:
Me.txtUciEngine.Text = "C:\Chess\GameReport\stockfish-163-64-ja.exe"
after browsing to the chess engine with the "Open UCI Engine" feature, save the new path in a settings file.

Suggestion:
If you compile "As ANY" then it will run fine in 32 or 64 bit environments.
Parent - - By jackwelb (*) Date 2010-04-02 22:19
Good idea.  Thanks.  I should probably do that with the other settings as well (i.e. default to user settings of last time program was run).
Parent - - By dcorbit (***) Date 2010-04-06 23:01
Let us know when you have an update
Parent - By jackwelb (*) Date 2010-04-07 01:10
Should be 2-3 days.  Will be adding the .ini file to preserve settings.  Also changing the "Move Ranking" section and some other items.

The default compile option was "as any", so the program was always able to run in 32 or 64-bit environments.  Didn't know that until I turned on advanced compile options.  Doing this project has been a great way to learn Visual Basic.
Parent - By jackwelb (*) Date 2010-04-09 20:41
Here is the latest version.  Update includes a settings file (appears after first use), better tuning (more accurate ELO) and other changes.  The program should be a bit more user-friendly though it will still be unresponsive during analysis.  The readme file has also been updated.

The program has been tuned to Stockfish 1.6.  Stockfish 1.7 will work, but has given a lower ELO in my brief testing.

Comments are appreciated.  Please e-mail games you feel are way-off in terms of the Game ELO.  I can use them to refine the program.

One question:  For "expected error" and "actual error", would you prefer pawn units (currently implemented) or winning percentage (as implemented for "Rating")?
Attachment: ChessGameReport.exe (56k)
Attachment: Readme.txt (4k)
Parent - - By Olympus (*) Date 2010-04-13 01:56
Could this tool be used to find good test positions for chess engines? If so, what criteria should be used to pick test positions - "MOVE RANKING", "BEST MOVES", "MOST CHALLENGING POSITIONS", or "Move Rating"?

Thanks
Parent - - By jackwelb (*) Date 2010-04-13 14:38
The "Most Challenging Positions" would be best for finding candidates for test positions.  Though it would be better for human test positions than computer ones.  I have attached a version of the program which will allow analysis at greater depths.  Analyzing a game at depth 17 would take 8 hours on a quad core cpu.  I also suggest you use a skill level of 2500.

The reason it would not work is because you are using a chess engine to "find" moves a chess engine may "not find".  It may work because this program gets a score for every move (multiPV 99).  By searching more broadly it may find a move which was previously pruned.

The "most challenging position" is defined as: the best move at a high depth is least likely to be among the best moves at a low depth (based on player skill level).

By the way, you could also analyze GM games with this version.  Use depth 17 (~8 hours using 4-cpu) and a skill level elo equal to the participants.
Attachment: ChessGameReport.exe (56k)
Up Topic The Rybka Lounge / Computer Chess / Rating a Chess Game
1 2 Previous Next  

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill