Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Tony's positional test suite

Author: Pete Galati

Date: 12:41:53 01/17/01

Go up one level in this thread


On January 17, 2001 at 13:22:02, Dann Corbit wrote:

>On January 17, 2001 at 11:09:27, David Dahlem wrote:
>
>>
>>On January 17, 2001 at 06:25:04, Uri Blass wrote:
>>
>>>On January 17, 2001 at 05:28:37, allan johnson wrote:
>>>
>>>>On January 16, 2001 at 20:09:53, Dann Corbit wrote:
>>>>
>>>>>Here are the remarks that describe the actual positions:
>>>>>http://home.interact.se/~w100107/pos.htm
>>>>>
>>>>>It also gives the names of the annotators.
>>>>
>>>>Dann Any suggestions as to why Century3  did so badly [relatively] in
>>>>the test suites?
>>>>Allan
>>>
>>>Part of the people who analyzed the games are not close to be GM's.
>>>
>>>For example one of them Magnus holm has only 2198 fide rating(I searched his
>>>name in the online database of chessbase).
>>>
>>>I think that it is a bad idea to trust this test.
>>>
>>>I do not trust even GM's.
>>>
>>>I prefer to see a test suite that was generated by chess programs because I
>>>believe more in their moves.
>>>
>>>Uri
>>>
>>>Uri
>>
>>I agree. Why not use these  positions in your suggestion for top engines to
>>analyze for 24 hours?
>
>Better yet, analayze the entire trace of:
>1.  The games actually played
>2.  The suggested alternatives
>3.  The moves the engines suggest

I don't completely understand. Are you talking about analyzing games as in
Crafty's "annotate" command?  If so, then what would you do with the
annotations?

Also, if you have several different programs crunching numbers on the games and
positions, how do you decide which one is correct?

>
>It would take about a month of effort with several computers to complete.  But
>when finished, the results would be a worthy test suite.

If possible, it would be great if somebody here at CCC knew a highly rated GM
that would be willing to sit down and provide opinions, partly because computer
Chess programs can't be incorporating as much human instinct for the game as
they'd like to.

Anyhow..., this below may or may not illustrate what Uri is trying to say.  From
that test suite, pos 8, Comet in Chessbase instead of the Dos version, agreed
with b4 for a while, and then said "screw that" and went and picked the lowest
score Qc1!  How could this be?

positional scores are: b4=10, Nd4=8, Rd2=5, Qc1=5"

[D]2rq3r/pb1pbkpp/1p2pp2/n1P5/2P5/QP2BNPB/P3PP1P/3R1RK1 w - - 0 1; id "8";

Analysis by Comet B27:

1.Qxa5 bxa5
  -+  (-6.17)   Depth: 1/6   00:00:00
1.Qa4
  ±  (1.12)   Depth: 1/15   00:00:00
1.Qa4
  ±  (1.12)   Depth: 2/15   00:00:00
1.Qa4
  ±  (1.12)   Depth: 2/15   00:00:00
1.Qa4
  ±  (1.12)   Depth: 2/15   00:00:00
1.Qa4 Bc6
  ±  (0.73)   Depth: 2/15   00:00:00
1.b4 Nxc4 2.Qxa7 Nxe3 3.fxe3
  ±  (1.07)   Depth: 2/15   00:00:00
1.b4 Nxc4 2.Qxa7 Nxe3 3.fxe3
  ±  (1.07)   Depth: 3/15   00:00:00
1.b4 Nxc4 2.Qxa7 Bc6
  ±  (1.01)   Depth: 4/19   00:00:00
1.b4 Nxc4 2.Qxa7 Bd5 3.Bd4 bxc5 4.Bxc5
  ±  (0.87)   Depth: 5/19   00:00:00  30kN
1.b4 Nxc4 2.Qxa7 Bd5 3.Bd4 bxc5 4.bxc5
  ±  (0.72)   Depth: 5/19   00:00:01  112kN
1.b4 Nxc4 2.Qxa7 Bc6 3.Bd4 e5
  ²  (0.66)   Depth: 6/22   00:00:02  238kN
1.b4 Nxc4 2.Qxa7 Bc6 3.Nd4 Bd5 4.Nf5 bxc5 5.Bxc5 Bxc5 6.bxc5
  ²  (0.57)   Depth: 7/23   00:00:04  589kN
1.Qa4 Bc6 2.Qb4 Bxc5 3.Qc3 Qe7 4.Bg4
  ²  (0.61)   Depth: 7/23   00:00:06  861kN
1.Qb4 Bxc5 2.Bxc5 bxc5 3.Qc3 f5 4.Ne5+ Kf8
  ±  (0.79)   Depth: 7/31   00:00:10  1495kN
1.Qb4 Bxc5 2.Bxc5 Rxc5 3.Rd6 Bxf3 4.exf3
  ±  (0.86)   Depth: 7/31   00:00:12  1726kN
1.Qb2 Bxc5 2.Bxc5 Rxc5 3.Rd6 Bxf3 4.exf3
  ±  (0.89)   Depth: 7/31   00:00:13  1972kN
1.Qc1 Bxc5 2.Bxc5 Rxc5 3.Rd6 Bxf3 4.exf3
  ±  (0.93)   Depth: 7/31   00:00:14  2193kN
1.Qc1 bxc5 2.Qd2 d5 3.cxd5 Bxd5 4.Qc3 Qc7
  ±  (0.82)   Depth: 8/31   00:00:19  2944kN
1.Qb2 bxc5 2.Bf4 h5 3.Bd6 Rc6 4.Bxe7 Qxe7
  ±  (0.83)   Depth: 8/31   00:00:22  3376kN
1.Qb2 bxc5 2.Qd2 d6 3.Bf4 Qb6 4.Qd3 Bxf3 5.Qxf3
  ±  (0.87)   Depth: 9/37   00:00:42  6700kN
1.Qb2 bxc5 2.Qd2 d6 3.Bf4 Rc6 4.Bxe6+ Kxe6 5.Qc3
  ±  (0.73)   Depth: 10/37   00:01:23  13096kN
1.Qb2 bxc5 2.Bf4 d6 3.Qd2 Rc6 4.Qc3 g5 5.Be3 Rc8
  ²  (0.62)   Depth: 10/37   00:04:04  38252kN
1.Qc1 bxc5 2.Bd2 d6 3.Bc3 Be4 4.Qf4 f5
  ²  (0.69)   Depth: 10/37   00:04:27  41483kN
1.Qc1 bxc5 2.Bd2 d6 3.Bc3 Be4 4.Qf4 Bxf3 5.exf3 f5
  ±  (0.82)   Depth: 11/37   00:07:35  70752kN
1.Qc1 Bxc5 2.Bxc5 Rxc5 3.Qd2 Bxf3 4.exf3 d5 5.Bxe6+ Kxe6 6.Qd4
  ±  (0.82)   Depth: 11/37   00:08:24  80351kN
1.Qc1 bxc5 2.Bd2 Nc6 3.Bc3 Qc7 4.Qd2 d6 5.Qf4 e5 6.Qd2 Rb8
  ±  (0.78)   Depth: 12/37   00:16:29  166083kN
1.Rd2 Bxc5 2.Bxc5 Rxc5 3.Rfd1 d5 4.cxd5 Rxd5 5.Rxd5 exd5
  ±  (0.79)   Depth: 12/39   00:26:16  274572kN
1.Rd2 bxc5 2.Rfd1 d6 3.Bf4 Rc6 4.Bg2 Qc7 5.Rd3 Ra6 6.Qb2 e5 7.Bd2
  ±  (0.81)   Depth: 13/39   00:46:21  504811kN
1.Qc1 bxc5 2.Bd2 Nc6 3.Bc3 Qc7 4.Qd2 Qxg3+ 5.hxg3 Nd4
  ±  (0.92)   Depth: 13/39   00:54:34  601587kN
1.Qc1 bxc5 2.Bd2 Nc6 3.Bc3 Qc7 4.Qe3 Rhd8 5.Rd2 Rb8 6.Rfd1 Kg8 7.Bg2
  ±  (0.94)   Depth: 13/39   01:03:58  713444kN
1.Qc1 bxc5 2.Bd2 Nc6 3.Bxe6+ dxe6 4.Qc2
  ±  (0.80)   Depth: 14/39   01:50:02  1261026kN

(Galati, ` 17.01.2001)




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.