Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Crafty 19.7 GCM-ECP results

Author: Uri Blass

Date: 12:53:19 12/15/03

Go up one level in this thread


On December 15, 2003 at 15:21:57, Tord Romstad wrote:

>On December 15, 2003 at 13:58:02, Dann Corbit wrote:
>
>>Number of tests:                       183
>>Max score:                             183
>>Engines score:                         165
>>Number with full score:                165
>>Found in: 1 sec = 28, 2 sec = 11, 5 sec = 29, 10 sec = 20, 30 sec = 30, 1 min =
>>9, 2 min = 12, 5 min = 17, 10 min = 4, 30 min = 5,
>>Time used for tests (wrong answer=900s): 27361s
>>
>>Positions with error (id):
>>ECM.1068, ECM.1197, ECM.1204, ECM.1217, ECM.1227,
>>ECM.1229, ECM.1265, ECM.1273, ECM.1294, ECM.1308, ECM.1314,
>>ECM.1438, ECM.1533, ECM.1592, ECM.1612, ECM.1617, ECM.1621,
>>ECM.1622
>
>Thanks for the results, Dann!  It looks slightly disappointing, even
>considering the slow hardware.  The results for Gothmog 0.4.2g on a Pentium
>IV 2.4 GHz:
>
>Found in: 1 sec = 72, 2 sec = 22, 5 sec = 26, 10 sec = 13, 30 sec = 15
>
>I've never found the patience to run the test with more than 30 seconds
>per position.
>
>Tord

I do not find the results disappointing because I never evaluated Crafty as a
tactical monster.

Latest Movei is also better than Crafty in the GCP test suite but it even does
not prove that movei is better in tactics than crafty because the tactics in
games is different than the tactics in test suite.

I also suspect that Gothmog "cheat" by finding some sacrifices for positional
reasons when these positional reasons may lead to wrong sacrifices in different
positions.

I will post some results tomorrow when I have access to my A1000 computer (I
saved there my results)

I remember that movei solved 166 position when I gave it 5 minutes per position
but solved is also miskeadubg for movei because movei prints wrong fail high so
practically it can print a move that it does not go to play in game because I
told it not to play fail high moves that it did not solve because they may be
wrong fail high(It is not the best decision and I should decide to play moves
that are suspected to be wrong fail high in time trouble at least in case that
the score before the wrong fail high is bad for movei but it is not very
important in games because usually movei has time to solve the fail high).

Uri



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.