Author: Christophe Theron
Date: 12:26:29 04/28/00
Go up one level in this thread
On April 28, 2000 at 06:49:20, Chessfun wrote:
>On April 28, 2000 at 02:47:51, Christophe Theron wrote:
>
>>On April 28, 2000 at 02:00:05, Ralf Elvsén wrote:
>>
>>>On April 28, 2000 at 00:36:59, Christophe Theron wrote:
>>>
>>>>On April 27, 2000 at 02:16:48, Chessfun wrote:
>>>>
>>>>>
>>>>>All games on one Cel 433.
>>>>>Ponder=off.
>>>>>Tablebases used at 25 and longer.
>>>>>Nunn 1 positions.
>>>>>No opening books are loaded.
>>>>>
>>>>> 1 min game Fritz 6a 14.5 - 5.5 Crafty 17-10
>>>>> 2 min game Fritz 6a 14.5 - 5.5 Crafty 17-10
>>>>> 3 min game Fritz 6a 13.0 - 7.0 Crafty 17-10
>>>>> 5 min game Fritz 6a 15.5 - 4.5 Crafty 17-10
>>>>>10 min game Fritz 6a 13.0 - 7.0 Crafty 17-10
>>>>>25 min game Fritz 6a 13.0 - 7.0 Crafty 17-10
>>>>>60 min game Fritz 6a 15.5 - 4.5 Crafty 17-10
>>>>>Tourney times Fritz 6a 14.5 - 5.5 Crafty 17-10
>>>>>
>>>>>Once I figure out how to autoplay from the Nunn 1 opening
>>>>>positions I will play all games with ponder=on.
>>>>>
>>>>>Thanks.
>>>>
>>>>
>>>>Great job!
>>>>
>>>>Even given the error margin due to the small number of games in each match, the
>>>>winning percentage is incredibly consistent.
>>>>
>>>>I'm not saying it would be as consistent with any program pair, but at least I
>>>>think it tells us something very interesting about these 2 programs.
>>>>
>>>>
>>>>
>>>> Christophe
>>>
>>>Yes, the consistency is almost too good to be true, not that I am saying
>>>there is something strange going on... :)
>>>
>>>If the games have been posted here, I am too lazy looking at them. Has anyone
>>>checked if there is a strong consistency in the outcome of particular openings
>>>played with different tine controls? I.e. , does Fritz always win one position
>>>and Crafty another?
>>>
>>>Sorry if this has been asked before.
>>>
>>>Ralf
>>
>>
>>
>>That's indeed something you should do, Sarah.
>>
>>No need to walk thru the games, just looking at the results lists will do.
>>
>>If the programs always win, or lose, in the same positions, I guess we can
>>suspect that the understanding of the position has played a crucial role. Which
>>would mean that the evaluation functions are the key point in the outcome of the
>>match.
>>
>>
>>
>> Christophe
>
>
>This is something I looked at and something that originally
>caused this post:
>http://site2936.dellhost.com/forums/1/message.shtml?108059
>Some positions are won some are lost. There seems no consistancy.
>Position #13 for example Crafty won at tourney time though Fritz 6
>as I recall had won most #13's prior to that.
>I will post a spreadsheet of the results similar to what I did
>in my Junior 6a Nunn 1 matches on my website:
>http://www.geocities.com/chessfun_1999
>The purpose of those spreadsheets in the format made was to see
>if Junior 6a consistancy won certain positions.
>
>Thanks.
OK, so if there is no win or loss consistency in any given position, the problem
of knowing if the programs understand the position or not, and the fact that one
program would never have reached the position by itself, do not matter anymore.
It cannot be said that the starting positions are more favourable to one
program.
All these observations add a lot of validity to this kind of test.
And the fact that the outcome of the match does not vary significantly when the
time controls change is still remarkable. It tells nothing in general, but it is
a very interesting information to compare the 2 programs in question.
Christophe
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.