Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Pro Deo 1.1 testing by SSDF is wrong !

Author: Darrel Briley

Date: 19:31:20 06/02/05

Go up one level in this thread


On June 02, 2005 at 14:39:01, Pedro Gomes wrote:

>On June 02, 2005 at 05:09:03, Andreas Stabel wrote:
>
>
>What is very strange is the following:
>
>1) there is no any apologize for those very serious mistakes
>2) Tony Hedlund is already back from his vacations
>
>PG
>
http://www.talkchess.com/forums/1/message.html?429373

This looks like an apology and an acceptance to me...
Text from thread follows:
>Hi Tony,
>
>I already suspected something like that. First of all the personality is
>missing, it means you are playing with an engine of 3 years ago. Secondly the
>hash table size used is only 4 Mb, this would explain the low ply depths.

My mistake. I played with the winboard version using Arena GUI, I thought it
could handle the settings. But I should of course have checked the param-file,
sloppy of me.
Consider this, Pro Deo did rather well against Chess Tiger, Deep Sjeng, Gandalf
and Ruffian.

>Please reread the instruction email I have send you at the time, everything is
>in there.

Yes it is. But I wanted so bad use Arena, and you didn't know anything about
that. Bad call by me. I will go on a vacation tomorrow morning, but I will
restart the testing when I'm back.

>Good luck and keep up the good work.
>
>Ed

Not a very good work this time, I'm afraid. Sorry for this, Ed.

Best
Tony

All okay Tony, wish you a good vacation.

Ed

>
>>Hi,
>>
>>I started to react when Pro Deo lost all its games at the end of the testing
>>against two programs. I don't remember the programs, but it was those before
>>the current testing against Shredder and Junior.
>>
>>If I remember correctly Pro Deo was leading both matches and then suddenly lost
>>all 3-5 games at then end of both matches. I thought at the moment that it was
>>peculiar, but statistically possible. I continued watching Pro Deo and saw that
>>it won a game in the next match and didn't think more of it before now.
>>
>>It is now clear that the test against Junior is wrong (see posts by Ed Shröder
>>and others). The match against Shredder also seems to give too bad results.
>>
>>All this started to happen at a definite moment in the previous matches. I don't
>>know if they always run Pro Deo on the same machine - if so something must have
>>happened to it. If it is run on several machines I must admit a can see no
>>explanation except perhaps a systematic change in the settings that has turned
>>out to be bad.
>>
>>I would call for the testing to be halted until this problem can be solved and
>>then for all Pro Deo matches to be run again.
>>
>>I don't think Ed Shöder and his very nice program deserves this.
>>
>>Still - I would like to thank Tony Hedlund and the other testers in SSDF for
>>the nice work and incredible amount of time they put into this.
>>
>>Best regards
>>Andreas Stabel



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.