Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: PB-ON vs PB-OFF (results experiment-1)

Author: Peter Kappler

Date: 09:18:11 10/10/99

Go up one level in this thread


On October 10, 1999 at 04:00:21, Mark Young wrote:

>On October 10, 1999 at 03:22:13, Harald Faber wrote:
>
>>On October 10, 1999 at 03:14:10, Ed Schröder wrote:
>>
>>>PB-ON vs PB-OFF (results experiment-1)
>>>
>>>To enrich the discussion about the value of the "Permanent Brain" (PB) I
>>>have started 2 experiments with Rebel Century (RC) which will give some
>>>data for a better judgement.
>>>
>>>Experiment-1:
>>>RC (PB=ON) vs RC (PB=OFF)
>>>100 auto232 games
>>>Time control: 60 secs average.
>>>Hardware: 4xPII-266 + 2xPII-450
>>>Result: 61-39
>>>
>>>Experiment-2:
>>>RC (PB=ON) vs RC (PB=OFF)
>>>100 auto232 games
>>>Time control: RC (PB=ON) 30 sec average
>>>Time control: RC (PB=OFF) 60 sec average
>>>Hardware: 4xPII-266 + 2xPII-450
>>>Status: in progress
>>>
>>>Ed Schroder
>>
>>Sorry Ed, but where is the sense in it? Is there any difference than playing
>>Rebel10-Rebel9 which is also meaningless?
>>Would you expect a result of 50-50 when both playing PB=on or both PB=off? I
>>wouldn't.
>>I think the most interesting idea is to take Rebel+PB=on against another program
>>with PB=on and as comparison play the same match with both PB=off. Of course you
>>can extend this to Rebel+PB-vs-Opp X PB=off and Rebel PB=off vs Opp X PB=on.
>>
>>But Rebel vs Rebel, sorry, there is really no sense in it.
>
>You hit the nail on the head...this has been the argument. playing both programs
>with PB off as you do with one computer.
>
>His experiment is meaningless.


I'm afraid I agree.  The original debate was whether single-computer winboard
matches (pondering=off) could produce reliable results.

Everybody understands that playing with ponder=off will weaken a program.  What
isn't so clear is if weakens 'program X' more than 'program Y'.  Ed's experiment
does nothing to answer this question.  (Perhaps he can repeat his X vs. X
experiment with other programs - that would produce some useful information for
comparison.)

--Peter

--Peter





This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.