Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Maths: Fair match between programs on uneven machines

Author: James T. Walker

Date: 14:00:41 02/15/00

Go up one level in this thread


On February 15, 2000 at 09:36:18, Enrique Irazoqui wrote:

>On February 15, 2000 at 09:12:25, Shep wrote:
>
>Hi Shep,
>
>Your math is interesting, but don't you think that the easiest and most accurate
>procedure in the case of uneven hardware is the simple swapping of machines?
>Each program would play half the match on the fast computer and half on the slow
>one.
>
>Enrique
>
>>Hi all,
>>
>>I was trying to write this post earlier, but found a flaw in my calculations, so
>>here goes the fixed one:
>>
>>Suppose you want to play a match on two machines with PB and only have two
>>machines of different speed. (Obviously, just adjusting the time controls to
>>reflect the speed difference won't make it fair.)
>>
>>Assume that machine A is the faster one and that machine B is slower by a factor
>>of k>1. The natural impulse would be to give machine B k-times as much
>>reflection time.
>>For simplicity, let's assume that both machines predict precisely 50% of their
>>opponent's moves. Then the effective reflection times for both side are:
>>
>>  R_a(k) = 1+k/2
>>  R_b(k) = k+1/2
>>
>>Both reflection time functions are linear in k and intersect at k=1, thus it's
>>easy to see that
>>
>> R_a(k) < R_b(k)  for all k>1
>>
>>Thus
>>
>>  l := R_b(k)/R_a(k) > 1 for all k>1
>>
>>is the factor by which B's reflection time is too big to be fair.
>>
>>Consequently, to have a fair match, the multiplier for B's reflection time needs
>>to be k/l instead of k.
>>A quick calculation yields the final formula:
>>
>>  m := k/l = (k^2+2k)/(2k+1)
>>
>>Thus, if machine B is given m-times the reflection time of machine A, the match
>>is fair (under the assumption that both sides predict 50% which is not precise,
>>but rather realistic - the final formula is slightly more complex for uneven
>>prediction rates).
>>
>>Example table:
>>
>>    k    m
>>   --------
>>    2   ~1.6
>>    3   ~2.1
>>    4   ~2.7
>>    5   ~3.1
>>   10   ~5.8
>>
>>---
>>Shep

Hello Enrique,
I think the math is silly and not even logical.  In any case I have run several
test trying to give time odds to compensate for my two different
computers(K6-3-450 & PII-333).  I once tried giving Crafty 3 times as much time
as Fritz in order to compensate for speed difference and Crafty did worse with
the 3X factor than with equal time.  I still have it labeled Crafty(3X) in my
database and it's rating is lower than Crafty.  I have found that swapping with
my two computers gives very good results as long as you play enough games.  In
any short contest you will occasionally get some very strange results.  I have
seen Chess Tiger beat Fritz 6 by 9-1 when running on the PII-333 while Fritz was
on the K6-3-450.  You and I both know this is not a realistic score between
these two at any speed.  Anyway the bottom line is you can test the above math
empirically by playing the same program against itself and looking at the final
results.  If the math above was good and you play a few hundred games the
program would play itself to a tie(Reasonably close anyway).
Jim Walker



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.