Author: Bertil Eklund
Date: 13:43:08 04/27/00
Go up one level in this thread
On April 27, 2000 at 12:28:38, Enrique Irazoqui wrote: >On April 27, 2000 at 12:20:10, blass uri wrote: > >>On April 27, 2000 at 11:48:24, Enrique Irazoqui wrote: >> >>>On April 27, 2000 at 02:16:48, Chessfun wrote: >>> >>>> >>>>All games on one Cel 433. >>>>Ponder=off. >>>>Tablebases used at 25 and longer. >>>>Nunn 1 positions. >>>>No opening books are loaded. >>>> >>>> 1 min game Fritz 6a 14.5 - 5.5 Crafty 17-10 >>>> 2 min game Fritz 6a 14.5 - 5.5 Crafty 17-10 >>>> 3 min game Fritz 6a 13.0 - 7.0 Crafty 17-10 >>>> 5 min game Fritz 6a 15.5 - 4.5 Crafty 17-10 >>>>10 min game Fritz 6a 13.0 - 7.0 Crafty 17-10 >>>>25 min game Fritz 6a 13.0 - 7.0 Crafty 17-10 >>>>60 min game Fritz 6a 15.5 - 4.5 Crafty 17-10 >>>>Tourney times Fritz 6a 14.5 - 5.5 Crafty 17-10 >>>> >>>>Once I figure out how to autoplay from the Nunn 1 opening >>>>positions I will play all games with ponder=on. >>>> >>>>Thanks. >>> >>>I find what you are doing very interesting, not so much concerning the relative >>>strength of Fritz and Crafty, which a series of matches between them can't >>>determine anyway, but regarding testing procedures. >>> >>>I ran 2 similar matches myself between Crafty 17.10 and Fritz 6a in the GUI of >>>Fritz 6a, with the General book of F6 (Alex Kure), tablebases on (2.6 GB of the >>>Turbo CDs) and 4MB hash for each engine. The first match was played on 2 P600E, >>>Game/1 minute, ponder on. The second, on a single P600E, ponder on and game/2 >>>minutes, since each program is using 50% of the CPU. >>> >>>In the first match, Fritz 6a won 15-5, which is consistent with your 14.5-5.5 >>>and seems to indicate that ponder off doesn't hurt Crafty more than Fritz. >> >>I cannot compare between your match and the nunn match because the positions are >>not the same. >> >>I guess that ponder off does not hurt crafty more than Fritz but to prove it you >>should use the same positions. >> >>It is better to use something like the nunn match in every test otherwise the >>lucky program with the choice of the opening has advantage. >>You can use different positions and not have to use the nunn positions but every >>program should play the same positions with white and black. >> >>Uri > >I find interesting this series of matches because they may tell us something >about the value of ponder on/off, playing on 1 or 2 machines, blitz vs. slow >games. About using the Nunn positions, I think that they are useful to avoid >randomness and to measure engines instead of books, but maybe we can achieve the >same by using the same book for both engines, as I did. So far, my results and >Chessfun's are pretty consistent. > >Instead, there is lack of consistency between these blitz results and the SSDF >match at 40:2 that Fritz wins so far by 15-10, or 60% instead of the 75% of the >blitz matches. > >Enrique Hi! One of the reasons could be that they use a similar book. If you use the same book, or nearly the same I believe the results can be more even. Bertil
This page took 0.01 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.