Author: Robert Hyatt
Date: 21:50:40 10/05/99
Go up one level in this thread
On October 06, 1999 at 00:40:23, Christophe Theron wrote: > >Probably because you feel like you are allowed to make rock statements like > > "Testing on _one_ machine is a bad practice, period." > >and that you do that everytime you post here, as if you were the ultimate expert >here. > > Err... I believe I _am_ the "resident expert" when it comes to Crafty, wouldn't you think? IE who would claim to know more about how it works, how it was designed, why it was designed that way? And whether you like it or not, one more time: "using crafty, testing on one machine _is_ a bad idea. If you don't like that, tough. test your own program in any way you want. I don't want to take the time to fiddle with this." > >> but I'm up to the task. > > >I know. > > > >>If it takes a 'crippled' machine for you to find new algorithms or find old >>bugs, fine. I have a better testing methodology. Because such testing is not >>exactly a modern approach to developing software. It is just as easy to cut the >>search time by 90% rather than finding a machine 1/10th the speed. Exactly the >>same result... > >No. > >I'm using the standard PC timer resolution, which is about 0.05 seconds, to make >time measurements in my program. > >My K6-300 is about 100 times faster than my 386sx20. And I wanted, for some >purpose, to play blitz games at 386sx20 rate. > >To get on the K6 the same time per move, I should have set it to game in 3 >seconds, which makes something like 0.05 seconds per move in average. This is >too close from the PC timer resolution, so I had to test on 386. > >The purpose of the test was to check if my pruning near the horizon was as good >as the pruning of very old programs (Psion and Genius to name them). It was not, >and if I had no 386 at hand I would probably have overlooked it. > >I would not run on a 386 all day, but in this case it helped. > > > > >>>As for "will it be useful in serious games", keep an eye on the results of Tiger >>>and you will know. >>> >>>Thanks for your time and patience, Doctor Hyatt. >>> >>> >>> >>> Christophe >> >> >>I'll bet you a buck that your testing with ponder=off won't help you one iota >>in "real" games... Because you won't be playing with ponder=off in "real" >>games, just like the rest of us.. > >I *never* play real games, except when I operate Tiger at a tournament (or the >day before to be sure that playing real games still works). > >I have *never* played a long time control game (40 moves in 2 hours) in my "lab" >since more than 5 years. > >The last time I played a game in 1 hour in the lab was 2 years ago. 2 games >against CM4000, I remember. > >99% of the games I play with Tiger are on a single computer (switching back and >forth between the 2 programs under Windows), and of course PB off. > >So if testing with PB off does not help me, I guess you can deduce I have made >no progress since more than 5 years. > > > Christophe Please try to read carefully. testing _specifically_ to tune the ponder=off mode of playing will _not_ help you win a game anywhere, except when you play ponder=off games. Testing with ponder=off is fine. I do it all the time to get more repeatibility when testing or debugging. But I don't test/tune _specifically_ for that mode (ponder=off). As a result, that mode is much less tested than ponder=on. I have seen the result. And I don't like what I see, and I don't have the time, nor do I want to take the time to improve that which has nothing to do with 'winning real games.' end of story... cute/snide remarks don't cut bait here. If you want to make it that when I tell someone that my program isn't set up to work in a mode they are using it, that I am calling them stupid... or if you want to twist what I wrote to say you have made no progress... that's your choice. But it isn't what I _said_.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.