Author: Dann Corbit
Date: 09:39:48 07/20/99
Go up one level in this thread
On July 20, 1999 at 12:28:40, KarinsDad wrote: >On July 20, 1999 at 12:12:14, Dann Corbit wrote: > >>I think it would be interesting to benchmark chess algorithms: >>0. Move generators -- all types >>1. Alpha-Beta vs MTD(f) >>2. Bitboards vs 0x88 >>3. etc. >> >>Prepare a large crosstable and do a large number of runs with as many >>implementations as possible and under as many different conditions as possible. >> >>Change the search time from very short searches (10 sec or less) up to half an >>hour to find the bit O(f(n)) properties of the algorithms. >> >>A systematic study might eliminate a lot of guesswork or even tell us *where* >>certain algorithms work better than others. For instance, we might use one >>algorithm at a certain time control and a different algorithm at a longer time >>control and yet another at correspondence chess time controls. > >Sounds good in theory, but the main difficulty comes in with the control. In >order to get valid results, you have to change only one element in a program at >a time. Since chess programs have so many elements which are linked to one >algorithm or another (because I am using Alpha-Beta, I can also use lazy >evaluation), you would have to do a lot of work to ensure that you are comparing >apples with apples. I am not saying that it cannot be done, I just foresee that >it would require a lot of work (similar to what Aske Plaat and some of the other >researchers have done). We might be able to achieve something like that by looking at certain implementations. For instance, we could find out the record for legal move generation for a normalized number of CPU mips. After finding out what the fastest routines are, we could see what algorithms they use. We could find programs where they have replaceable drivers for search techniques and have benchmarked both techniques, etc.
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.