Author: Eran
Date: 08:25:17 02/07/02
Go up one level in this thread
On February 07, 2002 at 08:30:07, Uri Blass wrote: >On February 06, 2002 at 19:48:13, Eran wrote: > >> >>The interesting comparative results of the MATS test set (The MAstricht Test >>Set) are shown below. >> >>Fritz7 with futility pruning (selected): >>Result 18 out of 24 = 75% Average time = 18.05s / 163.09s >> >>Fritz7 without futility pruning (deselected): >>Result 19 out of 24 = 79% Average time = 25.08s / 145.04s >> >>Fritz7 with latest update (version 7.0.0.6 - January 22, 2002) >>MATS test set contains 24 positions in total >> >>For more information about MATS test set, please click below >> >>http://www.cs.rulimburg.nl/~uiterwyk/icca/mats.htm . >> >>Also, the test set in epd format can be downloaded from there. >> >>I tried to compare how well Fritz7 played with and without futility pruning. >>Please see the comments as follows below. >> >>Firstly, based on the test Fritz7 without futility pruning seemed to solve more >>positions than with futility pruning. The only game number 10 in the test set >>was solved by Fritz7 without futility pruning only. The rest were the same but >>with futility pruning Fritz7 searched a bit faster. That indicated that without >>futility pruning Fritz7 seemed to play better in positional games. Obviously, >>with futility pruning Fritz7 overlooked it because futility pruning was an >>aggressive, faster and deeper search that might miss some good moves. Secondly, >>Fritz7 without futility pruning seemed to search slower than with futility >>pruning but overlooked less. >> >>Conclusion: I believe that Fritz7 with futility pruning is better in >>time-control games in tournament such as rapid chess, sudden death and any >>tactical-oriented games. On the other hand, if you want to let Fritz7 analyze a >>position or a game for a long time, futility pruning should be turned off since >>time is not very important. > >I suspect that you did not give Fritz enough time in order to know what happens >at long time control. >I think that it may be more interesting to see results of Fritz at 1 hour per >move with and without futility pruning. > >total 48 hours for all the test >average time of 20 seconds per position means that there was no position when >Fritz needs more than 10 minutes to solve. > >I do not believe that there is no position when Fritz needs more than 10 minutes >to solve and I guess that if you give Fritz one hour per move you will find more >information. > >I tend to believe that the default option is best for all time control unless I >see a proof that it is not and the results are not enough to convince me. > >Uri If the futility pruning cuts one variation that leads to finding the best move 1.b4 in the game # 10 in the MATS test set, then Fritz7 will never search that variation again because it is cut forever. So I don't believe that if Fritz7 with futility pruning continues searching, it will ever find the best move 1.b4 in one or two hours later. I do not think that a very long time calculation for Fritz with futility pruning makes sense. It would be a bit more sense for Fritz without futility pruning. Futility pruning is useful for control-time game like blitz, rapid chess and the like meaning time is of great concern. Eran
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.