Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Fruit 2.1 with Futility and Delta pruning

Author: Joachim Rang

Date: 05:39:19 06/21/05

Go up one level in this thread


On June 21, 2005 at 08:31:23, Aaron Gordon wrote:

>On June 21, 2005 at 08:18:49, Joachim Rang wrote:
>
>>On June 21, 2005 at 02:54:06, m.d.hurd wrote:
>>
>>>Just for fun I set Fruit 2.1 standard versus Fruit 2.1 with Futility and Delta
>>>pruning switched on.
>>>
>>>2 rounds of 5 games at game in 30 minutes. 128 kb cache for each engine using
>>>the supplied book_small.bin
>>>
>>>I wanted to see how differently they played and whether the extra settings made
>>>much difference.
>>>
>>>10 games is obviously not enough to say one way or another, however maybe
>>>someone would like to test this further.
>>>
>>>For some strange reason I called the Fruit 2.1 with the extra settings Fruit 2.1
>>>vr/dp, anyway ....
>>>
>>>The games were run on a single AMD 2400 XP with 1 gb memory.
>>>
>>>Round one Fruit 2.1 vr/dp scored 3.5 and Fruit 2.1 standard 1.5
>>>
>>>Round two Fruit 2.1 vr/dp scored 3.5 and Fruit 2.1 standard 1.5
>>>
>>>Total 7 points out of 10 for Fruit with the extra settings.
>>>
>>>Fruit 2.1 standard settings never won a game.
>>>
>>>If anyone wants the pgn just let me know.
>>>
>>>Regards
>>>
>>>Mike.
>>
>>
>>Prior to release 2.0 I tested it thoroughly. Ater 400 games it scored about 10
>>Elopoints better than without futility and delta pruning. It did very well in
>>Testsuitesthough. Fabien decided against it, since 10 Elopoints were too small
>>to be sure that it helps and since I had only data for very fast blitz and the
>>new history pruning was a clear improvement. I think it is a bit more likely
>>that it helps than that it hurt but the difference will be small (10 Elopoints.
>>
>>Perhaps someone will make a really significant test sometimes?
>>
>>regards Joachim
>
>I have been doing a bit of testing with games and test positions. So far, it
>looks like both of you are correct. I am seeing a definite improvement with both
>delta and futility pruning enabled. I have yet to see a position that shows a
>negative impact from having it enabled (I'm not saying there isn't such a
>position, just that I have yet to find it). Some moves take 3 times less time to
>find with both of these options enabled, I'll continue testing and see how it
>goes.


I had a lengthy discussion with Fabien about that. It probably does help
tactically (which are mst testpositions) but it might hurt positionally. Anyway
Fabien believes the most you can get is 10 Elo and he didn't want to take the
risk for such a small gain.

I would like to test it definitely but besides tespostions I think a gauntlet
against 10 different engines with 400 games for Fruit is minimum. Again to prove
a 10 Elopoint increase it is definitely much testing time. And then you canT be
sure that it helps with all time controls.

regards Joachim



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.