Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Chessfun and Nunn1 Tests

Author: Chessfun

Date: 02:49:07 05/11/00

Go up one level in this thread


On May 11, 2000 at 02:32:07, Mogens Larsen wrote:

>On May 11, 2000 at 00:59:13, Chessfun wrote:
>
>>Initially the interest was in the result Jouni posted, Crafty 17-10
>>beating F6a. I asked for the scores and the parameters none were forthcoming.
>>Though it is known that it was with ponder=off.
>>So I decided to run the games myself since I do NOT believe Crafty 17-10 can
>>beat Fritz 6a at Nunn 1. No questions were asked about these results of Jouni's
>>by others or parameters as ensued when my results were posted.
>
>You couldn't run the games yourself since you didn't know Jounis configuration.
>You can run a lot of different timecontrols of course, but the chances of
>examining the same timecontrol as Jouni were next to nothing.


The exact same time control is irrelevant since playing 1/0 2/0 3/0 5/0
10/0 25/0 60/0 120'/40 60'/20 30 covers the field. And since in most cases the
scores were similar playing 15/0 or 5/5 would result in the same score within
a reasonable percentage and since these scores are nothing like Jouni's there
is no way 15-5 to F6 at say 5/0 would change to 12-8 crafty at 5/5.


>>The object initially as stated above was to see whether as claimed Crafty
>>could beat F6a in Nunn 1. Since the time controls were unknown I ran a number
>>of different controls. Although it can be claimed that hash is unknown as are
>>other variables they are still variables and in the case of mine there are none
>>of significance.
>
>This is not true and I think you know it.


No, in my opinion it is true and I know it.


>>I am not sure of any influence of learning. Playing 1/0 then 2/0 then 3/0
>>then 5/0 etc etc what is to be learned for the 5/0 game by initially playing
>>the 1/0 2/0 and 3/0 games. since those time controls are slower. Even if that
>>were the case again none of these questions were asked about Jouni's results.
>
>The learning may or may not be important, but it's a factor in the equation. A
>big factor IMO and one that could/should have been removed. If you claim that
>your test proves anything, you're bound to receive criticism, however valid it
>may be. I don't see why the lack of comments on Jounis result have anything to
>do with this. Your test was much more extensive and advanced than Jounis,
>therefore results and their interpretation was more important.


I don't see the issue with learning, it may be a factor, it is also a factor
both programs have built in. It is also a fact that Jouni's scores which were
the original intent to check were obtained with learning on.
Mine never started out as being any more advanced or extensive than Jouni's.
The questions revolved around mine from the start.


>>They only became issues as lame arguments as much as I am the crafty hater for
>>simply playing these games, and that is in fact how the arguments degenerated.
>>My results didn't sit well therefore they are to be questioned. Jouni's suited
>>therefore let's all take them at face value and knitpick at small variables in
>>Sarah's games such as she posted at ccc while games were running...ha...as I
>>said bunk.
>
>Hmm... I don't think anyone considers you to be a Crafty hater. There were small
>variables and there were big variables. You didn't bother adressing any of them,
>so...


There were a number of posts implying I was biased against Crafty.
The variables were addressed. And they were small there are no big
variables worth the kind of attention my posts get compared to others.


>>Thousands of games and results are posted here at ccc never have I seen so many
>>questions about variables as with mine. Therefore it can only be concluded since
>>no questions are asked about the other games whether the posters of those
>>questions are truly sincere about the questions or whether they just want to see
>>there name on a post.
>
>You're to fond of conclusions without the aid of fact.


That was a fact. How many other game scores do you for example pose questions
of setup on. Remember Chris Taylor's 40 min blitz. Your only question there
for example was what was the time control. This despite chris playing on
two different computers, which left open a myriad of questions based on a 9
round tourney. Did you ask any of those questions? did you ask about the
autoplayer, did you question any of the results?. No you didn't.

Therefore my conclusion is clear and supported by fact.


>>Since again the object was to see if Crafty could win at Nunn 1 whether it
>>was at a disadvantage positionally or tactically from the starting position
>>is irrelevant since Jouni had posted Crafty had beaten F6a at Nunn 1.
>>The objective was simple enough, to see whether similar results to Jouni's
>>could be obtained.
>
>You wrote in the beginning of the post that the reproducing the Jouni test was
>only an interest, which developed into a question of ponder. What is the
>truth?If your objective was to disprove Jounis test, you have to continue
>testing. Since you believe that your test was productive, I would like to know
>_one_ single thing: What comparable data did your test produce? The reason I ask
>is that I haven't seen any yet.


The idea initially as stated was to see if as Jouni stated Crafty could
beat F6 at Nunn 1 blitz. This developed into the ponder issue.
That is the truth. It is true that I did not believe Jouni's score, but I
went into it with an open mind as far as it being within the realm of
possibility.

The test isn't yet complete. Upon completion I will post the results
and comparative data.


>>For others that have recently posted incorrect statements about the 5/0
>>games here are the FACTS:
>>The games looped overnight and played two sets of 20 games.
>>Set one was won by F6a 15-5 and set two by crafty 11-9.
>>
>>On review of both sets on both computers using Crafty's and F6a's evals
>>I determined that F6a's eval depths clearly were lower than they should have
>>been based on the time control and trying a few test positions.
>>Crafty's evals were also checked and found to be fine.
>>The game scores with these crafty evals were then discarded as the match scores
>>were being saved on the computer running crafty. The other comp running F6a
>>still has the game scores with it's eval. Point being that they were checked
>>using both F6a and Crafty evals to check depth.
>
>Why didn't you just state in your first post that the evaluations of Fritz and
>Crafty had been checked? Instead you wrote that you replayed the games and
>selected the 15-5. I think you're bending fact to accomodate your conclusion.

I don't keep track of posts unless they are within the 7 day range of ccc.
But I believe I said I replayed them and got the same 15-5 score. I don't
believe I used the words I selected.

Later that same day I believe Uri pointed out the problem in the 25/0
game and it was during that process that I looked closer at the evals etc.
from the 5/0 games. So, I am bending no facts.


>>Whether for some reason it was believed that I had stopped the games I am
>>not sure. However they continue. But playing 120'/40 60'/20 30 x 20 games
>>takes some time as does the 1 hour games. Both are now complete and all that
>>is left are the 25/0 which are currently running score 8-3 to F6a.
>
>Please post them when you can. And the IP adresses as well of course.

I shall post the games when complete.

The Ip's adresses:

Mogens IP
212.10.80.124 non static received
212.10.24.241 non static received

inetnum:     212.10.80.0 - 212.10.95.255 IP range
netname:     STOFANET-9

Chessfun IP
24.15.180.95 Current non static

ATHOME		      24.0.0.0 - 24.23.255.255
@Home Network      24.15.176.0 - 24.15.191.255

These are from my own records not CCC's.

Thanks.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.