Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Speed vs. Knowledge Debate Not To Be Decided Soon :-)

Author: Vincent Vega

Date: 22:11:07 02/13/00

Go up one level in this thread


On February 13, 2000 at 17:46:16, Albert Silver wrote:

>So he is studying the Elo value of each ply for only one program? What's the
>point? He'll have to analyze the value for each and every ply along the line,
>and even then the results will only be for that one program.

The point is to find out whether there is a falloff in elo gain when plies
increase.  Why it is important should be obvious if you followed any related
discussion - if such a falloff exists, it means that for this program (I believe
Crafty was to be used) even exponential processor speed increases (Moore’s law)
will have a diminishing impact on ratings.  The point of my original post was
that I believe that if such a falloff exists (previous data says it does not),
high-knowledge programs (and programs with high-branching factors) will have an
edge in the future because they will be hurt less.

>Why is it no-no, and why do you have to use time to get anything significant? If
>you want to refute what I've said about it, I'd like to at least see the
>reasoning.

It is a no-no because 1. programs can easily have different branching factors so
one more ply for one program may mean 4 times as many nodes evaluated and 7
times as many for another, 2. to get to the 10th ply for one program may mean
that it has evaluated 10,000 positions for 0.01 second each, for another
10,000,000,000 positions for 0.1 second each, and for yet another 10,000,000
positions for 0.0001 second each, 3. evaluation of that fixed ply could be
similarly skewed.  As a result, fixing plies at some level, as you tried to do,
doesn't lead to any significant results because it handicaps programs with fast
evaluations and low branching factors for no reason and makes inter-program
comparisons invalid.

If you think you can restate your arguments using time, I'd like to hear them.
I'm afraid that using plies to compare different programs is fatally flawed.
Time is an obvious constant because there is no way for a program to decide to
use more time and still play another program (I guess it could use less, but for
all the chess programs I know of, that would be counterproductive).

>How much higher? In my opinion this probability is close to nil unless the
>position has already been compromised; yet how will Mindblack achieve this great
>position with random move choices?

You are making an error here.  The playing strength of Mindblank and CyberGM
isn't in question here.  The question is how much they gain by multiplying the
time they have to evaluate the position.   So if after 10 mins, Mindblank
evaluation was weak, the question is how less-weak will it be after 20 mins, not
whether it will be as good as that of CyberGM.   If it's better by an average of
100 points than it was, but CyberGM's is better by 150 points than it was, that
means CyberGM gains more (I'm not saying whether it does or not, that's just an
example).

>I imagine that writing an ultrafast program with no knowledge would be extremely
>easy. Try it. I think you'll find that it will lose so fast it won't even be
>funny. Do you think it will magically start coordinating an attack against the
>enemy king without any knowledge?

That's the same error as before.  Of course it will be bad.  I never doubted
that.  That's not the issue, though.

>I suspect, no offense, that although you know how to play, that you aren't very
>strong. I say this because I tend to see these arguments that knowledge is
>over-rated by people who do not realize just how deep knowledge can go. A GM has
>_skills_ that a 2200 player simply doesn't have. It goes beyond the simple 'he
>plays better positional moves and calculates deeper'.

What in heavens made you think that I believe knowledge is overrated?  That's a
complete opposite of what I stated in several posts already.  I think knowledge
is the way to go and I like for CSTAL to do well exactly because it's said to be
knowledge-based (even if its programmer is somewhat disliked here).  I don't
know if it will be able to match current leaders, but I hope it will.  Please
answer that question so I’ll know where my statements may have been unclear.

Even when I was just starting playing chess it was absolutely clear to me that
better players not only saw deeper but also had superior knowledge of the game.
Was it different for you?  Did you only see tactics when you were starting out
and you didn't notice any greater understanding of the game in superior players?
 If not why would you assume that a potentially weaker player would make the
same mistake?

BTW, when I was in my teens I played competitively for a while until I found
other interests.  I did quite well back then.  Now my playing strength has
probably declined quite a bit, I don't really know.



This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.