Computer Chess Club Archives


Search

Terms

Messages

Subject: Re: Test suites vs. playing -This is amazing to me.

Author: Harald Faber

Date: 00:37:02 03/17/00

Go up one level in this thread


On March 16, 2000 at 17:08:20, Robert Hyatt wrote:

>On March 16, 2000 at 16:10:12, G. R. Morton wrote:
>
>>On March 16, 2000 at 01:34:06, Jouni Uski wrote:
>>
>>>For me personally performance in test suites is more important, than playing
>>>strength. Because I am not GM I can't play against them. So about 80% of my
>>>computer use is test positions. And I removed even Junior 6 from my hard disk,
>>>because it's too weak to find combinations or endgame moves...
>>>
>>>Jouni
>>
>>How can Junior 6 be poor at combinatinos, and also mediocre at positional tests
>>, and still be the highest rated software?  If this is true it is very puzzling
>>since every move of a computer game can be thought of as the software?s solution
>>to a tactical or positional test position. There should be a very strong
>>correlation one would think.  As a comparison, people who score very high on
>>I.Q. and SAT tests are nor just good on such tests - which is, of course, why
>>these tests are given.  Their strong correlation with high performance or
>>success in many other activities are well noted (see ?The Bell Curve? book for
>>instance).  Did not Larry Kauffman once claim that his test suites could be used
>>to fairly accurately estimate the software?s rating?   What else is going on
>>here?
>
>
>It is easy to explain.  In test suites, there is usually a tactical answer
>that must be found by search.  It requires _no_ knowledge of any kind, just
>a fast search.  Which is why I don't care much about test suites in general,
>as they only test one aspect of the game.  Tactics are important.  But in many
>cases, tactics is not enough until we get to machines that are in the petahertz
>speed range.
>
>I could easily see any program (Junior in this case) doing poorly on some
>tactical test, but being an outstanding chess player...

You should be fair and add that Junior "doing poorly on some tactical test" is
still far above the human tactical abilities.




This page took 0 seconds to execute

Last modified: Thu, 15 Apr 21 08:11:13 -0700

Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.