Author: Stuart Cracraft
Date: 22:10:47 08/28/04
Go up one level in this thread
On August 28, 2004 at 11:03:44, Dan Honeycutt wrote: >On August 27, 2004 at 22:44:47, Stuart Cracraft wrote: > >> >>Computer vs. computer and especially computer against a version of itself >>is well-known for exaggerating the relative difference. >> > >Hi Stuart: >Could this explain that the stronger version could lose to the weaker version >because their play is so nearly identical? > > >>Why not setup your program for internet chess server chess and have it >>play there? >> > >I'm trying to do an A-B comparison where A and B are identical except for X to >see if X is an improvement. I'd have to let both play on the server long enough >to get a reliable rating which would seem slower than a controlled test - though >I would get a lot more variety of opponents. Use brute force: 1) run a very large test suite 2) do self play a very large number of games with slight randomization 3) run it for a large number of games on ICS It's a lot of work but you want to know whether X wins or not and the future of your program depends on it. Stuart
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.