Author: Jon Dart
Date: 20:57:07 07/16/04
I ran the "IQ2" test from http://www.horizonchess.com/Jim/iq2.html through a new version of Arasan that can show 2nd and 3rd best solutions as well as the PV, at a time control of 10 minutes/move on a fairly fast machine (P4 3GHz). I also checked some problems with Crafty. It seems there are a number of possible problems in the test suite: test "18.5.IQ.1075": [D] 1q3rnk/5p2/3p1P1p/p3n3/Np1r2P1/1P1B4/1PP4Q/1K1R3R w - - Qxh6+ is a mate in 4, Qd2 is a mate in 7. test "19.5.IQ.1077": [D] 3r3k/p5qp/bp2B1p1/n2P1p2/5N2/Q1R5/P4PPP/6K1 w - - Arasan thinks the suggested solution Qb2 is best but other moves are close in score: result: Qb2 600 seconds. score: +2.70 365878189 nodes. ++ correct Qb2 Nc4 Nxg6+ Qxg6 Rxc4+ Qg7 Qxg7+ Kxg7 Ra4 Bd3 Rxa7+ Kg6 a4 h5 a5 bxa5 Rxa5 Rd6 Ra3 Be4 result(2): Qc1 600 seconds. score: +2.52 368803984 nodes. ** error Qc1 Qf6 Rg3 g5 Nh5 Qd4 Rxg5 Nc4 Rxf5 Nd6 Rf4 Qe5 a3 Re8 Qc6 result(3): h4 600 seconds. score: +2.02 366906297 nodes. ** error h4 Nc4 Qc1 b5 Rg3 b4 Bxf5 Rd6 h5 g5 Ne6 Qf6 Qxg5 Qa1+ Kh2 Qxa2 "21.5.IQ.1081" [D] 4k3/pp2pp2/4n1p1/3RP1P1/2r1N3/P1P5/1P2q3/1K5Q w - - Crafty selects the move Nc5, which is given as the solution - Crafty's score is 0. Arasan didn't choose Nc5, but thinks several other moves have similar scores: result: Qh8+ 600 seconds. score: +0.17 384673649 nodes. ** error Qh8+ Nf8 Nf6+ exf6 Rd8+ Kxd8 Qxf8+ Kc7 Qd6+ Kc8 Qf8+ Kd7 Qd6+ Kc8 result(2): Nf6+ 600 seconds. score: +0.17 383394542 nodes. ** error Nf6+ exf6 Qh8+ Nf8 Rd8+ Kxd8 Qxf8+ Kc7 Qd6+ Kc8 Qf8+ Kd7 Qd6+ Kc8 result(3): Nd2 600 seconds. score: -0.25 369292497 nodes. ** error Nd2 Rg4 Qh8+ Nf8 Rc5 Qd3+ Ka1 Rg1+ Ka2 Qd7 Nf3 Qe6+ c4 Rd1 Nh2 Rg1 Qh6 Qf5 Rc7 "27.5.IQ.1120" [D] r1bq1rk1/5pbp/pB1p1np1/3Pp3/4P3/2p1QP2/PP4PP/1KNR1B1R b - - Here, Arasan liked Ng4 better than Rb8. But Crafty does choose Rb8 and gives t a score of +2.89 after 30 minutes. So this test looks ok, just not solved by Arasan (I don't know why yet). "38.5.IQ.1234" [D] 2q5/1b2Q3/1p3pkp/4p1p1/3n4/4N2P/5PP1/4R1K1 b - - Crafty and Arasan both choose the suggested solution Bxg2 as the best move. But Arasan thinks other moves are close in score: result: Bxg2 600 seconds. score: -0.02 382331121 nodes. ++ correct Bxg2 Nxg2 Nf3+ Kf1 h5 Ne3 Nxe1 Kxe1 b5 Ke2 Qc6 Qd8 result(2): Qc6 600 seconds. score: -0.23 384676993 nodes. ** error Qc6 Qd8 Qe6 Ng4 h5 Nxe5+ fxe5 Qxd4 exd4 Rxe6+ Kf5 Rxb6 Bd5 Rh6 h4 g3 hxg3 result(3): Bc6 600 seconds. score: -0.23 375665444 nodes. ** error Bc6 Ng4 Qe6 Qd8 Bd5 Qh8 Nf5 Ra1 Qe7 Rd1 Bc6 Qg8+ Qg7 Qe6 Nd4 "52.6.IQ.949" [D] 5r1k/1b1P3p/4Q1pb/8/P7/4N1PP/1P2r3/R2R2K1 w - - Qf6+ is the suggested solution but if White makes the forcing check Qe5+ first he will get the same result. "85.6.IQ.1146": [D] 1r2r1k1/p1p2p1p/6p1/8/8/4NBPb/qBQ2K1P/1R6 b - - Crafty and Arasan find the solution Rxe3 but Arasan thinks Rb3 is practically as good: result: Rxe3 600 seconds. score: +2.28 363219392 nodes. ++ correct Rxe3 Kxe3 Bf5 Be4 Qb3+ Qd3 Qxd3+ Bxd3 Re8+ Kd2 Rd8 Be5 Rxd3+ Kc1 f6 Bxf6 Rd6 Rb8+ result(2): Rb3 600 seconds. score: +2.27 370911230 nodes. ** error Rb3 Bd5 Rexe3 Qxc7 Rf3+ Bxf3 Rxb2+ Rxb2 Qxb2+ Ke3 Qb3+ Ke2 Qb5+ Ke3 a5 g4 Qb3+ Ke2 a4 Qg3 Qc4+ result(3): Qb3 600 seconds. score: +0.84 356314200 nodes. ** error Qb3 Be4 Qxc2+ Bxc2 Be6 Bd4 Rxb1 Bxb1 a5 Bc2 f5 Ba4 Ra8 Ke2 Kf7 So I think you could add Rb3 to the solution set. "87.6.IQ.1182" [D] 1rb1r1k1/3n1ppp/p1p1p3/q3P3/7P/2N1Q1R1/PPP3P1/2KR1B2 w - - Rxd7 is the suggested solution. Crafty selects it but with a score of only 0.26. Arasan finds several moves it thinks are better, but all with modest scores: result: Bxa6 600 seconds. score: +0.55 363786239 nodes. ** error Bxa6 Qxa6 Rxd7 Bxd7 Rxg7+ Kxg7 Qg5+ Kh8 Qf6+ Kg8 Qg5+ Kf8 Qh6+ Ke7 Qf6+ Kf8 Qh8+ Ke7 Qf6+ result(2): Qg5 600 seconds. score: +0.45 355295980 nodes. ** error Qg5 Qxe5 Bxa6 h6 Qxe5 Nxe5 Be2 Ra8 h5 Ba6 Re3 Nc4 Re4 Na5 Bxa6 result(3): a3 600 seconds. score: +0.45 347912593 nodes. ** error a3 Qxe5 Bxa6 Qxe3+ Rxe3 Nb6 Bxc8 Rbxc8 g4 f5 gxf5 exf5 Rxe8+ Rxe8 a4 Ra8 Rd6 f4 "101.7.IQ.997" [D} r1b2r1k/1pq3bp/8/3Qp2n/1P1n1pp1/2NP2P1/3BPPBP/1R2NRK1 b - - Qxc3 is the solution, which Arasan and Crafty select, but Arasan also thinks f3 is good: "101.7.IQ.997" result: Qxc3 600 seconds. score: +1.55 333391272 nodes. ++ correct Qxc3 Bxc3 Nxe2+ Kh1 Nxc3 Qb3 Nxb1 Qxb1 f3 Bxf3 gxf3 Qb3 Bh3 Rg1 b6 Nc2 Nf6 result(2): f3 600 seconds. score: +1.41 331355460 nodes. ** error f3 exf3 gxf3 Bxf3 Rxf3 Nxf3 Nf6 Qxd4 exd4 Nxd4 Qd7 Be3 Ne8 Ncb5 Qh3 result(3): Ra3 600 seconds. score: +0.28 316496635 nodes. ** error Ra3 Nb5 Nxe2+ Kh1 Qe7 Nxa3 fxg3 Qc4 gxh2 d4 exd4 Rd1 h6 Nb5 g3 fxg3 "105.7.IQ.1005": [D] r3r3/pp2bBkp/6p1/q3p2Q/4n3/2N2R2/PPP3PP/2KR4 w - - Bxg6 is given as the solution but Arasan likes Qg4 better: "105.7.IQ.1005" result: Bxg6 600 seconds. score: +0.41 366908163 nodes. ++ correct Bxg6 hxg6 Rf7+ Kxf7 Qh7+ Kf8 Qh8+ Kf7 Qh7+ result(2): Qg4 600 seconds. score: +0.48 358864869 nodes. ** error Qg4 Bg5+ Kb1 Nxc3+ Rxc3 Kxf7 Ra3 Qc5 Qxg5 Kg8 Re3 Rac8 c3 Qe7 Qh6 Qf8 Qg5 result(3): Qh3 600 seconds. score: -1.63 365809665 nodes. ** error Qh3 Bg5+ Kb1 Red8 Rdf1 Nd2+ Ka1 Nxf1 Rxf1 Qa6 Qf3 Qf6 Qe2 Bf4 Bd5 Qb6 "116.7.IQ.1094" [D] 5rk1/p1Q2p1p/6p1/1P3q2/P2PNn2/R4P2/4rP1P/5R1K b - - Arasan and Crafty find the move Rc8, but Arasan thinks other moves are almost equivalent: "116.7.IQ.1094" result: Rc8 600 seconds. score: -0.16 384624996 nodes. ++ correct Rc8 Qd7 Qxd7 Nf6+ Kg7 Nxd7 Rxf2 Raa1 Rxf1+ Rxf1 Rd8 Ne5 Rxd4 Ra1 Kf6 Nc6 Rd7 Kg1 h5 result(2): Rxe4 600 seconds. score: -0.11 375398239 nodes. ** error Rxe4 fxe4 Qxe4+ f3 Qe2 Rg1 Nh3 Rga1 Nf2+ Kg1 Nh3+ Kh1 result(3): Re8 600 seconds. score: -0.25 374389780 nodes. ** error Re8 Rg1 Nh3 Rf1 Nf4 "143.8.IQ.1044": 2rq4/p2n1pk1/4b1r1/2pNp1p1/BpP1Pn2/3PQPP1/PR6/1R2B1K1 b - - Qh8 is given as the solution but both Arasan and Crafty select Nh3+. Arasan also thinks Nb6 is good: result: Nh3+ 600 seconds. score: +0.27 327685265 nodes. ** error Nh3+ Kf1 Kg8 Bb5 Qf8 Bd2 g4 f4 exf4 Nxf4 Rf6 d4 Nxf4 result(2): Nb6 600 seconds. score: +0.28 325183810 nodes. ** error Nb6 Bb5 g4 Nxf4 exf4 Qxf4 Qxd3 Ba6 Rd8 Rb3 Qd6 Qxd6 Rxd6 e5 Rd8 result(3): Qh8 600 seconds. score: +0.16 331548802 nodes. ++ correct Qh8 Bxd7 Bxd7 Rh2 Nh3+ Kg2 Rh6 Kf1 Qe8 f4 exf4 gxf4 g4 d4 Re6 "145.8.IQ.1061" Nxd5 is given as the solution but Arasan thinks Rxa5 is also not bad: "145.8.IQ.1061" result: Nxd5 600 seconds. score: +1.98 351172216 nodes. ++ correct Nxd5 exd5 e6 Qc6 Qe5 Nc7 e7 Bf7 exd8=N Rxd8 g5 Re8 Qxc7+ Qxc7 Bxc7 Kxc7 Re1 hxg5 Rxe8 Bxe8 Bxd5 result(2): Rxa5 600 seconds. score: +1.67 345655615 nodes. ** error Rxa5 bxa5 Nxd5 exd5 e6 Qc6 e7 Qxf6 exd8=Q+ Kxd8 Bxd5 Bd7 Bxc4 Re8 Qd3 Nc7 Rb7 Ne6 Rxa7 result(3): Ra2 600 seconds. score: -0.77 327279887 nodes. ** error Ra2 h5 gxh5 Rxh5+ Kg1 Bf7 Kf1 Nb8 Rab2 g5 Qg4 Nd7 Nxd5 exd5 Bxd5 "147.8.IQ.1104" [D] 3r4/5pkp/B5p1/PPn1p3/2P1P3/4qP1P/1Q4P1/4NK2 b - - Crafty and Arasan prefer Rd1 over the given solution Rd2 (but both are good): result: Rd2 600 seconds. score: +7.23 407769988 nodes. ++ correct Rd2 Qxd2 Qxd2 g4 Qxa5 Ng2 Qb4 Kf2 Qxc4 Kg3 Qd3 Kf2 Nxa6 bxa6 Qxa6 Kg3 Kf6 result(2): Rd1 600 seconds. score: +7.48 399398951 nodes. ** error Rd1 Qe2 Qc1 Qxd1 Qxd1 Kf2 Qd4+ Kf1 Qxc4+ Kf2 Qa2+ Kf1 Qxa5 g4 Nxa6 bxa6 Qxa6+ Kf2 Qb6+ Ke2 Qb2+ Ke3 Qc1+ Ke2 Kf6 result(3): Nd3 600 seconds. score: +1.95 400377885 nodes. ** error Nd3 Nxd3 Rxd3 Qxe5+ f6 Qa1 Rd2 Qe1 Qd3+ Kg1 Rd1 Qxd1 Qxd1+ Kh2 Qd4 b6 Qe5+ Kh1 Qxa5 b7 Qb6 "149.8.IQ.1131" [D] b2rr1k1/P3pp2/3p2p1/1Q1Pb2p/2P4P/1R2B1P1/4qPBK/1R6 w - - Qxe8 is given as the solution but Arasan finds some other winning moves (Crafty selects Qa4 with a score +5.2): "149.8.IQ.1131" result: Qxe8+ 600 seconds. score: +4.48 355697413 nodes. ++ correct Qxe8+ Rxe8 result(2): Qa5 600 seconds. score: +4.09 353019280 nodes. ** error Qa5 Qxc4 Rb8 Rc8 Rc1 Qxh4+ Kg1 Qg4 Rcxc8 Rxc8 Qc7 Rf8 Rxf8+ Kxf8 Qd8+ Kg7 Qxa8 Bxg3 Qb7 Qd1+ result(3): Qa6 600 seconds. score: +3.58 352409763 nodes. ** error Qa6 g5 Bf1 Qg4 Bh3 Qe4 Bxg5 Qc2 Be3 e6 Bb6 Rc8 dxe6 Rxc4 exf7+ "160.8.IQ.1282" [D] 2r1r1k1/4qpb1/p2p2p1/1p1Pn1P1/3BB3/P1P5/1P4Q1/1K2R2R w - - This already has multiple solution moves given (Bxg6 Qh2 Qh3) but Arasan also likes Qg3: result: Qh2 600 seconds. score: +2.92 351278325 nodes. ++ correct Qh2 Kf8 Bxg6 Qxg5 Reg1 Qf6 Qh7 Rc7 Bd3 Rce7 result(2): Qg3 600 seconds. score: +2.61 345570180 nodes. ** error Qg3 Red8 Re2 Rc4 Reh2 Kf8 Bc2 Re8 Rh7 a5 Qh4 Qb7 Be4 a4 result(3): Qh3 600 seconds. score: +2.19 343681975 nodes. ++ correct Qh3 Qxg5 Qh7+ Kf8 Reg1 Qf4 Bxg6 Nxg6 Bxg7+ Ke7 Ka1 Rh8 Bxh8 Rxh8 Qg7 Rxh1 Rxh1 "166.9.IQ.965" [D] r6r/p1kn4/2p1b3/q3p1Qp/4P3/2PBB2P/P5P1/3R1RK1 w - - Bc4 is the given solution, but Arasan finds other good moves: result: Rf2 600 seconds. score: +1.63 327729011 nodes. ** error Rf2 Rae8 Rfd2 Qxc3 Bxa7 Ra8 Rc2 Qb4 Qg6 Qe7 Be3 Rxa2 result(2): Qg6 600 seconds. score: +1.59 328575067 nodes. ** error Qg6 Qxa2 Rf2 Qb3 Bc2 Qa2 Rfd2 Rag8 Rxd7+ Kb8 Bb1 Qb3 Bc2 Rxg6 result(3): Bc4 600 seconds. score: +1.58 328178281 nodes. ++ correct Bc4 Bxc4 Rxd7+ Kxd7 Rd1+ Kc8 Qf6 Kb7 Rd7+ Qc7 Rxc7+ Kxc7 Qxe5+ Kb7 Bxa7 Bxa2 Bd4 in addition, Crafty selected Be2 with a score of +2.3. "172.9.IQ.1148" [D] r4r1k/6pp/3p3b/1p1Npb2/3nB2q/2N3P1/PP3P1P/R2Q1RK1 b - - Qxe4 is the given solution but Arasan thinks other moves are equivalent: result: Qxe4 600 seconds. score: +0.16 362339994 nodes. ++ correct Qxe4 Nxe4 Bxe4 Nc3 Bf3 Qd3 b4 Rae1 Bc6 f4 bxc3 Qxc3 Bb5 Rf2 Rxa2 fxe5 result(2): Qg4 600 seconds. score: +0.08 375803186 nodes. ** error Qg4 Qxg4 Bxg4 f4 exf4 Nxf4 Rab8 Ncd5 Rbe8 Bg2 Bxf4 Nxf4 Nc2 Rac1 Ne3 Rf2 result(3): Qd8 600 seconds. score: -0.05 362716441 nodes. ** error Qd8 Bxf5 Rxf5 f4 Rf7 Ne4 Qb8 Qh5 Rf5 Qd1 Rf8 Rf2 Qb7 Ndc3 Ra6 However, Crafty gives a score of +1.44 to Qxe4 so it may really be best. "174.9.IQ.1216" [D] r3kb1r/pp3p1p/4pp2/q2pN3/2P5/8/PP3PPP/R2QR1K1 w kq - The solution Nxf7 does not look like it is much better than alternatives: result: cxd5 600 seconds. score: -0.03 374941994 nodes. ** error cxd5 fxe5 dxe6 fxe6 Qh5+ Ke7 Rxe5 Qb6 Qh4+ Kf7 Qf4+ Ke7 Rae1 Re8 Rxe6+ Qxe6 Rxe6+ Kxe6 Qe4+ Kf7 Qxb7+ result(2): Ng4 600 seconds. score: -0.30 360901593 nodes. ** error Ng4 O-O-O Qd4 h5 Nxf6 Qc5 Qxc5+ Bxc5 cxd5 Be7 Rac1+ Kb8 Ne4 exd5 Ng3 Bf6 Rc2 result(3): Nxf7 600 seconds. score: +0.16 355697677 nodes. ++ correct Nxf7 Kxf7 Qh5+ Ke7 cxd5 e5 Rxe5+ fxe5 Qxe5+ Kd7 Qe6+ Kd8 Qf6+ Kc7 Rc1+ Qc5 Qf4+ Kd7 Rxc5 Bxc5 Qf7+ Kc8 Qf5+ Kc7 Qd3 "178.9.IQ.1278" [D] 1b4k1/1pnq1r1p/4p1p1/1pPpP2Q/1P5B/3BPP2/7P/6RK w - - Bxg6 is the given solution but it appears Bf6 also wins: "178.9.IQ.1278" result: Bxg6 600 seconds. score:+11.13 375020103 nodes. ++ correct Bxg6 hxg6 result(2): Bf6 600 seconds. score:+11.59 351876895 nodes. ** error Bf6 Rg7 Bxg6 hxg6 Rxg6 d4 Rxg7+ Qxg7 Bxg7 Kxg7 exd4 Ba7 Qg5+ Kf7 Qd8 Nd5 Qd7+ Kf8 Qc8+ Kg7 Qxb7+ Kg6 Qxa7 Nxb4 Qb6 result(3): c6 600 seconds. score: +7.73 369995300 nodes. ** error c6 bxc6 Bxg6 hxg6 Rxg6+ Rg7 Bf6 Ba7 Bxg7 Qxg7 Qg4 Qxg6 Qxg6+ Kf8 Qh7 Bb6 Qh8+ Kf7 Qb8 Na8 Qxa8 Bxe3 Qxc6 "189.10.IQ.1076" [D] 2r3k1/1rq2p1p/pp1p1bp1/2pP2N1/2P1R3/1Q6/PP3PP1/4R1K1 w - - Nxh7+ is the given solution but Arasan likes Re8+ better result: Nxh7 600 seconds. score: +0.52 374983814 nodes. ++ correct Nxh7 Be5 Ng5 Qd7 Nf3 Bf6 Qa3 b5 b3 bxc4 bxc4 Ra8 R4e2 Rb4 Re4 Rb2 result(2): Re8+ 600 seconds. score: +0.97 383494142 nodes. ** error Re8+ Rxe8 Rxe8+ Kg7 Nxh7 Be5 Nf8 Rb8 Rxb8 Qxb8 Nd7 Qd8 Nxb6 Qg5 Qc2 Qd8 Na4 f5 Nc3 Kf6 result(3): Qe3 600 seconds. score: -0.89 385773936 nodes. ** error Qe3 Qd8 Re8+ Qxe8 Qxe8+ Rxe8 Rxe8+ Kg7 Ne4 Be7 Ra8 f5 Nc3 a5 Kf1 Bf6 Ke2 Bxc3 bxc3 Re7+ Kd3 h6 "198.11.IQ.1080" [D] 2r1r1k1/pp1b1ppp/1q6/3P4/7N/Pn1Q4/1P3PPP/1RB2RK1 b - - Arasan thinks Rxc1 is about as good as Nxc1: result: Nxc1 600 seconds. score: +1.69 406056098 nodes. ++ correct Nxc1 Rfxc1 Rxc1+ Rxc1 Qh6 Qc4 Bb5 Qc5 b6 Nf5 bxc5 Nxh6+ gxh6 b3 Re2 f3 Rb2 d6 Bd7 result(2): Rxc1 600 seconds. score: +1.55 392283677 nodes. ** error Rxc1 Rbxc1 Nxc1 Rxc1 Qh6 Qc4 Bb5 Qc5 b6 Nf5 bxc5 Nxh6+ gxh6 d6 Bd7 b3 Re5 result(3): Qb5 600 seconds. score: +0.83 384209881 nodes. ** error Qb5 Qxb5 Bxb5 Rd1 Bd3 d6 Re6 d7 Rd8 Bg5 Rxd7 h3 f6 Be3 Red6 "201.11.IQ.1263" [D] r4rk1/pp2qpp1/2p1bn1p/8/1bP4Q/5N1P/PPB2PP1/R1BR2K1 w - - Arasan didn't find the solution Bxh6. Crafty did but the score is only 0.44. Arasan's output: result: a3 600 seconds. score: +0.45 337469837 nodes. ** error a3 Ba5 b4 Bd8 Be3 Bb6 Bd2 Rfe8 Bc3 Bd8 a4 c5 b5 Kh8 result(2): Qg3 600 seconds. score: +0.30 340027559 nodes. ** error Qg3 Kh8 a3 Ba5 Qh4 Bc7 Bg5 Rfe8 Bxf6 Qxf6 Qxf6 gxf6 b3 c5 result(3): Be3 600 seconds. score: +0.25 349394743 nodes. ** error Be3 Bc5 Bd2 Nd7 Qg3 Bd6 Bf4 Bxf4 Qxf4 Rfe8 Rd4 c5 Rdd1 suggested actions: "18.5.IQ.1075": remove; there are 2 mate solutions. Plus this test is probably too easy (mate in 4). "19.5.IQ.1077": remove, multiple moves are close in score. "21.5.IQ.1081": remove, multiple moves are close in score. "27.5.IQ.1120": keep, Crafty thinks solution Rb8 is best. "38.5.IQ.1234": remove, multiple moves are close in score. "52.6.IQ.949": remove, or add Qe5+ as 2nd solution "85.6.IQ.1146": add Rb3 as solution "52.6.IQ.949": remove, not clear solution move Rxd7 is best. "101.7.IQ.997": remove, or add f3 as solution "105.7.IQ.1005": add Qg4 to solution set "116.7.IQ.1094": remove, multiple moves are close in score "143.8.IQ.1044": remove, multiple moves are close in score "145.8.IQ.1061": remove, best move differs from 2nd best by small amount "147.8.IQ.1104": add Rd1 as solution "149.8.IQ.1131": remove, multiple moves are close in score "160.8.IQ.1282": remove, too many solutions "166.9.IQ.965": remove, multiple moves are close in score. "172.9.IQ.1148": keep, looks like Qxe4 is best (Crafty)
This page took 0 seconds to execute
Last modified: Thu, 15 Apr 21 08:11:13 -0700
Current Computer Chess Club Forums at Talkchess. This site by Sean Mintz.