Feature request: alternate red/blue positions in series
Posted: Tue May 27, 2008 6:07 pm
I always keep several old versions of my bot around and test changes that I make to my main bot against other versions to see what sort of a percentage increase in wins those changes generate. I don't know why I never noticed this before, but I just forked my code again and ran some series and have noticed that running identical bots against each other, the red one in the top position wins at about a 2-1 margin. I have switched them up to make sure that there wasn't an accidental code change and been running sims since last night and am consistently getting the 2-1 ratio.
It probably depends a lot on the bot, though. Run two Ghengis' against each other and I would expect it would be near 50-50 because there is so much luck involved with such a dumb bot, but I guess mine is good at quickly getting the cities it can get and then goes into very long and protracted wars against itself in which the bots order apparently makes a difference.
Anyway, at the least, this is a heads up for anyone who is doing back testing like this. Run you sim one way for 2 hours, then flip it for another two hours if you want an accurate comparison.
(It could also be some other bug, like always awarding the win to the first bot in the case of a stalemate since my bot stalemates against itself a huge percentage of the time.)
It probably depends a lot on the bot, though. Run two Ghengis' against each other and I would expect it would be near 50-50 because there is so much luck involved with such a dumb bot, but I guess mine is good at quickly getting the cities it can get and then goes into very long and protracted wars against itself in which the bots order apparently makes a difference.
Anyway, at the least, this is a heads up for anyone who is doing back testing like this. Run you sim one way for 2 hours, then flip it for another two hours if you want an accurate comparison.
(It could also be some other bug, like always awarding the win to the first bot in the case of a stalemate since my bot stalemates against itself a huge percentage of the time.)