arXiv (Cornell University) · 2019 · 10 citations · 25 references
ComputingComputer ScienceAlgorithmsArtificial IntelligenceGame TheoryBayesian GamesMonte Carlo MethodsMonte Carlo SimulationStochastic GamesHeuristic Evaluation FunctionsHidden Information ModelsInformation SetsMonte Carlo Tree SearchOpponent ModelingStrategy Learning
This technical report documents the winner of the Computational Intelligence in Games(CIG) 2018 Hanabi competition. We introduce Re-determinizing IS-MCTS, a novel extension of Information Set Monte Carlo Tree Search (IS-MCTS) that prevents a leakage of hidden information into opponent models that can occur in IS-MCTS, and is particularly severe in Hanabi. Re-determinizing IS-MCTS scores higher in Hanabi for 2-4 players than previously published work at the time of the competition. Given the 40ms competition time limit per move we use a learned evaluation function to estimate leaf node values and avoid full simulations during MCTS. For the Mixed track competition, in which the identity of the other players is unknown, a simple Bayesian opponent model is used that is updated as each game proceeds.
25
Mastering the game of Go without human knowledge
David Silver, Julian Schrittwieser, Karen Simonyan et al. · Nature · 2017 · 9.2K citations
Engineering, Educational Psychology, Cognitive Psychology +7
Monte-Carlo Planning in Large POMDPs
David Silver, Joel Veness · DSpace@MIT (Massachusetts Institute of Technology) · 2010 · 856 citations · Full text
Combining online and offline knowledge in UCT
Sylvain Gelly, David Silver · 2007 · 458 citations · Full text