Observing the Evolution of Neural Networks Learning to Play the Game of Othello
A study was conducted to find out how game-playing strategies for Othello (also known as reversi) can be learned without expert knowledge. The approach used the coevolution of a fixed-architecture neural-network-based evaluation function combined with a standard minimax search algorithm. Comparisons...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
2005
|
| Subjects: | |
| Online Access: | http://shdl.mmu.edu.my/2221/ http://shdl.mmu.edu.my/2221/2/1534.pdf |
| _version_ | 1848789997415563264 |
|---|---|
| author | Chong, S.Y. Tan, M.K. White, J.D. |
| author_facet | Chong, S.Y. Tan, M.K. White, J.D. |
| author_sort | Chong, S.Y. |
| building | MMU Institutional Repository |
| collection | Online Access |
| description | A study was conducted to find out how game-playing strategies for Othello (also known as reversi) can be learned without expert knowledge. The approach used the coevolution of a fixed-architecture neural-network-based evaluation function combined with a standard minimax search algorithm. Comparisons between evolving neural networks and computer players that used deterministic strategies allowed evolution to be observed in real-time. Neural networks evolved to outperform the computer players playing at higher ply-depths, despite being handicapped by playing black and using minimax at ply-depth of two. In addition, the playing ability of the population progressed from novice, to intermediate, and then to master's level. Individual neural networks discovered various game-playing strategies, starting with positional and later mobility. These results show that neural networks can be evolved as evaluation functions, despite the general difficulties associated with this approach. Success in this case was due to a simple spatial preprocessing layer in the neural network that captured spatial information, self-adaptation of every weight and bias of the neural network, and a selection method that allowed a diverse population of neural networks to be carried forward from one generation to the next. |
| first_indexed | 2025-11-14T18:05:36Z |
| format | Article |
| id | mmu-2221 |
| institution | Multimedia University |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T18:05:36Z |
| publishDate | 2005 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | mmu-22212011-08-12T01:23:54Z http://shdl.mmu.edu.my/2221/ Observing the Evolution of Neural Networks Learning to Play the Game of Othello Chong, S.Y. Tan, M.K. White, J.D. QA75.5-76.95 Electronic computers. Computer science A study was conducted to find out how game-playing strategies for Othello (also known as reversi) can be learned without expert knowledge. The approach used the coevolution of a fixed-architecture neural-network-based evaluation function combined with a standard minimax search algorithm. Comparisons between evolving neural networks and computer players that used deterministic strategies allowed evolution to be observed in real-time. Neural networks evolved to outperform the computer players playing at higher ply-depths, despite being handicapped by playing black and using minimax at ply-depth of two. In addition, the playing ability of the population progressed from novice, to intermediate, and then to master's level. Individual neural networks discovered various game-playing strategies, starting with positional and later mobility. These results show that neural networks can be evolved as evaluation functions, despite the general difficulties associated with this approach. Success in this case was due to a simple spatial preprocessing layer in the neural network that captured spatial information, self-adaptation of every weight and bias of the neural network, and a selection method that allowed a diverse population of neural networks to be carried forward from one generation to the next. 2005-06 Article NonPeerReviewed application/pdf en http://shdl.mmu.edu.my/2221/2/1534.pdf Chong, S.Y. and Tan, M.K. and White, J.D. (2005) Observing the Evolution of Neural Networks Learning to Play the Game of Othello. IEEE Transactions on Evolutionary Computation, 9 (3). pp. 240-251. ISSN 1089-778X http://dx.doi.org/10.1109/TEVC.2005.843750 doi:10.1109/TEVC.2005.843750 doi:10.1109/TEVC.2005.843750 |
| spellingShingle | QA75.5-76.95 Electronic computers. Computer science Chong, S.Y. Tan, M.K. White, J.D. Observing the Evolution of Neural Networks Learning to Play the Game of Othello |
| title | Observing the Evolution of Neural Networks Learning to Play the Game of Othello |
| title_full | Observing the Evolution of Neural Networks Learning to Play the Game of Othello |
| title_fullStr | Observing the Evolution of Neural Networks Learning to Play the Game of Othello |
| title_full_unstemmed | Observing the Evolution of Neural Networks Learning to Play the Game of Othello |
| title_short | Observing the Evolution of Neural Networks Learning to Play the Game of Othello |
| title_sort | observing the evolution of neural networks learning to play the game of othello |
| topic | QA75.5-76.95 Electronic computers. Computer science |
| url | http://shdl.mmu.edu.my/2221/ http://shdl.mmu.edu.my/2221/ http://shdl.mmu.edu.my/2221/ http://shdl.mmu.edu.my/2221/2/1534.pdf |