SELF-EVALUATION OF RTS TROOP’S PERFORMANCE
DOI:
https://doi.org/10.11113/jt.v76.5890Keywords:
RTS games, evolutionary computing, evolutionary programming, differential evolution, feed-forward neural networkAbstract
This paper demonstrates the research results obtained from a comparison of Evolutionary Programming (EP) and hybrid Differential Evolution (DE) and Feed Forward Neural Network (FFNN) algorithms in the Real Time Strategy (RTS) computer game, namely Warcraft III. The main aims of this research are to: test the feasibility of implementing EP and hybrid DE into RTS game, compare the performances of EP and hybrid DE, and generate gaming RTS controllers autonomously, an issue primarily of reinforcement/troops balancing. This micromanagement issue has been overlooked since last decade. Experimental results demonstrate success with all aims: both EP and hybrid DE could be implemented into the Warcraft III platform, and both algorithms used able to generate optimal solutions.
References
Bakkes, S., Kerbusch, P., Spronck, P., and van den Herik, J. 2007. Automatically Evaluating the Status of an RTS Game. Proceedings of the Annual Belgian-Dutch Machine Learning Conference. 143-144.
Baptista, D. and Morgado-Dias, F. 2013. A Survey of Artificial Neural Network Training Tools. Neural Computing and Applications. 23(3-4): 609-615.
Ch’ng, S. H., and Teo, J. 2012. Online Evolution of Offensive Strategies in Real-time Strategy Gaming. IEEE Congress on Evolutionary Computation. 1-8.
Chambers, C., Feng, W. C., Feng, W. C., and Saha, D. 2005. Mitigating Information Exposure to Cheaters in Real-Time Strategy Games. Proceedings of the international workshop on Network and operating systems support for digital audio and video. 7-12.
Chang, K. T., Ong, J. H., Teo, J., and Chin, K. O. 2011. The Evolution of Gamebot for 3D First Person Shooter (FPS). IEEE The Sixth International Conference on Bio-Inspired Computing: Theories and Applications. 21-26.
Chin, K.O., and Teo, J. 2010. Evolution and Analysis of Self-Synthesized Minimalist Neural Controllers for Collective Robotics using Pareto Multi-objective Optimization. IEEE World Congress on Computational Intelligence. 2172-2178.
Eiben, A. E., and Smith, J. E. 2003. Introduction to Evolutionary Computing. Springer Science & Business Media.
Gagné, A. R., El-Nasr, M. S., and Shaw, C. D. 2011. A Deeper Look at the Use of Telemetry for Analysis of Player Behavior in RTS Games. Entertainment Computing–ICEC. 247-257.
Hagelback, J., and Johansson, S. J. 2010. A Study on Human like Characteristics in Real Time Strategy Games. In IEEE Symposium Computational Intelligence and Games (CIG). 139-145.
Isberg, J. 2004. Using Interactive Computer Games for AI Research. Master Thesis. Lund University.
Leow, C. L., Gan, K. S., Tan, T. G., Chin, K. O., Alfred, R., and Anthony, P. 2013. Self-Synthesized Controllers for Tower Defense Game using Genetic Programming. IEEE 2013 International Conference on Control System, Computing and Engineering (ICCSCE'2013). 487-492.
Miles, C., and Louis, S.J. 2006. Towards the Co-Evolution of Influence Map Tree Based Strategy Game Players. In IEEE Symposium on Computational Intelligence and Games. 75-82.
Ng, C. H., Niew, S. H., Chin, K. O., and Teo, J. 2011. Infinite Mario Bross AI using Genetic Algorithm. IEEE Conference on Sustainable Utilization and Development in Engineering and Technology. 85-89.
Ng, P. H. F., Li, Y., and Shiu, S. C. K. 2013. New Fuzzy Integral for the Unit Maneuver in RTS Game. In Pattern Recognition and Machine Intelligence. 256-261.
Niu, B., Wang, H. B., Ng, P. H. F., and Shiu, S. C. K. 2009. A Neural-Evolutionary Model for Case-Based Planning in Real Time Strategy Games. IEA/AIE. 291-300.
Ontanon, S. 2012. Case Acquisition Strategies for Case-Based Reasoning in Real-Time Strategy Games. Twenty-Fifth International FLAIRS Conference.
Pedersen, C., Togelius, J., and Yannakakis, G. N. 2009. Modeling Player Experience in Super Mario Bros. In IEEE Symposium on Computational Intelligence and Games. 132-139.
Ponsen, M., Spronck, P., Munoz-Avila, H., and Aha, D. W. 2007. Knowledge Acquisition for Adaptive game AI. Science of Computer Programming. 67(1): 59-75.
Rogers, K., and Andrew, S. 2014. A Micromanagement Task Allocation System for Real-Time Strategy Games. Computational Intelligence and AI in Games, IEEE Transactions on. 6(1): 67-77.
Sheldon, N., Girard, E., Borg, S., Claypool, M., and Agu, E. 2003. The Effect of Latency on User Performance in Warcraft III. Proceedings of the 2nd workshop on Network and system support for games. 3-14.
Shi, J. L., Tan, T. G., Teo, J., Chin, K. O., Alfred, R., and Anthony, P. 2013. Evolving Controllers for Simulated Car Racing Using Differential Evolution. Asia-Pacific Journal of Information Technology and Multimedia. 2(1): 57-68.
Storn, R. and Price, K. 1995. Differential Evolution: A Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces. International Computer Science Institute, Berkeley. Technical Report No. TR-95-012.
Szczepanski, T., and Aamodt, A. 2009. Case-Based Reasoning for Improved Micromanagement in Real-Time Strategy Games. Proceedings of the Workshop on Case-Based Reasoning for Computer Games, 8th International Conference on Case-Based Reasoning. 139-148.
Tan, K. B., Teo, J., Chin, K. O., and Anthony, P. 2012. An Evolutionary Multi-objective Optimization Approach to Computer Go Controller Synthesis. PRICAI 2012: Trends in Artificial Intelligence Lecture Notes in Computer Science, 7458: 801-806.
Tan, T. G., Teo, J., Chin, K. O., and Anthony, P. 2012. Pareto Ensembles for Evolutionary Synthesis of Neurocontrollers in a 2D Maze-based Video Game. Applied Mechanics and Materials. 3173-3177.
Uriarte, A., and Ontañón, S. 2012. Kiting in RTS Games Using Influence Maps. Eighth Artificial Intelligence and Interactive Digital Entertainment Conference.
Warcraft III, 2008. [Online]. From: http://www.blizzard.com/us/war3/. [Accessed on 24 November 2013].
Downloads
Published
Issue
Section
License
Copyright of articles that appear in Jurnal Teknologi belongs exclusively to Penerbit Universiti Teknologi Malaysia (Penerbit UTM Press). This copyright covers the rights to reproduce the article, including reprints, electronic reproductions, or any other reproductions of similar nature.
