Applying Markov decision processes to 2D real time games
| dc.contributor.author | Hartley, Thomas | |
| dc.contributor.author | Mehdi, Quasim | |
| dc.contributor.author | Gough, Norman | |
| dc.date.accessioned | 2008-07-10T13:55:16Z | |
| dc.date.available | 2008-07-10T13:55:16Z | |
| dc.date.issued | 2004 | |
| dc.identifier.citation | In: Mehdi, Q. and Gough, N. (Eds.), Proceedings of CGAIDE’2004. 5th Game-On International Conference on Computer Games: Artificial Intelligence, Design and Education, 8-10 November, 2004, Microsoft Academic Campus, Reading UK | |
| dc.identifier.isbn | 0-9549016-0-6 | |
| dc.identifier.uri | http://hdl.handle.net/2436/31518 | |
| dc.description.abstract | This paper presents the outcomes of a research project into the field of artificial intelligence (AI) and computer game AI. The project considered the problem of applying AI techniques to computer games. Current commercial computer games tend to use complex scripts to control AI opponents. This can result in poor and predictable gameplay. The use of academic AI techniques is a possible solution to overcome these shortcomings. This paper describes the process of applying Markov decision processes (MDPs) using the value iteration algorithm to a 2D real time computer game. We also introduce a new stopping criterion for value iteration, which has been designed for use in computer games and we discuss results from experiments conducted on the MDPs AI engine. This paper also outlines conclusions about how successful MDPs are in relation to a real computer game AI engine and how useful they might be to computer games developers. | |
| dc.language.iso | en | |
| dc.publisher | University of Wolverhampton, School of Computing and Information Technology | |
| dc.subject | Games | |
| dc.subject | Games based learning | |
| dc.subject | Learning technology | |
| dc.subject | E-learning | |
| dc.subject | AI | |
| dc.subject | Markov decision processes | |
| dc.subject | Value iteration | |
| dc.subject | Artificial Intelligence | |
| dc.subject | AI in computer games | |
| dc.title | Applying Markov decision processes to 2D real time games | |
| dc.title.alternative | Proceedings of CGAIDE’2004 | |
| dc.type | Conference contribution | |
| refterms.dateFOA | 2018-08-20T13:50:55Z | |
| html.description.abstract | This paper presents the outcomes of a research project into the field of artificial intelligence (AI) and computer game AI. The project considered the problem of applying AI techniques to computer games. Current commercial computer games tend to use complex scripts to control AI opponents. This can result in poor and predictable gameplay. The use of academic AI techniques is a possible solution to overcome these shortcomings. This paper describes the process of applying Markov decision processes (MDPs) using the value iteration algorithm to a 2D real time computer game. We also introduce a new stopping criterion for value iteration, which has been designed for use in computer games and we discuss results from experiments conducted on the MDPs AI engine. This paper also outlines conclusions about how successful MDPs are in relation to a real computer game AI engine and how useful they might be to computer games developers. |
