2.50
Hdl Handle:
http://hdl.handle.net/2436/31519
Title:
Using value iteration to solve sequential decision problems in games
Authors:
Hartley, Thomas; Mehdi, Qasim; Gough, Norman
Other Titles:
Proceedings of CGAIDE’2004
Abstract:
Solving sequential decision problems in computer games, such as non-player character (NPC) navigation, can be quite a complex task. Current games tend to rely on scripts and finite state machines (FSM) to control AI opponents. These approaches however have shortcomings; as a result academic AI techniques may be a more desirable solution to solve these types of problems. This paper describes the process of applying the value iteration algorithm to an AI engine, which can be applied to a computer game. We also introduce a new stopping criterion called game value iteration, which has been designed for use in 2D real time computer games and we discuss results from experiments conducted on the AI engine. We also outline our conclusions which state that the value iteration and the newly introduced game value iteration algorithms can be successfully applied to intelligent NPC behaviour in computer games; however there are certain problems, such as execution speed, which need to be addressed when dealing with real time games.
Citation:
In: Mehdi, Q. and Gough, N. (Eds.), Proceedings of CGAIDE’2004. 5th Game-On International Conference on Computer Games: Artificial Intelligence, Design and Education, 8-10 November, 2004, Microsoft Academic Campus, Reading UK
Publisher:
University of Wolverhampton, School of Computing and Information Technology
Issue Date:
2004
URI:
http://hdl.handle.net/2436/31519
Additional Links:
http://www.cgames.org/; http://www.wlv.ac.uk/Default.aspx?page=14750
Type:
Meetings and Proceedings
Language:
en
ISBN:
0-9549016-0-6
Appears in Collections:
Game Simulation and Artificial Intelligence Centre (GSAI)

Full metadata record

DC FieldValue Language
dc.contributor.authorHartley, Thomas-
dc.contributor.authorMehdi, Qasim-
dc.contributor.authorGough, Norman-
dc.date.accessioned2008-07-10T14:02:53Z-
dc.date.available2008-07-10T14:02:53Z-
dc.date.issued2004-
dc.identifier.citationIn: Mehdi, Q. and Gough, N. (Eds.), Proceedings of CGAIDE’2004. 5th Game-On International Conference on Computer Games: Artificial Intelligence, Design and Education, 8-10 November, 2004, Microsoft Academic Campus, Reading UKen
dc.identifier.isbn0-9549016-0-6-
dc.identifier.urihttp://hdl.handle.net/2436/31519-
dc.description.abstractSolving sequential decision problems in computer games, such as non-player character (NPC) navigation, can be quite a complex task. Current games tend to rely on scripts and finite state machines (FSM) to control AI opponents. These approaches however have shortcomings; as a result academic AI techniques may be a more desirable solution to solve these types of problems. This paper describes the process of applying the value iteration algorithm to an AI engine, which can be applied to a computer game. We also introduce a new stopping criterion called game value iteration, which has been designed for use in 2D real time computer games and we discuss results from experiments conducted on the AI engine. We also outline our conclusions which state that the value iteration and the newly introduced game value iteration algorithms can be successfully applied to intelligent NPC behaviour in computer games; however there are certain problems, such as execution speed, which need to be addressed when dealing with real time games.en
dc.language.isoenen
dc.publisherUniversity of Wolverhampton, School of Computing and Information Technologyen
dc.relation.urlhttp://www.cgames.org/en
dc.relation.urlhttp://www.wlv.ac.uk/Default.aspx?page=14750en
dc.subjectValue iterationen
dc.subjectArtificial Intelligenceen
dc.subjectComputer gamesen
dc.subjectGames-
dc.subjectGames based learning-
dc.subjectLearning technology-
dc.subjectE-learning-
dc.subjectAI-
dc.titleUsing value iteration to solve sequential decision problems in gamesen
dc.title.alternativeProceedings of CGAIDE’2004en
dc.typeMeetings and Proceedingsen
All Items in WIRE are protected by copyright, with all rights reserved, unless otherwise indicated.