Game Learningc4board

(see also: GBG: General Board Games in CIOP and Neue Themenangebote im Bereich Game Learning)

Games are of interest to me concerning their strategies and concerning the question whether a computer can learn these strategies just from self-play, without explicitly programming the tactics or performing exhaustive search.

In our research group we study extensively the game "Connect-4" ("Four-in-a-Row"). We were able to develop an agent which learns Connect-4 nearly perfectly just from self-play. Our Java-based Connect-4 Game Playing Framework (C4GPF) is now open-source for interested researchers. Read more…

The long-term goal of our research group is it to transfer these learning strategies to other games as well (2048, dots-and-boxes, go, chess, checkers, Abalone, Sim, …). The related research field is known as General Game Playing (GGP). The aim of GGP is it to develop agents which are able to learn a great variety of games.

The teaching course WPF Spiele + Simulation (in German) gives an introduction to the foundations of simulation, their application in games and in game physics, which deals with realistic kinematics and dynamics for video game worlds.

 

Project members

saminehBagheri   Samineh Bagheri, M.Sc., TH Köln markus2 Markus Thill, M.Sc., TH Köln
patrickPortrait Dr. Patrick Koch, TH Köln konen-3   Prof. Dr. Wolfgang Konen, TH Köln

 

Publications Games

2019

Konen, Wolfgang

General Board Game Playing for Education and Research in Generic AI Game Learning Inproceedings

Perez, Diego; Mostaghim, Sanaz; Lucas, Simon (Ed.): IEEE Conference on Games, London, 2019.

Links | BibTeX

Konen, Wolfgang

The GBG Class Interface Tutorial V2.0: General Board Game Playing and Learning Technical Report

Research Center CIOP (Computational Intelligence, Optimization and Data Mining) 2019.

Links | BibTeX

Barsnick, Felix

Implementierung und Untersuchung eines Turniersystems für KI-Agenten in Brettspielen Masters Thesis

TH Köln -- University of Applied Sciences, 2019, (Master thesis).

Links | BibTeX

2017

Kutsch, Johannes

KI-Agenten fur das Spiel 2048: Untersuchung von Lernalgorithmen für nichtdeterministische Spiele Masters Thesis

TH Köln -- University of Applied Sciences, 2017, (Bachelor thesis).

Links | BibTeX

Galitzki, Kevin

Selbstlernende Agenten für das skalierbare Spiel Hex: Untersuchung verschiedener KI-Verfahren im GBG-Framework Masters Thesis

TH Köln -- University of Applied Sciences, 2017, (Bachelor thesis).

Links | BibTeX

Konen, Wolfgang

The GBG Class Interface Tutorial: General Board Game Playing and Learning Technical Report

Research Center CIOP (Computational Intelligence, Optimization and Data Mining) Cologne University of Applied Science, 2017, (e-print published at http://www.gm.fh-koeln.de/ciopwebpub/Kone17a.d/TR-GBG.pdf).

Links | BibTeX

2016

Bagheri, Samineh; Thill, Markus; Koch, Patrick; Konen, Wolfgang

Online Adaptable Learning Rates for the Game Connect-4 Journal Article

IEEE Transactions on Computational Intelligence and AI in Games, 8 (1), pp. 33-42, 2016, (accepted 11/2014).

Links | BibTeX

2015

Konen, Wolfgang

Reinforcement Learning for Board Games: The Temporal Difference Algorithm Technical Report

Research Center CIOP (Computational Intelligence, Optimization and Data Mining) Cologne University of Applied Sciences, 2015.

Links | BibTeX

Konen, Wolfgang

Reinforcement Learning für Brettspiele: Der Temporal Difference Algorithmus Technical Report

Research Center CIOP (Computational Intelligence, Optimization and Data Mining) Cologne University of Applied Science, 2015, (Updated version 2015).

Links | BibTeX

2014

Thill, Markus; Konen, Wolfgang

Connect-4 Game Playing Framework (C4GPF) Miscellaneous

2014.

Links | BibTeX

Konen, Wolfgang; Koch, Patrick

Adaptation in Nonlinear Learning Models for Nonstationary Tasks Inproceedings

Bartz-Beielstein, T; Filipic, B (Ed.): PPSN'2014: 13th International Conference on Parallel Problem Solving From Nature, Ljubljana, pp. 292–301, Springer, Heidelberg, 2014.

Links | BibTeX

Bagheri, Samineh; Thill, Markus; Koch, Patrick; Konen, Wolfgang

Online Adaptable Learning Rates for the Game Connect-4 Technical Report

CIplus (TR 03/2014), 2014, (Preprint version of the article in IEEE Transactions on Computational Intelligence and AI in Games, 2016).

Links | BibTeX

Thill, Markus; Bagheri, Samineh; Koch, Patrick; Konen, Wolfgang

Temporal Difference Learning with Eligibility Traces for the Game Connect-4 Inproceedings

Preuss, Mike ; Rudolph, Günther (Ed.): CIG'2014, International Conference on Computational Intelligence in Games, Dortmund, pp. 84 – 91, 2014.

Links | BibTeX

2012

Thill, Markus; Koch, Patrick; Konen, Wolfgang

Reinforcement learning with n-tuples on the game Connect-4 Inproceedings

Coello Coello, Carlos ; Cutello, Vincenzo ; others, (Ed.): PPSN'2012: 12th International Conference on Parallel Problem Solving From Nature, Taormina, pp. 184–194, Springer, Heidelberg, 2012.

Links | BibTeX

Thill, Markus

Reinforcement Learning mit N-Tupel-Systemen für Vier Gewinnt Masters Thesis

TH Köln -- University of Applied Sciences, 2012, (Bachelor thesis, 1st prize in Opitz award 2013, Festo award 2012, Ferchau award 2012).

Links | BibTeX

2011

Konen, Wolfgang

Self-configuration from a Machine-Learning Perspective Technical Report

Research Center CIOP (Computational Intelligence, Optimization and Data Mining) Cologne University of Applied Science, Faculty of Computer Science and Engineering Science, (05/11; arXiv: 1105.1951), 2011, ISSN: 2191-365X, (e-print published at http://arxiv.org/abs/1105.1951 and Dagstuhl Preprint Archive, Workshop 11181 "Organic Computing -- Design of Self-Organizing Systems").

Links | BibTeX

2009

Konen, Wolfgang; Bartz-Beielstein, Thomas

Reinforcement learning for games: failures and successes -- CMA-ES and TDL in comparision Inproceedings

GECCO '09: Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference, pp. 2641–2648, ACM, Montreal, Québec, Canada, 2009.

Links | BibTeX

Konen, Wolfgang; Bartz-Beielstein, Thomas

Evolutionsstrategien und Reinforcement Learning für strategische Brettspiele Technical Report

Cologne University of Applied Sciences 2009.

Links | BibTeX

2008

Konen, Wolfgang; Bartz-Beielstein, Thomas

Reinforcement Learning: Insights from Interesting Failures in Parameter Selection Inproceedings

Rudolph, Günter ; others, (Ed.): PPSN'2008: 10th International Conference on Parallel Problem Solving From Nature, Dortmund, pp. 478–487, Springer, Berlin, 2008.

Links | BibTeX

Konen, Wolfgang

Reinforcement Learning für Brettspiele: Der Temporal Difference Algorithmus Technical Report

Cologne University of Applied Sciences 2008.

Links | BibTeX

Konen, Wolfgang; Bartz-Beielstein, Thomas

Reinforcement Learning für strategische Brettspiele Technical Report

Cologne University of Applied Sciences 2008.

Links | BibTeX