"Reinforcement Learning for N-Player Games: The Importance of Final Adaptation" by Wolfgang Konen and Samineh Bagheri. The talk presented a new approach for game learning and game playing on a variety of games with 1, 2 and 3 players.
"Time Series Encodings with Temporal Convolutional Networks" by Markus Thill, Wolfgang Konen and Thomas Bäck. The talk presented a deep learning approach for anomaly detection of otherwise hard-to-find temporal anomalies in time series.
Although a fully-online event, the single-track conference took place in a nice atmosphere, with many discussions and informal chats. A side effect of the online format was that each speaker was asked to record a backup video, which could be played in case of technical problems. Thus, if you missed the conference, you can nevertheless take a look at the paper, the slides and the video, if you like:
The State of North Rhine-Westphalia provides a grant for the AI Graduate College Data-NInJA („Trustworthy AI for Seamless Problem Solving: Next Generation Intelligence Joins Robust Data Analysis“), coordinated by Prof. Barbara Hammer, University Bielefeld. The grant consists of seven PhD tandems, which were selected out of 37 applications for this grant by an expert jury.
TH Köln takes part in this Graduate College with a PhD tandem together with Ruhr-University Bochum (RUB). Under the title „(RL)³: Representation, Reinforcement und Rule Learning“ the research is conducted by Prof. Laurenz Wiskott from the Neuroinformatics Institute, RUB, and Prof. Wolfgang Konen from the Cologne Institute of Computer Science, TH Köln, together with two PhD students at each institution. The reseach aims at explainable and interpretable AI models, where methods from (deep) reinforcement learning and representation learning will play an important role. The new element of this research project is that both PhD students, one at RUB and one at TH Köln, will work closely together in the PhD tandem, together with their supervisors.
First Place in Opitz Reward 2020 for Jordan Scholzen (Source: Jordan Scholzen / TH Köln)
Jordan Scholzen got with his Bachelor's thesis "Künstliche Intelligenz in der Kompositionslehre - Eine Untersuchung von Long-Short-Term-Memory-Netzen zur Analyse von Kontrapunkten nach Fux" the first place in the Opitz-Innovation Reward 2020. The thesis, supervised by Prof. Dr. Wolfgang Konen, investigates how a supportive AI for music scholars studying composition can look like. Scholzen showed that neural networks of LSTM type allow to learn whether a certain musical line in a counterpoint violates or adheres to the rules once formulated by famous baroque music instructor Johann Joseph Fux.
It is characteristical and shows the importance of the area AI that all 3 Opitz rewards in 2020 covered themes connected with AI. More about Opitz-Innovationspreis 2020 (sorry, in German only) can be found here. The full Bachelor's thesis (again sorry: only German) can be found here.
The Covid-19 crisis pushed many of us to change our working styles. As universities all over Germany changed to an online version, video streaming became a daily necessecity for students to follow the lectures and for professor to be able to evaluate the students' presentations. We hear very often that the stay-home orders amend Covid-19 crisis had an immediate positive impact on the air-pollution and the environment in general but the question is if our new adapted life-style keeps this positive impacts also on the longer runs. Therefore, it is very interesting to answer questions like: "What are the CO2 costs of video streaming?". Professor Wolfgang Konen takes a look at this very important question in this article (unfortunately only in German).
I am very happy to announce that on Wednesday, April 8th 2020, the PhD-colloquium of Samineh Bagheri, which I had the honor to supervise at TH Köln, successfully took place. Her thesis “Self-Adjusting Surrogate-Assisted Optimization Techniques for Expensive Constrained Black Box Problems” deals with state-of-the art optimization algorithms supported by RBF surrogate models. In normal times we would have been all traveling to Leiden University and would have made the ceremony in the prestigious Leiden senate hall. But times are not normal. Due to Covid-19 it was impossible to proceed as planned. But Leiden University is very innovative, and they decided to do their first-time ever fully-online Weiterlesen »
We are happy to inform you that a new version of the SACOBRA package is available on CRAN. SACOBRA is a self-adjusting surrogate assisted optimization framework designed for expensive black-box constrained problems.
This version of SACOBRA can handle black-box equality constraints as described in this paper. Also the online model selection algorithm described in an award-winning paper is available to use in our recent release of SACOBRA. Additionally, the implementation of all 24 G-problems (the most commonly used test-suite for black-box constrained optimization problems in optimization community) is directly available in our package. If you have used SACOBRA 1.1 you might have experienced repeated warning messages coming from nloptr package, this issue is also resolved for the moment.
You can easily install SACOBRA by running the following line in your R command line:
If you have any interesting or challenging constrained optimization problems that you want to solve efficiently, apply SACOBRA and let us know about your experience.
The GroupLearn proposal of Prof. Konen is one of the three proposals from TH Köln that wins a Stifterverband Fellowship in 2020. This year only 10 of the 87 submitted Senior Fellowship proposals were selected for funding by Stifterverband. These fellowships were awarded with 50.000 Euro funding.
Stifterverband NRW awards Fellowships for Innovations in Digital University Teaching for purposes like redesign of university teaching modules using digital technologies and the development of digitally supported teaching and examination formats.
GroupLearn - Group-based learning in the digital learning world MathWeb
In order to promote group work among students, Prof. Wolfgang Konen wants to create with "GroupLearn for MathWeb" a space where students can support and exchange ideas. "GroupLearn", is a digital learning world that is intended to provide a fun and impactful environment to practice mathematical problems. Two main functionalities of GroupLearn can be listed as follows:
The Exercise Compiler is designed to provide an interactive, user-friendly environment in which students design new exercises and their solutions for MathWeb that other students can solve. (The picture above shows a possible layout of the exercise editor.)
The Discussion Forum is intended to provide a place for students and learning coaches to exchange solutions, questions, and problems.
Markus Thill, who is PhD student in our CIOP group, is working on developing new anomaly detection algorithms since 2017 under supervision of Prof. Wolfgang Konen. The field of anomaly detection, which is today often tackled with machine learning algorithms, became a hot topic in the last years. Thill's recent paper titled "Anomaly detection in electrocardiogram readings with stacked LSTM networks" won the best paperaward at the ITAT conference. LSTM (Long Short-Term Memory) networks are a special form of recurrent neural networks and thus belong to the group of deep learning algorithms.
ITAT (Information technologies -- Applications and Theory) is an annual European conference being held in Slovakia. This year ITAT took place from 21 till 23 of September and hosted a number of interesting talks focusing on time series analysis topics including anomaly detection, forecasting etc. " Word guessing game with a social robotic head " was one of the three invited talks in this conference.
Thill uses a deep learning approach to tackle the challenging task of anomaly detection. This method, called LSTM-AD, is described in detail in this paper and shows very promising results compared to the state-of-the-art (see figure above). A distinguishing feature of LSTM-AD is that it learns unsupervised what an anomaly is, just by analysing sufficient data with predominantly normal behaviour. Thill's method is applied to electrocardiograms (heart beat recordings) and can detect anomalies in these electrocardiograms with great reliability.
The Many Criteria Optimization and Decision Analysis (MACODA) workshop, organized by a team of successful researcher and scientists in the field of multi and many obejctive optimization was held from Monday 16 September through Friday 20 September 2019 in Leiden.
The motivated participants of this workshop including early stage researchers, post docs, professors and several researchers working in industry all had a shared goal and that was to address this question: "How should we use computational support to deal with problems with many objectives?" This question is crucially important, as the real-world optimization problems can often be formulated as multi or many objective optimization tasks.
The first day of the workshop belonged to several interesting talks given by pioneers in the field of many and multi-objective optimization, Prof. Hisao Ishibuchi and Prof. Miettinnen. Also, the early stage researchers found the opportunity to share their recent works. From the very first day participants found time and opportunity to discuss different topics and challenges in the field. The atmosphere of sharing and learning from each other got even better as we started with the open space workshop model on the second day. In this form of workshops everybody is invited to come up with topics that have a high importance to discuss with the community. Everyone who comes up with a topic can write it on a card and attach it to the wall in a specific cell showing a specific time slot and room. This is an official invitation to the rest of the participants to join the discussion if it is of their interest. Every discussion was documented.
In the course of the workshop a lot of existing challenges in the field along with possible cures were discussed. Some of the groups ended up finalizing their work with a plan for future collaborations in form of a paper or a project.
Wolfgang Konen presented his work on General Board Game Playing at CoG'2019, the Conference on Games, which took place between 20-23 of August in London, UK. You can find the poster here and the accompanying paper here on arXiv. The General Board Game (GBG) Playing Framework is about computer agents that learn game strategies just from self-play and work across a large variety of board games. It is also an educational project that makes it easier for computer science students to start their projects, Bachelor or Master theses in the area of game learning. The GBG poster presentation led to a series of interesting discussions and feedbacks.
Conference CoG (formerly known as Conference on Artificial Intelligence in Games) started with a fascinating keynote given by David Silver from Google's DeepMind. David shared very interesting insights about their famous AlphaGo and AlphaZero learning agents and their new works AlphaStar (mastering the real-time-strategy game StarCraft II) and AlphaFold (cutting-edge technology for 3D protein folding). Many other interesting talks, posters and tutorials (among them one given by Boris Naujoks, TH Köln, together with Vanessa Volz on Game Benchmarks for EAs) made the conference a very stimulating event. Apart from interesting keynotes, talks and discussions, a "Games Night" event was organized which spiced up the whole program.