Markus Thill, who is PhD student in our CIOP group, is working on developing new anomaly detection algorithms since 2017 under supervision of Prof. Wolfgang Konen. The field of anomaly detection, which is today often tackled with machine learning algorithms, became a hot topic in the last years. Thill's recent paper titled "Anomaly detection in electrocardiogram readings with stacked LSTM networks" won the best paperaward at the ITAT conference. LSTM (Long Short-Term Memory) networks are a special form of recurrent neural networks and thus belong to the group of deep learning algorithms.
ITAT (Information technologies -- Applications and Theory) is an annual European conference being held in Slovakia. This year ITAT took place from 21 till 23 of September and hosted a number of interesting talks focusing on time series analysis topics including anomaly detection, forecasting etc. " Word guessing game with a social robotic head " was one of the three invited talks in this conference.
Thill uses a deep learning approach to tackle the challenging task of anomaly detection. This method, called LSTM-AD, is described in detail in this paper and shows very promising results compared to the state-of-the-art (see figure above). A distinguishing feature of LSTM-AD is that it learns unsupervised what an anomaly is, just by analysing sufficient data with predominantly normal behaviour. Thill's method is applied to electrocardiograms (heart beat recordings) and can detect anomalies in these electrocardiograms with great reliability.
The Many Criteria Optimization and Decision Analysis (MACODA) workshop, organized by a team of successful researcher and scientists in the field of multi and many obejctive optimization was held from Monday 16 September through Friday 20 September 2019 in Leiden.
The motivated participants of this workshop including early stage researchers, post docs, professors and several researchers working in industry all had a shared goal and that was to address this question: "How should we use computational support to deal with problems with many objectives?" This question is crucially important, as the real-world optimization problems can often be formulated as multi or many objective optimization tasks.
The first day of the workshop belonged to several interesting talks given by pioneers in the field of many and multi-objective optimization, Prof. Hisao Ishibuchi and Prof. Miettinnen. Also, the early stage researchers found the opportunity to share their recent works. From the very first day participants found time and opportunity to discuss different topics and challenges in the field. The atmosphere of sharing and learning from each other got even better as we started with the open space workshop model on the second day. In this form of workshops everybody is invited to come up with topics that have a high importance to discuss with the community. Everyone who comes up with a topic can write it on a card and attach it to the wall in a specific cell showing a specific time slot and room. This is an official invitation to the rest of the participants to join the discussion if it is of their interest. Every discussion was documented.
In the course of the workshop a lot of existing challenges in the field along with possible cures were discussed. Some of the groups ended up finalizing their work with a plan for future collaborations in form of a paper or a project.
Wolfgang Konen presented his work on General Board Game Playing at CoG'2019, the Conference on Games, which took place between 20-23 of August in London, UK. You can find the poster here and the accompanying paper here on arXiv. The General Board Game (GBG) Playing Framework is about computer agents that learn game strategies just from self-play and work across a large variety of board games. It is also an educational project that makes it easier for computer science students to start their projects, Bachelor or Master theses in the area of game learning. The GBG poster presentation led to a series of interesting discussions and feedbacks.
Conference CoG (formerly known as Conference on Artificial Intelligence in Games) started with a fascinating keynote given by David Silver from Google's DeepMind. David shared very interesting insights about their famous AlphaGo and AlphaZero learning agents and their new works AlphaStar (mastering the real-time-strategy game StarCraft II) and AlphaFold (cutting-edge technology for 3D protein folding). Many other interesting talks, posters and tutorials (among them one given by Boris Naujoks, TH Köln, together with Vanessa Volz on Game Benchmarks for EAs) made the conference a very stimulating event. Apart from interesting keynotes, talks and discussions, a "Games Night" event was organized which spiced up the whole program.
This year, beautiful Prague hosted GECCO 2019, from 13th to 17th of July. GECCO -- standing for The Genetic and Evolutionary Computation Conference-- is an outstanding conference which brings many active scientists and PhD students together annually. We have presented a recent piece of our work in form of a poster. The work titled: "Online Whitening for High Conditioning Optimization Problems" is a preliminary work toward addressing the challenges of handling high conditioning functions with surrogates. GECCO provided a great opportunity to recieve interesting feedback and ideas from the optimization community.
From the 501 papers received, 173 contribuations were accepted as full papers and 168 contributions as poster by GECCO 2019 committee. High quality paper and poster sessions both enabled valubale chances to exchange opinion and evolve your ideas. Apart from these sessions, GECCO hosted plenty of useful tutorials, workshops, keynotes and social events.
"Challenges for Learning in Complex Environments" was the name of an outstanding keynote talk given by Raia Hadsell, the Robotics Lead of Google DeepMind. She emphasized on the importance of multiobjective learners and the continual learning concept.
We are pleased to inform you that the recent work "General Board Game Playing for Education and Research in Generic AI Game Learning" of Prof. Wolfgang Konen has been accepted for publication and it will be presented as a Poster at IEEE CONFERENCE ON GAMES (CoG) 2019. CoG 2019, held in London, UK, will be hosting many peer-reviewed paper and poster presentations as well as academical and industrial invited talks in various game technology related fields. Wolfgang Konen introduces a general board game playing and learning framework, in his recent paper. You can find more information about the developed educational tool by Wolfgang Konen in one of our former blog-posts.
Recommender System is the name given to any software designed to recommend you objects to purchase, to click on or to watch, which might be attractive to you with a high probability. Development of such systems became a hot topic for software developers and machine learning engineers in the last years. A well-performing recommender system can make significant contributions to various online platforms.
Nowadays, many of us interact with recommender systems on a daily basis. If you have an account in Amazon or Netflix or many similar online services, you may have received suggestions that often fit your interest. This can vary from a movie suggested by Netflix or very various products suggested by Amazon. The targeted advertisements on Facebook or the targeted pop-up advertisements in your browser are also other examples of applications of these systems. Almost no two person receives the exact same advertisements or suggestions on an online platform. All these personalized suggestions and advertistments use recommender systems to find the best match for your interests according to your former ratings, purchases or clicks.
Content-based recommender systems often make use of the explicit features of the users and the items to provide recommendations. In contrary, the Collaborative Filtering recommender systems do not have access to any sort of explicit features and tend to learn the important features of users and items implicitly. The real-world recommender systems are often a hybrid of both approaches.
You can try our movie recommender system demo, by simply giving your own ratings and see what the system will suggest to you. This movie recommender system is based on the implementation of Matrix Factorization algorithm in Python. Matrix Factorization is a collaborative filtering approach which tends to learn implicit features for users and items by factorizing the exiting rating matrix. We expalin this algorithm in more details, in this Google Colaboratory Notebook . We describe how the recommender system problem turns into an optimization problem and how to handle such optimization tasks. Also a step-by-step implementation of this algorithm in Python is provided.
On Saturday, May, 25th, 2019, TH Köln hosted the annual Digital Xchange conference, which is organized as a cooperative work of Opitz Consulting and TH Köln, for the third time. This 1-day conference is becoming more and more popular: this year it attracted more than 800 participants. More than 100 talks were given in the field of digitalization and its impact on industry. The topics had a large variety and covered many areas of digitalization including Big Data, Cloud Computing, Industry 4.0, Machine Learning, Artifical Intelligence, etc. You can find a list of all talks here.
One of the very interesting talks at Digital Xchange which attracted a large group of audience was "Deep Learning mit Keras und TensorFlow" given by Henning Buhl. He is a Computer Science Bachelor student at TH Köln who also works part-time under supervision of Prof. Wolfgang Konen. His talk coverd a large range of themes from neural networks to machine learning and Python code examples. As part of his talk he gave a live demo on Google Colaboratory with Jupyter notebooks showing TensorFlow and Keras examples. These examples are available on GitHub for your own study if you like. You can find them here or here on GitHub.
This year the 28th Computational Intelligence workshop took place on November, 29th-30th, in Dortmund. As every year, this two-day workshop was packed with many interesting talks and two gripping keynotes (deep learning and OpenML). The presentations and the keynotes had diverse topics including fuzzy control, surrogate-assisted optimization, modeling techniques, deep learning, interesting applications (e.g. gait recognition, driving lane recognition) and several other areas
The deep learning and reinforcement learning summer schools hosted by Canadian Institute For Advanced Research (CIFAR) and the Vector Institute are among the most prestigious summer schools in the field of machine learning and artificial intelligence. This year the summer school was taking place in Toronto, Canada from 25th of July till 3rd of August including 7 days of deep learning school and 3 days of reinforcement learning lectures. Since deep learning became very popular in the last years, a large number of students and researchers (over 1200 applicants) applied to participate in both of these summer schools and a little bit more than 250 delegated to attend. This year two of the PhD students from TH Köln were among the 23% lucky attendees of these valuable summer schools.
Every day of the summer schools was planned with many interesting lectures, contributed talks and a poster session. The lectures covered a wide variety of topics. Also the level of the lectures were varying from basics going to very advanced topics. The lecturers were from DeepMind, Google Brain, Microsoft Research, Vector Institute as well as pioneers of the field from University of Toronto, University of Alberta and the Montreal Institute of Learning Algorithm (MILA) and several other active institutes in the field. The contributed talks were given by PhD students and were selected by the summer school's organizers committee. Samineh Bagheri and Markus Thill from TH Köln also had a chance to present a poster in this summer school.
We are grateful for partial funding of travel and conference costs by the deanery of the faculty and the computer science institute.
ECDA is an international conference with the main focus on data science and data mining which is being held in different European cities since 2013 almost every year. This year the conference was held in Paderborn, Germany. This 3-days conference hosted many interesting keynotes and a large number of talks given by scientists from all over the world. Prof. Wolfgang Konen organized and chaired the "Time Series Analysis and Online Algorithms" session. In the same session Markus Thill presented his recent work "Online Adaptable Time Series Anomaly Detection with Discrete Wavelet Transforms and Multivariate Gaussian Distributions" and he received valuable remarks and feedback. The deadline for the paper submission is on 15th of September and after successfully passing through a reviewing process the work will be published in Archives of Data Science, Series A Journal.