Disputation von Tayfun Alpay am 24.03.2021, 14:00 Uhr
24. März 2021, von Reinhard Zierke
Einladung zur hochschulöffentlichen Disputation im Rahmen des Promotionsverfahrens von
Herrn Tayfun Alpay
Titel der Dissertation:
Periodicity, Surprisal, Attention: Skip Conditions for Recurrent Neural Networks
Abstract:
Recurrent neural networks are powerful models used for sequence learning. This thesis addresses the typical limitation of recurrent neural networks to fully process and update for every timestep of an input sequence, even if the presented information is redundant or not relevant to the given task. Based on the conditional computation framework, we introduce and investigate periodicity, surprisal, and attention as constraints to model effective skipping. We evaluate the presented methodologies in the context of natural language processing and explore how we can balance potential trade-offs between model performance and skipping.
Datum und Uhrzeit: Mittwoch, 24. März 2021 um 14:00 Uhr
Ort: per Videokonferenz in Zoom
Betreuer: Prof. Dr. Stefan Wermter
Prof. Dr. Matthias Rarey
Vorsitzender des Fachpromotionsausschusses Informatik