"Explainable Visual Question Answering" - Student Project Funded by University of Hamburg

17 October 2022

Photo: UHH/Knowledge Technology

The project “Explainable Visual Question Answering” by Jakob Ambsdorf, Lukas Braach, Jae Hee Lee, and Björn Plüster builds upon the a recent vision-language Transformer-based neural model. The concrete goal is to extend this model to output a plausible textual explanation for the given answer. Additionally, the group plans to evaluate the faithfulness of the explanations of this model. The findings will be summarized in an upcoming research paper and submitted to a top-tier AI conference. To support this ambitious goal, the group has been granted research funds from the University of Hamburg’s excellence strategy cluster. Congratulations to Jakob Ambsdorf, Lukas Braach, Jae Hee Lee, and Björn Plüster!