Opening the Black Box: Analyzing Attention Weights and Hidden States in Pre-trained Language Models for Non-language Tasks

Opening the Black Box: Analyzing Attention Weights and Hidden States in Pre-trained Language Models for Non-language Tasks

Mohamad Ballout, Ulf Krumnack, Gunther Heidemann, Kai-Uwe KuhnbergerVianna da Motta