MIDAL: A Dataset of Math Image Descriptions for Accessible Learning

Abstract

Many open educational resources are lacking in accessibility, especially in-depth image descriptions. In subjects like Science and Mathematics, however, it can be particularly difficult to write image descriptions since there can be many complicated expressions and names depending upon the course level. To help fill that gap in a small way, we introduce Math Image Descriptions for Accessible Learning (MIDAL), a math image-description dataset of 2,020 mathematical images spanning multiple educational levels, to aid in training vision language models to create image descriptions following accessibility best practices. We hope MIDAL is a valuable resource in enhancing the conversation and innovation regarding accessibility of STEM content in higher education. This dataset is however not just limited in math description generation but can also be used to fine-tune language models that can have improved mathematical reasoning and answers.