The submission presents the Collection of Multilingual Parallel Sequences (CoMParS) as a structured basis for evaluating LLMs that aim to model cross-linguistic functional-semantic phenomena. CoMParS is developed within the long-term project Grammar of German in a European perspective (GDE) at the Leibniz Institute for the German Language (IDS) in Mannheim. GDE seeks to construct a multi-contrastive grammar of German against the background of other European languages, using cognitively motivated functional domains (Givón 1984; Zifonun 2017; Frajzyngier 2021) as tertia comparationis linked to traditional part-of-speech categories.

The paper outlines the research question (form-driven and distribution-based constraints on LLMs used for cross-linguistic research), presents a functionally-oriented resource (CoMParS), and sketches ways in which CoMParS may assist in improving the described state of affairs.