European Association for Digital Humanities 2026
15-19 September 2026
Jagiellonian University, Kraków, Poland
Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions on that day or at that location. Please select a single session for detailed view (with abstracts and downloads if available).
|
Daily Overview |
| Session | |
|
LP15: Ask and You Shall Retrieve: LLMs, Libraries, and the Search for Meaning Location: Room 505, al. Mickiewicza 9b Session Chair: Beata Trawinski | |
| Presentation 1 | |
Do you know what I'm looking for? LLM-supported query formulation for complex query languages. Saxon Academy of Sciences and Humanities in Leipzig, Germany The submission investigates how large language models (LLMs) can support the formulation of complex queries in scientific information systems, using the Federated Content Search (FCS) and its LexCQL query language as an example. Access to such systems is often hindered by implicit technical knowledge requirements, limited usability, and linguistic barriers. LLMs offer a promising alternative by enabling intuitive, natural-language interaction. A key challenge is the absence of natural-language, real-world user requests, as systems like the FCS operate exclusively with formal queries. To address this gap, synthetic information needs are generated by transforming existing query logs into natural-language user queries using LLMs, guided by simplified personas. These synthetic queries are then translated back into LexCQL, allowing both stages to be evaluated without a gold standard. Manual evaluation of 280 samples each shows that most generated information needs correctly reflect the underlying technical queries and most generated LexCQL queries are predominantly correct, confirming the feasibility of the approach. The evaluation also reveals shortcomings in the underlying technical specification. These findings will be incorporated into the next revision of the specification and demonstrate how gaps in the clarity of technical documentation can be identified that are relevant both for humans and for its use in LLM-based applications. | |
