Doctoral Researcher in AI System Evaluation with a focus on Benchmarking (KTS-82)

Köln

Full-time

Temporary

GESIS Leibniz Institute for the Social Sciences is an internationally active research institute, funded by federal and state governments and member of the Leibniz Association.

Starting on 01 October 2026 our Department Knowledge Technologies for the Social Sciences (KTS), Team Human Information Interaction located in Cologne is looking for a

Doctoral Researcher in AI System Evaluation with a focus on Benchmarking(Salary group 13 TV-L, working time 100%, limited till 31 December 2028, with the option to extend)

The department Knowledge Technologies for Social Sciences (KTS) conducts research at the intersection of information retrieval, natural language processing, semantic technologies and human information interaction as foundation for innovative web portals and platforms for the search and use of research data.

AI is transforming the scientific process across disciplines. In the NFDI4DS and BERD projects, we develop infrastructures that empower researchers to responsibly adopt AI methods—for example, by establishing fair benchmarking protocols, ensuring transparent evaluation and documentation of AI models and LLMs, and curating a repository of open, reusable AI-based methods, along with related training materials and events. In this context, we are seeking a motivated researcher to support these activities by conducting cutting-edge research.

Your tasks will be:

Design, implement and evaluate infrastructure for the responsible use of AI in research, including benchmarking protocols, transparent evaluation and documentation of AI/LLM models
Train and evaluate AI models / LLMs for research (“research co-pilots"), e.g. within the GESIS Search environment
Conduct research in the areas mentioned above
Dissemination of project results through publications and workshops

Your profile:

Very good university degree (master's/diploma or equivalent) in computer science, data science, or a related field
Experience in AI benchmarking, including metrics, reproducible assessment pipelines, and systematic performance analysis
Very good experience in software development with Python, AI-tooling, and NLP technologies
Very good knowledge of English, good verbal and written communication skills in German desirable

Our Benefits:

Flexible working hours and regulations for mobile working
Opportunity to pursue a PhD at Heinrich-Heine University Düsseldorf, supervised by Prof. Dr. Stefan Dietze
Very good conditions for reconciling work and family life, e.g. subsidies for childcare for children who have not yet attained the age of compulsory schooling
Holistic company health management and discounted participation in the university's sports programme
Generous support for your pension provision as a direct insurance policy
Promotion of your skills through further training measures

Contact

For further information concerning the tasks please contact contact person via phone +49 (221) 47694-536 or via E-Mail (Dagmar.Kern@gesis.org). If you have questions about the application process, please contact Christine Laßmann (Christine.Lassmann@gesis.org) via E-Mail.

Interested?

Please apply via our Online-application portal until 29 June 2026.
Our reference number is: KTS-82

About us

GESIS is one of the world's leading social science infrastructure facilities, supporting researchers at all levels of their research projects with expertise and infrastructure services. We help ensure that socially relevant questions can be answered based on reliable data, the latest scientific methods and research information. We help with study planning and data collection, provide high-quality research data, support with data preparation and analysis, and finally with data archiving.
GESIS helps you gain further qualifications. We offer our employees a wide range of career opportunities in an appealing work environment with a high degree of personal responsibility and creative freedom. With us, you will work in an international environment in the heart of Mannheim and Cologne and benefit from a flexible work environment as well as internal and external networks.
GESIS ensures compliance with the guidelines for the severely disabled and promotes professional equality between women and men.
Full-time positions can also be filled on a part-time basis.
As a family-friendly employer, we have been certified by the “berufundfamilie” audit since 2010.
Further information on working at GESIS can be found here.