Qiaoyuan Zheng I am a Master’s student in Data Science at ETH Zürich and a Research Assistant at the ETH AI Center. My research focuses on LLM evaluation , interpretable capability assessment , and privacy in language agents .
Previously, I studied Computer Science and Mathematics at Sorbonne University. I also worked on time-series forecasting at ESIEE Paris, supervised by Dr. You Jiang.
Email / CV / Google Scholar / GitHub / LinkedIn
Publications Experience Education Projects About Publications I work on evaluating language models beyond aggregate benchmark scores, including privacy–utility trade-offs, ranking robustness, and interpretable skill profiles.
Qiaoyuan Zheng , Yiqu Yang, Qi Gao, Imanol Schlag
NeurIPS 2026 E&D Track.
Project Page arXiv GitHub Dataset Cites 7
BibTeX Copy BibTeX @misc{zheng2026polarbenchdiagnosticbenchmarkprivacyutility,
title={POLAR-Bench: A Diagnostic Benchmark for Privacy-Utility Trade-offs in LLM Agents},
author={Qiaoyuan Zheng and Yiqu Yang and Qi Gao and Imanol Schlag},
year={2026},
eprint={2605.19127},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2605.19127},
}A diagnostic benchmark with 7,852 samples across 10 domains for evaluating the trade-off between task utility and user-defined privacy constraints in LLM agents.
Qiaoyuan Zheng , Yiqu Yang
NeurIPS 2026 TAE Workshop.
Project Page arXiv GitHub Cites 2
BibTeX Copy BibTeX @misc{zheng2026neartiedllmrankingsrobust,
title={Are Near-Tied LLM Rankings Robust to Family-DIF-Guided Benchmark Recomposition?},
author={Qiaoyuan Zheng and Yiqu Yang},
year={2026},
eprint={2609.00482},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2609.00482},
}We study the robustness of near-tied LLM rankings across five benchmarks using item response theory and differential item functioning, with owner-disjoint evaluation folds and matched-random controls.
Peng Cui, Qiaoyuan Zheng (co-first author), Rudolf Debelak, Mrinmaya Sachan
Preprint. Under review.
arXiv Cites 1
BibTeX Copy BibTeX @misc{cui2026makesharderexplainingquestion,
title={What Makes Something Hard(er)? Explaining Question Difficulty in Natural Language},
author={Peng Cui and Qiaoyuan Zheng and Rudolf Debelak and Mrinmaya Sachan},
year={2026},
eprint={2610.01627},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2610.01627},
}Combining item response theory with LLM-based contrastive hypothesis generation to explain question difficulty, with validation through held-out difficulty prediction and targeted question rewriting across reasoning benchmarks.
Berke Arda, Peng Cui, Qiaoyuan Zheng , Rudolf Debelak, Mubashara Akhtar, Mrinmaya Sachan
Under review.
arXiv Cites 0
BibTeX Copy BibTeX @misc{arda2026skillevallearninginterpretableability,
title={SkillEval: Learning Interpretable Ability Profiles of LLMs via Cognitive Diagnosis Models},
author={Berke Arda and Peng Cui and Qiaoyuan Zheng and Rudolf Debelak and Mubashara Akhtar and Mrinmaya Sachan},
year={2026},
eprint={2610.28767},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2610.28767},
}Citing papers 0 Each paper below includes this work in its references. Different versions of the same paper count once. This verified list may not be exhaustive.
Last checked: 9 November 2026
No citing papers have been verified yet. This does not imply that no citations exist.
Combining LLM-based skill discovery with neural cognitive diagnosis to construct interpretable ability profiles for 3,811 LLMs across 9,523 items from five benchmarks.
Yiqu Yang (co-first author), Qiaoyuan Zheng (co-first author), Yang Tian, Yu Fan, Elliott Ash
Under review.
Project Page arXiv GitHub Dataset Cites 1
BibTeX Copy BibTeX @misc{yang2026tuplebenchevaluatingmitigatingprivacyutility,
title={TUPLE-Bench: Evaluating and Mitigating Privacy-Utility Trade-offs in Typed Decision Models},
author={Yiqu Yang and Qiaoyuan Zheng and Yang Tian and Yu Fan and Elliott Ash},
year={2026},
eprint={2610.23668},
archivePrefix={arXiv},
primaryClass={cs.CR},
url={https://arxiv.org/abs/2610.23668},
}A benchmark of 720 synthetic counterfactual pairs across three domains evaluating privacy leakage and downstream utility across five output-release settings. We develop workflow-constrained privacy quantization (WCPQ) to reduce secret recovery while preserving action branches and costs across 18 frozen workflow/cost combinations.
Vilém Zouhar, Niyati Bafna, Mukund Choudhary, …, Qiaoyuan Zheng , …
Preprint.
arXiv Cites 5
BibTeX Copy BibTeX @misc{zouhar2026translationbenchmark,
title={Last Translation Benchmark},
author={Vilém Zouhar and Niyati Bafna and Mukund Choudhary and Maike Züfle and Sara Rajaee and Pinzhen Chen and Jannis Vamvas and Sara Papi and Ona de Gibert and Bhavitvya Malik and Eliya Habba and Orfeas Menis Mastromichalakis and Patrícia Schmidtová and Michelle Wastl and Sheriff Issaka and Leshem Choshen and Stella Biderman and Antonis Anastasopoulos and Jan Niehues and Rico Sennrich and Mrinmaya Sachan and Ondřej Bojar and Kenton Murray and Jörg Tiedemann and Alham Fikri Aji and Philipp Koehn and Christof Monz and Alexandra Birch and Sowmya Vajjala and Chalamalasetti Kranti and Cristina España-Bonet and Nobin Sarwar and David Kaczér and Sourajit Saha and Jonathan Tonglet and Shunta Asano and Malik Marmonier and Daban Q. Jaff and Vaisakhi Mishra and Hend Al-Khalifa and Gabriele Sarti and Nils Rehlinger and Juan Daniel Cuervo Villa and Dominik Macháček and Saugata Purkayastha and Jagannathan Ramanujam and Shubhashis Roy Dipta and Aviral Nigam and Shuaib Shuaib Yusuf and Heejin Do and Jonathan Yahav and Johannes-Rudolf David and Maria Carmen Staiano and Zuzana Nadova and Fred Philippy and Ron Keinan and Maria Lymperaiou and Silvia Casola and Fabian Retkowski and Andrés Jerez and Hanna Yukhy- menko and Sangwon Ryu and Avantica Vempati and Sukannya Purkayastha and Adrian Cosma and Erivan Inan and Vitalii Babenko and Wafa Aissa and Valentin Scourneau and Fatima Haouari and Venkata Prasanth Kumar Gummadi and Mehdi Jafarzadeh and Manon Reusens and Kaiser Sun and Lukas Edman and Shaomu Tan and Giuseppe Gallipoli and Pawan Sasanka Ammanamanchi and Manar Ali and Mohammad Sadegh Gholizadeh and Dipankar Srirag and Marek Šuppa and Javier García Gilabert and Ruta Binkyte and Ana-Maria Bucur and Sabry E. Farrag and Youssef Saber and Yihong Liu and Theresia Veronika Rampisela and Christian Hoang and Nicoleta Cojocaru and Jan Kocoń and Jean Maillard and Xiaochuang Yuan and Sina Ahmadi and Daryna Dementieva and Philipp Mondorf and Kaustubh Dhole and Valmik Nahata and Roman Wixinger and Amir Hossein Yari and Shenbin Qian and Manuel Tuor and Fida Mohammad Thoker and Sergey Troshin and Lance Calvin Lim Gamboa and Amir Arsalan Rezapour and Kätriin Kukk and Koel Dutta Chowdhury and Shaswati Saha and Seth Aycock and Bo Chen and Linh Vu and Vatsal Venkatkrishna and Shayan Bali and Arafat Ahsan and Luan Thanh Nguyen and Hassan Soliman and Ngoc Quynh Tram Do and Azmine Toushik Wasi and R. Damanhuri and Marius Huber and Kazuki Egashira and Jimson Paulo Layacan and David Africa and Vladislav Poritski and Mike Zhang and Deep Shah and Abdulaziz Nura Kani and Luis Frentzen Salim and Paul Gavrikov and Bello Umar Bello and Ayush Sunil Munot and Anumit Garg and Yolanda Xavier and Qiaoyuan Zheng and Kawsar Ahmed and Debanshu Das and Zimu Wang and Gengyu Rao and Kamile Dementaviciute and Farhan Farsi and L D M S Sai Teja and Dawei Zhu and Yi Fan and Wei Liu and Marco Gaido and Elias Herranen and Sankalan Pal Chowdhury and Karen Sanchez and Guy Kaplan and Farzad Shami and Ashok Urlana and Amir Hossein Kargaran and Sofie Goethals and Priyaranjan Pattnayak and Oksana Volchek and Marii Ojastu and Hongbin Na and Emilian Radoi and Chenyi Zhao and Carlos Hinojosa and Andrei Niculae and Andrea Gregor de Varda and Zaid Alyafeai and Tomasz Limisiewicz and Reem Alzahrani and Pouya Sadeghi and Nehal Kathrotia and Mateusz Lango and Enzo Doyen and Alex Flückiger and Ulysses Sekai Tully Carr and Samuel Simko and Ritwik Tiwari and Rishit Dagli and Isaac R Caswell and Bowen Yi and Aicha Chorana and Selja Keränen and Sadiksha Chitrakar and Muhammad Ravi Shulthan Habibi and Joy Olusanya and Bishal Shrestha and Zhengxiang Wang and Vivek Harsha Lakkamaneni and Sophia Conrad and Panayiotis Panayiotou and Nazia Tasnim and Marta Punsola Munárriz and Marko Culjak and Luis Lara and Jenny Chim and Jannatul Nayem and Fidel Rodríguez Velásquez and Eran Yahav and Blanka Kövér and Beatrice Savoldi and Anmol Goel and Aishik Mandal and Tosin Adewumi and Raoyuan Zhao and Mykola Haltiuk and Antonia Karamolegkou and Yuxing Lu and Thura Aung and Naser Almousa and Tommaso Cerruti and Raia Abu Ahmad and Beni Egressy and Alireza Pakniat and Stéphane J. P. S. Thunus and Rachel Bawden and Lena Libon and Samridhya Biswas and Prakhar Gupta and Nusrat Jahan Lia and Nguyen Tai and Natchapon Jongwiriyanurak and Minh Ngoc Do and Ivan Barać and Dzmitry Kuzmin and Badal Nyalang and Antoine Taroni and Andy Catruna and Rushikesh Zawar and Roland Aydin and Pavel Stepachev and Ilai Yaron Levy and Andreas Simons and Rayyan Merchant and Ziyi Yang and Samuel Frontull and Kenneth Enevoldsen and Harris Abdul Majid and Tim Graf and Tatiana Bielakova and Sharifa Djurabaeva and Shaoxiong Ji and Jirui Qi and Ayla Rigouts Terryn and Yurii Paniv and Xiyan Fu and Sunisth Kumar and Shree Harsha Bokkahalli Satish and Papa Abdou Karim Karou Diallo and Mengyu Ye and Maximilian Vieweg and Matija Akrap and Kristýna Onderková and Joseph Attieh and Ivan Yuri De Leon and Ibrahim Baroud and Esrael Teferi Tensay and Elisabeth Fittschen and David Dukić and Benoît Sagot and Jingwei Ni and Yu Fan and Juri Opitz},
year={2026},
eprint={2609.04173},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2609.04173},
}I contributed translation test cases and reviewed English, Chinese, and French benchmark submissions.
Research Experience
ETH AI Center 2026–present Research Assistant · Zurich, Switzerland
Developing a multilingual benchmark for legal compliance in LLMs, including reproducible scenario-generation, review, and evaluation pipelines. Collaborating with legal experts and investigating applications for LLM post-training.
ESIEE Paris 2023 Research Assistant · Paris, France
Implemented Transformer-based models and PatchTST for time-series forecasting under Dr. You Jiang, adapting training pipelines and comparing model performance and computational efficiency on synthetic datasets. [code]
Education
ETH Zürich 2025–present MSc in Data Science
Sorbonne University 2022–2025 BSc in Computer Science / Mathematics
Selected Projects
Aperiodic Tiling Generation 2024 Sorbonne University
Implemented Penrose, Wang, and Hat tiling algorithms in Python; optimized generation with duplicate detection and spatial pruning.
Q-Learning and SARSA in Grid Worlds 2023 ESIEE Paris · GitHub
Compared Q-learning and SARSA across 15 custom environments. Built a map editor and environments adopted for master’s-level teaching at UPEC.
A little more about me I speak Chinese, English, and French. Outside research, I enjoy playing drums and saxophone, cooking, reading, and calligraphy.
You can reach me at zqiaoyuan@ethz.ch .