Papers
Reverse chronological. See also my CV.
2026
- Elahe Rahimi, François Roewer-Després, Hassan Sajjad, Md Mahbub Alam, Sher Badshah, Elham Dolatabadi, Frank Rudzicz. REFRAME: A Test Suite for the Knowledge–Deployment Gap in LLMs. Conference on Empirical Methods in Natural Language Processing (EMNLP), 2026, pp. 57310-57325.
- Sher Badshah, Ali Emami, Hassan Sajjad. SCOPE: Selective Conformal Optimized Pairwise LLM Judging. International Conference on Machine Learning (ICML), PMLR 306, 2026, pp. 4894-4916.
- Sher Badshah, Ali Emami, Hassan Sajjad. Judge, Retrieve, or Abstain: Uncertainty-Guarded LLM Judging with Provable Risk Guarantees. Conference on Language Modeling (COLM), 2026.
- Sher Badshah, Ali Emami, Hassan Sajjad. SAGE: A Search-Augmented Evaluation of Large Language Models on Free-Form QA. Annual Meeting of the Association for Computational Linguistics (ACL), 2026, pp. 1466-1491.
2025
- Sher Badshah, Moamen Moustafa, Hassan Sajjad. CLEV: LLM-Based Evaluation Through Lightweight Efficient Voting for Free-Form Question-Answering. Findings of the ACL: IJCNLP-AACL 2025, pp. 1513-1531.
- Sher Badshah, Hassan Sajjad. Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QA. Proceedings of the 9th Widening NLP Workshop, 2025, pp. 251-267.
- Jinkun Chen, Sher Badshah, Xuemin Yu, Sijia Han. Static Sandboxes Are Inadequate: Modeling Societal Complexity Requires Open-Ended Co-Evolution in LLM-Based Multi-Agent Simulations. arXiv:2510.13982, 2025.
2024
- Sher Badshah, Hassan Sajjad. Quantifying the Capabilities of LLMs Across Scale and Precision. arXiv:2405.03146, 2024.
Earlier work (software engineering)
- Arif Ali Khan, Sher Badshah, et al. Ethics of AI: A Systematic Literature Review of Principles and Challenges. EASE, ACM, 2022, pp. 394-401.
- Sher Badshah. Challenges to Project Management in Distributed Software Development: A Systematic Literature Review. In Evolving Software Processes: Trends and Future Directions, Wiley, 2022, pp. 241-251.
- Peng Zhou, Arif Ali Khan, Peng Liang, Sher Badshah. System and Software Processes in Practice: Insights from Chinese Industry. EASE, ACM, 2021.
- Sher Badshah, Arif Ali Khan, Shahid Hussain, Bilal Khan. What Users Really Think About the Usability of Smartphone Applications: A Diversity-Based Empirical Investigation. Multimedia Tools and Applications 80(6), 2021, pp. 9177-9207.
- Sher Badshah, Arif Ali Khan, Bilal Khan. Towards Process Improvement in DevOps: A Systematic Literature Review. EASE, ACM, 2020, pp. 427-433.
- Bilal Khan, Danish Iqbal, Sher Badshah. Cross-Project Software Fault Prediction Using Data Leveraging Techniques to Improve Software Quality. EASE, ACM, 2020, pp. 434-438.