Shaker Mahmud KhandakerS. M. Khandaker

Publications

Papers, tools and artifacts

Full author lists in publication order; my name appears as printed in each record. Status is shown where a paper is not yet in its final published form.

Also on ORCID, DBLP and researchr.

2026

Journal articleSCP · 2026

AugmenTest: A tool for improving test quality through automatic assertion generation

Shaker Mahmud Khandaker, Fitsum Kifetew, Davide Prandi and Angelo Susi

Science of Computer Programming, vol. 254, article 103531. Elsevier.

The tool paper for AugmenTest: it describes how the tool uses large language models to generate test assertions from a method's documentation and comments, so that automatically generated tests check intended behaviour rather than whatever the code currently does.

DOI 10.1016/j.scico.2026.103531
Cite (BibTeX)
@article{khandaker2026augmentest,
  title = {AugmenTest: A tool for improving test quality through automatic assertion generation},
  author = {Shaker Mahmud Khandaker and Fitsum Kifetew and Davide Prandi and Angelo Susi},
  journal = {Science of Computer Programming},
  year = {2026},
  volume = {254},
  pages = {103531},
  publisher = {Elsevier},
  doi = {10.1016/j.scico.2026.103531}
}
Conference paperIn conference programmeQUATIC 2026 · 2026

Interactive Optimization of System Configurations Using Feature Models

Shaker Mahmud Khandaker, Fitsum Meshesha Kifetew, Davide Prandi and Angelo Susi

International Conference on the Quality of Information and Communications Technology (QUATIC 2026), Requirements Engineering track.Full paper in the QUATIC 2026 scientific programme (9 September 2026). Proceedings details to follow.

An approach to optimising system configurations interactively, using feature models to describe the space of valid configurations.

Conference programme
Cite (BibTeX)
@inproceedings{khandaker2026interactive,
  title = {Interactive Optimization of System Configurations Using Feature Models},
  author = {Shaker Mahmud Khandaker and Fitsum Meshesha Kifetew and Davide Prandi and Angelo Susi},
  booktitle = {International Conference on the Quality of Information and Communications Technology (QUATIC 2026), Requirements Engineering track},
  year = {2026}
}

2025

Conference paperICST 2025 · 2025

AugmenTest: Enhancing Tests with LLM-Driven Oracles

Shaker Mahmud Khandaker, Fitsum Kifetew, Davide Prandi and Angelo Susi

2025 IEEE Conference on Software Testing, Verification and Validation (ICST), Naples, Italy, pp. 279–289. IEEE.

Generating correct test oracles is still an open problem in automated test generation. AugmenTest asks LLMs to infer the intended behaviour of a method from its documentation and developer comments, without looking at the code, and compares four prompting and retrieval-augmented variants. On 203 bug-revealing tests from 142 Java classes, the Extended Prompt variant produced correct assertions in 30% of cases in the most conservative setting, against 8.2% for the state-of-the-art TOGA approach; the RAG variants did not improve results.

DOI 10.1109/ICST62969.2025.10988926arXiv preprintReplication packageConference page
Cite (BibTeX)
@inproceedings{khandaker2025augmentest,
  title = {AugmenTest: Enhancing Tests with LLM-Driven Oracles},
  author = {Shaker Mahmud Khandaker and Fitsum Kifetew and Davide Prandi and Angelo Susi},
  booktitle = {2025 IEEE Conference on Software Testing, Verification and Validation (ICST), Naples, Italy},
  year = {2025},
  pages = {279--289},
  publisher = {IEEE},
  doi = {10.1109/ICST62969.2025.10988926}
}

2024

Conference paperISoLA 2024 · 2024

Model-Based Testing of Railway Interlocking Systems

Alessandro Cimatti, Shaker Khandaker, Fitsum Kifetew, Lorenzo Leone, Davide Prandi, Giuseppe Scaglione, Angelo Susi and Orazio Turboli

Leveraging Applications of Formal Methods, Verification and Validation. Application Areas (ISoLA 2024), Lecture Notes in Computer Science, pp. 112–126. Springer.

Model-based testing applied to railway interlocking systems, the safety-critical systems that control signals and switches.

DOI 10.1007/978-3-031-75390-9_8
Cite (BibTeX)
@inproceedings{cimatti2024model,
  title = {Model-Based Testing of Railway Interlocking Systems},
  author = {Alessandro Cimatti and Shaker Khandaker and Fitsum Kifetew and Lorenzo Leone and Davide Prandi and Giuseppe Scaglione and Angelo Susi and Orazio Turboli},
  booktitle = {Leveraging Applications of Formal Methods, Verification and Validation. Application Areas (ISoLA 2024), Lecture Notes in Computer Science},
  year = {2024},
  pages = {112--126},
  publisher = {Springer},
  doi = {10.1007/978-3-031-75390-9_8}
}

2023

ThesisM.Sc. thesis · 2023

Exploring the Feasibility and Effectiveness of Large Language Models for Automated Test Oracle Generation in Software Testing

Shaker Mahmud Khandaker

Master's thesis, M.Sc. in Data Science, University of Trento. Supervisors: Fitsum Meshesha Kifetew, Paolo Rota.Academic year 2022/2023

Introduces EvoOracle, which combines EvoSuite-generated tests with LLM prompts to generate assertions, and evaluates five LLMs on 146 test methods from four projects. The starting point for the AugmenTest work.

Thesis sourcesEvoOracle code
Cite (BibTeX)
@mastersthesis{khandaker2023exploring,
  title = {Exploring the Feasibility and Effectiveness of Large Language Models for Automated Test Oracle Generation in Software Testing},
  author = {Shaker Mahmud Khandaker},
  howpublished = {Master's thesis, M.Sc. in Data Science, University of Trento. Supervisors: Fitsum Meshesha Kifetew, Paolo Rota},
  year = {2023}
}

2018

Conference paperICIEV 2018 · 2018

A Portable Braille Refreshable Display Using Micro Servos

A M Muntasir Rahman, Shaker Mahmud Khandaker, Nasif Noor Saleheen, Tasnia Nobi Afee, Naba Afrin and Md. Ashraful Alam

2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), pp. 212–217. IEEE.

A single-cell refreshable braille display driven by micro servos instead of solenoids or lead screws, aiming for a portable, simple and low-cost device. A prototype was built to evaluate efficiency, cost and portability.

DOI 10.1109/ICIEV.2018.8641028
Cite (BibTeX)
@inproceedings{rahman2018portable,
  title = {A Portable Braille Refreshable Display Using Micro Servos},
  author = {A M Muntasir Rahman and Shaker Mahmud Khandaker and Nasif Noor Saleheen and Tasnia Nobi Afee and Naba Afrin and Md. Ashraful Alam},
  booktitle = {2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR)},
  year = {2018},
  pages = {212--217},
  publisher = {IEEE},
  doi = {10.1109/ICIEV.2018.8641028}
}