Publications
Towards Scalable Evaluation of Software Understanding: A Methodology Proposal
| Author | Magin, Florian; Wache, Magdalena; Scherf, Fabian William; Fischer, Cléo; Zabel, Jonas |
|---|---|
| Date | 2025 |
| Type | Conference Paper |
| Abstract | In reverse engineering our goal is to build systems that help people to understand software. However, the field has not converged on a way to measure software understanding. In this paper, we make the case that understanding should be measured via performance on understanding-questions. We propose a method for constructing understanding-questions and evaluating answers at scale. We conduct a case study in which we apply our method and compare Ghidra’s default auto analysis with an analysis that supports binary constructs that are specific to Objective-C. |
| Conference | Workshop on Software Understanding and Reverse Engineering 2025 |
| Url | https://publica.fraunhofer.de/handle/publica/498893 |
