Mutating Matters: Analyzing the Influence of Mutation Testing in Programming Courses
| dc.contributor.author | Mansur, Rifat Sabbir | en |
| dc.contributor.author | Shaffer, Clifford | en |
| dc.contributor.author | Edwards, Stephen | en |
| dc.date.accessioned | 2025-01-09T17:37:40Z | en |
| dc.date.available | 2025-01-09T17:37:40Z | en |
| dc.date.issued | 2024-12-05 | en |
| dc.date.updated | 2025-01-01T08:52:56Z | en |
| dc.description.abstract | Mutation testing is used to gauge the quality of software test suites by introducing small faults, called “mutations”, into code to assess if a test suite can detect them. Although it has been applied extensively in the software industry, mutation testing’s use in programming courses faces both computational and pedagogical barriers. This study examines the impact of mutation testing on student performance in a post-CS2 Data Structures and Algorithms course with 3-4 week life-cycle programming projects. We collected a semester of data with projects using only code coverage (control group) and another semester that used mutation testing (experimental group). We investigated three aspects of mutation testing impact: the quality of student-written test suites, the correctness and complexity of students’ solution code, and the degree of incremental test writing. Our findings suggest that students using mutation testing, as a group, demonstrated higher quality test suites and wrote better solution code compared to students using traditional code coverage methods. Students using mutation testing were more likely to exhibit incremental testing practices. | en |
| dc.description.version | Published version | en |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.doi | https://doi.org/10.1145/3649165.3690110 | en |
| dc.identifier.uri | https://hdl.handle.net/10919/124018 | en |
| dc.language.iso | en | en |
| dc.publisher | ACM | en |
| dc.rights | Creative Commons Attribution 4.0 International | en |
| dc.rights.holder | The author(s) | en |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | en |
| dc.title | Mutating Matters: Analyzing the Influence of Mutation Testing in Programming Courses | en |
| dc.type | Article - Refereed | en |
| dc.type.dcmitype | Text | en |