µSE: Mutation-Based Evaluation of Security-Focused Static Analysis Tools for Android

Abstract

This demo paper presents the technical details and usage scenarios of µSE: a mutation-based tool for evaluating security-focused static analysis tools for Android. Mutation testing is generally used by software practitioners to assess the robustness of a given test-suite. However, we leverage this technique to systematically evaluate static analysis tools and uncover and document soundness issues.µSE s analysis has found 25 previously undocumented flaws in static data leak detection tools for Android.µSE offers four mutation schemes, namely Reachability, Complex-reachability, TaintSink, and ScopeSink, which determine the locations of seeded mutants. Furthermore, the user can extend µSE by customizing the API calls targeted by the mutation analysis.µSE is also practical, as it makes use of filtering techniques based on compilation and execution criteria that reduces the number of ineffective mutations.