Witt, Alice; Huggins, Anna; Governatori, Guido; Buckley, Joshua
Abstract: A critical challenge in “Rules as Code” (“RaC”) initiatives is ensuring legal accuracy. In this paper, we present the preliminary results of a two-week, first of its kind experiment that aims to shed light on how different legally trained people interpret and translate Australian Commonwealth legislation into machine-readable code. We find that coders collaboratively agreeing on key legal terms, or atoms, before commencing independent coding work can significantly increase the similarity of their encoded rules. Participants nonetheless made a range of divergent interpretive choices, which we argue are most likely due to: (1) the complexity of statutory interpretation, (2) encoded provisions having varying levels of granularity and (3) the functionality of our coding language. Based on these findings, we draw an important distinction between processes for technical validation of encoded rules, which focus on ensuring rules adhere to select coding languages and conventions, and processes of legal alignment, which we conceptualise as enhancing congruence between the encoded rules and the true meaning of the statutory provisions in line with the modern approach to statutory interpretation. We argue that these processes are distinct but both critically important in enhancing the accuracy of RaC. We conclude by underlining the need for multi-disciplinary expertise across specific legal subject matters, statutory interpretation and technical programming in RaC initiatives.