Lucia de Berk heeft het ondervonden: bewijs op basis van statistiek leidt gemakkelijk tot fouten. Dit project beoogt het maken van zulke fouten te helpen voorkomen. De nieuwe aanpak van het project is om de succesvolle statistische modelleertechniek van Bayesiaanse netwerken te koppelen aan goed bij de juridische denkwereld aansluitende modellen van argumentatie en scenarioconstructie.
Lucia de Berk found out first-hand: evidence based on statistics can easily lead to errors. This project aims to help prevent this sort of error from occurring. The project's new approach is to link the successful statistical modelling technique of Bayesian networks to models that effectively dovetail legal argumentation and scenario construction in the legal world.
Scientific summary
Recent miscarriages of justice have increased the interest from legal practice in
scientifically founded ways of treating evidence. Forensic statistics can provide such
foundations. However, because of the communication gap between forensic statisticians,
crime investigators and lawyers, statistical evidence is easily misinterpreted in court,
resulting in wrong decisions. Therefore, methods must be developed to support the
communication between the parties involved. Since lawyers are more used to thinking in
terms of arguments and scenarios, we propose to develop methods that support
argumentation- and narrative-based communication about statistical evidence, building
on AI models of argumentation and scenario construction.
We focus on Bayesian Networks, since their graphical structure can be used to express
scenarios, while they also support probabilistic reasoning. To draw inferences from
Bayesian Networks, lawyers must understand how the evidence was modelled and what
the model means. Therefore, support tools will be developed both for the modelling of
evidence as a Bayesian Network and for the understanding of the resulting network. To
support the modelling of evidence in Bayesian Networks, argumentation tools will be
developed to model inferences and disagreement between experts, while narrative tools
will be developed to support the construction of alternative scenarios. To aid the
understanding of a Bayesian Network, tools will be developed for automatically extracting
both arguments and scenarios from a network and for comparing alternative scenarios.
The mathematical and computational tools developed in the project will be practically
assessed by means of realistic case studies and training sessions in collaboration with
forensic legal practice.
Publications
Dissertations
- Vlek, C. (2016). When Stories and Numbers Meet in Court. Constructing and Explaining Bayesian Networks for Criminal Cases with Scenarios. October 28, 2016. Dissertation University of Groningen.
- Timmer, S. (2017). Designing and Understanding Forensic Bayesian Networks using Argumentation. February 1, 2017. Dissertation Utrecht University.
Journal articles
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2014). Building Bayesian Networks for Legal Evidence with Narratives: a Case Study Evaluation. Artificial Intelligence and Law 22 (4), 375-421. http://dx.doi.org/10.1007/s10506-014-9161-7 details pdf
doi
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2016). A Method for Explaining Bayesian Networks for Legal Evidence with Scenarios. Artificial Intelligence and Law 24 (3), 285-324. http://dx.doi.org/10.1007/s10506-016-9183-4 details pdf
doi
- Verheij, B., Bex, F.J., Timmer, S., Vlek, C., Meyer, J.J., Renooij, S., & Prakken, H. (2016). Arguments, Scenarios and Probabilities: Connections Between Three Normative Frameworks for Evidential Reasoning. Law, Probability & Risk 15, 35-70. http://dx.doi.org/10.1093/lpr/mgv013 details pdf
doi
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2017). A Two-phase Method for Extracting Explanatory Arguments from Bayesian Networks. International Journal of Approximate Reasoning 80, 475-494. http://dx.doi.org/10.1016/j.ijar.2016.09.002 details pdf
doi
Conference contributions (peer reviewed)
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2013). Modeling Crime Scenarios in a Bayesian Network. The 14th International Conference on Artificial Intelligence and Law (ICAIL 2013). Proceedings of the Conference, 150-159. New York (New York): ACM. details pdf
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2013). Representing and Evaluating Legal Narratives with Subscenarios in a Bayesian Network. Proceedings of the 2013 Workshop on Computational Models of Narrative (CMN 2013) (eds. Finlayson, M.A., Fisseni, B., Löwe, B., & Meister, J.C.), 315-332. Dagstuhl: OASICS. details pdf
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2013). Inference and Attack in Bayesian Networks. 25th Benelux Conference on Artificial Intelligence (BNAIC 2013) (eds. Hindriks, K., De Weerdt, M., Van Riemsdijk, B., & Warnier, M.), 199-206. Delft: Delft University. details pdf
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2013). Unfolding Crime Scenarios with Variations: A Method for Building a Bayesian Network for Legal Narratives. Legal Knowledge and Information Systems. JURIX 2013: The Twenty-Sixth Annual Conference (ed. Ashley, K.D.), 145-154. Amsterdam: IOS Press. details pdf
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2014). Extracting Legal Arguments from Forensic Bayesian Networks. Legal Knowledge and Information Systems. JURIX 2014: The Twenty-Seventh Annual Conference (ed. Hoekstra, R.), 71-80. Amsterdam: IOS Press. details pdf
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2014). Extracting Scenarios from a Bayesian Network as Explanations for Legal Evidence. Legal Knowledge and Information Systems. JURIX 2014: The Twenty-Seventh Annual Conference (ed. Hoekstra, R.), 103-112. Amsterdam: IOS Press. details pdf
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2015). Constructing and Understanding Bayesian Networks for Legal Evidence with Scenario Schemes. The 15th International Conference on Artificial Intelligence and Law (ICAIL 2015). Proceedings of the Conference, 128-137. New York (New York): ACM. http://dx.doi.org/10.1145/2746090.2746097 details pdf
doi
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2015). A Structure-guided Approach to Capturing Bayesian Reasoning about Legal Evidence in Argumentation. The 15th International Conference on Artificial Intelligence and Law (ICAIL 2015). Proceedings of the Conference, 109-118. New York (New York): ACM. http://dx.doi.org/10.1145/2746090.2746093 details pdf
doi
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2015). Explaining Legal Bayesian networks Using Support Graphs. Legal Knowledge and Information Systems. JURIX 2015: The Twenty-eighth Annual Conference (ed. Rotolo, A.), 121-130. Amsterdam: IOS Press. http://dx.doi.org/10.3233/978-1-61499-609-5-121 details pdf
doi
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2015). Capturing Critical Questions in Bayesian Network Fragments. Legal Knowledge and Information Systems. JURIX 2015: The Twenty-eighth Annual Conference (ed. Rotolo, A.), 173-176. Amsterdam: IOS Press. http://dx.doi.org/10.3233/978-1-61499-609-5-173 details pdf
doi
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2015). Explaining Bayesian Networks using Argumentation. Symbolic and Quantitative Approaches to Reasoning with Uncertainty 13th European Conference, ECSQARU 2015, Compiègne, France, July 15-17, 2015. Proceedings (eds. Destercke, S., & Denoeux, T.), 83-92. Berlin: Springer. http://dx.doi.org/10.1007/978-3-319-20807-7_8 details pdf
doi
- Vlek, C., Prakken, H., Renooij, S., & Verheij, B. (2015). Representing the Quality of Crime Scenarios in a Bayesian Network. Legal Knowledge and Information Systems. JURIX 2015: The Twenty-eighth Annual Conference (ed. Rotolo, A.), 131-140. Amsterdam: IOS Press. http://dx.doi.org/10.3233/978-1-61499-609-5-131 details pdf
doi
Other publications (demonstrations, abstracts)
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2014). A Tool for the Generation of Arguments from Bayesian Networks. Computational Models of Argument. Proceedings of COMMA 2014 (eds. Parsons, S., Oren, N., Reed, C., & Cerutti, F.), 479-480. Amsterdam: IOS Press. http://dx.doi.org/10.3233/978-1-61499-436-7-479 details pdf
doi
- Timmer, S., Meyer, J.J., Prakken, H., Renooij, S., & Verheij, B. (2015). Demonstration of a Structure-guided Approach to Capturing Bayesian Reasoning about Legal Evidence in Argumentation. The 15th International Conference on Artificial Intelligence and Law (ICAIL 2015). Proceedings of the Conference, 233-234. New York (New York): ACM. http://dx.doi.org/10.1145/2746090.2750370 details pdf
doi
- Verheij, B., Bex, F.J., Timmer, S., Vlek, C., Meyer, J.J., Renooij, S., & Prakken, H. (2016). Arguments, Scenarios and Probabilities: Connections Between Three Normative Frameworks for Evidential Reasoning (Abstract). Proceedings of the 28th Benelux Conference on Artificial Intelligence (BNAIC 2016) (eds. Bredeweg, B., & Bosse, T.), 192-193. details pdf
Team members
-
Prof. dr. B. Verheij, principal investigator (Department of Artificial Intelligence, University of Groningen)
-
Prof. dr. mr. H. Prakken (Faculty of Law, University of Groningen, Department of Information and Computing Sciences, Utrecht University)
-
Dr. S. Renooij (Department of Information and Computing Sciences, Utrecht University)
-
Sjoerd Timmer, PhD Researcher 1 (Department of Information and Computing Sciences, Utrecht University)
-
Charlotte Vlek, PhD Researcher 2 (Department of Artificial Intelligence, University of Groningen)
-
Prof. dr. J.-J. Ch. Meyer (Department of Information and Computing Sciences, Utrecht University)
-
Prof. dr. L.C. Verbrugge (Department of Artificial Intelligence, University of Groningen)
-
Dr. F.J. Bex (Argumentation Research Group, School of Computing, University of Dundee)
-
Mr. G.C. Haverkate (Wetenschappelijk Bureau Openbaar Ministerie, WBOM)
-
Mr. A. Bood (Wetenschappelijk Bureau Openbaar Ministerie, WBOM)
-
Mr. drs. J. Moors (district court Amsterdam, Opleidingsinstituut van de Rechterlijke Organisatie, SSR)
-
Mr. H.W.G. Stikkelbroeck (court of appeal Arnhem, Opleidingsinstituut van de Rechterlijke Organisatie, SSR)
-
B.G.L. Stinissen (Opleidingsinstituut van de Rechterlijke Organisatie, SSR)
-
Mr. E.J. Willekers (Opleidingsinstituut van de Rechterlijke Organisatie, SSR)
Program web site: NWO Forensic Science
|
News
-
On Wednesday February 1, 2017,
Sjoerd Timmer
defends his dissertation `Designing and Understanding Forensic Bayesian Networks using Argumentation'.
-
ZonMW organizes the final symposium of the NWO Forensic Science research program (report in Dutch).
-
Sjoerd Timmer's paper A Two-phase Method for Extracting Explanatory Arguments from Bayesian Networks appears in the journal International Journal of Approximate Reasoning.
-
Friday October 28, 2016: Defence Charlotte Vlek's dissertation `When Stories and Numbers Meet in Court. Constructing and Explaining Bayesian Networks for Criminal Cases with Scenarios'
(download dissertation, press report)
-
Thursday October 27, 2016: Workshop Beyond a Reasonable Doubt: Scenarios and Bayesian Networks for Analyzing Forensic Evidence
-
AI4J - Artificial Intelligence for Justice, workshop at the 22nd European Conference on Artificial Intelligence (ECAI 2016); August 30, 2016
The Hague, The Netherlands.
Organisers: Floris Bex, Tom van Engers, Henry Prakken, Bart Verheij
-
Charlotte Vlek's paper A Method for Explaining Bayesian Networks for Legal Evidence with Scenarios appears in the journal Artificial Intelligence and Law (2016).
-
The paper Arguments, Scenarios and Probabilities: Connections Between Three Normative Frameworks for Evidential Reasoning has been published in the journal Law, Probability and Risk (2016). Authors: Bart Verheij, Floris Bex, Sjoerd Timmer, Charlotte Vlek, John-Jules Meyer, Silja Renooij, Henry Prakken.
-
Charlotte Vlek and Sjoerd Timmer present papers at the 28th International Conference on Legal Knowledge and Information Systems (JURIX 2015) in Braga, Portugal:
Representing the quality of crime scenarios in a Bayesian network,
Explaining legal Bayesian networks using support graphs and
Capturing Critical Questions in Bayesian Network Fragments.
-
In Bielefeld, at the ZiF Center for Interdisciplinary Research (September 28-30, 2015), there is the workshop Models of Rational Proof in Criminal Law (organizers: Floris Bex, Anne Ruth Mackor, Henry Prakken), with support from the project. The program includes presentations by several project members (Sjoerd Timmer, Charlotte Vlek, Floris Bex, Henry Prakken, Bart Verheij).
-
Henry Prakken serves as expert witness on the value of probabilistic analysis in a high-profile Dutch murder case: de Zes van Breda; see this news report (Telegraaf, July 7, 2015; in Dutch).
- At the International Conference on Legal Argumentation and the Rule of Law (June 25 & 26, 2015), the project is represented in the panel Legitimacy of Legal Decisions and Justification in Matters of Fact in Criminal Trials. Chair: Henry Prakken. Panelists include project team members Charlotte Vlek, Sjoerd Timmer, Floris Bex, Henry Prakken and Bart Verheij.
- On June 12, 2015, Marcello Di Bello and Bart Verheij organize a workshop Studying Evidence in the Law - Formal, Computational and Philosophical Methods at the 15th International Conference on AI and Law (ICAIL 2015) in San Diego, California.
-
Sjoerd Timmer presents a paper at the 13th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU 2015) in Compiègne, France: Explaining Bayesian Networks using Argumentation.
-
Charlotte Vlek and Sjoerd Timmer present their work at the 15th International Conference on AI and Law (ICAIL 2015) in San Diego, California: Constructing and Understanding Bayesian Networks for Legal Evidence with Scenario Schemes and A Structure-guided Approach to Capturing Bayesian Reasoning about Legal Evidence in Argumentation. Sjoerd also gives a demonstration.
- Charlotte Vlek, Sjoerd Timmer and Bart Verheij have organized a workshop on the forensic relevance of Bayesian Networks (April 17, 2015; University of Groningen; language: Dutch). Speakers: Silja Renooij, Marjan Sjerps, Peter van Koppen and Henry Prakken.
-
Charlotte Vlek and Sjoerd Timmer present papers at the 27th International Conference on Legal Knowledge and Information Systems (JURIX 2014) in Kraków, Poland: Extracting Scenarios from a Bayesian Network as Explanations for Legal Evidence and Extracting Legal Arguments from Forensic Bayesian Networks.
-
Charlotte Vlek's paper Building Bayesian Networks for Legal Evidence with Narratives: a Case Study Evaluation appears in the journal Artificial Intelligence and Law (2014).
-
Bart Verheij's paper To Catch a Thief With and Without Numbers: Arguments, Scenarios and Probabilities in Evidential Reasoning appears in the journal Law, Probability and Risk (2014).
- At the Fifth International Conference on Computational Models of Argument (COMMA 2014) (Scotland, September 9-12, 2014), Sjoerd Timmer presents the demo A Tool for the Generation of Arguments from Bayesian Networks and Bart Verheij the paper Arguments and Their Strength: Revisiting Pollock's Anti-Probabilistic Starting Points.
- The project is well-represented at the 9th International Conference on Forensic Inference and Statistics (ICFIS 2014) (Leiden, August 19-22, 2014). Charlotte Vlek, Sjoerd Timmer, and Floris Bex present their work. Bart Verheij is a keynote speaker.
- On May 30, 2014, Marcello Di Bello and Bart Verheij organize the symposium Trial With and Without Mathematics. Legal, Philosophical and Computational Perspectives at Stanford University. Henry Prakken is one of the invited speakers.
- On February 18, 2014, the academic and legal-professional partners of the project meet in order to discuss the connections and tensions between evidential reasoning with arguments, narrative and probabilities.
- Bart Verheij gives an invited graduate course at the Institute of Logic and Cognition, Sun Yat-Sen University, Guangzhou, including lectures on the role of argumentation, narrative and probabilities in forensic evidence (November, 2013).
- Sjoerd Timmer presents the paper "Inference and Attack in Bayesian Networks" at the 25th Benelux Conference on Artificial Intelligence (BNAIC 2013),
Delft University of Technology (TU Delft), November 7-8, 2013.
- On September 19, 2013, Bart Verheij presents the project at Codex - the Stanford Center for Legal Informatics, in a talk entitled "Can AI models help prevent miscarriages of justice?".
- Charlotte Vlek presents the paper "Representing and Evaluating Legal Narratives with Subscenarios in a Bayesian Network" at the Workshop on Computational Models of Narrative, Hamburg, Germany, August 4-6, 2013.
- Charlotte Vlek presents the paper "Modeling crime scenarios in a Bayesian network" at the 14th International Conference on Artificial Intelligence and Law, June 10-14, 2013, Rome (Italy).
- In the academic year 2013-2014, Bart Verheij is a resident fellow at Stanford University, participating in Codex - the Stanford Center for Legal Informatics, a collaboration between the Stanford AI Lab and Stanford Law School.
- On Tuesday September 18 2012, the 1st Symposium Forensic Science is organized by NWO Forensic Science program. All projects will be presented.
- Both vacancies have been filled. Charlotte Vlek has started in June 2012, and Sjoerd Timmer in July.
- April 18, 2012: Symposium Sluitend bewijs? Onzekerheid en argumentatie in het recht
|