Project

Bias Mitigation in Human in the Loop Decision Systems

This PhD project is a collaboration with CIRES Partner Organisation the Queensland Police Service. It focuses on integrating fairness into learning algorithms used in the context of policing services and tasks and aims to observe if this leads to improved outcomes and experiences. The approach will include the development of human-in-the-loop AI, where humans help to increase transparency of automatic decision-making process, e.g., by generating natural language explanations on why a specific amount of police resources is required in a certain suburb. It commenced in April 2023 with the recruitment of PhD researcher Hongliang Ni at The University of Queensland.

About the Project

When humans label data to train AI models, their own biases and stereotypes may be reflected in the data, which consequently appear in the resulting trained models leading to unfair, biased, and non-transparent decisions. In collaboration with the Queensland Police Service (QPS), this project focuses on integrating fairness into learning algorithms used in the context of policing services and tasks and aims to observe if this leads to improved outcomes and experiences. The approach will include the development of human-in-the-loop AI, where humans help to increase transparency of automatic decision-making process, e.g., by generating natural language explanations on why a specific amount of police resources is required in a certain suburb.

This project commenced in April 2023 with the recruitment of PhD researcher Hongliang Ni, who is based at The University of Queensland and will collaborate closely with leading experts in the Queensland Police Service (QPS) to generate more transparent, fair, and trustworthy decision-support systems driven by data and controlled by humans. Through this project, Hongliang will develop novel bias tracking, management, and reduction method over the entire Artificial Intelligence pipeline: from data collection and curation to model training and deployment with end users. It is one of two projects with Queensland Police Service related to the responsible use of sensitive data assets. The other project Data as a Service Architecture commenced in October 2023.

Hongliang is supervised by CIRES Chief Investigator Associate Professor Gianluca Demartini, Centre Director Professor Shazia Sadiq, and Nick Moss, Manager, Data Services at the Queensland Police Service.

The Queensland Police Service (QPS) aims to be a data driven organisation with an advanced data analytics capability to inform decision making via legally and ethically actionable analytics. 

The QPS Organisational Insights Platform (OIP) was established as the QPS advanced data and analytics platform for tactical, operational, and strategic decision making.  A foundational building block of the OIP is the Data Lake to become the QPS centralised repository to store approved structured and unstructured data. The information resilience challenge is how to extract insights from, and the responsible use of, sensitive data assets. 

QPS are looking at this partnership opportunity with CIRES to build, protect and sustain agile data pipelines, in addition to upskilling officers, and identifying and employing potential data scientists, to position QPS as an insight driven organisation. One key measure of success will be better informed tactical, operational, and strategic decision makers who can apply resources, develop policy, procedures, and practices so that the lives of Queenslanders benefit positively. 


Project Team

Hongliang Ni

PhD Researcher

A.Prof Gianluca Demartini

Chief Investigator

Prof. Shazia Sadiq FTSE

Centre Director

Nick Moss

Partner Investigator




Partner




View All projects