We are pleased to share with you our Second Stakeholder Workshop Summary Report, summarising key findings from our Second Stakeholder Workshop taken place on December 6th, 2019, at Mary Ward House in London. The workshop brought together participants from academia, education, NGOs and enterprises to discuss trust in relation to algorithmic decision-making services and platforms.
This workshop is the second of the series. In our first stakeholder workshop (April 2019), we have explored stakeholders’ general conceptualisation of trust, in relation to an algorithmic system. We found several factors key to trust development, including consistency, transparency and fairness of algorithmic results.
In this workshop, our key goal was to gain feedback to our two latest technology prototypes, which were designed to facilitate users’ perception of algorithm transparency, fairness and trustworthiness:
- An algorithm exploration sandbox tool, which investigates how user groups develop their trust perceptions of algorithms when being provided with algorithm explanations and an ability to explore algorithmic behaviours by filtering and querying algorithms. Hotel booking was chosen as the recommendation scenario for this prototype, as it was perceived relevant to all user groups and particularly to the target groups 16-25 and 65+.
- The trust mediation tool, which aims to enable users to raise trust-related queries and issues related to AI-algorithms and influence the behaviour of the algorithms accordingly. The tool is expected to be used following users’ interactions with the aforementioned “algorithm sandbox”. The initial prototype was inspired by a `chatbot’ style mediation process, facilitating the dialogue between users’ express of algorithm trust concerns and structured responses generated by mediation algorithms, with an aim of enhancing users’ trust of algorithmic outcomes.
The full report can be downloaded here. If you have any feedback or comments to the report, please do not hesitate to write to the report authors:
- Jun Zhao ( firstname.lastname@example.org), University of Oxford
- Menisha Patel (email@example.com), University of Oxford
- Philip Inglesant (firstname.lastname@example.org), University of Oxford
Our following-up stakeholder workshop is scheduled for July 2020. If you would like to be kept posted regarding this as well as related news about the ReEnTrust project, please feel free to sign up to our stakeholder group.