Please note: The algorithm descriptions in English have been automatically translated. Errors may have been introduced in this process. For the original descriptions, go to the Dutch version of the Algorithm Register.

PZH-Assist

PZH-Assist is a chatbot that can be consulted for general use. This chatbot is not trained on internal data and has no knowledge of it. However, it is possible to ad hoc insert a document into the chatbot and ask questions about it. The chatbot is only available to employees of Province of South Holland.

Last change on 18th of July 2024, at 9:23 (CET) | Publication Standard 1.0
Publication category
Impactful algorithms
Impact assessment
DPIA
Status
In development

General information

Theme

  • Organisation and business operations
  • Work

Begin date

04-2024

End date

12-2024

Contact information

Voor vragen en opmerkingen kan je terecht bij: digitaalzuidholland@pzh.nl Wil je bezwaar maken, dan kan je terecht bij de Juridische afdeling van dienst beheer organisatie. https://www.zuid-holland.nl/contact/

Link to publication website

https://www.zuid-holland.nl/politiek-bestuur/feiten-cijfers/algoritmeregister/

Responsible use

Goal and impact

PZH-Assist has been developed as a secure alternative to ChatGPT and similar chatbots. PZH-Assist is only available to officials of South Holland province. PZH-Assist is intended as an assistant and has no direct impact on businesses and citizens. PZH-assist does not necessarily have a direct and major impact on citizens, as it is mainly used internally. However, the user determines the specific purpose for which PZH-assist is used.


The experiment has been completed. PZH-assist will remain available until the end of 2024.

Considerations

PZH-Assist mitigates a number of privacy risks that commercial language models do have. For example, the conversations and uploaded files are not used to train the language models. Furthermore, PZH-Assist does not monitor interface usage.

Human intervention

PZH-Assist is not used for automated decision-making. Employees ask questions and receive answers from the chatbot. Employees themselves are responsible for using the answers correctly.

Risk management

Privacy:

- Conversations and files are used to train language models. This risk is mitigated by the fact that we use a proprietary environment where the conversations and files are stored. The language models used also run in our own environment and do not learn from the calls and files.

- Monitoring interface usage. This risk is mitigated by the fact that we have built our own interface. This proprietary interface does not monitor interface usage.

- Extracting personal data from the underlying language model. Through a process of prompt engineering, we tried to extract third-party personal data from the underlying language model. From this process, this was not possible and the underlying security measures worked.

Elaboration on impact assessments

DPIA has been carried out and is now also signed off by the Data Protection Officer. Consent is subject to 12 months.

An IAMA is in preparation.

Impact assessment

DPIA: x

Operations

Data

This chatbot is not trained on internal data and has no knowledge of it. However, it is possible to ad hoc insert a document into the chatbot and ask questions about it.

Technical design

PZH-Assist uses private instance of GPT4o. (Azure OpenAI) to formulate answers to queries. https://learn.microsoft.com/en-us/azure/ai-services/openai/overview

External provider

Microsoft (Azure OpenAI)

Similar algorithm descriptions

  • The virtual assistant Gem is a digital help on the Utrecht municipality's website for answering resident and business questions. Via the chat widget on the website, you can talk to Gem

    Last change on 18th of November 2024, at 11:06 (CET) | Publication Standard 1.0
    Publication category
    Impactful algorithms
    Impact assessment
    DPIA
    Status
    In use
  • A system in the form of an internal chatbot that supports NCSC staff in answering specific questions on NIS2 legislation from external organisations.

    Last change on 19th of December 2024, at 13:14 (CET) | Publication Standard 1.0
    Publication category
    Other algorithms
    Impact assessment
    Field not filled in.
    Status
    In development
  • Someone asks Chatbot a question. Chatbot responds with an answer generated by Ai. Municipality of Veere feeds the chatbot with information (links to sites/knowledge base) and monitors/analyses chatbot usage.

    Last change on 18th of April 2024, at 14:14 (CET) | Publication Standard 1.0
    Publication category
    Other algorithms
    Impact assessment
    Field not filled in.
    Status
    In development
  • The virtual assistant Gem is a digital aid on the public website of the municipality of Gooise Meren for answering questions from citizens and entrepreneurs.

    Last change on 17th of June 2024, at 10:50 (CET) | Publication Standard 1.0
    Publication category
    Other algorithms
    Impact assessment
    Field not filled in.
    Status
    In use
  • The virtual assistant Gem is a digital help on Roosendaal websites to answer civic and business questions. Using the chat button on our websites, you can talk to Gem.

    Last change on 7th of August 2024, at 9:44 (CET) | Publication Standard 1.0
    Publication category
    Impactful algorithms
    Impact assessment
    Field not filled in.
    Status
    In use