Using an unauthorized AI assistant, such as Read.ai, within your Zoom or Teams meetings to provide notes or transcriptions may provide the content (recordings and transcriptions) and all data discussed or shared with the vendor.  This information is collected and used to train the AI and is ultimately retained by the AI developer and could be shared with other third parties. These AI tools should not be used in Zoom or Teams meetings when discussing high-risk, sensitive or internal data. Additionally, these AI assistants may attend any of your other scheduled meetings, even if you are not present, and ingest the data.  Meeting hosts should remove the AI as an attendee from meetings if they appear. 

Generative AI tools may not comply with the laws and regulations that govern the use of data and content in different contexts and jurisdictions. Initiatives involving PII at the university, including generative AI, are subject to all applicable laws, University policies and University contractual obligations.

In the university setting, specific applicable privacy laws for data use and generative AI include the U.S. Privacy Act, state privacy laws such as the Personal Information Protection Act, industry specific regulations such as Family Educational Rights and Privacy Act, Health Insurance Portability and Accountability Act, Children’s Online Privacy Protection Rule and geographic and extraterritorial international laws such as EU’s General Data Protection Regulation and China’s Personal Information Protection Law of the People’s Republic of China among others.

Exercise an abundance of caution when considering any new technology that processes PII. Given the unprecedented access to and increasing adoption of AI and generative AI capabilities, market forces are driving steep competition to add AI capabilities to existing offerings. This pressure may result in compromised laws/policies, ethics and integrity when rushing new features and new capabilities to market.
Under the GDPR, individuals “have the right not to be subject to a decision based solely on automated processing, including profiling,” that has legal or similarly significant effects (GDPR Article 22(1), PIPL Article 73). State privacy laws further impact AI developers and providers, with examples such as Colorado, Virginia and Connecticut granting individuals the right to opt out of personal data processing for profiling purposes.

Generative AI tools may not adhere to the ethical and professional standards and norms that apply to different domains and activities, such as research, education or journalism. These tools may violate the intellectual property rights of the original data or content owners or infringe on the privacy rights of the data subjects through utilization of training data.
The training data itself might be sourced from collections that breach intellectual property and privacy laws and regulations. Such tainted data has the potential to compromise the model and any subsequent products derived from it. It’s crucial to recognize that training data encompasses both structured and unstructured information, ranging from databases and text to video, books, websites, blogs and more, used in the training of machine learning algorithms.
Identification and removal of PII from large language models remain largely untested, introducing complexities in addressing data subject requests within regulated timeframes. Additionally, if PII is integrated into LLMs, generative AI could inadvertently expose PII within its generated output. This underscores the importance of a comprehensive understanding and management of these potential intellectual property and privacy challenges associated with generative AI technologies.

Users are more likely to overshare when data collection is interactive and conversational. Users may lack the technical literacy or awareness to understand that generative AI only mimics human behavior. In other words, users may intentionally be led to believe they are interacting with an actual human. Relying solely on generative AI interactions could lead to unintentional oversharing and potential deception.
Generative AI systems have the potential to generate false, misleading or inaccurate content for the intended purpose or audience. Users need to be careful and critical when using and evaluating the output content of generative AI tools.
• Generative AI tools may create biased, misleading, inaccurate or offensive content.
• Generative AI tools may not be able to handle complex, ambiguous or nuanced prompts or feedback or cope with unexpected or erroneous input data.
• Output may not be accurate or true. These models are not evaluating or analyzing their outputs for accuracy in fact or substance. Instead, they evaluate their outputs in comparison with the similarities to the training data they are built upon.
Generative AI tools, despite the name, are not intelligent. They are designed to mimic human behavior and to do so in a conversational manner. This could give users a false sense of confidence or accurateness in the AI-supplied results.
Generative AI tools may be used by malicious actors to manipulate or deceive others, such as by creating fake news, deepfakes or phishing messages. It is crucial to establish and enforce ethical and professional standards and norms for the use of generative AI, and to ensure the traceability and accountability of the data and content that it generates.
Generative AI systems have the potential to generate content that may inadvertently or intentionally defame individuals or organizations. Vigilance is key when implementing measures to prevent generation of defamatory content, such as robust content moderation, human review and editing and filtering mechanisms. Clear University policies should address and rectify any instances of defamation that may arise from the use of generative AI systems, ensuring accountability and protecting the reputation of the university and our communities. Verifying generative AI responses for accuracy reduces but does not eliminate this potential. If a user has a strong suspicion of generated content creating a situation like this, the user should validate the information with another source.

It is unclear what personal information, user behavior and analytics are being recorded and retained, or shared with third-parties. As generative AI is mainstreamed, it is likely to follow proven channels for monetization, such as using personal data for targeted advertising. Clear policies should be established regarding retention and deletion of user data collected during interactions with generative AI systems. When considering generative AI uses, determine whether users have the ability to request the deletion of their personal data, which is a requirement of the EU’s GDPR and most other privacy laws and regulations.
Given the prolonged and conversational interaction of many chatbot-based generative AI solutions, special care should be taken to minimize legal and privacy risks related to wiretap laws. Risks arise in many possible implementations, including under federal and state wiretap laws. The extent of the risk largely depends on what information is collected and who has access. Configuring the generative AI solutions with these risks in mind, including incorporating appropriate notice and consent language, is essential. Any implementation of a generative AI service should be reviewed by University Counsel and the University Ethics and Compliance Office.
Generative AI models can be susceptible to adversarial prompt engineering, where malicious actors manipulate input to generate harmful or misleading content. Malicious prompt engineering may result in dissemination of false information, exposure of sensitive data or inappropriate collection of private information from users.
A list of AI tools, including generative AI tools, that have been reviewed by the University or System can be found: https://citl.illinois.edu/citl-101/instructional-spaces-technologies/teaching-with-technology/generative-artificial-intelligence/genai-tools 

The implementation of generative AI should be transparent to the user and be accompanied by training and educational programming. Promoting AI literacy within the university community is crucial for better understanding of the privacy implications of interacting with generative AI systems, empowering individuals to make informed decisions and take privacy precautions.