Artificial Intelligence has several issues, but it can also have benefits if used appropriately. When using AI, consider the following advice (adapted from TRU Library's guide "Artificial Intelligence: A Guide for Students"):
ROBOT Test
Based on the work by Hervieux & Wheatley (2020), the ROBOT test is an evaluation tool you can use to help you consider the legitimacy of AI technologies.
Reliability |
|
Objective |
|
Bias |
|
Ownership |
|
Type |
|
The "ROBOT Test" by S. Hervieux & A. Wheatley via The LibrAIry, is licensed under CC BY-NC-SA 4.0
Created by Lo. (2023), this framework is based on core principles to make a good prompt for Generative AI. Prompts should be Concise, Logical, Explicit, Adaptive, and Reflective.
Concise | Use clear, brief, and specific sentences when creating prompts. |
Logical | Maintain a flow and order of ideas within your prompt. |
Explicit | Provide precise instructions for the desired output (e.g. specify format, scope, and other constraints for how you want your answer to be). |
Adaptive | Be flexible; try different prompts and compare their outputs. |
Reflective | Adjust and improve prompts based on your assessment of the AI tool's answers. |
"Prompt Engineering is the process of designing and refining text inputs (prompts) to achieve specific application objectives with AI models" (Bambroo, 2024).
A good prompt requires careful thinking about the components of a prompt, and constant evaluation and refinement of outputs. When creating your prompts, consider the following:
Goal: what response do you want from the AI tool?
Instructions: give clear and concise instructions on what the AI tool should do.
Context & examples: provide background information to help the AI tool understand what kind of information is needed and why. Consider giving examples of desired outputs.
Expectations: provide information about how the AI tool should respond (e.g. tone, reading level, etc.)
Source: what information or samples should be used to create the prompt?
Screenshot of a prompt for Microsoft Copilot. Microsoft (n.d.)
Accuracy & Comprehensiveness |
a) Compare and verify: can you find alternative sources that corroborate the information provided by the AI? Who (person or organization) is providing this information? Can you find the original source from which the information was extracted? b) Check AI-generated citations: does the cited source truly exist? Was it cited correctly? Checking the reference on other pages such as the YukonU Library Discovery Search, Google , or WorldCat is recommended to ensure that the AI is not "hallucinating" citations. If the citation in fact exists, check the original source to confirm the information was correctly summarized. c) Check to see if there is anything missing from the output. Most free AI tools (Microsoft Copilot, ChatGPT and others) retrieve information available from the open web but are not able to retrieve data from sources that exist behind a paywall, such as subscription-based journals and library databases. This means that AI-generated outputs may lack the depth and breadth of more reliable sources of information. |
Bias | AI tools may provide biased answers as a result of inherent algorithmic biases. Depending on the question asked, consider which groups or perspectives may be absent or misrepresented in the output provided by the AI tool. |
Copyright | Copyright legislation in regards to AI-generated works is still evolving. Since AI tools are often trained on works that are copyrighted and may end up using content from those works without the appropriate credit, it is worthwhile to do some lateral searching to investigate what the original source(s) might be and credit them accordingly. |
Currency |
Outputs from AI tools are not always based on the most current information. For example, as of January 2025 ChatGPT-4's training data included information up to April 2023, and Microsoft Copilot up to October 2023. While some AI tools have the ability to search the general web for more up-to-date information, it is better to consult other sources if your question is related to current events or to areas that are constantly changing. |