This module provides a brief overview of the process involved when ChatGPT-3.5 responds to a user's initial question or prompt.
It also provides definitions for terminology that will be used throughout the workshop.
Image Caption: A diagram that provides a simplified overview of how an interaction with ChatGPT-3.5 works.
ChatGPT, classified as a generative AI (or artificial intelligence) model within the realm of supervised machine learning, creates new content by discerning patterns in the information it has encountered before (Chapman, 2023). This includes predicting the next word in a sequence given the context of preceding words during its training. While ChatGPT excels in generating contextually relevant text, other models within this category have extended their generative capabilities to produce diverse content formats including audio, images, and videos.
Basic Explanation of How An Interaction With ChatGPT-3.5 Works
Here is a brief explanation of the process involved when ChatGPT-3.5 responds to a user's initial question or prompt. Please also refer to the above diagram. You will see the terminology used in this section throughout the workshop.
References
Ball, J. (2023, February ). How does ChatGPT work? [Diagram]. Compose & Consult. https://composeandconsult.com/the-edit-effect/ai-platforms-hallucination-effect-content-generation
Brown, T., Mann, B., Ryder, N. ... Amodei, D. (2020). Language models are few-shot learners. arXiv. https://doi.org/10.48550/arXiv.2005.14165
(See "Table 2.2: Datasets used to train GPT-3" on p. 9.)
Chapman, J. (2023). What is ChatGPT? [MOOC lecture]. In J. Chapman, & A. Peterson, Introduction to ChatGPT. Datacamp. https://app.datacamp.com/learn/courses/introduction-to-chatgp
Gewirtz, D. (2023, September 20). How does ChatGPT actually work? ZDNET. https://www.zdnet.com/article/how-does-chatgpt-work/
Li, J. (2023, July 14). ChatGPT in a nutshell. Medium. https://medium.com/@lij061703/chatgpt-in-a-nutshell-37ea5ddbc362