From the course: Generative AI: Working with Large Language Models

Unlock the full course today

Join today to access over 23,100 courses taught by industry experts.

Challenges and shortcomings of GPT-3

Challenges and shortcomings of GPT-3

From the course: Generative AI: Working with Large Language Models

Start my 1-month free trial Buy for my team

Challenges and shortcomings of GPT-3

“

- [Instructor] GPT-3 is not without its problems. GPT-3 was trained on data that is biased. Now, human language and text reflects our bias, and you and I are in many sense privileged as we have access to computers, we can easily publish our thoughts online, whether that's through a blog post or on a site like Reddit. And part of this data that GPT-3 was trained on was data that was deemed interesting on Reddit based on up votes from other users. Unfortunately, this means that biases and dominant worldviews then make it into training data and are encoded in large language models. Let's see if there are examples of bias in the model. So I'm going to head over to the OpenAI GPT-3 model. So this is the playground. Now, I'm not going to cherry pick any results. I'm going to give them to you exactly as I see them. So if we take our first sentence, So after a long day's work at the hospital, the nurse was tired because, and I select…

Contents