# [[GPT-3]]
![[GPT-3.svg]]
GPT-3 stands for Generative Pre-Training, and it is the third iteration from the company [[OpenAI]] of a neural network focused on language comprehension and production. It is generally considered to be the machine best able to approximate human speech.
Generative means that GPT-3 has production as its goal, and unlike other forms of AI, it can produce long texts with little prompting.
Pre-training means that the program already comes with general linguistic knowledge that it can use, although it still requires literature samples for production of text within a specific domain.
![[What Is GPT-3 - Everything Your Business Needs to Know About OpenAI’s Breakthrough AI Language Program ZDNet#^34a829]] [^zdnet]
GPT-3, however, is still [[Artificial Intelligence#^9dfa41|weak AI]]. It cannot learn beyond what it's programmed to do, and is not capable of truly independent learning.
GPT-3 works by converting words from samples into numerical representations, called vectors, and then by calculating the probability of each word appearing in certain combinations. With this probability, it can predict the next words in a sequence, given prompting from a user.
![[What Is GPT-3 - Everything Your Business Needs to Know About OpenAI’s Breakthrough AI Language Program ZDNet#^1f6f6a]] [^zdnet]
![[What Is GPT-3 - Everything Your Business Needs to Know About OpenAI’s Breakthrough AI Language Program ZDNet#^b4c947]] [^zdnet]
![[What Is GPT-3 - Everything Your Business Needs to Know About OpenAI’s Breakthrough AI Language Program ZDNet#^81a456]] [^zdnet]
## Related
- [[Applications of GPT-3]]
[^zdnet]: Ray, T. (2020). _What is GPT-3? Everything your business needs to know about OpenAI's breakthrough AI language program_. Retrieved in September 2020 from [ZDNet](https://www.zdnet.com/article/what-is-gpt-3-everything-business-needs-to-know-about-openais-breakthrough-ai-language-program/).
%%
# Excalidraw Data
## Text Elements
## Drawing
```json
{
"type": "excalidraw",
"version": 2,
"source": "https://github.com/zsviczian/obsidian-excalidraw-plugin/releases/tag/2.1.4",
"elements": [
{
"id": "4y8R7iOA",
"type": "text",
"x": 118.49495565891266,
"y": -333.44393157958984,
"width": 3.8599853515625,
"height": 24,
"angle": 0,
"strokeColor": "#1e1e1e",
"backgroundColor": "transparent",
"fillStyle": "solid",
"strokeWidth": 2,
"strokeStyle": "solid",
"roughness": 1,
"opacity": 100,
"groupIds": [],
"frameId": null,
"roundness": null,
"seed": 967149026,
"version": 2,
"versionNonce": 939059582,
"isDeleted": true,
"boundElements": null,
"updated": 1713723615080,
"link": null,
"locked": false,
"text": "",
"rawText": "",
"fontSize": 20,
"fontFamily": 4,
"textAlign": "left",
"verticalAlign": "top",
"containerId": null,
"originalText": "",
"lineHeight": 1.2
}
],
"appState": {
"theme": "dark",
"viewBackgroundColor": "#ffffff",
"currentItemStrokeColor": "#1e1e1e",
"currentItemBackgroundColor": "transparent",
"currentItemFillStyle": "solid",
"currentItemStrokeWidth": 2,
"currentItemStrokeStyle": "solid",
"currentItemRoughness": 1,
"currentItemOpacity": 100,
"currentItemFontFamily": 4,
"currentItemFontSize": 20,
"currentItemTextAlign": "left",
"currentItemStartArrowhead": null,
"currentItemEndArrowhead": "arrow",
"scrollX": 583.2388916015625,
"scrollY": 573.6323852539062,
"zoom": {
"value": 1
},
"currentItemRoundness": "round",
"gridSize": null,
"gridColor": {
"Bold": "#C9C9C9FF",
"Regular": "#EDEDEDFF"
},
"currentStrokeOptions": null,
"previousGridSize": null,
"frameRendering": {
"enabled": true,
"clip": true,
"name": true,
"outline": true
}
},
"files": {}
}
```
%%