# [[Concerns regarding artificial intelligence]] ![[Concerns regarding artificial intelligence.svg]] %% date:: [[2020-10-02]], [[2023-01-16]] [[Linguistics]] [[Artificial Intelligence]] [[Natural Language Processing]] %% # [[Concerns regarding artificial intelligence]] - [[AI Hallucination]]: discrepancy between the truth and generated content - [[AI Toxicity]]: harmful or offensive language - [[AI Bias]]: unfair assumptions made by the AI ## In sci-fi culture - The threat of artificial intelligence involves mainly strong AI and can be boiled down to two likely scenarios: - AI is given malicious or wrong instructions and is lethally competent in carrying it out. - AI is given well-intentioned instructions, but its "recursive self-improvement" leads it to take actions that conflict with human principles. - "`Some might argue that a program that can calculate probabilities across vast assemblages of text may be a different kind of intelligence, perhaps an alien intelligence other than our own. `" - "`If it is possible to consider other forms of intelligence, then an emergent property such as the distributed representations that take shape inside neural nets may be one place to look for it. `" - Both these threats really involve the instructions given to AI being either deliberately malicious or incomplete. In order to address the threat from AI, both of these must be addressed: - Systems and standards must be put into place to limit and regulate access to AI. Global coordination may be necessary, in the way that it is for the threat of nuclear weapons, which also threaten global well-being. - Care must be taken in coming up with a set of instructions to program the most basic human principles into every machine with AI (example: Do not harm sentient beings except when X. Do not cause global extinction.) - "`the concern about advanced AI isn’t malevolence but competence. A super-intelligent AI will be extremely good at accomplishing its goals, and if those goals aren’t aligned with ours, we have a problem. `" %% # Excalidraw Data ## Text Elements ## Drawing ```json { "type": "excalidraw", "version": 2, "source": "https://github.com/zsviczian/obsidian-excalidraw-plugin/releases/tag/2.1.4", "elements": [ { "id": "4y8R7iOA", "type": "text", "x": 118.49495565891266, "y": -333.44393157958984, "width": 3.8599853515625, "height": 24, "angle": 0, "strokeColor": "#1e1e1e", "backgroundColor": "transparent", "fillStyle": "solid", "strokeWidth": 2, "strokeStyle": "solid", "roughness": 1, "opacity": 100, "groupIds": [], "frameId": null, "roundness": null, "seed": 967149026, "version": 2, "versionNonce": 939059582, "isDeleted": true, "boundElements": null, "updated": 1713723615080, "link": null, "locked": false, "text": "", "rawText": "", "fontSize": 20, "fontFamily": 4, "textAlign": "left", "verticalAlign": "top", "containerId": null, "originalText": "", "lineHeight": 1.2 } ], "appState": { "theme": "dark", "viewBackgroundColor": "#ffffff", "currentItemStrokeColor": "#1e1e1e", "currentItemBackgroundColor": "transparent", "currentItemFillStyle": "solid", "currentItemStrokeWidth": 2, "currentItemStrokeStyle": "solid", "currentItemRoughness": 1, "currentItemOpacity": 100, "currentItemFontFamily": 4, "currentItemFontSize": 20, "currentItemTextAlign": "left", "currentItemStartArrowhead": null, "currentItemEndArrowhead": "arrow", "scrollX": 583.2388916015625, "scrollY": 573.6323852539062, "zoom": { "value": 1 }, "currentItemRoundness": "round", "gridSize": null, "gridColor": { "Bold": "#C9C9C9FF", "Regular": "#EDEDEDFF" }, "currentStrokeOptions": null, "previousGridSize": null, "frameRendering": { "enabled": true, "clip": true, "name": true, "outline": true } }, "files": {} } ``` %%