# [[Ollama]]
![[Ollama.svg]]
Ollama is both the framework for deploying models to [[Docker]], [[Kubernetes]], and [[WebAssembly]] as well as the company running it. Ollama works well with [[Large Language Model|LLMs]] like [[Llama]] and [[Llama 2]] by [[Meta]], but does not provide the models themselves.
## Features
### UI
Ollama also comes with a UI that provides a simple chat interface for selecting a model. However, one reason it might not be enough is that there's no way to change which model you're interacting with at a time such as to inject a router script. If you want to use a router, [[Open WebUI]] is your best bet.
### CLI
Ollama comes with a CLI for interacting with models. Running this:
```bash
ollama run qwen2.5-coder:7b
```
allows you to directly use that model (if previously downloaded) from the terminal.
## Usage
### Installation
```bash
brew install ollama
```
### Starting Ollama
```bash
ollama serve
```
### Downloading LLMs
```bash
ollama pull qwen3:8b
ollama pull qwen2.5-coder:7b
ollama pull llama3.2:3b
```
%%
## Excalidraw Data
### Text Elements
### Drawing
```json
{
"type": "excalidraw",
"version": 2,
"source": "https://github.com/zsviczian/obsidian-excalidraw-plugin/releases/tag/2.1.4",
"elements": [
{
"id": "4y8R7iOA",
"type": "text",
"x": 118.49495565891266,
"y": -333.44393157958984,
"width": 3.8599853515625,
"height": 24,
"angle": 0,
"strokeColor": "#1e1e1e",
"backgroundColor": "transparent",
"fillStyle": "solid",
"strokeWidth": 2,
"strokeStyle": "solid",
"roughness": 1,
"opacity": 100,
"groupIds": [],
"frameId": null,
"roundness": null,
"seed": 967149026,
"version": 2,
"versionNonce": 939059582,
"isDeleted": true,
"boundElements": null,
"updated": 1713723615080,
"link": null,
"locked": false,
"text": "",
"rawText": "",
"fontSize": 20,
"fontFamily": 4,
"textAlign": "left",
"verticalAlign": "top",
"containerId": null,
"originalText": "",
"lineHeight": 1.2
}
],
"appState": {
"theme": "dark",
"viewBackgroundColor": "#ffffff",
"currentItemStrokeColor": "#1e1e1e",
"currentItemBackgroundColor": "transparent",
"currentItemFillStyle": "solid",
"currentItemStrokeWidth": 2,
"currentItemStrokeStyle": "solid",
"currentItemRoughness": 1,
"currentItemOpacity": 100,
"currentItemFontFamily": 4,
"currentItemFontSize": 20,
"currentItemTextAlign": "left",
"currentItemStartArrowhead": null,
"currentItemEndArrowhead": "arrow",
"scrollX": 583.2388916015625,
"scrollY": 573.6323852539062,
"zoom": {
"value": 1
},
"currentItemRoundness": "round",
"gridSize": null,
"gridColor": {
"Bold": "#C9C9C9FF",
"Regular": "#EDEDEDFF"
},
"currentStrokeOptions": null,
"previousGridSize": null,
"frameRendering": {
"enabled": true,
"clip": true,
"name": true,
"outline": true
}
},
"files": {}
}
```
%%