Large Language Models
Mike Slinn

Chatting with Ollama via web-ui

Published 2024-01-14. Last modified 2024-01-17.
Time to read: 2 minutes.

This page is part of the llm collection, categorized under AI, LLM, Ollama.

Ollama was discussed in the previous article. Ollama Web UI is a way to chat with Ollama models using a web browser.

Installation

The installation instructions push the user of Docker really hard. As readers of my articles may know, I believe Docker is oversold. I followed these instructions, which do not require Docker. The instructions require Node.js and npm; I wrote installation documentation for Node.js and npm, in case you need it.

Shell
$ git clone https://github.com/ollama-webui/ollama-webui.git
Cloning into 'ollama-webui'...
remote: Enumerating objects: 5307, done.
remote: Counting objects: 100% (1554/1554), done.
remote: Compressing objects: 100% (544/544), done.
remote: Total 5307 (delta 1112), reused 1059 (delta 1000), pack-reused 3753
Receiving objects: 100% (5307/5307), 27.32 MiB | 6.29 MiB/s, done.
Resolving deltas: 100% (3157/3157), done. 
$ cd ollama-webui/
$ cp example.env .env
$ cat .env # Ollama URL for the backend to connect # The path '/ollama/api' will be redirected to the specified backend URL OLLAMA_API_BASE_URL='http://localhost:11434/api'
OPENAI_API_BASE_URL=''

$ npm i # install all the dependencies in your project added 297 packages, and audited 298 packages in 13s
found 0 vulnerabilities

This next step, which builds the project, generates a lot of warnings.

Shell
$ npm run build
> ollama-webui@0.0.1 build
> vite build

vite v4.5.1 building SSR bundle for production... transforming (1) src/routes/+layout.svelte1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/auth/+page.svelte:64:4 A11y: <img> element should have an alt attribute 62: <div class="flex space-x-2"> 63: <div class=" self-center"> 64: <img src="/ollama.png" class=" w-8" /> ^ 65: </div> 66: </div> transforming (48) node_modules/@sveltejs/kit/src/runtime/server/data/index.js1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/admin/EditUserModal.svelte:152:1 Unused CSS selector ".tabs::-webkit-scrollbar" 150: } 151: 152: .tabs::-webkit-scrollbar { ^ 153: display: none; /* for Chrome, Safari and Opera */ 154: } 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/admin/EditUserModal.svelte:156:1 Unused CSS selector ".tabs" 154: } 155: 156: .tabs { ^ 157: -ms-overflow-style: none; /* IE and Edge */ 158: scrollbar-width: none; /* Firefox */ 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/admin/EditUserModal.svelte:161:1 Unused CSS selector "input[type='number']" 159: } 160: 161: input[type='number'] { ^ 162: -moz-appearance: textfield; /* Firefox */ 163: } 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:310:1 Unused CSS selector ".loading" 308: 309: <style> 310: .loading { ^ 311: display: inline-block; 312: clip-path: inset(0 1ch 0 0); 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:323:1 Unused CSS selector "pre[class*='language-']" 321: } 322: 323: pre[class*='language-'] { ^ 324: position: relative; 325: overflow: auto; 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:333:1 Unused CSS selector "pre[class*='language-'] button" 331: } 332: 333: pre[class*='language-'] button { ^ 334: position: absolute; 335: top: 5px; 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:347:1 Unused CSS selector "pre[class*='language-'] button:hover" 345: } 346: 347: pre[class*='language-'] button:hover { ^ 348: cursor: pointer; 349: background-color: #bcbabb; transforming (105) node_modules/svelte-french-toast/dist/core/toast.js1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/documents/EditDocModal.svelte:131:1 Unused CSS selector ".tabs::-webkit-scrollbar" 129: } 130: 131: .tabs::-webkit-scrollbar { ^ 132: display: none; /* for Chrome, Safari and Opera */ 133: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/documents/EditDocModal.svelte:135:1 Unused CSS selector ".tabs" 133: } 134: 135: .tabs { ^ 136: -ms-overflow-style: none; /* IE and Edge */ 137: scrollbar-width: none; /* Firefox */ 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/documents/EditDocModal.svelte:140:1 Unused CSS selector "input[type='number']" 138: } 139: 140: input[type='number'] { ^ 141: -moz-appearance: textfield; /* Firefox */ 142: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/SettingsModal.svelte:1784:11 'toggleAuthHeader' is not defined 1782: type="button" 1783: on:click={() => { 1784: toggleAuthHeader(); ^ 1785: }} 1786: > 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/SettingsModal.svelte:2015:1 Unused CSS selector "input[type='number']" 2013: } 2014: 2015: input[type='number'] { ^ 2016: -moz-appearance: textfield; /* Firefox */ 2017: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/layout/Sidebar.svelte:69:6 A11y: <img> element should have an alt attribute 67: <div class="flex self-center"> 68: <div class="self-center mr-3.5"> 69: <img src="/ollama.png" class=" w-5 invert-[100%] rounded-full" /> ^ 70: </div> 71: 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:212:1 Unused CSS selector "input::-webkit-outer-spin-button" 210: 211: <style> 212: input::-webkit-outer-spin-button, ^ 213: input::-webkit-inner-spin-button { 214: /* display: none; <- Crashes Chrome on hover */ 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:213:1 Unused CSS selector "input::-webkit-inner-spin-button" 211: <style> 212: input::-webkit-outer-spin-button, 213: input::-webkit-inner-spin-button { ^ 214: /* display: none; <- Crashes Chrome on hover */ 215: -webkit-appearance: none; 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:219:1 Unused CSS selector ".tabs::-webkit-scrollbar" 217: } 218: 219: .tabs::-webkit-scrollbar { ^ 220: display: none; /* for Chrome, Safari and Opera */ 221: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:223:1 Unused CSS selector ".tabs" 221: } 222: 223: .tabs { ^ 224: -ms-overflow-style: none; /* IE and Edge */ 225: scrollbar-width: none; /* Firefox */ 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:228:1 Unused CSS selector "input[type='number']" 226: } 227: 228: input[type='number'] { ^ 229: -moz-appearance: textfield; /* Firefox */ 230: }

Nearly done:

Shell
$ cd backend
$ pip install -r requirements.txt -U Collecting fastapi (from -r requirements.txt (line 1)) Downloading fastapi-0.109.0-py3-none-any.whl.metadata (24 kB) Collecting pydantic (from -r requirements.txt (line 3)) Downloading pydantic-2.5.3-py3-none-any.whl.metadata (65 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.6/65.6 kB 1.9 MB/s eta 0:00:00 Collecting python-multipart (from -r requirements.txt (line 4)) Downloading python_multipart-0.0.6-py3-none-any.whl (45 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.7/45.7 kB 2.1 MB/s eta 0:00:00 Collecting flask (from -r requirements.txt (line 6)) Downloading flask-3.0.0-py3-none-any.whl.metadata (3.6 kB) Collecting flask_cors (from -r requirements.txt (line 7)) Downloading Flask_Cors-4.0.0-py2.py3-none-any.whl.metadata (5.4 kB) Collecting python-socketio (from -r requirements.txt (line 9)) Downloading python_socketio-5.11.0-py3-none-any.whl.metadata (3.2 kB) Collecting python-jose (from -r requirements.txt (line 10)) Downloading python_jose-3.3.0-py2.py3-none-any.whl (33 kB) Collecting uuid (from -r requirements.txt (line 12)) Downloading uuid-1.30.tar.gz (5.8 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: requests in /home/mslinn/venv/default/lib/python3.11/site-packages (from -r requirements.txt (line 14)) (2.31.0) Collecting aiohttp (from -r requirements.txt (line 15)) Downloading aiohttp-3.9.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.4 kB) Collecting peewee (from -r requirements.txt (line 16)) Downloading peewee-3.17.0.tar.gz (2.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.9/2.9 MB 57.8 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting bcrypt (from -r requirements.txt (line 17)) Downloading bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (9.5 kB) Collecting langchain (from -r requirements.txt (line 19)) Downloading langchain-0.1.0-py3-none-any.whl.metadata (13 kB) Collecting langchain-community (from -r requirements.txt (line 20)) Downloading langchain_community-0.0.13-py3-none-any.whl.metadata (7.5 kB) Collecting chromadb (from -r requirements.txt (line 21)) Downloading chromadb-0.4.22-py3-none-any.whl.metadata (7.3 kB) Collecting sentence_transformers (from -r requirements.txt (line 22)) Downloading sentence-transformers-2.2.2.tar.gz (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.0/86.0 kB 4.1 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting pypdf (from -r requirements.txt (line 23)) Downloading pypdf-3.17.4-py3-none-any.whl.metadata (7.5 kB) Collecting docx2txt (from -r requirements.txt (line 24)) Downloading docx2txt-0.8.tar.gz (2.8 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting unstructured (from -r requirements.txt (line 25)) Downloading unstructured-0.12.0-py3-none-any.whl.metadata (26 kB) Collecting markdown (from -r requirements.txt (line 26)) Downloading Markdown-3.5.2-py3-none-any.whl.metadata (7.0 kB) Collecting PyJWT (from -r requirements.txt (line 28)) Downloading PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB) Collecting black (from -r requirements.txt (line 31)) Downloading black-23.12.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (68 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69.0/69.0 kB 2.5 MB/s eta 0:00:00 Collecting uvicorn[standard] (from -r requirements.txt (line 2)) Downloading uvicorn-0.26.0-py3-none-any.whl.metadata (6.4 kB) Collecting passlib[bcrypt] (from -r requirements.txt (line 11)) Downloading passlib-1.7.4-py2.py3-none-any.whl (525 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 525.6/525.6 kB 25.1 MB/s eta 0:00:00 Collecting starlette<0.36.0,>=0.35.0 (from fastapi->-r requirements.txt (line 1)) Downloading starlette-0.35.1-py3-none-any.whl.metadata (5.8 kB) Requirement already satisfied: typing-extensions>=4.8.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from fastapi->-r requirements.txt (line 1)) (4.9.0) Collecting click>=7.0 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB) Collecting h11>=0.8 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 3.0 MB/s eta 0:00:00 Collecting httptools>=0.5.0 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading httptools-0.6.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.6 kB) Collecting python-dotenv>=0.13 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading python_dotenv-1.0.0-py3-none-any.whl (19 kB) Requirement already satisfied: pyyaml>=5.1 in /home/mslinn/venv/default/lib/python3.11/site-packages (from uvicorn[standard]->-r requirements.txt (line 2)) (6.0.1) Collecting uvloop!=0.15.0,!=0.15.1,>=0.14.0 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading uvloop-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB) Collecting watchfiles>=0.13 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading watchfiles-0.21.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB) Requirement already satisfied: websockets>=10.4 in /home/mslinn/venv/default/lib/python3.11/site-packages (from uvicorn[standard]->-r requirements.txt (line 2)) (12.0) Collecting annotated-types>=0.4.0 (from pydantic->-r requirements.txt (line 3)) Downloading annotated_types-0.6.0-py3-none-any.whl.metadata (12 kB) Collecting pydantic-core==2.14.6 (from pydantic->-r requirements.txt (line 3)) Downloading pydantic_core-2.14.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB) Collecting Werkzeug>=3.0.0 (from flask->-r requirements.txt (line 6)) Downloading werkzeug-3.0.1-py3-none-any.whl.metadata (4.1 kB) Requirement already satisfied: Jinja2>=3.1.2 in /home/mslinn/venv/default/lib/python3.11/site-packages (from flask->-r requirements.txt (line 6)) (3.1.3) Collecting itsdangerous>=2.1.2 (from flask->-r requirements.txt (line 6)) Downloading itsdangerous-2.1.2-py3-none-any.whl (15 kB) Collecting blinker>=1.6.2 (from flask->-r requirements.txt (line 6)) Downloading blinker-1.7.0-py3-none-any.whl.metadata (1.9 kB) Collecting bidict>=0.21.0 (from python-socketio->-r requirements.txt (line 9)) Downloading bidict-0.22.1-py3-none-any.whl (35 kB) Collecting python-engineio>=4.8.0 (from python-socketio->-r requirements.txt (line 9)) Downloading python_engineio-4.8.2-py3-none-any.whl.metadata (2.2 kB) Collecting ecdsa!=0.15 (from python-jose->-r requirements.txt (line 10)) Downloading ecdsa-0.18.0-py2.py3-none-any.whl (142 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.9/142.9 kB 7.4 MB/s eta 0:00:00 Collecting rsa (from python-jose->-r requirements.txt (line 10)) Downloading rsa-4.9-py3-none-any.whl (34 kB) Collecting pyasn1 (from python-jose->-r requirements.txt (line 10)) Downloading pyasn1-0.5.1-py2.py3-none-any.whl.metadata (8.6 kB) Requirement already satisfied: charset-normalizer<4,>=2 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (3.3.2) Requirement already satisfied: idna<4,>=2.5 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (3.6) Requirement already satisfied: urllib3<3,>=1.21.1 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (2023.11.17) Collecting attrs>=17.3.0 (from aiohttp->-r requirements.txt (line 15)) Downloading attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB) Collecting multidict<7.0,>=4.5 (from aiohttp->-r requirements.txt (line 15)) Downloading multidict-6.0.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (117 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.4/117.4 kB 6.8 MB/s eta 0:00:00 Collecting yarl<2.0,>=1.0 (from aiohttp->-r requirements.txt (line 15)) Downloading yarl-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (31 kB) Collecting frozenlist>=1.1.1 (from aiohttp->-r requirements.txt (line 15)) Downloading frozenlist-1.4.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB) Collecting aiosignal>=1.1.2 (from aiohttp->-r requirements.txt (line 15)) Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB) Collecting SQLAlchemy<3,>=1.4 (from langchain->-r requirements.txt (line 19)) Downloading SQLAlchemy-2.0.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.6 kB) Collecting dataclasses-json<0.7,>=0.5.7 (from langchain->-r requirements.txt (line 19)) Downloading dataclasses_json-0.6.3-py3-none-any.whl.metadata (25 kB) Collecting jsonpatch<2.0,>=1.33 (from langchain->-r requirements.txt (line 19)) Downloading jsonpatch-1.33-py2.py3-none-any.whl.metadata (3.0 kB) Collecting langchain-core<0.2,>=0.1.7 (from langchain->-r requirements.txt (line 19)) Downloading langchain_core-0.1.11-py3-none-any.whl.metadata (4.2 kB) Collecting langsmith<0.1.0,>=0.0.77 (from langchain->-r requirements.txt (line 19)) Downloading langsmith-0.0.80-py3-none-any.whl.metadata (10 kB) Requirement already satisfied: numpy<2,>=1 in /home/mslinn/venv/default/lib/python3.11/site-packages (from langchain->-r requirements.txt (line 19)) (1.26.3) Collecting tenacity<9.0.0,>=8.1.0 (from langchain->-r requirements.txt (line 19)) Downloading tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB) Collecting build>=1.0.3 (from chromadb->-r requirements.txt (line 21)) Downloading build-1.0.3-py3-none-any.whl.metadata (4.2 kB) Collecting chroma-hnswlib==0.7.3 (from chromadb->-r requirements.txt (line 21)) Downloading chroma_hnswlib-0.7.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (252 bytes) Collecting posthog>=2.4.0 (from chromadb->-r requirements.txt (line 21)) Downloading posthog-3.3.1-py2.py3-none-any.whl.metadata (2.0 kB) Collecting pulsar-client>=3.1.0 (from chromadb->-r requirements.txt (line 21)) Downloading pulsar_client-3.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.0 kB) Collecting onnxruntime>=1.14.1 (from chromadb->-r requirements.txt (line 21)) Downloading onnxruntime-1.16.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.3 kB) Collecting opentelemetry-api>=1.2.0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_api-1.22.0-py3-none-any.whl.metadata (1.4 kB) Collecting opentelemetry-exporter-otlp-proto-grpc>=1.2.0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_exporter_otlp_proto_grpc-1.22.0-py3-none-any.whl.metadata (2.4 kB) Collecting opentelemetry-instrumentation-fastapi>=0.41b0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_instrumentation_fastapi-0.43b0-py3-none-any.whl.metadata (2.3 kB) Collecting opentelemetry-sdk>=1.2.0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_sdk-1.22.0-py3-none-any.whl.metadata (1.5 kB) Collecting tokenizers>=0.13.2 (from chromadb->-r requirements.txt (line 21)) Downloading tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB) Collecting pypika>=0.48.9 (from chromadb->-r requirements.txt (line 21)) Downloading PyPika-0.48.9.tar.gz (67 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.3/67.3 kB 3.2 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: tqdm>=4.65.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from chromadb->-r requirements.txt (line 21)) (4.66.1) Collecting overrides>=7.3.1 (from chromadb->-r requirements.txt (line 21)) Downloading overrides-7.4.0-py3-none-any.whl.metadata (5.7 kB) Collecting importlib-resources (from chromadb->-r requirements.txt (line 21)) Downloading importlib_resources-6.1.1-py3-none-any.whl.metadata (4.1 kB) Collecting grpcio>=1.58.0 (from chromadb->-r requirements.txt (line 21)) Downloading grpcio-1.60.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) Collecting typer>=0.9.0 (from chromadb->-r requirements.txt (line 21)) Downloading typer-0.9.0-py3-none-any.whl (45 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.9/45.9 kB 4.5 MB/s eta 0:00:00 Collecting kubernetes>=28.1.0 (from chromadb->-r requirements.txt (line 21)) Downloading kubernetes-29.0.0-py2.py3-none-any.whl.metadata (1.5 kB) Collecting mmh3>=4.0.1 (from chromadb->-r requirements.txt (line 21)) Downloading mmh3-4.1.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (13 kB) Collecting transformers<5.0.0,>=4.6.0 (from sentence_transformers->-r requirements.txt (line 22)) Downloading transformers-4.36.2-py3-none-any.whl.metadata (126 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.8/126.8 kB 6.3 MB/s eta 0:00:00 Requirement already satisfied: torch>=1.6.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from sentence_transformers->-r requirements.txt (line 22)) (2.1.2) Collecting torchvision (from sentence_transformers->-r requirements.txt (line 22)) Downloading torchvision-0.16.2-cp311-cp311-manylinux1_x86_64.whl.metadata (6.6 kB) Collecting scikit-learn (from sentence_transformers->-r requirements.txt (line 22)) Downloading scikit_learn-1.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting scipy (from sentence_transformers->-r requirements.txt (line 22)) Downloading scipy-1.11.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.4/60.4 kB 2.7 MB/s eta 0:00:00 Collecting nltk (from sentence_transformers->-r requirements.txt (line 22)) Downloading nltk-3.8.1-py3-none-any.whl (1.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 59.0 MB/s eta 0:00:00 Collecting sentencepiece (from sentence_transformers->-r requirements.txt (line 22)) Downloading sentencepiece-0.1.99-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 37.3 MB/s eta 0:00:00 Requirement already satisfied: huggingface-hub>=0.4.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from sentence_transformers->-r requirements.txt (line 22)) (0.20.2) Collecting chardet (from unstructured->-r requirements.txt (line 25)) Downloading chardet-5.2.0-py3-none-any.whl.metadata (3.4 kB) Collecting filetype (from unstructured->-r requirements.txt (line 25)) Downloading filetype-1.2.0-py2.py3-none-any.whl (19 kB) Collecting python-magic (from unstructured->-r requirements.txt (line 25)) Downloading python_magic-0.4.27-py2.py3-none-any.whl (13 kB) Collecting lxml (from unstructured->-r requirements.txt (line 25)) Downloading lxml-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.5 kB) Collecting tabulate (from unstructured->-r requirements.txt (line 25)) Downloading tabulate-0.9.0-py3-none-any.whl (35 kB) Collecting beautifulsoup4 (from unstructured->-r requirements.txt (line 25)) Downloading beautifulsoup4-4.12.2-py3-none-any.whl (142 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.0/143.0 kB 9.7 MB/s eta 0:00:00 Collecting emoji (from unstructured->-r requirements.txt (line 25)) Downloading emoji-2.9.0-py2.py3-none-any.whl.metadata (5.3 kB) Collecting python-iso639 (from unstructured->-r requirements.txt (line 25)) Downloading python_iso639-2024.1.2-py3-none-any.whl.metadata (13 kB) Collecting langdetect (from unstructured->-r requirements.txt (line 25)) Downloading langdetect-1.0.9.tar.gz (981 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 981.5/981.5 kB 32.6 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting rapidfuzz (from unstructured->-r requirements.txt (line 25)) Downloading rapidfuzz-3.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting backoff (from unstructured->-r requirements.txt (line 25)) Downloading backoff-2.2.1-py3-none-any.whl (15 kB) Collecting unstructured-client (from unstructured->-r requirements.txt (line 25)) Downloading unstructured_client-0.15.2-py3-none-any.whl.metadata (4.9 kB) Collecting wrapt (from unstructured->-r requirements.txt (line 25)) Downloading wrapt-1.16.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB) Collecting cryptography>=3.4.0 (from pyjwt[crypto]->-r requirements.txt (line 29)) Downloading cryptography-41.0.7-cp37-abi3-manylinux_2_28_x86_64.whl.metadata (5.2 kB) Collecting mypy-extensions>=0.4.3 (from black->-r requirements.txt (line 31)) Downloading mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB) Requirement already satisfied: packaging>=22.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from black->-r requirements.txt (line 31)) (23.2) Collecting pathspec>=0.9.0 (from black->-r requirements.txt (line 31)) Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) Collecting platformdirs>=2 (from black->-r requirements.txt (line 31)) Downloading platformdirs-4.1.0-py3-none-any.whl.metadata (11 kB) Collecting pyproject_hooks (from build>=1.0.3->chromadb->-r requirements.txt (line 21)) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Collecting cffi>=1.12 (from cryptography>=3.4.0->pyjwt[crypto]->-r requirements.txt (line 29)) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB) Collecting marshmallow<4.0.0,>=3.18.0 (from dataclasses-json<0.7,>=0.5.7->langchain->-r requirements.txt (line 19)) Downloading marshmallow-3.20.2-py3-none-any.whl.metadata (7.5 kB) Collecting typing-inspect<1,>=0.4.0 (from dataclasses-json<0.7,>=0.5.7->langchain->-r requirements.txt (line 19)) Downloading typing_inspect-0.9.0-py3-none-any.whl.metadata (1.5 kB) Collecting six>=1.9.0 (from ecdsa!=0.15->python-jose->-r requirements.txt (line 10)) Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) Requirement already satisfied: filelock in /home/mslinn/venv/default/lib/python3.11/site-packages (from huggingface-hub>=0.4.0->sentence_transformers->-r requirements.txt (line 22)) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from huggingface-hub>=0.4.0->sentence_transformers->-r requirements.txt (line 22)) (2023.12.2) Requirement already satisfied: MarkupSafe>=2.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 6)) (2.1.3) Collecting jsonpointer>=1.9 (from jsonpatch<2.0,>=1.33->langchain->-r requirements.txt (line 19)) Downloading jsonpointer-2.4-py2.py3-none-any.whl.metadata (2.5 kB) Collecting python-dateutil>=2.5.3 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 15.0 MB/s eta 0:00:00 Collecting google-auth>=1.0.1 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading google_auth-2.26.2-py2.py3-none-any.whl.metadata (4.7 kB) Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading websocket_client-1.7.0-py3-none-any.whl.metadata (7.9 kB) Collecting requests-oauthlib (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting oauthlib>=3.2.2 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 6.2 MB/s eta 0:00:00 Collecting anyio<5,>=3 (from langchain-core<0.2,>=0.1.7->langchain->-r requirements.txt (line 19)) Downloading anyio-4.2.0-py3-none-any.whl.metadata (4.6 kB) Collecting coloredlogs (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 2.4 MB/s eta 0:00:00 Collecting flatbuffers (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading flatbuffers-23.5.26-py2.py3-none-any.whl.metadata (850 bytes) Collecting protobuf (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading protobuf-4.25.2-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes) Requirement already satisfied: sympy in /home/mslinn/venv/default/lib/python3.11/site-packages (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) (1.12) Collecting deprecated>=1.2.6 (from opentelemetry-api>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB) Collecting importlib-metadata<7.0,>=6.0 (from opentelemetry-api>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading importlib_metadata-6.11.0-py3-none-any.whl.metadata (4.9 kB) Collecting googleapis-common-protos~=1.52 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading googleapis_common_protos-1.62.0-py2.py3-none-any.whl.metadata (1.5 kB) Collecting opentelemetry-exporter-otlp-proto-common==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_exporter_otlp_proto_common-1.22.0-py3-none-any.whl.metadata (1.9 kB) Collecting opentelemetry-proto==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_proto-1.22.0-py3-none-any.whl.metadata (2.3 kB) Collecting opentelemetry-instrumentation-asgi==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_instrumentation_asgi-0.43b0-py3-none-any.whl.metadata (2.1 kB) Collecting opentelemetry-instrumentation==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_instrumentation-0.43b0-py3-none-any.whl.metadata (5.9 kB) Collecting opentelemetry-semantic-conventions==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_semantic_conventions-0.43b0-py3-none-any.whl.metadata (2.3 kB) Collecting opentelemetry-util-http==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_util_http-0.43b0-py3-none-any.whl.metadata (2.5 kB) Requirement already satisfied: setuptools>=16.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from opentelemetry-instrumentation==0.43b0->opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) (69.0.3) Collecting asgiref~=3.0 (from opentelemetry-instrumentation-asgi==0.43b0->opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading asgiref-3.7.2-py3-none-any.whl.metadata (9.2 kB) Collecting monotonic>=1.5 (from posthog>=2.4.0->chromadb->-r requirements.txt (line 21)) Downloading monotonic-1.6-py2.py3-none-any.whl (8.2 kB) Collecting simple-websocket>=0.10.0 (from python-engineio>=4.8.0->python-socketio->-r requirements.txt (line 9)) Downloading simple_websocket-1.0.0-py3-none-any.whl.metadata (1.3 kB) Collecting greenlet!=0.4.17 (from SQLAlchemy<3,>=1.4->langchain->-r requirements.txt (line 19)) Downloading greenlet-3.0.3-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.8 kB) Requirement already satisfied: networkx in /home/mslinn/venv/default/lib/python3.11/site-packages (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) (3.2.1) Collecting nvidia-cuda-nvrtc-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cuda_nvrtc_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (23.7 MB) Collecting nvidia-cuda-runtime-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cuda_runtime_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (823 kB) Collecting nvidia-cuda-cupti-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cuda_cupti_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (14.1 MB) Collecting nvidia-cudnn-cu12==8.9.2.26 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) Collecting nvidia-cublas-cu12==12.1.3.1 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cublas_cu12-12.1.3.1-py3-none-manylinux1_x86_64.whl (410.6 MB) Collecting nvidia-cufft-cu12==11.0.2.54 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cufft_cu12-11.0.2.54-py3-none-manylinux1_x86_64.whl (121.6 MB) Collecting nvidia-curand-cu12==10.3.2.106 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_curand_cu12-10.3.2.106-py3-none-manylinux1_x86_64.whl (56.5 MB) Collecting nvidia-cusolver-cu12==11.4.5.107 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cusolver_cu12-11.4.5.107-py3-none-manylinux1_x86_64.whl (124.2 MB) Collecting nvidia-cusparse-cu12==12.1.0.106 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cusparse_cu12-12.1.0.106-py3-none-manylinux1_x86_64.whl (196.0 MB) Collecting nvidia-nccl-cu12==2.18.1 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_nccl_cu12-2.18.1-py3-none-manylinux1_x86_64.whl (209.8 MB) Collecting nvidia-nvtx-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_nvtx_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (99 kB) Collecting triton==2.1.0 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached triton-2.1.0-0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.3 kB) Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/mslinn/venv/default/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) (12.3.101) Requirement already satisfied: regex!=2019.12.17 in /home/mslinn/venv/default/lib/python3.11/site-packages (from transformers<5.0.0,>=4.6.0->sentence_transformers->-r requirements.txt (line 22)) (2023.12.25) Collecting safetensors>=0.3.1 (from transformers<5.0.0,>=4.6.0->sentence_transformers->-r requirements.txt (line 22)) Downloading safetensors-0.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB) Collecting soupsieve>1.2 (from beautifulsoup4->unstructured->-r requirements.txt (line 25)) Downloading soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB) Collecting joblib (from nltk->sentence_transformers->-r requirements.txt (line 22)) Downloading joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB) Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence_transformers->-r requirements.txt (line 22)) Downloading threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB) Collecting pillow!=8.3.*,>=5.3.0 (from torchvision->sentence_transformers->-r requirements.txt (line 22)) Downloading pillow-10.2.0-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (9.7 kB) Collecting jsonpath-python>=1.0.6 (from unstructured-client->unstructured->-r requirements.txt (line 25)) Downloading jsonpath_python-1.0.6-py3-none-any.whl (7.6 kB) Collecting sniffio>=1.1 (from anyio<5,>=3->langchain-core<0.2,>=0.1.7->langchain->-r requirements.txt (line 19)) Downloading sniffio-1.3.0-py3-none-any.whl (10 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.4.0->pyjwt[crypto]->-r requirements.txt (line 29)) Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 8.0 MB/s eta 0:00:00 Collecting cachetools<6.0,>=2.0.0 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading cachetools-5.3.2-py3-none-any.whl.metadata (5.2 kB) Collecting pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 9.7 MB/s eta 0:00:00 Collecting zipp>=0.5 (from importlib-metadata<7.0,>=6.0->opentelemetry-api>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading zipp-3.17.0-py3-none-any.whl.metadata (3.7 kB) Collecting wsproto (from simple-websocket>=0.10.0->python-engineio>=4.8.0->python-socketio->-r requirements.txt (line 9)) Downloading wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading humanfriendly-10.0-py2.py3-none-any.whl (86 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 4.7 MB/s eta 0:00:00 Requirement already satisfied: mpmath>=0.19 in /home/mslinn/venv/default/lib/python3.11/site-packages (from sympy->onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) (1.3.0) Downloading fastapi-0.109.0-py3-none-any.whl (92 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92.0/92.0 kB 5.3 MB/s eta 0:00:00 Downloading pydantic-2.5.3-py3-none-any.whl (381 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 381.9/381.9 kB 16.8 MB/s eta 0:00:00 Downloading pydantic_core-2.14.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 41.9 MB/s eta 0:00:00 Downloading flask-3.0.0-py3-none-any.whl (99 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 99.7/99.7 kB 4.8 MB/s eta 0:00:00 Downloading Flask_Cors-4.0.0-py2.py3-none-any.whl (14 kB) Downloading python_socketio-5.11.0-py3-none-any.whl (75 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.4/75.4 kB 2.8 MB/s eta 0:00:00 Downloading aiohttp-3.9.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 37.3 MB/s eta 0:00:00 Downloading bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 25.4 MB/s eta 0:00:00 Downloading langchain-0.1.0-py3-none-any.whl (797 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 798.0/798.0 kB 32.2 MB/s eta 0:00:00 Downloading langchain_community-0.0.13-py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 42.9 MB/s eta 0:00:00 Downloading chromadb-0.4.22-py3-none-any.whl (509 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 509.0/509.0 kB 17.4 MB/s eta 0:00:00 Downloading chroma_hnswlib-0.7.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 46.4 MB/s eta 0:00:00 Downloading pypdf-3.17.4-py3-none-any.whl (278 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.2/278.2 kB 22.0 MB/s eta 0:00:00 Downloading unstructured-0.12.0-py3-none-any.whl (1.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 45.8 MB/s eta 0:00:00 Downloading Markdown-3.5.2-py3-none-any.whl (103 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.9/103.9 kB 4.3 MB/s eta 0:00:00 Downloading PyJWT-2.8.0-py3-none-any.whl (22 kB) Downloading black-23.12.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 36.5 MB/s eta 0:00:00 Downloading annotated_types-0.6.0-py3-none-any.whl (12 kB) Downloading attrs-23.2.0-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.8/60.8 kB 2.8 MB/s eta 0:00:00 Downloading blinker-1.7.0-py3-none-any.whl (13 kB) Downloading build-1.0.3-py3-none-any.whl (18 kB) Downloading click-8.1.7-py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 5.9 MB/s eta 0:00:00 Downloading cryptography-41.0.7-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 45.6 MB/s eta 0:00:00 Downloading dataclasses_json-0.6.3-py3-none-any.whl (28 kB) Downloading frozenlist-1.4.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (272 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 272.3/272.3 kB 23.7 MB/s eta 0:00:00 Downloading grpcio-1.60.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 37.5 MB/s eta 0:00:00 Downloading httptools-0.6.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (318 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 318.5/318.5 kB 11.5 MB/s eta 0:00:00 Downloading jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Downloading kubernetes-29.0.0-py2.py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 27.8 MB/s eta 0:00:00 Downloading langchain_core-0.1.11-py3-none-any.whl (218 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 218.6/218.6 kB 9.0 MB/s eta 0:00:00 Downloading langsmith-0.0.80-py3-none-any.whl (48 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.3/48.3 kB 2.2 MB/s eta 0:00:00 Downloading mmh3-4.1.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (67 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.8/67.8 kB 3.6 MB/s eta 0:00:00 Downloading onnxruntime-1.16.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.4/6.4 MB 28.6 MB/s eta 0:00:00 Downloading opentelemetry_api-1.22.0-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.9/57.9 kB 2.5 MB/s eta 0:00:00 Downloading opentelemetry_exporter_otlp_proto_grpc-1.22.0-py3-none-any.whl (18 kB) Downloading opentelemetry_exporter_otlp_proto_common-1.22.0-py3-none-any.whl (17 kB) Downloading opentelemetry_proto-1.22.0-py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.8/50.8 kB 2.2 MB/s eta 0:00:00 Downloading opentelemetry_instrumentation_fastapi-0.43b0-py3-none-any.whl (11 kB) Downloading opentelemetry_instrumentation-0.43b0-py3-none-any.whl (28 kB) Downloading opentelemetry_instrumentation_asgi-0.43b0-py3-none-any.whl (14 kB) Downloading opentelemetry_semantic_conventions-0.43b0-py3-none-any.whl (36 kB) Downloading opentelemetry_util_http-0.43b0-py3-none-any.whl (6.9 kB) Downloading opentelemetry_sdk-1.22.0-py3-none-any.whl (105 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 105.6/105.6 kB 6.3 MB/s eta 0:00:00 Downloading overrides-7.4.0-py3-none-any.whl (17 kB) Downloading pathspec-0.12.1-py3-none-any.whl (31 kB) Downloading platformdirs-4.1.0-py3-none-any.whl (17 kB) Downloading posthog-3.3.1-py2.py3-none-any.whl (40 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.6/40.6 kB 4.2 MB/s eta 0:00:00 Downloading pulsar_client-3.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 30.0 MB/s eta 0:00:00 Downloading python_engineio-4.8.2-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.4/57.4 kB 1.4 MB/s eta 0:00:00 Downloading SQLAlchemy-2.0.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 29.2 MB/s eta 0:00:00 Downloading starlette-0.35.1-py3-none-any.whl (71 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.1/71.1 kB 3.7 MB/s eta 0:00:00 Downloading tenacity-8.2.3-py3-none-any.whl (24 kB) Downloading tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 37.2 MB/s eta 0:00:00 Using cached nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl (731.7 MB) Using cached triton-2.1.0-0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89.2 MB) Downloading transformers-4.36.2-py3-none-any.whl (8.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.2/8.2 MB 30.2 MB/s eta 0:00:00 Downloading uvicorn-0.26.0-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.5/60.5 kB 3.4 MB/s eta 0:00:00 Downloading uvloop-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.5/3.5 MB 35.9 MB/s eta 0:00:00 Downloading watchfiles-0.21.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 30.7 MB/s eta 0:00:00 Downloading werkzeug-3.0.1-py3-none-any.whl (226 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 226.7/226.7 kB 6.3 MB/s eta 0:00:00 Downloading wrapt-1.16.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (80 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.7/80.7 kB 4.3 MB/s eta 0:00:00 Downloading yarl-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (328 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 328.1/328.1 kB 14.8 MB/s eta 0:00:00 Downloading chardet-5.2.0-py3-none-any.whl (199 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 7.8 MB/s eta 0:00:00 Downloading emoji-2.9.0-py2.py3-none-any.whl (397 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 397.5/397.5 kB 14.0 MB/s eta 0:00:00 Downloading importlib_resources-6.1.1-py3-none-any.whl (33 kB) Downloading lxml-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.1/8.1 MB 51.1 MB/s eta 0:00:00 Downloading pyasn1-0.5.1-py2.py3-none-any.whl (84 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.9/84.9 kB 3.8 MB/s eta 0:00:00 Downloading python_iso639-2024.1.2-py3-none-any.whl (274 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 274.7/274.7 kB 12.2 MB/s eta 0:00:00 Downloading rapidfuzz-3.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 37.6 MB/s eta 0:00:00 Downloading scikit_learn-1.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (10.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.9/10.9 MB 30.6 MB/s eta 0:00:00 Downloading scipy-1.11.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36.4/36.4 MB 29.5 MB/s eta 0:00:00 Downloading torchvision-0.16.2-cp311-cp311-manylinux1_x86_64.whl (6.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 33.4 MB/s eta 0:00:00 Downloading unstructured_client-0.15.2-py3-none-any.whl (20 kB) Downloading anyio-4.2.0-py3-none-any.whl (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.5/85.5 kB 23.0 MB/s eta 0:00:00 Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 464.8/464.8 kB 39.8 MB/s eta 0:00:00 Downloading Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB) Downloading google_auth-2.26.2-py2.py3-none-any.whl (186 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 186.5/186.5 kB 27.6 MB/s eta 0:00:00 Downloading googleapis_common_protos-1.62.0-py2.py3-none-any.whl (228 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 228.7/228.7 kB 31.9 MB/s eta 0:00:00 Downloading greenlet-3.0.3-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (620 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 620.0/620.0 kB 39.7 MB/s eta 0:00:00 Downloading importlib_metadata-6.11.0-py3-none-any.whl (23 kB) Downloading joblib-1.3.2-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.2/302.2 kB 35.7 MB/s eta 0:00:00 Downloading jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Downloading marshmallow-3.20.2-py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.4/49.4 kB 18.6 MB/s eta 0:00:00 Downloading pillow-10.2.0-cp311-cp311-manylinux_2_28_x86_64.whl (4.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 41.7 MB/s eta 0:00:00 Downloading protobuf-4.25.2-cp37-abi3-manylinux2014_x86_64.whl (294 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 31.8 MB/s eta 0:00:00 Downloading safetensors-0.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 31.7 MB/s eta 0:00:00 Downloading simple_websocket-1.0.0-py3-none-any.whl (13 kB) Downloading soupsieve-2.5-py3-none-any.whl (36 kB) Downloading threadpoolctl-3.2.0-py3-none-any.whl (15 kB) Downloading typing_inspect-0.9.0-py3-none-any.whl (8.8 kB) Downloading websocket_client-1.7.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.5/58.5 kB 22.3 MB/s eta 0:00:00 Downloading flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB) Downloading asgiref-3.7.2-py3-none-any.whl (24 kB) Downloading cachetools-5.3.2-py3-none-any.whl (9.3 kB) Downloading zipp-3.17.0-py3-none-any.whl (7.4 kB) Building wheels for collected packages: uuid, peewee, sentence_transformers, docx2txt, pypika, langdetect Building wheel for uuid (pyproject.toml) ... done Created wheel for uuid: filename=uuid-1.30-py3-none-any.whl size=6479 sha256=4223c744be8113c0dc882dfd15ad1165bb049542ff97ee2934c953ef0810c511 Stored in directory: /home/mslinn/.cache/pip/wheels/e0/01/df/bd20df409bd81f8b99e6cd343c5f49731dc0a20eefefdafae0 Building wheel for peewee (pyproject.toml) ... done Created wheel for peewee: filename=peewee-3.17.0-cp311-cp311-linux_x86_64.whl size=771047 sha256=a939a40468afc2b8508e3845fbb70a929d888422cdb1a6a8a17e830fa9bc73b9 Stored in directory: /home/mslinn/.cache/pip/wheels/02/20/23/74a10d0cd31f5d41c19b92ddf4c138ceff01b9f4675f19dbf5 Building wheel for sentence_transformers (pyproject.toml) ... done Created wheel for sentence_transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125923 sha256=e01fac84fc5b8e1729fe40189242bbe8c4e10a9586faa516a833f0a6c4066394 Stored in directory: /home/mslinn/.cache/pip/wheels/ff/27/bf/ffba8b318b02d7f691a57084ee154e26ed24d012b0c7805881 Building wheel for docx2txt (pyproject.toml) ... done Created wheel for docx2txt: filename=docx2txt-0.8-py3-none-any.whl size=3960 sha256=1202b50098db6b00c964e64feb9c8722f50d0a1a512b3eff4f1e454ffa96924b Stored in directory: /home/mslinn/.cache/pip/wheels/0f/0e/7a/3094a4ceefe657bff7e12dd9592a9d5b6487ef4338ace0afa6 Building wheel for pypika (pyproject.toml) ... done Created wheel for pypika: filename=PyPika-0.48.9-py2.py3-none-any.whl size=53723 sha256=ef69fbe603fb2427ddeeb2811da3eec124e6a72793f6318c3e605af63849620d Stored in directory: /home/mslinn/.cache/pip/wheels/a3/01/bd/4c40ceb9d5354160cb186dcc153360f4ab7eb23e2b24daf96d Building wheel for langdetect (pyproject.toml) ... done Created wheel for langdetect: filename=langdetect-1.0.9-py3-none-any.whl size=993225 sha256=41379f27ebd38beecd305466a334035621ad4ce4546e5d300e249033e7c99641 Stored in directory: /home/mslinn/.cache/pip/wheels/0a/f2/b2/e5ca405801e05eb7c8ed5b3b4bcf1fcabcd6272c167640072e Successfully built uuid peewee sentence_transformers docx2txt pypika langdetect Installing collected packages: uuid, sentencepiece, pypika, peewee, passlib, monotonic, mmh3, flatbuffers, filetype, docx2txt, zipp, wrapt, Werkzeug, websocket-client, uvloop, triton, threadpoolctl, tenacity, tabulate, soupsieve, sniffio, six, scipy, safetensors, rapidfuzz, python-multipart, python-magic, python-iso639, python-dotenv, pyproject_hooks, pypdf, PyJWT, pydantic-core, pycparser, pyasn1, pulsar-client, protobuf, platformdirs, pillow, pathspec, overrides, opentelemetry-util-http, opentelemetry-semantic-conventions, oauthlib, nvidia-nvtx-cu12, nvidia-nccl-cu12, nvidia-cusparse-cu12, nvidia-curand-cu12, nvidia-cufft-cu12, nvidia-cuda-runtime-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, mypy-extensions, multidict, marshmallow, markdown, lxml, jsonpointer, jsonpath-python, joblib, itsdangerous, importlib-resources, humanfriendly, httptools, h11, grpcio, greenlet, frozenlist, emoji, click, chroma-hnswlib, chardet, cachetools, blinker, bidict, bcrypt, backoff, attrs, asgiref, annotated-types, yarl, wsproto, uvicorn, typing-inspect, typer, SQLAlchemy, scikit-learn, rsa, requests-oauthlib, python-dateutil, pydantic, pyasn1-modules, opentelemetry-proto, nvidia-cusolver-cu12, nvidia-cudnn-cu12, nltk, langdetect, jsonpatch, importlib-metadata, googleapis-common-protos, flask, ecdsa, deprecated, coloredlogs, cffi, build, black, beautifulsoup4, anyio, aiosignal, watchfiles, tokenizers, starlette, simple-websocket, python-jose, posthog, opentelemetry-exporter-otlp-proto-common, opentelemetry-api, onnxruntime, langsmith, google-auth, flask_cors, dataclasses-json, cryptography, aiohttp, unstructured-client, transformers, torchvision, python-engineio, opentelemetry-sdk, opentelemetry-instrumentation, langchain-core, kubernetes, fastapi, unstructured, sentence_transformers, python-socketio, opentelemetry-instrumentation-asgi, opentelemetry-exporter-otlp-proto-grpc, langchain-community, opentelemetry-instrumentation-fastapi, langchain, chromadb Attempting uninstall: triton Found existing installation: triton 2.2.0 Uninstalling triton-2.2.0: Successfully uninstalled triton-2.2.0 Attempting uninstall: nvidia-nvtx-cu12 Found existing installation: nvidia-nvtx-cu12 12.3.101 Uninstalling nvidia-nvtx-cu12-12.3.101: Successfully uninstalled nvidia-nvtx-cu12-12.3.101 Attempting uninstall: nvidia-nccl-cu12 Found existing installation: nvidia-nccl-cu12 2.19.3 Uninstalling nvidia-nccl-cu12-2.19.3: Successfully uninstalled nvidia-nccl-cu12-2.19.3 Attempting uninstall: nvidia-cusparse-cu12 Found existing installation: nvidia-cusparse-cu12 12.2.0.103 Uninstalling nvidia-cusparse-cu12-12.2.0.103: Successfully uninstalled nvidia-cusparse-cu12-12.2.0.103 Attempting uninstall: nvidia-curand-cu12 Found existing installation: nvidia-curand-cu12 10.3.4.107 Uninstalling nvidia-curand-cu12-10.3.4.107: Successfully uninstalled nvidia-curand-cu12-10.3.4.107 Attempting uninstall: nvidia-cufft-cu12 Found existing installation: nvidia-cufft-cu12 11.0.12.1 Uninstalling nvidia-cufft-cu12-11.0.12.1: Successfully uninstalled nvidia-cufft-cu12-11.0.12.1 Attempting uninstall: nvidia-cuda-runtime-cu12 Found existing installation: nvidia-cuda-runtime-cu12 12.3.101 Uninstalling nvidia-cuda-runtime-cu12-12.3.101: Successfully uninstalled nvidia-cuda-runtime-cu12-12.3.101 Attempting uninstall: nvidia-cuda-nvrtc-cu12 Found existing installation: nvidia-cuda-nvrtc-cu12 12.3.107 Uninstalling nvidia-cuda-nvrtc-cu12-12.3.107: Successfully uninstalled nvidia-cuda-nvrtc-cu12-12.3.107 Attempting uninstall: nvidia-cuda-cupti-cu12 Found existing installation: nvidia-cuda-cupti-cu12 12.3.101 Uninstalling nvidia-cuda-cupti-cu12-12.3.101: Successfully uninstalled nvidia-cuda-cupti-cu12-12.3.101 Attempting uninstall: nvidia-cublas-cu12 Found existing installation: nvidia-cublas-cu12 12.3.4.1 Uninstalling nvidia-cublas-cu12-12.3.4.1: Successfully uninstalled nvidia-cublas-cu12-12.3.4.1 Attempting uninstall: nvidia-cusolver-cu12 Found existing installation: nvidia-cusolver-cu12 11.5.4.101 Uninstalling nvidia-cusolver-cu12-11.5.4.101: Successfully uninstalled nvidia-cusolver-cu12-11.5.4.101 Attempting uninstall: nvidia-cudnn-cu12 Found existing installation: nvidia-cudnn-cu12 8.9.7.29 Uninstalling nvidia-cudnn-cu12-8.9.7.29: Successfully uninstalled nvidia-cudnn-cu12-8.9.7.29 Successfully installed PyJWT-2.8.0 SQLAlchemy-2.0.25 Werkzeug-3.0.1 aiohttp-3.9.1 aiosignal-1.3.1 annotated-types-0.6.0 anyio-4.2.0 asgiref-3.7.2 attrs-23.2.0 backoff-2.2.1 bcrypt-4.1.2 beautifulsoup4-4.12.2 bidict-0.22.1 black-23.12.1 blinker-1.7.0 build-1.0.3 cachetools-5.3.2 cffi-1.16.0 chardet-5.2.0 chroma-hnswlib-0.7.3 chromadb-0.4.22 click-8.1.7 coloredlogs-15.0.1 cryptography-41.0.7 dataclasses-json-0.6.3 deprecated-1.2.14 docx2txt-0.8 ecdsa-0.18.0 emoji-2.9.0 fastapi-0.109.0 filetype-1.2.0 flask-3.0.0 flask_cors-4.0.0 flatbuffers-23.5.26 frozenlist-1.4.1 google-auth-2.26.2 googleapis-common-protos-1.62.0 greenlet-3.0.3 grpcio-1.60.0 h11-0.14.0 httptools-0.6.1 humanfriendly-10.0 importlib-metadata-6.11.0 importlib-resources-6.1.1 itsdangerous-2.1.2 joblib-1.3.2 jsonpatch-1.33 jsonpath-python-1.0.6 jsonpointer-2.4 kubernetes-29.0.0 langchain-0.1.0 langchain-community-0.0.13 langchain-core-0.1.11 langdetect-1.0.9 langsmith-0.0.80 lxml-5.1.0 markdown-3.5.2 marshmallow-3.20.2 mmh3-4.1.0 monotonic-1.6 multidict-6.0.4 mypy-extensions-1.0.0 nltk-3.8.1 nvidia-cublas-cu12-12.1.3.1 nvidia-cuda-cupti-cu12-12.1.105 nvidia-cuda-nvrtc-cu12-12.1.105 nvidia-cuda-runtime-cu12-12.1.105 nvidia-cudnn-cu12-8.9.2.26 nvidia-cufft-cu12-11.0.2.54 nvidia-curand-cu12-10.3.2.106 nvidia-cusolver-cu12-11.4.5.107 nvidia-cusparse-cu12-12.1.0.106 nvidia-nccl-cu12-2.18.1 nvidia-nvtx-cu12-12.1.105 oauthlib-3.2.2 onnxruntime-1.16.3 opentelemetry-api-1.22.0 opentelemetry-exporter-otlp-proto-common-1.22.0 opentelemetry-exporter-otlp-proto-grpc-1.22.0 opentelemetry-instrumentation-0.43b0 opentelemetry-instrumentation-asgi-0.43b0 opentelemetry-instrumentation-fastapi-0.43b0 opentelemetry-proto-1.22.0 opentelemetry-sdk-1.22.0 opentelemetry-semantic-conventions-0.43b0 opentelemetry-util-http-0.43b0 overrides-7.4.0 passlib-1.7.4 pathspec-0.12.1 peewee-3.17.0 pillow-10.2.0 platformdirs-4.1.0 posthog-3.3.1 protobuf-4.25.2 pulsar-client-3.4.0 pyasn1-0.5.1 pyasn1-modules-0.3.0 pycparser-2.21 pydantic-2.5.3 pydantic-core-2.14.6 pypdf-3.17.4 pypika-0.48.9 pyproject_hooks-1.0.0 python-dateutil-2.8.2 python-dotenv-1.0.0 python-engineio-4.8.2 python-iso639-2024.1.2 python-jose-3.3.0 python-magic-0.4.27 python-multipart-0.0.6 python-socketio-5.11.0 rapidfuzz-3.6.1 requests-oauthlib-1.3.1 rsa-4.9 safetensors-0.4.1 scikit-learn-1.3.2 scipy-1.11.4 sentence_transformers-2.2.2 sentencepiece-0.1.99 simple-websocket-1.0.0 six-1.16.0 sniffio-1.3.0 soupsieve-2.5 starlette-0.35.1 tabulate-0.9.0 tenacity-8.2.3 threadpoolctl-3.2.0 tokenizers-0.15.0 torchvision-0.16.2 transformers-4.36.2 triton-2.1.0 typer-0.9.0 typing-inspect-0.9.0 unstructured-0.12.0 unstructured-client-0.15.2 uuid-1.30 uvicorn-0.26.0 uvloop-0.19.0 watchfiles-0.21.0 websocket-client-1.7.0 wrapt-1.16.0 wsproto-1.2.0 yarl-1.9.4 zipp-3.17.0

Starting web-ui

Shell
$ ./start.sh
INFO:     Started server process [503184]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) 

Now I pointed my web brower to localhost:8080. I saw:

After signing up, I saw:

Clicking on New Chat, and then Select a model allowed me to select a model from the models I had already installed.

The llava model is usually good for describing images. However, while I had good success using my command-line utility with llava to describe images, Ollama-webui completely failed.

I tried the image shown to the right twice: once by referencing the image at a URL, and once from an absolute path on my local machine. The results were both horrible.

You
describe the image at this url: https://www.mslinn.com/images/mike/mikePersuades_500x500.webp

Ollama Llava:13b
  1. A man standing in front of a group of people, trying to persuade them. The group is composed of at least five individuals.
  2. The main subject has his hands placed on his hips as he engages with the crowd.
You
describe the image at /var/sitesUbuntu/www.mslinn.com/assets/images/mikePersuades.png

Ollama Llava:13b
A man standing in front of a group of people, trying to persuade them. The group is composed of at least five individuals.

References



* indicates a required field.

Please select the following to receive Mike Slinn’s newsletter:

You can unsubscribe at any time by clicking the link in the footer of emails.

Mike Slinn uses Mailchimp as his marketing platform. By clicking below to subscribe, you acknowledge that your information will be transferred to Mailchimp for processing. Learn more about Mailchimp’s privacy practices.