Published 2024-01-14.
Last modified 2024-01-17.
Time to read: 2 minutes.
This page is part of the
llm collection.
Ollama was discussed in the previous article. Ollama Web UI is a way to chat with Ollama models using a web browser.
Installation
The installation instructions push the user of Docker really hard.
As readers of my articles may know, I believe Docker is oversold.
I followed
these instructions,
which do not require Docker.
The instructions require Node.js and npm;
I wrote installation documentation for Node.js and npm,
in case you need it.
Shell
$ git clone https://github.com/ollama-webui/ollama-webui.git Cloning into 'ollama-webui'... remote: Enumerating objects: 5307, done. remote: Counting objects: 100% (1554/1554), done. remote: Compressing objects: 100% (544/544), done. remote: Total 5307 (delta 1112), reused 1059 (delta 1000), pack-reused 3753 Receiving objects: 100% (5307/5307), 27.32 MiB | 6.29 MiB/s, done. Resolving deltas: 100% (3157/3157), done.
$ cd ollama-webui/
$ cp example.env .env
$ cat .env # Ollama URL for the backend to connect # The path '/ollama/api' will be redirected to the specified backend URL OLLAMA_API_BASE_URL='http://localhost:11434/api'
OPENAI_API_BASE_URL=''
$ npm i # install all the dependencies in your project added 297 packages, and audited 298 packages in 13s
found 0 vulnerabilities
This next step, which builds the project, generates a lot of warnings.
Shell
$ npm run build > ollama-webui@0.0.1 build > vite build
vite v4.5.1 building SSR bundle for production... transforming (1) src/routes/+layout.svelte1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/auth/+page.svelte:64:4 A11y: <img> element should have an alt attribute 62: <div class="flex space-x-2"> 63: <div class=" self-center"> 64: <img src="/ollama.png" class=" w-8" /> ^ 65: </div> 66: </div> transforming (48) node_modules/@sveltejs/kit/src/runtime/server/data/index.js1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/admin/EditUserModal.svelte:152:1 Unused CSS selector ".tabs::-webkit-scrollbar" 150: } 151: 152: .tabs::-webkit-scrollbar { ^ 153: display: none; /* for Chrome, Safari and Opera */ 154: } 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/admin/EditUserModal.svelte:156:1 Unused CSS selector ".tabs" 154: } 155: 156: .tabs { ^ 157: -ms-overflow-style: none; /* IE and Edge */ 158: scrollbar-width: none; /* Firefox */ 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/admin/EditUserModal.svelte:161:1 Unused CSS selector "input[type='number']" 159: } 160: 161: input[type='number'] { ^ 162: -moz-appearance: textfield; /* Firefox */ 163: } 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:310:1 Unused CSS selector ".loading" 308: 309: <style> 310: .loading { ^ 311: display: inline-block; 312: clip-path: inset(0 1ch 0 0); 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:323:1 Unused CSS selector "pre[class*='language-']" 321: } 322: 323: pre[class*='language-'] { ^ 324: position: relative; 325: overflow: auto; 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:333:1 Unused CSS selector "pre[class*='language-'] button" 331: } 332: 333: pre[class*='language-'] button { ^ 334: position: absolute; 335: top: 5px; 1:39:47 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/routes/(app)/+layout.svelte:347:1 Unused CSS selector "pre[class*='language-'] button:hover" 345: } 346: 347: pre[class*='language-'] button:hover { ^ 348: cursor: pointer; 349: background-color: #bcbabb; transforming (105) node_modules/svelte-french-toast/dist/core/toast.js1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/documents/EditDocModal.svelte:131:1 Unused CSS selector ".tabs::-webkit-scrollbar" 129: } 130: 131: .tabs::-webkit-scrollbar { ^ 132: display: none; /* for Chrome, Safari and Opera */ 133: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/documents/EditDocModal.svelte:135:1 Unused CSS selector ".tabs" 133: } 134: 135: .tabs { ^ 136: -ms-overflow-style: none; /* IE and Edge */ 137: scrollbar-width: none; /* Firefox */ 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/documents/EditDocModal.svelte:140:1 Unused CSS selector "input[type='number']" 138: } 139: 140: input[type='number'] { ^ 141: -moz-appearance: textfield; /* Firefox */ 142: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/SettingsModal.svelte:1784:11 'toggleAuthHeader' is not defined 1782: type="button" 1783: on:click={() => { 1784: toggleAuthHeader(); ^ 1785: }} 1786: > 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/SettingsModal.svelte:2015:1 Unused CSS selector "input[type='number']" 2013: } 2014: 2015: input[type='number'] { ^ 2016: -moz-appearance: textfield; /* Firefox */ 2017: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/layout/Sidebar.svelte:69:6 A11y: <img> element should have an alt attribute 67: <div class="flex self-center"> 68: <div class="self-center mr-3.5"> 69: <img src="/ollama.png" class=" w-5 invert-[100%] rounded-full" /> ^ 70: </div> 71: 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:212:1 Unused CSS selector "input::-webkit-outer-spin-button" 210: 211: <style> 212: input::-webkit-outer-spin-button, ^ 213: input::-webkit-inner-spin-button { 214: /* display: none; <- Crashes Chrome on hover */ 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:213:1 Unused CSS selector "input::-webkit-inner-spin-button" 211: <style> 212: input::-webkit-outer-spin-button, 213: input::-webkit-inner-spin-button { ^ 214: /* display: none; <- Crashes Chrome on hover */ 215: -webkit-appearance: none; 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:219:1 Unused CSS selector ".tabs::-webkit-scrollbar" 217: } 218: 219: .tabs::-webkit-scrollbar { ^ 220: display: none; /* for Chrome, Safari and Opera */ 221: } 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:223:1 Unused CSS selector ".tabs" 221: } 222: 223: .tabs { ^ 224: -ms-overflow-style: none; /* IE and Edge */ 225: scrollbar-width: none; /* Firefox */ 1:39:51 PM [vite-plugin-svelte] /mnt/f/work/llm/ollama-webui/src/lib/components/chat/ShortcutsModal.svelte:228:1 Unused CSS selector "input[type='number']" 226: } 227: 228: input[type='number'] { ^ 229: -moz-appearance: textfield; /* Firefox */ 230: }
Nearly done:
Shell
$ cd backend
$ pip install -r requirements.txt -U Collecting fastapi (from -r requirements.txt (line 1)) Downloading fastapi-0.109.0-py3-none-any.whl.metadata (24 kB) Collecting pydantic (from -r requirements.txt (line 3)) Downloading pydantic-2.5.3-py3-none-any.whl.metadata (65 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.6/65.6 kB 1.9 MB/s eta 0:00:00 Collecting python-multipart (from -r requirements.txt (line 4)) Downloading python_multipart-0.0.6-py3-none-any.whl (45 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.7/45.7 kB 2.1 MB/s eta 0:00:00 Collecting flask (from -r requirements.txt (line 6)) Downloading flask-3.0.0-py3-none-any.whl.metadata (3.6 kB) Collecting flask_cors (from -r requirements.txt (line 7)) Downloading Flask_Cors-4.0.0-py2.py3-none-any.whl.metadata (5.4 kB) Collecting python-socketio (from -r requirements.txt (line 9)) Downloading python_socketio-5.11.0-py3-none-any.whl.metadata (3.2 kB) Collecting python-jose (from -r requirements.txt (line 10)) Downloading python_jose-3.3.0-py2.py3-none-any.whl (33 kB) Collecting uuid (from -r requirements.txt (line 12)) Downloading uuid-1.30.tar.gz (5.8 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: requests in /home/mslinn/venv/default/lib/python3.11/site-packages (from -r requirements.txt (line 14)) (2.31.0) Collecting aiohttp (from -r requirements.txt (line 15)) Downloading aiohttp-3.9.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.4 kB) Collecting peewee (from -r requirements.txt (line 16)) Downloading peewee-3.17.0.tar.gz (2.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.9/2.9 MB 57.8 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting bcrypt (from -r requirements.txt (line 17)) Downloading bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (9.5 kB) Collecting langchain (from -r requirements.txt (line 19)) Downloading langchain-0.1.0-py3-none-any.whl.metadata (13 kB) Collecting langchain-community (from -r requirements.txt (line 20)) Downloading langchain_community-0.0.13-py3-none-any.whl.metadata (7.5 kB) Collecting chromadb (from -r requirements.txt (line 21)) Downloading chromadb-0.4.22-py3-none-any.whl.metadata (7.3 kB) Collecting sentence_transformers (from -r requirements.txt (line 22)) Downloading sentence-transformers-2.2.2.tar.gz (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.0/86.0 kB 4.1 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting pypdf (from -r requirements.txt (line 23)) Downloading pypdf-3.17.4-py3-none-any.whl.metadata (7.5 kB) Collecting docx2txt (from -r requirements.txt (line 24)) Downloading docx2txt-0.8.tar.gz (2.8 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting unstructured (from -r requirements.txt (line 25)) Downloading unstructured-0.12.0-py3-none-any.whl.metadata (26 kB) Collecting markdown (from -r requirements.txt (line 26)) Downloading Markdown-3.5.2-py3-none-any.whl.metadata (7.0 kB) Collecting PyJWT (from -r requirements.txt (line 28)) Downloading PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB) Collecting black (from -r requirements.txt (line 31)) Downloading black-23.12.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (68 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 69.0/69.0 kB 2.5 MB/s eta 0:00:00 Collecting uvicorn[standard] (from -r requirements.txt (line 2)) Downloading uvicorn-0.26.0-py3-none-any.whl.metadata (6.4 kB) Collecting passlib[bcrypt] (from -r requirements.txt (line 11)) Downloading passlib-1.7.4-py2.py3-none-any.whl (525 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 525.6/525.6 kB 25.1 MB/s eta 0:00:00 Collecting starlette<0.36.0,>=0.35.0 (from fastapi->-r requirements.txt (line 1)) Downloading starlette-0.35.1-py3-none-any.whl.metadata (5.8 kB) Requirement already satisfied: typing-extensions>=4.8.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from fastapi->-r requirements.txt (line 1)) (4.9.0) Collecting click>=7.0 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB) Collecting h11>=0.8 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading h11-0.14.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 3.0 MB/s eta 0:00:00 Collecting httptools>=0.5.0 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading httptools-0.6.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.6 kB) Collecting python-dotenv>=0.13 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading python_dotenv-1.0.0-py3-none-any.whl (19 kB) Requirement already satisfied: pyyaml>=5.1 in /home/mslinn/venv/default/lib/python3.11/site-packages (from uvicorn[standard]->-r requirements.txt (line 2)) (6.0.1) Collecting uvloop!=0.15.0,!=0.15.1,>=0.14.0 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading uvloop-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB) Collecting watchfiles>=0.13 (from uvicorn[standard]->-r requirements.txt (line 2)) Downloading watchfiles-0.21.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB) Requirement already satisfied: websockets>=10.4 in /home/mslinn/venv/default/lib/python3.11/site-packages (from uvicorn[standard]->-r requirements.txt (line 2)) (12.0) Collecting annotated-types>=0.4.0 (from pydantic->-r requirements.txt (line 3)) Downloading annotated_types-0.6.0-py3-none-any.whl.metadata (12 kB) Collecting pydantic-core==2.14.6 (from pydantic->-r requirements.txt (line 3)) Downloading pydantic_core-2.14.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB) Collecting Werkzeug>=3.0.0 (from flask->-r requirements.txt (line 6)) Downloading werkzeug-3.0.1-py3-none-any.whl.metadata (4.1 kB) Requirement already satisfied: Jinja2>=3.1.2 in /home/mslinn/venv/default/lib/python3.11/site-packages (from flask->-r requirements.txt (line 6)) (3.1.3) Collecting itsdangerous>=2.1.2 (from flask->-r requirements.txt (line 6)) Downloading itsdangerous-2.1.2-py3-none-any.whl (15 kB) Collecting blinker>=1.6.2 (from flask->-r requirements.txt (line 6)) Downloading blinker-1.7.0-py3-none-any.whl.metadata (1.9 kB) Collecting bidict>=0.21.0 (from python-socketio->-r requirements.txt (line 9)) Downloading bidict-0.22.1-py3-none-any.whl (35 kB) Collecting python-engineio>=4.8.0 (from python-socketio->-r requirements.txt (line 9)) Downloading python_engineio-4.8.2-py3-none-any.whl.metadata (2.2 kB) Collecting ecdsa!=0.15 (from python-jose->-r requirements.txt (line 10)) Downloading ecdsa-0.18.0-py2.py3-none-any.whl (142 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 142.9/142.9 kB 7.4 MB/s eta 0:00:00 Collecting rsa (from python-jose->-r requirements.txt (line 10)) Downloading rsa-4.9-py3-none-any.whl (34 kB) Collecting pyasn1 (from python-jose->-r requirements.txt (line 10)) Downloading pyasn1-0.5.1-py2.py3-none-any.whl.metadata (8.6 kB) Requirement already satisfied: charset-normalizer<4,>=2 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (3.3.2) Requirement already satisfied: idna<4,>=2.5 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (3.6) Requirement already satisfied: urllib3<3,>=1.21.1 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in /home/mslinn/venv/default/lib/python3.11/site-packages (from requests->-r requirements.txt (line 14)) (2023.11.17) Collecting attrs>=17.3.0 (from aiohttp->-r requirements.txt (line 15)) Downloading attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB) Collecting multidict<7.0,>=4.5 (from aiohttp->-r requirements.txt (line 15)) Downloading multidict-6.0.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (117 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.4/117.4 kB 6.8 MB/s eta 0:00:00 Collecting yarl<2.0,>=1.0 (from aiohttp->-r requirements.txt (line 15)) Downloading yarl-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (31 kB) Collecting frozenlist>=1.1.1 (from aiohttp->-r requirements.txt (line 15)) Downloading frozenlist-1.4.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB) Collecting aiosignal>=1.1.2 (from aiohttp->-r requirements.txt (line 15)) Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB) Collecting SQLAlchemy<3,>=1.4 (from langchain->-r requirements.txt (line 19)) Downloading SQLAlchemy-2.0.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.6 kB) Collecting dataclasses-json<0.7,>=0.5.7 (from langchain->-r requirements.txt (line 19)) Downloading dataclasses_json-0.6.3-py3-none-any.whl.metadata (25 kB) Collecting jsonpatch<2.0,>=1.33 (from langchain->-r requirements.txt (line 19)) Downloading jsonpatch-1.33-py2.py3-none-any.whl.metadata (3.0 kB) Collecting langchain-core<0.2,>=0.1.7 (from langchain->-r requirements.txt (line 19)) Downloading langchain_core-0.1.11-py3-none-any.whl.metadata (4.2 kB) Collecting langsmith<0.1.0,>=0.0.77 (from langchain->-r requirements.txt (line 19)) Downloading langsmith-0.0.80-py3-none-any.whl.metadata (10 kB) Requirement already satisfied: numpy<2,>=1 in /home/mslinn/venv/default/lib/python3.11/site-packages (from langchain->-r requirements.txt (line 19)) (1.26.3) Collecting tenacity<9.0.0,>=8.1.0 (from langchain->-r requirements.txt (line 19)) Downloading tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB) Collecting build>=1.0.3 (from chromadb->-r requirements.txt (line 21)) Downloading build-1.0.3-py3-none-any.whl.metadata (4.2 kB) Collecting chroma-hnswlib==0.7.3 (from chromadb->-r requirements.txt (line 21)) Downloading chroma_hnswlib-0.7.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (252 bytes) Collecting posthog>=2.4.0 (from chromadb->-r requirements.txt (line 21)) Downloading posthog-3.3.1-py2.py3-none-any.whl.metadata (2.0 kB) Collecting pulsar-client>=3.1.0 (from chromadb->-r requirements.txt (line 21)) Downloading pulsar_client-3.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.0 kB) Collecting onnxruntime>=1.14.1 (from chromadb->-r requirements.txt (line 21)) Downloading onnxruntime-1.16.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.3 kB) Collecting opentelemetry-api>=1.2.0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_api-1.22.0-py3-none-any.whl.metadata (1.4 kB) Collecting opentelemetry-exporter-otlp-proto-grpc>=1.2.0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_exporter_otlp_proto_grpc-1.22.0-py3-none-any.whl.metadata (2.4 kB) Collecting opentelemetry-instrumentation-fastapi>=0.41b0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_instrumentation_fastapi-0.43b0-py3-none-any.whl.metadata (2.3 kB) Collecting opentelemetry-sdk>=1.2.0 (from chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_sdk-1.22.0-py3-none-any.whl.metadata (1.5 kB) Collecting tokenizers>=0.13.2 (from chromadb->-r requirements.txt (line 21)) Downloading tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB) Collecting pypika>=0.48.9 (from chromadb->-r requirements.txt (line 21)) Downloading PyPika-0.48.9.tar.gz (67 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.3/67.3 kB 3.2 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: tqdm>=4.65.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from chromadb->-r requirements.txt (line 21)) (4.66.1) Collecting overrides>=7.3.1 (from chromadb->-r requirements.txt (line 21)) Downloading overrides-7.4.0-py3-none-any.whl.metadata (5.7 kB) Collecting importlib-resources (from chromadb->-r requirements.txt (line 21)) Downloading importlib_resources-6.1.1-py3-none-any.whl.metadata (4.1 kB) Collecting grpcio>=1.58.0 (from chromadb->-r requirements.txt (line 21)) Downloading grpcio-1.60.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) Collecting typer>=0.9.0 (from chromadb->-r requirements.txt (line 21)) Downloading typer-0.9.0-py3-none-any.whl (45 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.9/45.9 kB 4.5 MB/s eta 0:00:00 Collecting kubernetes>=28.1.0 (from chromadb->-r requirements.txt (line 21)) Downloading kubernetes-29.0.0-py2.py3-none-any.whl.metadata (1.5 kB) Collecting mmh3>=4.0.1 (from chromadb->-r requirements.txt (line 21)) Downloading mmh3-4.1.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (13 kB) Collecting transformers<5.0.0,>=4.6.0 (from sentence_transformers->-r requirements.txt (line 22)) Downloading transformers-4.36.2-py3-none-any.whl.metadata (126 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.8/126.8 kB 6.3 MB/s eta 0:00:00 Requirement already satisfied: torch>=1.6.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from sentence_transformers->-r requirements.txt (line 22)) (2.1.2) Collecting torchvision (from sentence_transformers->-r requirements.txt (line 22)) Downloading torchvision-0.16.2-cp311-cp311-manylinux1_x86_64.whl.metadata (6.6 kB) Collecting scikit-learn (from sentence_transformers->-r requirements.txt (line 22)) Downloading scikit_learn-1.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting scipy (from sentence_transformers->-r requirements.txt (line 22)) Downloading scipy-1.11.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.4/60.4 kB 2.7 MB/s eta 0:00:00 Collecting nltk (from sentence_transformers->-r requirements.txt (line 22)) Downloading nltk-3.8.1-py3-none-any.whl (1.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 59.0 MB/s eta 0:00:00 Collecting sentencepiece (from sentence_transformers->-r requirements.txt (line 22)) Downloading sentencepiece-0.1.99-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 37.3 MB/s eta 0:00:00 Requirement already satisfied: huggingface-hub>=0.4.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from sentence_transformers->-r requirements.txt (line 22)) (0.20.2) Collecting chardet (from unstructured->-r requirements.txt (line 25)) Downloading chardet-5.2.0-py3-none-any.whl.metadata (3.4 kB) Collecting filetype (from unstructured->-r requirements.txt (line 25)) Downloading filetype-1.2.0-py2.py3-none-any.whl (19 kB) Collecting python-magic (from unstructured->-r requirements.txt (line 25)) Downloading python_magic-0.4.27-py2.py3-none-any.whl (13 kB) Collecting lxml (from unstructured->-r requirements.txt (line 25)) Downloading lxml-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.5 kB) Collecting tabulate (from unstructured->-r requirements.txt (line 25)) Downloading tabulate-0.9.0-py3-none-any.whl (35 kB) Collecting beautifulsoup4 (from unstructured->-r requirements.txt (line 25)) Downloading beautifulsoup4-4.12.2-py3-none-any.whl (142 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.0/143.0 kB 9.7 MB/s eta 0:00:00 Collecting emoji (from unstructured->-r requirements.txt (line 25)) Downloading emoji-2.9.0-py2.py3-none-any.whl.metadata (5.3 kB) Collecting python-iso639 (from unstructured->-r requirements.txt (line 25)) Downloading python_iso639-2024.1.2-py3-none-any.whl.metadata (13 kB) Collecting langdetect (from unstructured->-r requirements.txt (line 25)) Downloading langdetect-1.0.9.tar.gz (981 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 981.5/981.5 kB 32.6 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting rapidfuzz (from unstructured->-r requirements.txt (line 25)) Downloading rapidfuzz-3.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting backoff (from unstructured->-r requirements.txt (line 25)) Downloading backoff-2.2.1-py3-none-any.whl (15 kB) Collecting unstructured-client (from unstructured->-r requirements.txt (line 25)) Downloading unstructured_client-0.15.2-py3-none-any.whl.metadata (4.9 kB) Collecting wrapt (from unstructured->-r requirements.txt (line 25)) Downloading wrapt-1.16.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB) Collecting cryptography>=3.4.0 (from pyjwt[crypto]->-r requirements.txt (line 29)) Downloading cryptography-41.0.7-cp37-abi3-manylinux_2_28_x86_64.whl.metadata (5.2 kB) Collecting mypy-extensions>=0.4.3 (from black->-r requirements.txt (line 31)) Downloading mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB) Requirement already satisfied: packaging>=22.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from black->-r requirements.txt (line 31)) (23.2) Collecting pathspec>=0.9.0 (from black->-r requirements.txt (line 31)) Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB) Collecting platformdirs>=2 (from black->-r requirements.txt (line 31)) Downloading platformdirs-4.1.0-py3-none-any.whl.metadata (11 kB) Collecting pyproject_hooks (from build>=1.0.3->chromadb->-r requirements.txt (line 21)) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Collecting cffi>=1.12 (from cryptography>=3.4.0->pyjwt[crypto]->-r requirements.txt (line 29)) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB) Collecting marshmallow<4.0.0,>=3.18.0 (from dataclasses-json<0.7,>=0.5.7->langchain->-r requirements.txt (line 19)) Downloading marshmallow-3.20.2-py3-none-any.whl.metadata (7.5 kB) Collecting typing-inspect<1,>=0.4.0 (from dataclasses-json<0.7,>=0.5.7->langchain->-r requirements.txt (line 19)) Downloading typing_inspect-0.9.0-py3-none-any.whl.metadata (1.5 kB) Collecting six>=1.9.0 (from ecdsa!=0.15->python-jose->-r requirements.txt (line 10)) Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) Requirement already satisfied: filelock in /home/mslinn/venv/default/lib/python3.11/site-packages (from huggingface-hub>=0.4.0->sentence_transformers->-r requirements.txt (line 22)) (3.13.1) Requirement already satisfied: fsspec>=2023.5.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from huggingface-hub>=0.4.0->sentence_transformers->-r requirements.txt (line 22)) (2023.12.2) Requirement already satisfied: MarkupSafe>=2.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from Jinja2>=3.1.2->flask->-r requirements.txt (line 6)) (2.1.3) Collecting jsonpointer>=1.9 (from jsonpatch<2.0,>=1.33->langchain->-r requirements.txt (line 19)) Downloading jsonpointer-2.4-py2.py3-none-any.whl.metadata (2.5 kB) Collecting python-dateutil>=2.5.3 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 15.0 MB/s eta 0:00:00 Collecting google-auth>=1.0.1 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading google_auth-2.26.2-py2.py3-none-any.whl.metadata (4.7 kB) Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading websocket_client-1.7.0-py3-none-any.whl.metadata (7.9 kB) Collecting requests-oauthlib (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting oauthlib>=3.2.2 (from kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.7/151.7 kB 6.2 MB/s eta 0:00:00 Collecting anyio<5,>=3 (from langchain-core<0.2,>=0.1.7->langchain->-r requirements.txt (line 19)) Downloading anyio-4.2.0-py3-none-any.whl.metadata (4.6 kB) Collecting coloredlogs (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 2.4 MB/s eta 0:00:00 Collecting flatbuffers (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading flatbuffers-23.5.26-py2.py3-none-any.whl.metadata (850 bytes) Collecting protobuf (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading protobuf-4.25.2-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes) Requirement already satisfied: sympy in /home/mslinn/venv/default/lib/python3.11/site-packages (from onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) (1.12) Collecting deprecated>=1.2.6 (from opentelemetry-api>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB) Collecting importlib-metadata<7.0,>=6.0 (from opentelemetry-api>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading importlib_metadata-6.11.0-py3-none-any.whl.metadata (4.9 kB) Collecting googleapis-common-protos~=1.52 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading googleapis_common_protos-1.62.0-py2.py3-none-any.whl.metadata (1.5 kB) Collecting opentelemetry-exporter-otlp-proto-common==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_exporter_otlp_proto_common-1.22.0-py3-none-any.whl.metadata (1.9 kB) Collecting opentelemetry-proto==1.22.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_proto-1.22.0-py3-none-any.whl.metadata (2.3 kB) Collecting opentelemetry-instrumentation-asgi==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_instrumentation_asgi-0.43b0-py3-none-any.whl.metadata (2.1 kB) Collecting opentelemetry-instrumentation==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_instrumentation-0.43b0-py3-none-any.whl.metadata (5.9 kB) Collecting opentelemetry-semantic-conventions==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_semantic_conventions-0.43b0-py3-none-any.whl.metadata (2.3 kB) Collecting opentelemetry-util-http==0.43b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading opentelemetry_util_http-0.43b0-py3-none-any.whl.metadata (2.5 kB) Requirement already satisfied: setuptools>=16.0 in /home/mslinn/venv/default/lib/python3.11/site-packages (from opentelemetry-instrumentation==0.43b0->opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) (69.0.3) Collecting asgiref~=3.0 (from opentelemetry-instrumentation-asgi==0.43b0->opentelemetry-instrumentation-fastapi>=0.41b0->chromadb->-r requirements.txt (line 21)) Downloading asgiref-3.7.2-py3-none-any.whl.metadata (9.2 kB) Collecting monotonic>=1.5 (from posthog>=2.4.0->chromadb->-r requirements.txt (line 21)) Downloading monotonic-1.6-py2.py3-none-any.whl (8.2 kB) Collecting simple-websocket>=0.10.0 (from python-engineio>=4.8.0->python-socketio->-r requirements.txt (line 9)) Downloading simple_websocket-1.0.0-py3-none-any.whl.metadata (1.3 kB) Collecting greenlet!=0.4.17 (from SQLAlchemy<3,>=1.4->langchain->-r requirements.txt (line 19)) Downloading greenlet-3.0.3-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.8 kB) Requirement already satisfied: networkx in /home/mslinn/venv/default/lib/python3.11/site-packages (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) (3.2.1) Collecting nvidia-cuda-nvrtc-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cuda_nvrtc_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (23.7 MB) Collecting nvidia-cuda-runtime-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cuda_runtime_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (823 kB) Collecting nvidia-cuda-cupti-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cuda_cupti_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (14.1 MB) Collecting nvidia-cudnn-cu12==8.9.2.26 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl.metadata (1.6 kB) Collecting nvidia-cublas-cu12==12.1.3.1 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cublas_cu12-12.1.3.1-py3-none-manylinux1_x86_64.whl (410.6 MB) Collecting nvidia-cufft-cu12==11.0.2.54 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cufft_cu12-11.0.2.54-py3-none-manylinux1_x86_64.whl (121.6 MB) Collecting nvidia-curand-cu12==10.3.2.106 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_curand_cu12-10.3.2.106-py3-none-manylinux1_x86_64.whl (56.5 MB) Collecting nvidia-cusolver-cu12==11.4.5.107 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cusolver_cu12-11.4.5.107-py3-none-manylinux1_x86_64.whl (124.2 MB) Collecting nvidia-cusparse-cu12==12.1.0.106 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_cusparse_cu12-12.1.0.106-py3-none-manylinux1_x86_64.whl (196.0 MB) Collecting nvidia-nccl-cu12==2.18.1 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_nccl_cu12-2.18.1-py3-none-manylinux1_x86_64.whl (209.8 MB) Collecting nvidia-nvtx-cu12==12.1.105 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached nvidia_nvtx_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (99 kB) Collecting triton==2.1.0 (from torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) Using cached triton-2.1.0-0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (1.3 kB) Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/mslinn/venv/default/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch>=1.6.0->sentence_transformers->-r requirements.txt (line 22)) (12.3.101) Requirement already satisfied: regex!=2019.12.17 in /home/mslinn/venv/default/lib/python3.11/site-packages (from transformers<5.0.0,>=4.6.0->sentence_transformers->-r requirements.txt (line 22)) (2023.12.25) Collecting safetensors>=0.3.1 (from transformers<5.0.0,>=4.6.0->sentence_transformers->-r requirements.txt (line 22)) Downloading safetensors-0.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB) Collecting soupsieve>1.2 (from beautifulsoup4->unstructured->-r requirements.txt (line 25)) Downloading soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB) Collecting joblib (from nltk->sentence_transformers->-r requirements.txt (line 22)) Downloading joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB) Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence_transformers->-r requirements.txt (line 22)) Downloading threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB) Collecting pillow!=8.3.*,>=5.3.0 (from torchvision->sentence_transformers->-r requirements.txt (line 22)) Downloading pillow-10.2.0-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (9.7 kB) Collecting jsonpath-python>=1.0.6 (from unstructured-client->unstructured->-r requirements.txt (line 25)) Downloading jsonpath_python-1.0.6-py3-none-any.whl (7.6 kB) Collecting sniffio>=1.1 (from anyio<5,>=3->langchain-core<0.2,>=0.1.7->langchain->-r requirements.txt (line 19)) Downloading sniffio-1.3.0-py3-none-any.whl (10 kB) Collecting pycparser (from cffi>=1.12->cryptography>=3.4.0->pyjwt[crypto]->-r requirements.txt (line 29)) Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 8.0 MB/s eta 0:00:00 Collecting cachetools<6.0,>=2.0.0 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading cachetools-5.3.2-py3-none-any.whl.metadata (5.2 kB) Collecting pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb->-r requirements.txt (line 21)) Downloading pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 9.7 MB/s eta 0:00:00 Collecting zipp>=0.5 (from importlib-metadata<7.0,>=6.0->opentelemetry-api>=1.2.0->chromadb->-r requirements.txt (line 21)) Downloading zipp-3.17.0-py3-none-any.whl.metadata (3.7 kB) Collecting wsproto (from simple-websocket>=0.10.0->python-engineio>=4.8.0->python-socketio->-r requirements.txt (line 9)) Downloading wsproto-1.2.0-py3-none-any.whl (24 kB) Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) Downloading humanfriendly-10.0-py2.py3-none-any.whl (86 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 4.7 MB/s eta 0:00:00 Requirement already satisfied: mpmath>=0.19 in /home/mslinn/venv/default/lib/python3.11/site-packages (from sympy->onnxruntime>=1.14.1->chromadb->-r requirements.txt (line 21)) (1.3.0) Downloading fastapi-0.109.0-py3-none-any.whl (92 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 92.0/92.0 kB 5.3 MB/s eta 0:00:00 Downloading pydantic-2.5.3-py3-none-any.whl (381 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 381.9/381.9 kB 16.8 MB/s eta 0:00:00 Downloading pydantic_core-2.14.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 41.9 MB/s eta 0:00:00 Downloading flask-3.0.0-py3-none-any.whl (99 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 99.7/99.7 kB 4.8 MB/s eta 0:00:00 Downloading Flask_Cors-4.0.0-py2.py3-none-any.whl (14 kB) Downloading python_socketio-5.11.0-py3-none-any.whl (75 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.4/75.4 kB 2.8 MB/s eta 0:00:00 Downloading aiohttp-3.9.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 37.3 MB/s eta 0:00:00 Downloading bcrypt-4.1.2-cp39-abi3-manylinux_2_28_x86_64.whl (698 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 698.9/698.9 kB 25.4 MB/s eta 0:00:00 Downloading langchain-0.1.0-py3-none-any.whl (797 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 798.0/798.0 kB 32.2 MB/s eta 0:00:00 Downloading langchain_community-0.0.13-py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 42.9 MB/s eta 0:00:00 Downloading chromadb-0.4.22-py3-none-any.whl (509 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 509.0/509.0 kB 17.4 MB/s eta 0:00:00 Downloading chroma_hnswlib-0.7.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 46.4 MB/s eta 0:00:00 Downloading pypdf-3.17.4-py3-none-any.whl (278 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.2/278.2 kB 22.0 MB/s eta 0:00:00 Downloading unstructured-0.12.0-py3-none-any.whl (1.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 45.8 MB/s eta 0:00:00 Downloading Markdown-3.5.2-py3-none-any.whl (103 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.9/103.9 kB 4.3 MB/s eta 0:00:00 Downloading PyJWT-2.8.0-py3-none-any.whl (22 kB) Downloading black-23.12.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 36.5 MB/s eta 0:00:00 Downloading annotated_types-0.6.0-py3-none-any.whl (12 kB) Downloading attrs-23.2.0-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.8/60.8 kB 2.8 MB/s eta 0:00:00 Downloading blinker-1.7.0-py3-none-any.whl (13 kB) Downloading build-1.0.3-py3-none-any.whl (18 kB) Downloading click-8.1.7-py3-none-any.whl (97 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 5.9 MB/s eta 0:00:00 Downloading cryptography-41.0.7-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 45.6 MB/s eta 0:00:00 Downloading dataclasses_json-0.6.3-py3-none-any.whl (28 kB) Downloading frozenlist-1.4.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (272 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 272.3/272.3 kB 23.7 MB/s eta 0:00:00 Downloading grpcio-1.60.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 37.5 MB/s eta 0:00:00 Downloading httptools-0.6.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (318 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 318.5/318.5 kB 11.5 MB/s eta 0:00:00 Downloading jsonpatch-1.33-py2.py3-none-any.whl (12 kB) Downloading kubernetes-29.0.0-py2.py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 27.8 MB/s eta 0:00:00 Downloading langchain_core-0.1.11-py3-none-any.whl (218 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 218.6/218.6 kB 9.0 MB/s eta 0:00:00 Downloading langsmith-0.0.80-py3-none-any.whl (48 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.3/48.3 kB 2.2 MB/s eta 0:00:00 Downloading mmh3-4.1.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (67 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.8/67.8 kB 3.6 MB/s eta 0:00:00 Downloading onnxruntime-1.16.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.4/6.4 MB 28.6 MB/s eta 0:00:00 Downloading opentelemetry_api-1.22.0-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.9/57.9 kB 2.5 MB/s eta 0:00:00 Downloading opentelemetry_exporter_otlp_proto_grpc-1.22.0-py3-none-any.whl (18 kB) Downloading opentelemetry_exporter_otlp_proto_common-1.22.0-py3-none-any.whl (17 kB) Downloading opentelemetry_proto-1.22.0-py3-none-any.whl (50 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 50.8/50.8 kB 2.2 MB/s eta 0:00:00 Downloading opentelemetry_instrumentation_fastapi-0.43b0-py3-none-any.whl (11 kB) Downloading opentelemetry_instrumentation-0.43b0-py3-none-any.whl (28 kB) Downloading opentelemetry_instrumentation_asgi-0.43b0-py3-none-any.whl (14 kB) Downloading opentelemetry_semantic_conventions-0.43b0-py3-none-any.whl (36 kB) Downloading opentelemetry_util_http-0.43b0-py3-none-any.whl (6.9 kB) Downloading opentelemetry_sdk-1.22.0-py3-none-any.whl (105 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 105.6/105.6 kB 6.3 MB/s eta 0:00:00 Downloading overrides-7.4.0-py3-none-any.whl (17 kB) Downloading pathspec-0.12.1-py3-none-any.whl (31 kB) Downloading platformdirs-4.1.0-py3-none-any.whl (17 kB) Downloading posthog-3.3.1-py2.py3-none-any.whl (40 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.6/40.6 kB 4.2 MB/s eta 0:00:00 Downloading pulsar_client-3.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.4/5.4 MB 30.0 MB/s eta 0:00:00 Downloading python_engineio-4.8.2-py3-none-any.whl (57 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.4/57.4 kB 1.4 MB/s eta 0:00:00 Downloading SQLAlchemy-2.0.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 29.2 MB/s eta 0:00:00 Downloading starlette-0.35.1-py3-none-any.whl (71 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.1/71.1 kB 3.7 MB/s eta 0:00:00 Downloading tenacity-8.2.3-py3-none-any.whl (24 kB) Downloading tokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 37.2 MB/s eta 0:00:00 Using cached nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl (731.7 MB) Using cached triton-2.1.0-0-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89.2 MB) Downloading transformers-4.36.2-py3-none-any.whl (8.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.2/8.2 MB 30.2 MB/s eta 0:00:00 Downloading uvicorn-0.26.0-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.5/60.5 kB 3.4 MB/s eta 0:00:00 Downloading uvloop-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.5/3.5 MB 35.9 MB/s eta 0:00:00 Downloading watchfiles-0.21.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 30.7 MB/s eta 0:00:00 Downloading werkzeug-3.0.1-py3-none-any.whl (226 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 226.7/226.7 kB 6.3 MB/s eta 0:00:00 Downloading wrapt-1.16.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (80 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.7/80.7 kB 4.3 MB/s eta 0:00:00 Downloading yarl-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (328 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 328.1/328.1 kB 14.8 MB/s eta 0:00:00 Downloading chardet-5.2.0-py3-none-any.whl (199 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 7.8 MB/s eta 0:00:00 Downloading emoji-2.9.0-py2.py3-none-any.whl (397 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 397.5/397.5 kB 14.0 MB/s eta 0:00:00 Downloading importlib_resources-6.1.1-py3-none-any.whl (33 kB) Downloading lxml-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.1/8.1 MB 51.1 MB/s eta 0:00:00 Downloading pyasn1-0.5.1-py2.py3-none-any.whl (84 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.9/84.9 kB 3.8 MB/s eta 0:00:00 Downloading python_iso639-2024.1.2-py3-none-any.whl (274 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 274.7/274.7 kB 12.2 MB/s eta 0:00:00 Downloading rapidfuzz-3.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 37.6 MB/s eta 0:00:00 Downloading scikit_learn-1.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (10.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.9/10.9 MB 30.6 MB/s eta 0:00:00 Downloading scipy-1.11.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 36.4/36.4 MB 29.5 MB/s eta 0:00:00 Downloading torchvision-0.16.2-cp311-cp311-manylinux1_x86_64.whl (6.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.8/6.8 MB 33.4 MB/s eta 0:00:00 Downloading unstructured_client-0.15.2-py3-none-any.whl (20 kB) Downloading anyio-4.2.0-py3-none-any.whl (85 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.5/85.5 kB 23.0 MB/s eta 0:00:00 Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 464.8/464.8 kB 39.8 MB/s eta 0:00:00 Downloading Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB) Downloading google_auth-2.26.2-py2.py3-none-any.whl (186 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 186.5/186.5 kB 27.6 MB/s eta 0:00:00 Downloading googleapis_common_protos-1.62.0-py2.py3-none-any.whl (228 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 228.7/228.7 kB 31.9 MB/s eta 0:00:00 Downloading greenlet-3.0.3-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (620 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 620.0/620.0 kB 39.7 MB/s eta 0:00:00 Downloading importlib_metadata-6.11.0-py3-none-any.whl (23 kB) Downloading joblib-1.3.2-py3-none-any.whl (302 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 302.2/302.2 kB 35.7 MB/s eta 0:00:00 Downloading jsonpointer-2.4-py2.py3-none-any.whl (7.8 kB) Downloading marshmallow-3.20.2-py3-none-any.whl (49 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.4/49.4 kB 18.6 MB/s eta 0:00:00 Downloading pillow-10.2.0-cp311-cp311-manylinux_2_28_x86_64.whl (4.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 41.7 MB/s eta 0:00:00 Downloading protobuf-4.25.2-cp37-abi3-manylinux2014_x86_64.whl (294 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 31.8 MB/s eta 0:00:00 Downloading safetensors-0.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 31.7 MB/s eta 0:00:00 Downloading simple_websocket-1.0.0-py3-none-any.whl (13 kB) Downloading soupsieve-2.5-py3-none-any.whl (36 kB) Downloading threadpoolctl-3.2.0-py3-none-any.whl (15 kB) Downloading typing_inspect-0.9.0-py3-none-any.whl (8.8 kB) Downloading websocket_client-1.7.0-py3-none-any.whl (58 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.5/58.5 kB 22.3 MB/s eta 0:00:00 Downloading flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB) Downloading asgiref-3.7.2-py3-none-any.whl (24 kB) Downloading cachetools-5.3.2-py3-none-any.whl (9.3 kB) Downloading zipp-3.17.0-py3-none-any.whl (7.4 kB) Building wheels for collected packages: uuid, peewee, sentence_transformers, docx2txt, pypika, langdetect Building wheel for uuid (pyproject.toml) ... done Created wheel for uuid: filename=uuid-1.30-py3-none-any.whl size=6479 sha256=4223c744be8113c0dc882dfd15ad1165bb049542ff97ee2934c953ef0810c511 Stored in directory: /home/mslinn/.cache/pip/wheels/e0/01/df/bd20df409bd81f8b99e6cd343c5f49731dc0a20eefefdafae0 Building wheel for peewee (pyproject.toml) ... done Created wheel for peewee: filename=peewee-3.17.0-cp311-cp311-linux_x86_64.whl size=771047 sha256=a939a40468afc2b8508e3845fbb70a929d888422cdb1a6a8a17e830fa9bc73b9 Stored in directory: /home/mslinn/.cache/pip/wheels/02/20/23/74a10d0cd31f5d41c19b92ddf4c138ceff01b9f4675f19dbf5 Building wheel for sentence_transformers (pyproject.toml) ... done Created wheel for sentence_transformers: filename=sentence_transformers-2.2.2-py3-none-any.whl size=125923 sha256=e01fac84fc5b8e1729fe40189242bbe8c4e10a9586faa516a833f0a6c4066394 Stored in directory: /home/mslinn/.cache/pip/wheels/ff/27/bf/ffba8b318b02d7f691a57084ee154e26ed24d012b0c7805881 Building wheel for docx2txt (pyproject.toml) ... done Created wheel for docx2txt: filename=docx2txt-0.8-py3-none-any.whl size=3960 sha256=1202b50098db6b00c964e64feb9c8722f50d0a1a512b3eff4f1e454ffa96924b Stored in directory: /home/mslinn/.cache/pip/wheels/0f/0e/7a/3094a4ceefe657bff7e12dd9592a9d5b6487ef4338ace0afa6 Building wheel for pypika (pyproject.toml) ... done Created wheel for pypika: filename=PyPika-0.48.9-py2.py3-none-any.whl size=53723 sha256=ef69fbe603fb2427ddeeb2811da3eec124e6a72793f6318c3e605af63849620d Stored in directory: /home/mslinn/.cache/pip/wheels/a3/01/bd/4c40ceb9d5354160cb186dcc153360f4ab7eb23e2b24daf96d Building wheel for langdetect (pyproject.toml) ... done Created wheel for langdetect: filename=langdetect-1.0.9-py3-none-any.whl size=993225 sha256=41379f27ebd38beecd305466a334035621ad4ce4546e5d300e249033e7c99641 Stored in directory: /home/mslinn/.cache/pip/wheels/0a/f2/b2/e5ca405801e05eb7c8ed5b3b4bcf1fcabcd6272c167640072e Successfully built uuid peewee sentence_transformers docx2txt pypika langdetect Installing collected packages: uuid, sentencepiece, pypika, peewee, passlib, monotonic, mmh3, flatbuffers, filetype, docx2txt, zipp, wrapt, Werkzeug, websocket-client, uvloop, triton, threadpoolctl, tenacity, tabulate, soupsieve, sniffio, six, scipy, safetensors, rapidfuzz, python-multipart, python-magic, python-iso639, python-dotenv, pyproject_hooks, pypdf, PyJWT, pydantic-core, pycparser, pyasn1, pulsar-client, protobuf, platformdirs, pillow, pathspec, overrides, opentelemetry-util-http, opentelemetry-semantic-conventions, oauthlib, nvidia-nvtx-cu12, nvidia-nccl-cu12, nvidia-cusparse-cu12, nvidia-curand-cu12, nvidia-cufft-cu12, nvidia-cuda-runtime-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, mypy-extensions, multidict, marshmallow, markdown, lxml, jsonpointer, jsonpath-python, joblib, itsdangerous, importlib-resources, humanfriendly, httptools, h11, grpcio, greenlet, frozenlist, emoji, click, chroma-hnswlib, chardet, cachetools, blinker, bidict, bcrypt, backoff, attrs, asgiref, annotated-types, yarl, wsproto, uvicorn, typing-inspect, typer, SQLAlchemy, scikit-learn, rsa, requests-oauthlib, python-dateutil, pydantic, pyasn1-modules, opentelemetry-proto, nvidia-cusolver-cu12, nvidia-cudnn-cu12, nltk, langdetect, jsonpatch, importlib-metadata, googleapis-common-protos, flask, ecdsa, deprecated, coloredlogs, cffi, build, black, beautifulsoup4, anyio, aiosignal, watchfiles, tokenizers, starlette, simple-websocket, python-jose, posthog, opentelemetry-exporter-otlp-proto-common, opentelemetry-api, onnxruntime, langsmith, google-auth, flask_cors, dataclasses-json, cryptography, aiohttp, unstructured-client, transformers, torchvision, python-engineio, opentelemetry-sdk, opentelemetry-instrumentation, langchain-core, kubernetes, fastapi, unstructured, sentence_transformers, python-socketio, opentelemetry-instrumentation-asgi, opentelemetry-exporter-otlp-proto-grpc, langchain-community, opentelemetry-instrumentation-fastapi, langchain, chromadb Attempting uninstall: triton Found existing installation: triton 2.2.0 Uninstalling triton-2.2.0: Successfully uninstalled triton-2.2.0 Attempting uninstall: nvidia-nvtx-cu12 Found existing installation: nvidia-nvtx-cu12 12.3.101 Uninstalling nvidia-nvtx-cu12-12.3.101: Successfully uninstalled nvidia-nvtx-cu12-12.3.101 Attempting uninstall: nvidia-nccl-cu12 Found existing installation: nvidia-nccl-cu12 2.19.3 Uninstalling nvidia-nccl-cu12-2.19.3: Successfully uninstalled nvidia-nccl-cu12-2.19.3 Attempting uninstall: nvidia-cusparse-cu12 Found existing installation: nvidia-cusparse-cu12 12.2.0.103 Uninstalling nvidia-cusparse-cu12-12.2.0.103: Successfully uninstalled nvidia-cusparse-cu12-12.2.0.103 Attempting uninstall: nvidia-curand-cu12 Found existing installation: nvidia-curand-cu12 10.3.4.107 Uninstalling nvidia-curand-cu12-10.3.4.107: Successfully uninstalled nvidia-curand-cu12-10.3.4.107 Attempting uninstall: nvidia-cufft-cu12 Found existing installation: nvidia-cufft-cu12 11.0.12.1 Uninstalling nvidia-cufft-cu12-11.0.12.1: Successfully uninstalled nvidia-cufft-cu12-11.0.12.1 Attempting uninstall: nvidia-cuda-runtime-cu12 Found existing installation: nvidia-cuda-runtime-cu12 12.3.101 Uninstalling nvidia-cuda-runtime-cu12-12.3.101: Successfully uninstalled nvidia-cuda-runtime-cu12-12.3.101 Attempting uninstall: nvidia-cuda-nvrtc-cu12 Found existing installation: nvidia-cuda-nvrtc-cu12 12.3.107 Uninstalling nvidia-cuda-nvrtc-cu12-12.3.107: Successfully uninstalled nvidia-cuda-nvrtc-cu12-12.3.107 Attempting uninstall: nvidia-cuda-cupti-cu12 Found existing installation: nvidia-cuda-cupti-cu12 12.3.101 Uninstalling nvidia-cuda-cupti-cu12-12.3.101: Successfully uninstalled nvidia-cuda-cupti-cu12-12.3.101 Attempting uninstall: nvidia-cublas-cu12 Found existing installation: nvidia-cublas-cu12 12.3.4.1 Uninstalling nvidia-cublas-cu12-12.3.4.1: Successfully uninstalled nvidia-cublas-cu12-12.3.4.1 Attempting uninstall: nvidia-cusolver-cu12 Found existing installation: nvidia-cusolver-cu12 11.5.4.101 Uninstalling nvidia-cusolver-cu12-11.5.4.101: Successfully uninstalled nvidia-cusolver-cu12-11.5.4.101 Attempting uninstall: nvidia-cudnn-cu12 Found existing installation: nvidia-cudnn-cu12 8.9.7.29 Uninstalling nvidia-cudnn-cu12-8.9.7.29: Successfully uninstalled nvidia-cudnn-cu12-8.9.7.29 Successfully installed PyJWT-2.8.0 SQLAlchemy-2.0.25 Werkzeug-3.0.1 aiohttp-3.9.1 aiosignal-1.3.1 annotated-types-0.6.0 anyio-4.2.0 asgiref-3.7.2 attrs-23.2.0 backoff-2.2.1 bcrypt-4.1.2 beautifulsoup4-4.12.2 bidict-0.22.1 black-23.12.1 blinker-1.7.0 build-1.0.3 cachetools-5.3.2 cffi-1.16.0 chardet-5.2.0 chroma-hnswlib-0.7.3 chromadb-0.4.22 click-8.1.7 coloredlogs-15.0.1 cryptography-41.0.7 dataclasses-json-0.6.3 deprecated-1.2.14 docx2txt-0.8 ecdsa-0.18.0 emoji-2.9.0 fastapi-0.109.0 filetype-1.2.0 flask-3.0.0 flask_cors-4.0.0 flatbuffers-23.5.26 frozenlist-1.4.1 google-auth-2.26.2 googleapis-common-protos-1.62.0 greenlet-3.0.3 grpcio-1.60.0 h11-0.14.0 httptools-0.6.1 humanfriendly-10.0 importlib-metadata-6.11.0 importlib-resources-6.1.1 itsdangerous-2.1.2 joblib-1.3.2 jsonpatch-1.33 jsonpath-python-1.0.6 jsonpointer-2.4 kubernetes-29.0.0 langchain-0.1.0 langchain-community-0.0.13 langchain-core-0.1.11 langdetect-1.0.9 langsmith-0.0.80 lxml-5.1.0 markdown-3.5.2 marshmallow-3.20.2 mmh3-4.1.0 monotonic-1.6 multidict-6.0.4 mypy-extensions-1.0.0 nltk-3.8.1 nvidia-cublas-cu12-12.1.3.1 nvidia-cuda-cupti-cu12-12.1.105 nvidia-cuda-nvrtc-cu12-12.1.105 nvidia-cuda-runtime-cu12-12.1.105 nvidia-cudnn-cu12-8.9.2.26 nvidia-cufft-cu12-11.0.2.54 nvidia-curand-cu12-10.3.2.106 nvidia-cusolver-cu12-11.4.5.107 nvidia-cusparse-cu12-12.1.0.106 nvidia-nccl-cu12-2.18.1 nvidia-nvtx-cu12-12.1.105 oauthlib-3.2.2 onnxruntime-1.16.3 opentelemetry-api-1.22.0 opentelemetry-exporter-otlp-proto-common-1.22.0 opentelemetry-exporter-otlp-proto-grpc-1.22.0 opentelemetry-instrumentation-0.43b0 opentelemetry-instrumentation-asgi-0.43b0 opentelemetry-instrumentation-fastapi-0.43b0 opentelemetry-proto-1.22.0 opentelemetry-sdk-1.22.0 opentelemetry-semantic-conventions-0.43b0 opentelemetry-util-http-0.43b0 overrides-7.4.0 passlib-1.7.4 pathspec-0.12.1 peewee-3.17.0 pillow-10.2.0 platformdirs-4.1.0 posthog-3.3.1 protobuf-4.25.2 pulsar-client-3.4.0 pyasn1-0.5.1 pyasn1-modules-0.3.0 pycparser-2.21 pydantic-2.5.3 pydantic-core-2.14.6 pypdf-3.17.4 pypika-0.48.9 pyproject_hooks-1.0.0 python-dateutil-2.8.2 python-dotenv-1.0.0 python-engineio-4.8.2 python-iso639-2024.1.2 python-jose-3.3.0 python-magic-0.4.27 python-multipart-0.0.6 python-socketio-5.11.0 rapidfuzz-3.6.1 requests-oauthlib-1.3.1 rsa-4.9 safetensors-0.4.1 scikit-learn-1.3.2 scipy-1.11.4 sentence_transformers-2.2.2 sentencepiece-0.1.99 simple-websocket-1.0.0 six-1.16.0 sniffio-1.3.0 soupsieve-2.5 starlette-0.35.1 tabulate-0.9.0 tenacity-8.2.3 threadpoolctl-3.2.0 tokenizers-0.15.0 torchvision-0.16.2 transformers-4.36.2 triton-2.1.0 typer-0.9.0 typing-inspect-0.9.0 unstructured-0.12.0 unstructured-client-0.15.2 uuid-1.30 uvicorn-0.26.0 uvloop-0.19.0 watchfiles-0.21.0 websocket-client-1.7.0 wrapt-1.16.0 wsproto-1.2.0 yarl-1.9.4 zipp-3.17.0
Starting web-ui
Shell
$ ./start.sh INFO: Started server process [503184] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
Now I pointed my web brower to localhost:8080.
I saw:
After signing up, I saw:
Clicking on New Chat, and then Select a model allowed me to select a model from the models I had already installed.
The llava model is usually good for describing images.
However, while I had good success using my command-line utility with llava to describe images, Ollama-webui completely failed.
I tried the image shown to the right twice: once by referencing the image at a URL, and once from an absolute path on my local machine. The results were both horrible.
You
describe the image at this url: https://www.mslinn.com/images/mike/mikePersuades_500x500.webp
Ollama Llava:13b
describe the image at /var/sitesUbuntu/www.mslinn.com/assets/images/mikePersuades.png
Ollama Llava:13b
A man standing in front of a group of people, trying to persuade them. The group is composed of at least five individuals.
describe the image at this url: https://www.mslinn.com/images/mike/mikePersuades_500x500.webp
Ollama Llava:13b
- A man standing in front of a group of people, trying to persuade them. The group is composed of at least five individuals.
- The main subject has his hands placed on his hips as he engages with the crowd.
describe the image at /var/sitesUbuntu/www.mslinn.com/assets/images/mikePersuades.png
Ollama Llava:13b
A man standing in front of a group of people, trying to persuade them. The group is composed of at least five individuals.