Getting Started with ChromaDB - Lowest Learning Curve Vector Database & Semantic Search

https://www.youtube.com/watch?v=QSW2L8dkaZk&ab_channel=JohnnyCode

which is based on

https://docs.trychroma.com/

Microsoft Windows [Version 10.0.19045.4291]

(c) Microsoft Corporation. All rights reserved.

C:\Users\Alex>path

PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\
WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files\Microsoft VS Code\bin;C:\
ProgramData\chocolatey\bin;C:\Program Files\dotnet\;C:\Users\Alex\AppData\Local\Programs\Python\
Launcher\;C:\Users\Alex\AppData\Local\Microsoft\WindowsApps;C:\Users\Alex\AppData\Local\Packages\
PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\Scripts\;

C:\Users\Alex>pip install chromadb

Defaulting to user installation because normal site-packages is not writeable

Collecting chromadb
Downloading chromadb-0.5.0-py3-none-any.whl.metadata (7.3 kB)
Collecting build>=1.0.3 (from chromadb)
Downloading build-1.2.1-py3-none-any.whl.metadata (4.3 kB)
Collecting requests>=2.28 (from chromadb)
Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting pydantic>=1.9 (from chromadb)
Downloading pydantic-2.7.1-py3-none-any.whl.metadata (107 kB)
---------------------------------------- 107.3/107.3 kB 1.6 MB/s eta 0:00:00
Collecting chroma-hnswlib==0.7.3 (from chromadb)
Downloading chroma-hnswlib-0.7.3.tar.gz (31 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting fastapi>=0.95.2 (from chromadb)
Downloading fastapi-0.110.2-py3-none-any.whl.metadata (24 kB)
Collecting uvicorn>=0.18.3 (from uvicorn[standard]>=0.18.3->chromadb)
Downloading uvicorn-0.29.0-py3-none-any.whl.metadata (6.3 kB)
Collecting numpy>=1.22.5 (from chromadb)
Using cached numpy-1.26.4-cp312-cp312-win_amd64.whl.metadata (61 kB)
Collecting posthog>=2.4.0 (from chromadb)
Downloading posthog-3.5.0-py2.py3-none-any.whl.metadata (2.0 kB)
Collecting typing-extensions>=4.5.0 (from chromadb)
Downloading typing_extensions-4.11.0-py3-none-any.whl.metadata (3.0 kB)
Collecting onnxruntime>=1.14.1 (from chromadb)
Downloading onnxruntime-1.17.3-cp312-cp312-win_amd64.whl.metadata (4.6 kB)
Collecting opentelemetry-api>=1.2.0 (from chromadb)
Downloading opentelemetry_api-1.24.0-py3-none-any.whl.metadata (1.3 kB)
Collecting opentelemetry-exporter-otlp-proto-grpc>=1.2.0 (from chromadb)
Downloading opentelemetry_exporter_otlp_proto_grpc-1.24.0-py3-none-any.whl.metadata (2.2 kB)
Collecting opentelemetry-instrumentation-fastapi>=0.41b0 (from chromadb)
Downloading opentelemetry_instrumentation_fastapi-0.45b0-py3-none-any.whl.metadata (2.0 kB)
Collecting opentelemetry-sdk>=1.2.0 (from chromadb)
 Downloading opentelemetry_sdk-1.24.0-py3-none-any.whl.metadata (1.4 kB)
Collecting tokenizers>=0.13.2 (from chromadb)
Downloading tokenizers-0.19.1-cp312-none-win_amd64.whl.metadata (6.9 kB)
Collecting pypika>=0.48.9 (from chromadb)
Downloading PyPika-0.48.9.tar.gz (67 kB)
---------------------------------------- 67.3/67.3 kB ? eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing metadata (pyproject.toml) ... done
Collecting tqdm>=4.65.0 (from chromadb)
Downloading tqdm-4.66.2-py3-none-any.whl.metadata (57 kB)
---------------------------------------- 57.6/57.6 kB 3.0 MB/s eta 0:00:00
Collecting overrides>=7.3.1 (from chromadb)
Downloading overrides-7.7.0-py3-none-any.whl.metadata (5.8 kB)
Collecting importlib-resources (from chromadb)
Downloading importlib_resources-6.4.0-py3-none-any.whl.metadata (3.9 kB)
Collecting grpcio>=1.58.0 (from chromadb)
Downloading grpcio-1.62.2-cp312-cp312-win_amd64.whl.metadata (4.2 kB)
Collecting bcrypt>=4.0.1 (from chromadb)
Downloading bcrypt-4.1.2-cp39-abi3-win_amd64.whl.metadata (9.8 kB)
Collecting typer>=0.9.0 (from chromadb)
Downloading typer-0.12.3-py3-none-any.whl.metadata (15 kB)
Collecting kubernetes>=28.1.0 (from chromadb)
Downloading kubernetes-29.0.0-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting tenacity>=8.2.3 (from chromadb)
Downloading tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting PyYAML>=6.0.0 (from chromadb)
Downloading PyYAML-6.0.1-cp312-cp312-win_amd64.whl.metadata (2.1 kB)
Collecting mmh3>=4.0.1 (from chromadb)
Downloading mmh3-4.1.0-cp312-cp312-win_amd64.whl.metadata (13 kB)
Collecting orjson>=3.9.12 (from chromadb)
Downloading orjson-3.10.1-cp312-none-win_amd64.whl.metadata (50 kB)
---------------------------------------- 50.9/50.9 kB ? eta 0:00:00
Collecting packaging>=19.1 (from build>=1.0.3->chromadb)
Downloading packaging-24.0-py3-none-any.whl.metadata (3.2 kB)
Collecting pyproject_hooks (from build>=1.0.3->chromadb)
Downloading pyproject_hooks-1.0.0-py3-none-any.whl.metadata (1.3 kB)
Collecting colorama (from build>=1.0.3->chromadb)
Downloading colorama-0.4.6-py2.py3-none-any.whl.metadata (17 kB)
Collecting starlette<0.38.0,>=0.37.2 (from fastapi>=0.95.2->chromadb)
Downloading starlette-0.37.2-py3-none-any.whl.metadata (5.9 kB)
Collecting certifi>=14.05.14 (from kubernetes>=28.1.0->chromadb)
Downloading certifi-2024.2.2-py3-none-any.whl.metadata (2.2 kB)
Collecting six>=1.9.0 (from kubernetes>=28.1.0->chromadb)
Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
Collecting python-dateutil>=2.5.3 (from kubernetes>=28.1.0->chromadb)
Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting google-auth>=1.0.1 (from kubernetes>=28.1.0->chromadb)
Downloading google_auth-2.29.0-py2.py3-none-any.whl.metadata (4.7 kB)
Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 (from kubernetes>=28.1.0->chromadb)
Downloading websocket_client-1.8.0-py3-none-any.whl.metadata (8.0 kB)
Collecting requests-oauthlib (from kubernetes>=28.1.0->chromadb)
Downloading requests_oauthlib-2.0.0-py2.py3-none-any.whl.metadata (11 kB)
Collecting oauthlib>=3.2.2 (from kubernetes>=28.1.0->chromadb)
Downloading oauthlib-3.2.2-py3-none-any.whl.metadata (7.5 kB)
Collecting urllib3>=1.24.2 (from kubernetes>=28.1.0->chromadb)
 Downloading urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB)
Collecting coloredlogs (from onnxruntime>=1.14.1->chromadb)
Downloading coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB)
Collecting flatbuffers (from onnxruntime>=1.14.1->chromadb)
Downloading flatbuffers-24.3.25-py2.py3-none-any.whl.metadata (850 bytes)
Collecting protobuf (from onnxruntime>=1.14.1->chromadb)
Downloading protobuf-5.26.1-cp310-abi3-win_amd64.whl.metadata (592 bytes)
Collecting sympy (from onnxruntime>=1.14.1->chromadb)
Downloading sympy-1.12-py3-none-any.whl.metadata (12 kB)
Collecting deprecated>=1.2.6 (from opentelemetry-api>=1.2.0->chromadb)
Downloading Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB)
Collecting importlib-metadata<=7.0,>=6.0 (from opentelemetry-api>=1.2.0->chromadb)
Downloading importlib_metadata-7.0.0-py3-none-any.whl.metadata (4.9 kB)
Collecting googleapis-common-protos~=1.52 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb)
Downloading googleapis_common_protos-1.63.0-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting opentelemetry-exporter-otlp-proto-common==1.24.0 (from opentelemetry-exporter-otlp-proto-
grpc>=1.2.0->chromadb)
Downloading opentelemetry_exporter_otlp_proto_common-1.24.0-py3-none-any.whl.metadata (1.7 kB)
Collecting opentelemetry-proto==1.24.0 (from opentelemetry-exporter-otlp-proto-grpc>=1.2.0->chromadb)
Downloading opentelemetry_proto-1.24.0-py3-none-any.whl.metadata (2.2 kB)
Collecting protobuf (from onnxruntime>=1.14.1->chromadb)
Downloading protobuf-4.25.3-cp310-abi3-win_amd64.whl.metadata (541 bytes)
Collecting opentelemetry-instrumentation-asgi==0.45b0 (from opentelemetry-instrumentation-fastapi>=0.41b0-
>chromadb)
Downloading opentelemetry_instrumentation_asgi-0.45b0-py3-none-any.whl.metadata (1.9 kB)
Collecting opentelemetry-instrumentation==0.45b0 (from opentelemetry-instrumentation-fastapi>=0.41b0-
>chromadb)
Downloading opentelemetry_instrumentation-0.45b0-py3-none-any.whl.metadata (6.1 kB)
Collecting opentelemetry-semantic-conventions==0.45b0 (from opentelemetry-instrumentation-fastapi>=0.41b0-
>chromadb)
Downloading opentelemetry_semantic_conventions-0.45b0-py3-none-any.whl.metadata (2.2 kB)
Collecting opentelemetry-util-http==0.45b0 (from opentelemetry-instrumentation-fastapi>=0.41b0->chromadb)
Downloading opentelemetry_util_http-0.45b0-py3-none-any.whl.metadata (2.4 kB)
Requirement already satisfied: setuptools>=16.0 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from opentelemetry-instrumentation==0.45b0->opentelemetry-instrumentation-fastapi>=0.41b0->chromadb)
(69.5.1)
Collecting wrapt<2.0.0,>=1.0.0 (from opentelemetry-instrumentation==0.45b0->opentelemetry-instrumentation-
fastapi>=0.41b0->chromadb)
Downloading wrapt-1.16.0-cp312-cp312-win_amd64.whl.metadata (6.8 kB)
Collecting asgiref~=3.0 (from opentelemetry-instrumentation-asgi==0.45b0->opentelemetry-instrumentation-
fastapi>=0.41b0->chromadb)
Downloading asgiref-3.8.1-py3-none-any.whl.metadata (9.3 kB)
Collecting monotonic>=1.5 (from posthog>=2.4.0->chromadb)
Downloading monotonic-1.6-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting backoff>=1.10.0 (from posthog>=2.4.0->chromadb)
Downloading backoff-2.2.1-py3-none-any.whl.metadata (14 kB)
Collecting annotated-types>=0.4.0 (from pydantic>=1.9->chromadb)
Downloading annotated_types-0.6.0-py3-none-any.whl.metadata (12 kB)
Collecting pydantic-core==2.18.2 (from pydantic>=1.9->chromadb)
Downloading pydantic_core-2.18.2-cp312-none-win_amd64.whl.metadata (6.7 kB)
Collecting charset-normalizer<4,>=2 (from requests>=2.28->chromadb)
Downloading charset_normalizer-3.3.2-cp312-cp312-win_amd64.whl.metadata (34 kB)
Collecting idna<4,>=2.5 (from requests>=2.28->chromadb)
Downloading idna-3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting huggingface-hub<1.0,>=0.16.4 (from tokenizers>=0.13.2->chromadb)
Downloading huggingface_hub-0.22.2-py3-none-any.whl.metadata (12 kB)
Collecting click>=8.0.0 (from typer>=0.9.0->chromadb)
Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting shellingham>=1.3.0 (from typer>=0.9.0->chromadb)
Downloading shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting rich>=10.11.0 (from typer>=0.9.0->chromadb)
Downloading rich-13.7.1-py3-none-any.whl.metadata (18 kB)
Collecting h11>=0.8 (from uvicorn>=0.18.3->uvicorn[standard]>=0.18.3->chromadb)
Downloading h11-0.14.0-py3-none-any.whl.metadata (8.2 kB)
Collecting httptools>=0.5.0 (from uvicorn[standard]>=0.18.3->chromadb)
Downloading httptools-0.6.1-cp312-cp312-win_amd64.whl.metadata (3.7 kB)
Collecting python-dotenv>=0.13 (from uvicorn[standard]>=0.18.3->chromadb)
Downloading python_dotenv-1.0.1-py3-none-any.whl.metadata (23 kB)
Collecting watchfiles>=0.13 (from uvicorn[standard]>=0.18.3->chromadb)
Downloading watchfiles-0.21.0-cp312-none-win_amd64.whl.metadata (5.0 kB)
Collecting websockets>=10.4 (from uvicorn[standard]>=0.18.3->chromadb)
Downloading websockets-12.0-cp312-cp312-win_amd64.whl.metadata (6.8 kB)
Collecting cachetools<6.0,>=2.0.0 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb)
Downloading cachetools-5.3.3-py3-none-any.whl.metadata (5.3 kB)
Collecting pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb)
Downloading pyasn1_modules-0.4.0-py3-none-any.whl.metadata (3.4 kB)
Collecting rsa<5,>=3.1.4 (from google-auth>=1.0.1->kubernetes>=28.1.0->chromadb)
Downloading rsa-4.9-py3-none-any.whl.metadata (4.2 kB)
Collecting filelock (from huggingface-hub<1.0,>=0.16.4->tokenizers>=0.13.2->chromadb)
Downloading filelock-3.13.4-py3-none-any.whl.metadata (2.8 kB)
Collecting fsspec>=2023.5.0 (from huggingface-hub<1.0,>=0.16.4->tokenizers>=0.13.2->chromadb)
Downloading fsspec-2024.3.1-py3-none-any.whl.metadata (6.8 kB)
Collecting zipp>=0.5 (from importlib-metadata<=7.0,>=6.0->opentelemetry-api>=1.2.0->chromadb)
Downloading zipp-3.18.1-py3-none-any.whl.metadata (3.5 kB)
Collecting markdown-it-py>=2.2.0 (from rich>=10.11.0->typer>=0.9.0->chromadb)
Downloading markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB)
Collecting pygments<3.0.0,>=2.13.0 (from rich>=10.11.0->typer>=0.9.0->chromadb)
Downloading pygments-2.17.2-py3-none-any.whl.metadata (2.6 kB)
Collecting anyio<5,>=3.4.0 (from starlette<0.38.0,>=0.37.2->fastapi>=0.95.2->chromadb)
Downloading anyio-4.3.0-py3-none-any.whl.metadata (4.6 kB)
Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime>=1.14.1->chromadb)
Downloading humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB)
Collecting mpmath>=0.19 (from sympy->onnxruntime>=1.14.1->chromadb)
Downloading mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting sniffio>=1.1 (from anyio<5,>=3.4.0->starlette<0.38.0,>=0.37.2->fastapi>=0.95.2->chromadb)
Downloading sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting pyreadline3 (from humanfriendly>=9.1->coloredlogs->onnxruntime>=1.14.1->chromadb)
Downloading pyreadline3-3.4.1-py3-none-any.whl.metadata (2.0 kB)
Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=10.11.0->typer>=0.9.0->chromadb)
Downloading mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB)
Collecting pyasn1<0.7.0,>=0.4.6 (from pyasn1-modules>=0.2.1->google-auth>=1.0.1->kubernetes>=28.1.0-
>chromadb)
Downloading pyasn1-0.6.0-py2.py3-none-any.whl.metadata (8.3 kB)
Downloading chromadb-0.5.0-py3-none-any.whl (526 kB)
---------------------------------------- 526.8/526.8 kB 16.7 MB/s eta 0:00:00
Downloading bcrypt-4.1.2-cp39-abi3-win_amd64.whl (158 kB)
---------------------------------------- 158.3/158.3 kB ? eta 0:00:00
Downloading build-1.2.1-py3-none-any.whl (21 kB)
Downloading fastapi-0.110.2-py3-none-any.whl (91 kB)
---------------------------------------- 91.9/91.9 kB ? eta 0:00:00
Downloading grpcio-1.62.2-cp312-cp312-win_amd64.whl (3.8 MB)
---------------------------------------- 3.8/3.8 MB 15.0 MB/s eta 0:00:00
Downloading kubernetes-29.0.0-py2.py3-none-any.whl (1.6 MB)
 ---------------------------------------- 1.6/1.6 MB 14.4 MB/s eta 0:00:00
Downloading mmh3-4.1.0-cp312-cp312-win_amd64.whl (31 kB)
Using cached numpy-1.26.4-cp312-cp312-win_amd64.whl (15.5 MB)
Downloading onnxruntime-1.17.3-cp312-cp312-win_amd64.whl (5.6 MB)
---------------------------------------- 5.6/5.6 MB 12.8 MB/s eta 0:00:00
Downloading opentelemetry_api-1.24.0-py3-none-any.whl (60 kB)
---------------------------------------- 60.1/60.1 kB ? eta 0:00:00
Downloading opentelemetry_exporter_otlp_proto_grpc-1.24.0-py3-none-any.whl (18 kB)
Downloading opentelemetry_exporter_otlp_proto_common-1.24.0-py3-none-any.whl (17 kB)
Downloading opentelemetry_proto-1.24.0-py3-none-any.whl (50 kB)
---------------------------------------- 50.8/50.8 kB ? eta 0:00:00
Downloading opentelemetry_instrumentation_fastapi-0.45b0-py3-none-any.whl (11 kB)
Downloading opentelemetry_instrumentation-0.45b0-py3-none-any.whl (28 kB)
Downloading opentelemetry_instrumentation_asgi-0.45b0-py3-none-any.whl (14 kB)
Downloading opentelemetry_semantic_conventions-0.45b0-py3-none-any.whl (36 kB)
Downloading opentelemetry_util_http-0.45b0-py3-none-any.whl (6.9 kB)
Downloading opentelemetry_sdk-1.24.0-py3-none-any.whl (106 kB)
---------------------------------------- 106.1/106.1 kB ? eta 0:00:00
Downloading orjson-3.10.1-cp312-none-win_amd64.whl (139 kB)
---------------------------------------- 139.2/139.2 kB ? eta 0:00:00
Downloading overrides-7.7.0-py3-none-any.whl (17 kB)
Downloading posthog-3.5.0-py2.py3-none-any.whl (41 kB)
---------------------------------------- 41.3/41.3 kB ? eta 0:00:00
Downloading pydantic-2.7.1-py3-none-any.whl (409 kB)
---------------------------------------- 409.3/409.3 kB 12.9 MB/s eta 0:00:00
Downloading pydantic_core-2.18.2-cp312-none-win_amd64.whl (1.9 MB)
---------------------------------------- 1.9/1.9 MB 15.3 MB/s eta 0:00:00
Downloading PyYAML-6.0.1-cp312-cp312-win_amd64.whl (138 kB)
---------------------------------------- 138.7/138.7 kB ? eta 0:00:00
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
---------------------------------------- 62.6/62.6 kB ? eta 0:00:00
Downloading tenacity-8.2.3-py3-none-any.whl (24 kB)
Downloading tokenizers-0.19.1-cp312-none-win_amd64.whl (2.2 MB)
---------------------------------------- 2.2/2.2 MB 12.8 MB/s eta 0:00:00
Downloading tqdm-4.66.2-py3-none-any.whl (78 kB)
---------------------------------------- 78.3/78.3 kB ? eta 0:00:00
Downloading typer-0.12.3-py3-none-any.whl (47 kB)
---------------------------------------- 47.2/47.2 kB ? eta 0:00:00
Downloading typing_extensions-4.11.0-py3-none-any.whl (34 kB)
Downloading uvicorn-0.29.0-py3-none-any.whl (60 kB)
---------------------------------------- 60.8/60.8 kB ? eta 0:00:00
Downloading importlib_resources-6.4.0-py3-none-any.whl (38 kB)
Downloading annotated_types-0.6.0-py3-none-any.whl (12 kB)
Downloading backoff-2.2.1-py3-none-any.whl (15 kB)
Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
---------------------------------------- 163.8/163.8 kB 10.2 MB/s eta 0:00:00
Downloading charset_normalizer-3.3.2-cp312-cp312-win_amd64.whl (100 kB)
---------------------------------------- 100.4/100.4 kB ? eta 0:00:00
Downloading click-8.1.7-py3-none-any.whl (97 kB)
---------------------------------------- 97.9/97.9 kB 5.5 MB/s eta 0:00:00
Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Downloading Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB)
Downloading google_auth-2.29.0-py2.py3-none-any.whl (189 kB)
---------------------------------------- 189.2/189.2 kB 11.2 MB/s eta 0:00:00
Downloading googleapis_common_protos-1.63.0-py2.py3-none-any.whl (229 kB)
---------------------------------------- 229.1/229.1 kB ? eta 0:00:00
Downloading h11-0.14.0-py3-none-any.whl (58 kB)
 ---------------------------------------- 58.3/58.3 kB ? eta 0:00:00
Downloading httptools-0.6.1-cp312-cp312-win_amd64.whl (55 kB)
---------------------------------------- 55.7/55.7 kB 2.8 MB/s eta 0:00:00
Downloading huggingface_hub-0.22.2-py3-none-any.whl (388 kB)
---------------------------------------- 388.9/388.9 kB 11.8 MB/s eta 0:00:00
Downloading idna-3.7-py3-none-any.whl (66 kB)
---------------------------------------- 66.8/66.8 kB ? eta 0:00:00
Downloading importlib_metadata-7.0.0-py3-none-any.whl (23 kB)
Downloading monotonic-1.6-py2.py3-none-any.whl (8.2 kB)
Downloading oauthlib-3.2.2-py3-none-any.whl (151 kB)
---------------------------------------- 151.7/151.7 kB ? eta 0:00:00
Downloading packaging-24.0-py3-none-any.whl (53 kB)
---------------------------------------- 53.5/53.5 kB ? eta 0:00:00
Downloading protobuf-4.25.3-cp310-abi3-win_amd64.whl (413 kB)
---------------------------------------- 413.4/413.4 kB 25.2 MB/s eta 0:00:00
Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
---------------------------------------- 229.9/229.9 kB ? eta 0:00:00
Downloading python_dotenv-1.0.1-py3-none-any.whl (19 kB)
Downloading rich-13.7.1-py3-none-any.whl (240 kB)
---------------------------------------- 240.7/240.7 kB ? eta 0:00:00
Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Downloading starlette-0.37.2-py3-none-any.whl (71 kB)
---------------------------------------- 71.9/71.9 kB ? eta 0:00:00
Downloading urllib3-2.2.1-py3-none-any.whl (121 kB)
---------------------------------------- 121.1/121.1 kB 6.9 MB/s eta 0:00:00
Downloading watchfiles-0.21.0-cp312-none-win_amd64.whl (280 kB)
---------------------------------------- 280.3/280.3 kB 16.9 MB/s eta 0:00:00
Downloading websocket_client-1.8.0-py3-none-any.whl (58 kB)
---------------------------------------- 58.8/58.8 kB ? eta 0:00:00
Downloading websockets-12.0-cp312-cp312-win_amd64.whl (124 kB)
---------------------------------------- 125.0/125.0 kB 7.6 MB/s eta 0:00:00
Downloading coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)
---------------------------------------- 46.0/46.0 kB ? eta 0:00:00
Downloading flatbuffers-24.3.25-py2.py3-none-any.whl (26 kB)
Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB)
Downloading requests_oauthlib-2.0.0-py2.py3-none-any.whl (24 kB)
Downloading sympy-1.12-py3-none-any.whl (5.7 MB)
---------------------------------------- 5.7/5.7 MB 11.5 MB/s eta 0:00:00
Downloading anyio-4.3.0-py3-none-any.whl (85 kB)
---------------------------------------- 85.6/85.6 kB ? eta 0:00:00
Downloading asgiref-3.8.1-py3-none-any.whl (23 kB)
Downloading cachetools-5.3.3-py3-none-any.whl (9.3 kB)
Downloading fsspec-2024.3.1-py3-none-any.whl (171 kB)
---------------------------------------- 172.0/172.0 kB 10.1 MB/s eta 0:00:00
Downloading humanfriendly-10.0-py2.py3-none-any.whl (86 kB)
---------------------------------------- 86.8/86.8 kB ? eta 0:00:00
Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
---------------------------------------- 87.5/87.5 kB ? eta 0:00:00
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
---------------------------------------- 536.2/536.2 kB 17.0 MB/s eta 0:00:00
Downloading pyasn1_modules-0.4.0-py3-none-any.whl (181 kB)
---------------------------------------- 181.2/181.2 kB 11.4 MB/s eta 0:00:00
Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
---------------------------------------- 1.2/1.2 MB 12.4 MB/s eta 0:00:00
Downloading rsa-4.9-py3-none-any.whl (34 kB)
Downloading wrapt-1.16.0-cp312-cp312-win_amd64.whl (37 kB)
 Downloading zipp-3.18.1-py3-none-any.whl (8.2 kB)
Downloading filelock-3.13.4-py3-none-any.whl (11 kB)
Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Downloading pyasn1-0.6.0-py2.py3-none-any.whl (85 kB)
---------------------------------------- 85.3/85.3 kB ? eta 0:00:00
Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
Downloading pyreadline3-3.4.1-py3-none-any.whl (95 kB)
---------------------------------------- 95.2/95.2 kB 5.3 MB/s eta 0:00:00
Building wheels for collected packages: chroma-hnswlib, pypika
Building wheel for chroma-hnswlib (pyproject.toml) ... done
Created wheel for chroma-hnswlib: filename=chroma_hnswlib-0.7.3-cp312-cp312-win_amd64.whl size=153691
sha256=7829e4e2d256d45e137bed0b670b3aec64c538ea2e045194894bddb27dc50b3c
Stored in directory: c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local\pip\cache\wheels\6d\14\
b5\68c4f2e056600c0348a94efba92dc975686ab72b714e0ca3d6
Building wheel for pypika (pyproject.toml) ... done
Created wheel for pypika: filename=PyPika-0.48.9-py2.py3-none-any.whl size=53835
sha256=32b858001d3573e4e0328ebe1fdca4e2303a889bb545ca5f5bc1043a1c294702
Stored in directory: c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local\pip\cache\wheels\d5\3d\
69\8d68d249cd3de2584f226e27fd431d6344f7d70fd856ebd01b
Successfully built chroma-hnswlib pypika
Installing collected packages: pyreadline3, pypika, mpmath, monotonic, mmh3, flatbuffers, zipp, wrapt,
websockets, websocket-client, urllib3, typing-extensions, tenacity, sympy, sniffio, six, shellingham, PyYAML,
python-dotenv, pyproject_hooks, pygments, pyasn1, protobuf, packaging, overrides, orjson, opentelemetry-util-
http, opentelemetry-semantic-conventions, oauthlib, numpy, mdurl, importlib-resources, idna, humanfriendly,
httptools, h11, grpcio, fsspec, filelock, colorama, charset-normalizer, certifi, cachetools, bcrypt, backoff, asgiref,
annotated-types, tqdm, rsa, requests, python-dateutil, pydantic-core, pyasn1-modules, opentelemetry-proto,
markdown-it-py, importlib-metadata, googleapis-common-protos, deprecated, coloredlogs, click, chroma-hnswlib,
build, anyio, watchfiles, uvicorn, starlette, rich, requests-oauthlib, pydantic, posthog, opentelemetry-exporter-otlp-
proto-common, opentelemetry-api, onnxruntime, huggingface-hub, google-auth, typer, tokenizers, opentelemetry-
sdk, opentelemetry-instrumentation, kubernetes, fastapi, opentelemetry-instrumentation-asgi, opentelemetry-
exporter-otlp-proto-grpc, opentelemetry-instrumentation-fastapi, chromadb
Successfully installed PyYAML-6.0.1 annotated-types-0.6.0 anyio-4.3.0 asgiref-3.8.1 backoff-2.2.1 bcrypt-4.1.2
build-1.2.1 cachetools-5.3.3 certifi-2024.2.2 charset-normalizer-3.3.2 chroma-hnswlib-0.7.3 chromadb-0.5.0 click-
8.1.7 colorama-0.4.6 coloredlogs-15.0.1 deprecated-1.2.14 fastapi-0.110.2 filelock-3.13.4 flatbuffers-24.3.25
fsspec-2024.3.1 google-auth-2.29.0 googleapis-common-protos-1.63.0 grpcio-1.62.2 h11-0.14.0 httptools-0.6.1
huggingface-hub-0.22.2 humanfriendly-10.0 idna-3.7 importlib-metadata-7.0.0 importlib-resources-6.4.0
kubernetes-29.0.0 markdown-it-py-3.0.0 mdurl-0.1.2 mmh3-4.1.0 monotonic-1.6 mpmath-1.3.0 numpy-1.26.4
oauthlib-3.2.2 onnxruntime-1.17.3 opentelemetry-api-1.24.0 opentelemetry-exporter-otlp-proto-common-1.24.0
opentelemetry-exporter-otlp-proto-grpc-1.24.0 opentelemetry-instrumentation-0.45b0 opentelemetry-
instrumentation-asgi-0.45b0 opentelemetry-instrumentation-fastapi-0.45b0 opentelemetry-proto-1.24.0
opentelemetry-sdk-1.24.0 opentelemetry-semantic-conventions-0.45b0 opentelemetry-util-http-0.45b0 orjson-
3.10.1 overrides-7.7.0 packaging-24.0 posthog-3.5.0 protobuf-4.25.3 pyasn1-0.6.0 pyasn1-modules-0.4.0 pydantic-
2.7.1 pydantic-core-2.18.2 pygments-2.17.2 pypika-0.48.9 pyproject_hooks-1.0.0 pyreadline3-3.4.1 python-
dateutil-2.9.0.post0 python-dotenv-1.0.1 requests-2.31.0 requests-oauthlib-2.0.0 rich-13.7.1 rsa-4.9 shellingham-
1.5.4 six-1.16.0 sniffio-1.3.1 starlette-0.37.2 sympy-1.12 tenacity-8.2.3 tokenizers-0.19.1 tqdm-4.66.2 typer-0.12.3
typing-extensions-4.11.0 urllib3-2.2.1 uvicorn-0.29.0 watchfiles-0.21.0 websocket-client-1.8.0 websockets-12.0
wrapt-1.16.0 zipp-3.18.1

[In Python environment]

import chromadb

chroma_client = chromadb.Client()
Embeddings

https://docs.trychroma.com/embeddings

By default, Chroma uses the Sentence Transformers all-MiniLM-L6-v2 model to create

embeddings.
Sentence Transformers Documentation https://www.sbert.net/
 Pretrained Models https://www.sbert.net/docs/pretrained_models.html

Install sentence-transformers from https://www.sbert.net/docs/installation.html

pip install -U sentence-transformers

pip install sentence_transformers

C:\Users\Alex>pip install -U sentence-transformers

Defaulting to user installation because normal site-packages is not writeable
Collecting sentence-transformers
Downloading sentence_transformers-2.7.0-py3-none-any.whl.metadata (11 kB)
Collecting transformers<5.0.0,>=4.34.0 (from sentence-transformers)
Downloading transformers-4.40.1-py3-none-any.whl.metadata (137 kB)
---------------------------------------- 138.0/138.0 kB 1.6 MB/s eta 0:00:00
Requirement already satisfied: tqdm in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from sentence-transformers) (4.66.2)
Collecting torch>=1.11.0 (from sentence-transformers)
Downloading torch-2.3.0-cp312-cp312-win_amd64.whl.metadata (26 kB)
Requirement already satisfied: numpy in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from sentence-transformers) (1.26.4)
Collecting scikit-learn (from sentence-transformers)
Downloading scikit_learn-1.4.2-cp312-cp312-win_amd64.whl.metadata (11 kB)
Collecting scipy (from sentence-transformers)
Downloading scipy-1.13.0-cp312-cp312-win_amd64.whl.metadata (60 kB)
---------------------------------------- 60.6/60.6 kB 3.1 MB/s eta 0:00:00
Requirement already satisfied: huggingface-hub>=0.15.1 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from sentence-transformers) (0.22.2)
Collecting Pillow (from sentence-transformers)
Downloading pillow-10.3.0-cp312-cp312-win_amd64.whl.metadata (9.4 kB)
Requirement already satisfied: filelock in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from huggingface-hub>=0.15.1->sentence-transformers) (3.13.4)
Requirement already satisfied: fsspec>=2023.5.0 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from huggingface-hub>=0.15.1->sentence-transformers) (2024.3.1)
Requirement already satisfied: packaging>=20.9 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from huggingface-hub>=0.15.1->sentence-transformers) (24.0)
Requirement already satisfied: pyyaml>=5.1 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from huggingface-hub>=0.15.1->sentence-transformers) (6.0.1)
Requirement already satisfied: requests in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from huggingface-hub>=0.15.1->sentence-transformers) (2.31.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from huggingface-hub>=0.15.1->sentence-transformers) (4.11.0)
Requirement already satisfied: sympy in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from torch>=1.11.0->sentence-transformers) (1.12)
Collecting networkx (from torch>=1.11.0->sentence-transformers)
Downloading networkx-3.3-py3-none-any.whl.metadata (5.1 kB)
Collecting jinja2 (from torch>=1.11.0->sentence-transformers)
Downloading Jinja2-3.1.3-py3-none-any.whl.metadata (3.3 kB)
Collecting mkl<=2021.4.0,>=2021.1.1 (from torch>=1.11.0->sentence-transformers)
Downloading mkl-2021.4.0-py2.py3-none-win_amd64.whl.metadata (1.4 kB)
Requirement already satisfied: colorama in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from tqdm->sentence-transformers) (0.4.6)
Collecting regex!=2019.12.17 (from transformers<5.0.0,>=4.34.0->sentence-transformers)
Downloading regex-2024.4.16-cp312-cp312-win_amd64.whl.metadata (41 kB)
---------------------------------------- 42.0/42.0 kB ? eta 0:00:00
Requirement already satisfied: tokenizers<0.20,>=0.19 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from transformers<5.0.0,>=4.34.0->sentence-transformers) (0.19.1)
Collecting safetensors>=0.4.1 (from transformers<5.0.0,>=4.34.0->sentence-transformers)
Downloading safetensors-0.4.3-cp312-none-win_amd64.whl.metadata (3.9 kB)
Collecting joblib>=1.2.0 (from scikit-learn->sentence-transformers)
Downloading joblib-1.4.0-py3-none-any.whl.metadata (5.4 kB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->sentence-transformers)
Downloading threadpoolctl-3.4.0-py3-none-any.whl.metadata (13 kB)
Collecting intel-openmp==2021.* (from mkl<=2021.4.0,>=2021.1.1->torch>=1.11.0->sentence-transformers)
Downloading intel_openmp-2021.4.0-py2.py3-none-win_amd64.whl.metadata (1.2 kB)
Collecting tbb==2021.* (from mkl<=2021.4.0,>=2021.1.1->torch>=1.11.0->sentence-transformers)
Downloading tbb-2021.12.0-py3-none-win_amd64.whl.metadata (1.1 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch>=1.11.0->sentence-transformers)
Downloading MarkupSafe-2.1.5-cp312-cp312-win_amd64.whl.metadata (3.1 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from requests->huggingface-hub>=0.15.1->sentence-transformers) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from requests->huggingface-hub>=0.15.1->sentence-transformers) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from requests->huggingface-hub>=0.15.1->sentence-transformers) (2.2.1)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from requests->huggingface-hub>=0.15.1->sentence-transformers) (2024.2.2)
Requirement already satisfied: mpmath>=0.19 in c:\users\alex\appdata\local\packages\
pythonsoftwarefoundation.python.3.12_qbz5n2kfra8p0\localcache\local-packages\python312\site-packages
(from sympy->torch>=1.11.0->sentence-transformers) (1.3.0)
Downloading sentence_transformers-2.7.0-py3-none-any.whl (171 kB)
---------------------------------------- 171.5/171.5 kB 10.7 MB/s eta 0:00:00
Downloading torch-2.3.0-cp312-cp312-win_amd64.whl (159.7 MB)
---------------------------------------- 159.7/159.7 MB 10.7 MB/s eta 0:00:00
Downloading transformers-4.40.1-py3-none-any.whl (9.0 MB)
---------------------------------------- 9.0/9.0 MB 13.4 MB/s eta 0:00:00
Downloading pillow-10.3.0-cp312-cp312-win_amd64.whl (2.5 MB)
---------------------------------------- 2.5/2.5 MB 13.4 MB/s eta 0:00:00
Downloading scikit_learn-1.4.2-cp312-cp312-win_amd64.whl (10.6 MB)
---------------------------------------- 10.6/10.6 MB 13.3 MB/s eta 0:00:00
Downloading scipy-1.13.0-cp312-cp312-win_amd64.whl (45.9 MB)
---------------------------------------- 45.9/45.9 MB 12.6 MB/s eta 0:00:00
Downloading joblib-1.4.0-py3-none-any.whl (301 kB)
---------------------------------------- 301.2/301.2 kB ? eta 0:00:00
Downloading mkl-2021.4.0-py2.py3-none-win_amd64.whl (228.5 MB)
---------------------------------------- 228.5/228.5 MB 9.9 MB/s eta 0:00:00
Downloading intel_openmp-2021.4.0-py2.py3-none-win_amd64.whl (3.5 MB)
---------------------------------------- 3.5/3.5 MB 8.3 MB/s eta 0:00:00
Downloading tbb-2021.12.0-py3-none-win_amd64.whl (286 kB)
---------------------------------------- 286.4/286.4 kB 2.0 MB/s eta 0:00:00
Downloading regex-2024.4.16-cp312-cp312-win_amd64.whl (268 kB)
---------------------------------------- 268.4/268.4 kB ? eta 0:00:00
Downloading safetensors-0.4.3-cp312-none-win_amd64.whl (289 kB)
---------------------------------------- 289.4/289.4 kB 18.6 MB/s eta 0:00:00
Downloading threadpoolctl-3.4.0-py3-none-any.whl (17 kB)
Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
---------------------------------------- 133.2/133.2 kB ? eta 0:00:00
Downloading networkx-3.3-py3-none-any.whl (1.7 MB)
---------------------------------------- 1.7/1.7 MB 15.4 MB/s eta 0:00:00
Downloading MarkupSafe-2.1.5-cp312-cp312-win_amd64.whl (17 kB)
Installing collected packages: tbb, intel-openmp, threadpoolctl, scipy, safetensors, regex, Pillow, networkx, mkl,
MarkupSafe, joblib, scikit-learn, jinja2, torch, transformers, sentence-transformers
WARNING: The scripts convert-caffe2-to-onnx.exe, convert-onnx-to-caffe2.exe and torchrun.exe are installed in
'C:\Users\Alex\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\
local-packages\Python312\Scripts' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The script transformers-cli.exe is installed in 'C:\Users\Alex\AppData\Local\Packages\
PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\Scripts' which
is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed MarkupSafe-2.1.5 Pillow-10.3.0 intel-openmp-2021.4.0 jinja2-3.1.3 joblib-1.4.0 mkl-
2021.4.0 networkx-3.3 regex-2024.4.16 safetensors-0.4.3 scikit-learn-1.4.2 scipy-1.13.0 sentence-transformers-
2.7.0 tbb-2021.12.0 threadpoolctl-3.4.0 torch-2.3.0 transformers-4.40.1

# Initiating a persistent Chroma client

# https://docs.trychroma.com/usage-guide
# You can configure Chroma to save and load from your local machine. Data will be
persisted automatically and loaded on start (if it exists).
client = chromadb.PersistentClient(path="VectorDB")
Looks like a splite3 database.