python-recipes/vector-search/01_redisvl.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "id": "cbba56a9",
      "metadata": {
        "id": "cbba56a9"
      },
      "source": [
        "![Redis](https://redis.io/wp-content/uploads/2024/04/Logotype.svg?auto=webp&quality=85,75&width=120)\n",
        "# Vector Search with RedisVL\n",
        "\n",
        "## Let's Begin!\n",
        "<a href=\"https://colab.research.google.com/github/redis-developer/redis-ai-resources/blob/main/python-recipes/vector-search/01_redisvl.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>\n"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "0b80de6b",
      "metadata": {
        "id": "0b80de6b"
      },
      "source": [
        "## Prepare data\n",
        "\n",
        "In this examples we will load a list of movies with the following attributes: `title`, `rating`, `description`, and `genre`.\n",
        "\n",
        "We will embed the movie description so that user's can search for movies that best match the kind of movie that they're looking for.\n",
        "\n",
        "**If you are running this notebook locally**, FYI you may not need to perform this step at all."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "id": "b966a9b5",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "b966a9b5",
        "outputId": "8fb1aed9-94a3-47b2-af50-4eac9b08d7f1"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Cloning into 'temp_repo'...\n",
            "remote: Enumerating objects: 669, done.\u001b[K\n",
            "remote: Counting objects: 100% (320/320), done.\u001b[K\n",
            "remote: Compressing objects: 100% (207/207), done.\u001b[K\n",
            "remote: Total 669 (delta 219), reused 141 (delta 112), pack-reused 349 (from 2)\u001b[K\n",
            "Receiving objects: 100% (669/669), 57.77 MiB | 20.61 MiB/s, done.\n",
            "Resolving deltas: 100% (287/287), done.\n"
          ]
        }
      ],
      "source": [
        "# NBVAL_SKIP\n",
        "!git clone https://github.com/redis-developer/redis-ai-resources.git temp_repo\n",
        "!mv temp_repo/python-recipes/vector-search/resources .\n",
        "!rm -rf temp_repo"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "19bdc2a5-2192-4f5f-bd6e-7c956fd0e230",
      "metadata": {
        "id": "19bdc2a5-2192-4f5f-bd6e-7c956fd0e230"
      },
      "source": [
        "## Packages"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "id": "c620286e",
      "metadata": {
        "id": "c620286e"
      },
      "outputs": [],
      "source": [
        "%pip install -q \"redisvl==0.5.2\" sentence-transformers pandas nltk"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "323aec7f",
      "metadata": {
        "id": "323aec7f"
      },
      "source": [
        "## Install Redis Stack\n",
        "\n",
        "Later in this tutorial, Redis will be used to store, index, and query vector\n",
        "embeddings created from PDF document chunks. **We need to make sure we have a Redis\n",
        "instance available.\n",
        "\n",
        "#### For Colab\n",
        "Use the shell script below to download, extract, and install [Redis Stack](https://redis.io/docs/getting-started/install-stack/) directly from the Redis package archive."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "id": "2cb85a99",
      "metadata": {
        "id": "2cb85a99"
      },
      "outputs": [],
      "source": [
        "# NBVAL_SKIP\n",
        "%%sh\n",
        "curl -fsSL https://packages.redis.io/gpg | sudo gpg --dearmor -o /usr/share/keyrings/redis-archive-keyring.gpg\n",
        "echo \"deb [signed-by=/usr/share/keyrings/redis-archive-keyring.gpg] https://packages.redis.io/deb $(lsb_release -cs) main\" | sudo tee /etc/apt/sources.list.d/redis.list\n",
        "sudo apt-get update  > /dev/null 2>&1\n",
        "sudo apt-get install redis-stack-server  > /dev/null 2>&1\n",
        "redis-stack-server --daemonize yes"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "7c5dbaaf",
      "metadata": {
        "id": "7c5dbaaf"
      },
      "source": [
        "#### For Alternative Environments\n",
        "There are many ways to get the necessary redis-stack instance running\n",
        "1. On cloud, deploy a [FREE instance of Redis in the cloud](https://redis.com/try-free/). Or, if you have your\n",
        "own version of Redis Enterprise running, that works too!\n",
        "2. Per OS, [see the docs](https://redis.io/docs/latest/operate/oss_and_stack/install/install-stack/)\n",
        "3. With docker: `docker run -d --name redis-stack-server -p 6379:6379 redis/redis-stack-server:latest`"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "1d4499ae",
      "metadata": {
        "id": "1d4499ae"
      },
      "source": [
        "### Define the Redis Connection URL\n",
        "\n",
        "By default this notebook connects to the local instance of Redis Stack. **If you have your own Redis Enterprise instance** - replace REDIS_PASSWORD, REDIS_HOST and REDIS_PORT values with your own."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 1,
      "id": "aefda1d1",
      "metadata": {
        "id": "aefda1d1"
      },
      "outputs": [],
      "source": [
        "import os\n",
        "import warnings\n",
        "\n",
        "warnings.filterwarnings('ignore')\n",
        "\n",
        "# Replace values below with your own if using Redis Cloud instance\n",
        "REDIS_HOST = os.getenv(\"REDIS_HOST\", \"localhost\") # ex: \"redis-18374.c253.us-central1-1.gce.cloud.redislabs.com\"\n",
        "REDIS_PORT = os.getenv(\"REDIS_PORT\", \"6379\")      # ex: 18374\n",
        "REDIS_PASSWORD = os.getenv(\"REDIS_PASSWORD\", \"\")  # ex: \"1TNxTEdYRDgIDKM2gDfasupCADXXXX\"\n",
        "\n",
        "# If SSL is enabled on the endpoint, use rediss:// as the URL prefix\n",
        "REDIS_URL = f\"redis://:{REDIS_PASSWORD}@{REDIS_HOST}:{REDIS_PORT}\""
      ]
    },
    {
      "cell_type": "markdown",
      "id": "f8c6ef53",
      "metadata": {
        "id": "f8c6ef53"
      },
      "source": [
        "### Create redis client"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 48,
      "id": "370c1fcc",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "370c1fcc",
        "outputId": "2b5297c6-83b7-468f-b2ac-c47acf13ba2e"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "True"
            ]
          },
          "execution_count": 48,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redis import Redis\n",
        "\n",
        "client = Redis.from_url(REDIS_URL)\n",
        "client.ping()"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 4,
      "id": "H4w8c3Bevzq4",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "H4w8c3Bevzq4",
        "outputId": "a4d3b9a4-adda-436e-9aef-b4b0120720ab"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "True"
            ]
          },
          "execution_count": 4,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "#client.flushall()"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "jCXiuk9ZTN_K",
      "metadata": {
        "id": "jCXiuk9ZTN_K"
      },
      "source": [
        "### Load Movies Dataset"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 49,
      "id": "8d561462",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 223
        },
        "id": "8d561462",
        "outputId": "75ae0f32-115f-427e-e426-9a018884e860"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Loaded 20 movie entries\n"
          ]
        },
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"df\",\n  \"rows\": 20,\n  \"fields\": [\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 20,\n        \"samples\": [\n          \"Explosive Pursuit\",\n          \"Despicable Me\",\n          \"The Incredibles\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"comedy\",\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"number\",\n        \"std\": 0,\n        \"min\": 6,\n        \"max\": 9,\n        \"num_unique_values\": 4,\n        \"samples\": [\n          8,\n          9\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"description\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 20,\n        \"samples\": [\n          \"A daring cop chases a notorious criminal across the city in a high-stakes game of cat and mouse.\",\n          \"When a criminal mastermind uses a trio of orphan girls as pawns for a grand scheme, he finds their love is profoundly changing him for the better.\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe",
              "variable_name": "df"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-918fd267-125d-4f88-bf24-a3a73afbd7f5\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>title</th>\n",
              "      <th>genre</th>\n",
              "      <th>rating</th>\n",
              "      <th>description</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Explosive Pursuit</td>\n",
              "      <td>action</td>\n",
              "      <td>7</td>\n",
              "      <td>A daring cop chases a notorious criminal acros...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Skyfall</td>\n",
              "      <td>action</td>\n",
              "      <td>8</td>\n",
              "      <td>James Bond returns to track down a dangerous n...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Fast &amp; Furious 9</td>\n",
              "      <td>action</td>\n",
              "      <td>6</td>\n",
              "      <td>Dom and his crew face off against a high-tech ...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>Black Widow</td>\n",
              "      <td>action</td>\n",
              "      <td>7</td>\n",
              "      <td>Natasha Romanoff confronts her dark past and f...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>John Wick</td>\n",
              "      <td>action</td>\n",
              "      <td>8</td>\n",
              "      <td>A retired hitman seeks vengeance against those...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-918fd267-125d-4f88-bf24-a3a73afbd7f5')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-918fd267-125d-4f88-bf24-a3a73afbd7f5 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-918fd267-125d-4f88-bf24-a3a73afbd7f5');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-e1aed19e-ae4c-45a9-8dd1-f63a2a98dd6d\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-e1aed19e-ae4c-45a9-8dd1-f63a2a98dd6d')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-e1aed19e-ae4c-45a9-8dd1-f63a2a98dd6d button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "               title   genre  rating  \\\n",
              "0  Explosive Pursuit  action       7   \n",
              "1            Skyfall  action       8   \n",
              "2   Fast & Furious 9  action       6   \n",
              "3        Black Widow  action       7   \n",
              "4          John Wick  action       8   \n",
              "\n",
              "                                         description  \n",
              "0  A daring cop chases a notorious criminal acros...  \n",
              "1  James Bond returns to track down a dangerous n...  \n",
              "2  Dom and his crew face off against a high-tech ...  \n",
              "3  Natasha Romanoff confronts her dark past and f...  \n",
              "4  A retired hitman seeks vengeance against those...  "
            ]
          },
          "execution_count": 49,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "import pandas as pd\n",
        "import numpy as np\n",
        "import json\n",
        "\n",
        "df = pd.read_json(\"resources/movies.json\")\n",
        "print(\"Loaded\", len(df), \"movie entries\")\n",
        "\n",
        "df.head()"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 50,
      "id": "bfiTJovpQX90",
      "metadata": {
        "id": "bfiTJovpQX90"
      },
      "outputs": [],
      "source": [
        "from redisvl.utils.vectorize import HFTextVectorizer\n",
        "\n",
        "os.environ[\"TOKENIZERS_PARALLELISM\"] = \"false\"\n",
        "\n",
        "\n",
        "hf = HFTextVectorizer(\"sentence-transformers/all-MiniLM-L6-v2\")"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 51,
      "id": "Vl3SehnxQvXo",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 206
        },
        "id": "Vl3SehnxQvXo",
        "outputId": "6b9f5555-dee7-4fd6-8dae-628919cfdc74"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"df\",\n  \"rows\": 20,\n  \"fields\": [\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 20,\n        \"samples\": [\n          \"Explosive Pursuit\",\n          \"Despicable Me\",\n          \"The Incredibles\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"comedy\",\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"number\",\n        \"std\": 0,\n        \"min\": 6,\n        \"max\": 9,\n        \"num_unique_values\": 4,\n        \"samples\": [\n          8,\n          9\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"description\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 20,\n        \"samples\": [\n          \"A daring cop chases a notorious criminal across the city in a high-stakes game of cat and mouse.\",\n          \"When a criminal mastermind uses a trio of orphan girls as pawns for a grand scheme, he finds their love is profoundly changing him for the better.\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 20,\n        \"samples\": [\n          \"b'\\\\x9bf|=\\\\na\\\\n;\\\\xbf\\\\x91\\\\xb7;\\\\x19\\\\xcb~\\\\xbd\\\\xd9d\\\\xce\\\\xbb\\\\xda\\\\x16J=X\\\\xa7?=\\\\xd4v\\\\x95<e\\\\xfa\\\\x06\\\\xbe\\\\x14Y\\\\xcf=1\\\\x07p=?\\\\xdb\\\\r\\\\xbd\\\\x8d\\\\xf2H\\\\xbdne\\\\xc6<@\\\\xdfa=e8\\\\x16\\\\xbc\\\\xa3\\\\xd3\\\\x13<9\\\\xaa\\\\x1c=\\\\x07\\\\xef\\\\x89<\\\\xca\\\\xb0-<\\\\x95\\\\xb2\\\\x9f\\\\xbcR\\\\x0b\\\\xc3\\\\xbd\\\\x9bNR=al\\\\xf7\\\\xbcN>\\\\x17\\\\xbe\\\\x14\\\\x11\\\\x05\\\\xb94u\\\\xbf<\\\\xc3\\\\xe0b\\\\xba\\\\xd0\\\\xa6\\\\xa8\\\\xbd\\\\x84\\\\xdc\\\\xec\\\\xbcTc%=\\\\xfe\\\\xe6r\\\\xbb+OG=5(\\\\x85=s@\\\\xa2\\\\xbc.Z\\\\xd0\\\\xbd;%K\\\\xbd\\\\xa5\\\\xed\\\\x94\\\\xbcn\\\\xddH=\\\\xbb&F<\\\\xc8*\\\\xec<\\\\x8d\\\\xd8\\\\x8d\\\\xbd\\\\xc9Z\\\\x98<\\\\r\\\\xa3\\\\xa3=:g3\\\\xbd\\\\x1f\\\\xcd\\\\xbd\\\\xbd\\\\x11%\\\\xf7;\\\\r\\\\xf5z=\\\\x02\\\\xb5\\\\x8c=\\\\x91\\\\x0e\\\\xc6\\\\xbdlI\\\\x90\\\\xbd%\\\\x16\\\\xbd;}\\\\xe7\\\\x0c\\\\xbd!3\\\\xc9\\\\xbct\\\\xf8\\\\xbb\\\\xbc\\\\xd2&u\\\\xbbA\\\\x8f\\\\xca<\\\\xfe\\\\x7fJ=\\\\x0b\\\\xaf*=\\\\x8dOU\\\\xbd\\\\xcd\\\\xf0\\\\x95\\\\xbc\\\\x1d\\\\x02\\\\x19=1\\\\xf4K<\\\\xcf\\\\xc2\\\\t=H\\\\x83\\\\xac=\\\\x9e\\\\xd7\\\\xb8\\\\xbd\\\\xf4\\\\xb5\\\\x9c\\\\xbd9\\\\x85\\\\x18=\\\\x9cd&=93\\\\xf8<\\\\xf2\\\\xf7\\\\x88<5v\\\\xf2\\\\xbb$=[\\\\xbd\\\\xa3\\\\xac\\\\xee\\\\xbb7:A\\\\xbd\\\\xd9d\\\\x19\\\\xbd\\\\xb7c\\\\xf2\\\\xbb\\\\x84\\\\xb9x;\\\\xb0;O<\\\\xc11,\\\\xbc\\\\xe4\\\\xae\\\\xae=\\\\x9f\\\\x00-\\\\xbc\\\\x14\\\\x06\\\\xae\\\\xbdh\\\\xd6\\\\x1a=\\\\xc4\\\\xbf\\\\xcd=\\\\x19\\\\x150=\\\\xe8\\\\xf1\\\\x9d\\\\xbc\\\\xaaGK=\\\\xaf\\\\xb8 =\\\\xb2\\\\xf1I\\\\xbdIe\\\\x9e\\\\xbb/\\\\x89\\\\xf7:\\\\x94\\\\xf8\\\\x1c=\\\\xa2\\\\xba\\\\xde<\\\\xa7o\\\\x16\\\\xbb\\\\t^p\\\\xbb\\\\xef\\\\xd5<<#\\\\xa6\\\\xa3\\\\xb8\\\\xc99s<\\\\xe83&<]\\\\x1c\\\\x18<\\\\x1c\\\\xd9-\\\\xbd\\\\xd3\\\\xe6\\\\x98<\\\\x0f\\\\xa1N=\\\\xa1/\\\\xa5=\\\\x1e\\\\xf3\\\\xdd<AL\\\\x13<\\\\xe5\\\\x12\\\\xce\\\\xba]\\\\x9e\\\\xdc\\\\xbc\\\\xa98\\\\x05=4\\\\xa1\\\\xf5<$\\\\xd8R\\\\xbc)\\\\x94-\\\\xbc\\\\xd1\\\\xea\\\\\\\\9\\\\xa01\\\\xec=]\\\\xf5V=>G\\\\xd6\\\\xbc\\\\x91\\\"S=\\\\xd7\\\\xd9^\\\\xbd\\\\xac\\\\xa3\\\\x91<\\\\xe5\\\\xd9\\\\x13<\\\\xbb\\\\xb2y\\\\xbbw\\\\x8d/\\\\xbd\\\\x99\\\\x06p<n\\\\x95\\\\x88\\\\xbb\\\\x8c\\\\xd0\\\\x9d<J\\\\x02\\\\xb6=\\\\x15\\\\xf1\\\\xad\\\\x89P\\\\xf2\\\\xa6\\\\xbb\\\\xb1\\\\xfbe\\\\xbd\\\\xddQK\\\\xbb\\\\x12\\\\x10\\\\x90\\\\xbb\\\\xf9s\\\\xb9\\\\xbbm\\\\xc9\\\\xb9\\\\xbb\\\\x03ik=\\\\xaa\\\\r\\\\xad<0f\\\\xa8\\\\xbd\\\\xb8]\\\\xcc=\\\\x16\\\\xe0 \\\\xbe\\\\xce4/\\\\xbdkf\\\\xf7\\\\xbc]\\\\x9av=\\\\xd8\\\\x0bq<-\\\\xda\\\\x1c\\\\xbd\\\\xf1\\\\x08\\\\x8b<\\\\xddn\\\\xa6\\\\xbc\\\\xb7t\\\\x86<\\\\x80\\\\x87\\\\x19=t\\\\xae\\\\xe4\\\\xbc\\\\x03m^\\\\xbc\\\\x15V\\\\x0e\\\\xbdx\\\\xb0\\\\xe3\\\\xbc\\\\xbeFU;\\\\xafG|\\\\xbdX\\\\xfb\\\\x8b\\\\xbd|\\\\x81*\\\\xbdw\\\\x83\\\\xf4=\\\\x88\\\\xb7\\\\x10;\\\\x0c!\\\\x0e\\\\xbd\\\\x03\\\\xd4\\\\xb4=\\\\x12&\\\\x15\\\\xbdU\\\\x86\\\\x83=V$:<#\\\\xea\\\\xa1<\\\\x1c\\\\x08\\\\x8d\\\\xbd\\\\x9f\\\\x00i\\\\xbd(\\\\x01\\\\xdd<\\\\x03\\\\x87\\\\xd6=6\\\\x98\\\\x9c\\\\xbd]|!\\\\xbd\\\\x88\\\\x1a\\\\xc5\\\\xb9\\\\xc0\\\\xb3\\\\x93\\\\xbc\\\\xe3\\\\xcb>\\\\xbd\\\\x83\\\\x1bF\\\\xbd\\\\xa2?\\\\x14\\\\xbe\\\\xc8\\\\x8f(\\\\xbd\\\\xe7O\\\\x89\\\\xbd\\\\x12\\\\xae\\\\xd4<\\\\xa6\\\\x12\\\\xc3=\\\\xb2\\\\x05O\\\\xbdZ\\\\x8ep\\\\xbc\\\\x1d\\\\xb5\\\\xac\\\\xbc\\\\xcc\\\\x9ee\\\\xbdf\\\\x8es;Ia\\\\xc1;\\\\xe5\\\\xfaB\\\\xbd\\\\x86\\\"\\\\xfe:\\\\x9c\\\\xe6\\\\xf4=\\\\xf6\\\\x15*<\\\\x81\\\\xf8\\\\x1b=\\\\x04\\\\xfcV\\\\xbd\\\\xd1\\\\xd1\\\\r==\\\\xee\\\\x06=\\\\x0cu\\\\xba\\\\xbd\\\\x10\\\\xa4\\\\xd6<\\\\xe3\\\\xeb\\\\xd9;\\\\xbe9/=\\\\xa9\\\\xc2\\\\x85=~\\\\x0b\\\"=\\\\xffi\\\\xef<7\\\\xe8c=\\\\xfb2\\\\x08\\\\xbe\\\\xe1\\\\x12;=YVW;P\\\\xa4b<\\\\xc8\\\\x9d\\\\xb7<\\\\x7fr;\\\\xbdhz\\\\x91\\\\xbcT\\\\x00<\\\\xbd\\\\x00\\\\x1a\\\\xa3<<K%\\\\xbca\\\\xe7\\\\xbf\\\\xbb|\\\\x87\\\\x12=\\\\x94\\\\x1d\\\\x95=\\\\x8c|\\\\xfd\\\\xbc\\\\xf1\\\\xf1\\\\xd1\\\\xbd\\\\x1dz\\\\x84;\\\\xd2\\\\tu=-\\\\x8ai<2\\\\x91R\\\\xbd\\\\xe2\\\\xf3m\\\\xbd\\\\x80\\\\xb83=_\\\\xedF=-\\\\xf3\\\\xd1\\\\x08xA\\\\xba<+\\\\xacO\\\\xbd\\\\x17\\\\x0f\\\\xc7;r\\\\xf4\\\\x04\\\\xbdJ\\\\x82\\\\x92\\\\xbd\\\\xad\\\\xddD=H\\\\xd8;\\\\xbc\\\\xdf;\\\\xf4\\\\xbc\\\\xbc\\\\x8f\\\\x97\\\\xbd0\\\\\\\\\\\\r\\\\xbd\\\\xe6\\\\x8c\\\\xf5\\\\xbd\\\\x91\\\\x13(=\\\\x9d\\\\xc8\\\\xc6=\\\\xb5\\\\xed\\\\x1a=\\\\x98\\\\xa8\\\\xf8=\\\\x99\\\\xc1\\\\xee\\\\xbc\\\\xc1.\\\\x18\\\\xbb\\\\xea~;<\\\\xd2F\\\\t\\\\xbd \\\\x08\\\\x17=\\\\x9d\\\\xa5\\\\x1e=\\\\x14K\\\\xcb\\\\xbd.\\\\xf7\\\\x8c\\\\xbdhb\\\\xed\\\\xbb\\\\xad[\\\\x19\\\\xbc\\\\\\\\\\\\x0c\\\\x13\\\\xbcZq\\\\x83=\\\\xebwd\\\\xbd\\\\xc7\\\\xc7\\\\xd1\\\\xbb\\\\x1elY\\\\xbc\\\\xa1|a=<\\\\xcf\\\\xfd\\\\xbc\\\\\\\\\\\\xa5\\\\x83\\\\xbb\\\\x94O\\\\x19\\\\xbd-\\\\x02]\\\\xbd\\\\xbc\\\\xeaz=\\\\xf75\\\\x9c=1^\\\\xa9\\\\xbd;^9\\\\xbcS\\\\xe4N\\\\xbcv\\\\x07x\\\\xbd\\\\x18{\\\\xa0=G\\\\x9f\\\\x96<Ct8\\\\xba\\\\x9d\\\\xbb=\\\\xbd\\\\xe2|(<\\\\x90\\\\xdf\\\\xb4\\\\xbbn\\\\xc9\\\\x0b\\\\xbd\\\\xbf\\\\x01\\\\x95\\\\xbd\\\\xfd\\\\xc6T=\\\\xfeo\\\\xd1<u3\\\\'\\\\xbd\\\\xae\\\\x00H<\\\\x91\\\\x0f\\\\xb8<)U}\\\\xbd\\\\x81}\\\\x01=\\\\xff\\\\xc9[\\\\xbd\\\\x1f\\\\xed\\\\x03<\\\\xfdb\\\\x0f\\\\xbd\\\\xb5\\\\x8e\\\\xe7\\\\xbc\\\\xf7\\\\x16\\\\xc8<\\\\xba\\\\x08\\\\x9c=\\\\x02\\\\xd5\\\\xa6\\\\xbdKQ\\\\xe5=\\\\\\\\-O<\\\\xd2\\\\xf22=\\\\xd326\\\\xbd\\\\xfc\\\\xe2\\\\xf2\\\\xbc\\\\x05[\\\\xa7<v\\\\xb2\\\\x02\\\\xbe\\\\xf4n2\\\\xbd\\\\xae\\\\x80\\\\x8a=\\\\xfe\\\\xc3\\\\t\\\\xbd\\\\x1a\\\\xb8\\\\xcd\\\\xbc\\\\xa6\\\\xdb\\\\xad\\\\xbb\\\\x8e\\\\xfd\\\\xde\\\\xbc\\\\x07\\\\x17E=\\\\x81\\\\x06\\\\xbd=$&m=\\\\x15X\\\\x8e=\\\\xe8\\\\xae\\\\xa4=\\\\x15\\\\xa3\\\\xca\\\\xbbq?\\\\r\\\\xbc\\\\xde9\\\\x9c<Nl\\\\x8e\\\\xbd<\\\\x10k=\\\\xa4\\\\xff\\\\xbe;n\\\\x16\\\\xff<z8\\\\x92<\\\\x9d2\\\\x8c;F\\\\xac\\\\xa3=W,v<\\\\x11\\\\x89\\\\xf0\\\\xbb\\\\xb8\\\\xdb\\\\x07\\\\xbc\\\\x81\\\\xae\\\\xbd\\\\xbc\\\\xb3\\\\x8f\\\\xb4\\\\xb2\\\\xaf\\\\x88\\\\xd3\\\\xbd\\\\x88\\\\xe9j=\\\\xe9\\\\xdb\\\\xa7\\\\xbd\\\\xd5\\\\x16\\\\xe5<:\\\\x19p=\\\\xf5\\\\xe6\\\\x9f=\\\\xe2Gh\\\\xbd\\\\xec\\\\x9a\\\\xf4\\\\xbdW\\\\xd6\\\\x07\\\\xbcP\\\\xddj<\\\\x13tw=\\\\x93\\\\xd0\\\\xe1<\\\\xb9\\\\xae\\\\x1e=\\\\xddF\\\\xc4<\\\\x7f0\\\\n<Bjd\\\\xbc\\\\xb7\\\\xfa\\\\x8c=\\\\x05\\\\x8b\\\\xa6\\\\xbc\\\\xc4-\\\\xcd\\\\xba\\\\xaep\\\\xcf=\\\\x17T-\\\\xbd\\\\xcaQn=<\\\\x16\\\\x9f\\\\xbd\\\\x95\\\\x8a_=A\\\\x13#<\\\\x01\\\\xabm;(\\\\x86\\\\x00\\\\xbe\\\\xdfy\\\\x8b\\\\xbceUG=\\\\xa2\\\\xa3\\\\xca={\\\\xbdq\\\\xbc\\\\x9d\\\\xe3:\\\\xbd\\\\xbd\\\\x93]<\\\\x8b]\\\\xd1;\\\\xc3d\\\\xae=\\\\xa9\\\\x1f\\\\x03\\\\xbd\\\\x06L\\\\x89=f:s\\\\xbd\\\\xa7\\\\x1eb=>\\\\xca\\\\t\\\\xbb\\\\xa1\\\\xfb\\\\xe7<z\\\\xce\\\\xe4\\\\xbcIV#=w\\\\x8bk\\\\xbd\\\\xf6h\\\\x01<\\\\xec\\\\xe5N\\\\xbd_\\\\x0c\\\\xb1\\\\xbcg\\\\x01J\\\\xbd\\\\\\\\\\\\xf4~=D\\\\xe3Z\\\\xbd\\\\x88/\\\\xf1\\\\xbb=98=\\\\x992T\\\\xbc3\\\\'\\\\x81<\\\\xc0\\\\xa0M=\\\\xe6\\\\xde\\\\x05<)I|\\\\xbd\\\\xcc\\\\x98w<\\\\xe2\\\\xd3\\\\xa7\\\\xbd\\\\xc6S \\\\xbd\\\\x81\\\\x13\\\\x07=\\\\xe9%\\\\x14\\\\xbc\\\\xc0v\\\\xe9<\\\\xf9,\\\\x97='\",\n          \"b'\\\\x05\\\\xb1\\\\x82\\\\xbd\\\\x14\\\\xeb\\\\xe6<\\\\x9b\\\\xbbI\\\\xbd\\\\x89\\\\x8bm\\\\xbc\\\\xac*\\\\x96\\\\xbc]H\\\\xf3<\\\\xbcu\\\\n=\\\\xd0\\\\x00@\\\\xbc\\\\xaa\\\\x05\\\\x85=\\\\x03\\\\x1cK\\\\xbch\\\\xd2*=\\\\x88(\\\\xb0=O\\\\x90\\\\xda<\\\\x98\\\\x91\\\\xfc\\\\xbc\\\\xd0y\\\\xb3;\\\\x16\\\\xe5\\\\xed<\\\\xbfw\\\\xbe<V\\\\xf5#=\\\\x92\\\\x15\\\\x0c\\\\xbdh\\\\xd6S\\\\xbc\\\\x07\\\\'\\\\x8f\\\\xbbI\\\\n\\\\x02\\\\xbe\\\\xed\\\\xfdk<\\\\x1e\\\\xb5\\\\x98\\\\xbd\\\\xcd\\\\x84X\\\\xbd\\\\xceR\\\\xdd<1\\\\x95\\\\xf4<\\\\xc9x1\\\\xbb\\\\x1b\\\\xe3\\\\x12\\\\xbd\\\\xfc\\\\x8f\\\\xe8;nH\\\\xfe<\\\\xf9\\\\xae\\\\x84=\\\\xa8\\\\x85l=\\\\xe9\\\\xa2l=@\\\\x11]\\\\xbc\\\\xddO0<J\\\\x83(\\\\xbd\\\\xe1S\\\\xd2=\\\\x9bJ\\\\xac\\\\xbc\\\\xbb\\\\xbb\\\\xa8\\\\xbbG\\\\xf1\\\\x08=\\\\xbc\\\\xa2\\\\xb6\\\\xbc\\\\xc3\\\\x14(\\\\xbc\\\\x10\\\\xf6\\\\x9f<\\\\x8b\\\\x13\\\\x8f\\\\xbd\\\\xaahD\\\\xbd\\\\xb6\\\\x14+\\\\xbd\\\\xb5\\\\xdb\\\\xd6\\\\xbc\\\\xc1\\\\x05\\\\\\\\<=\\\\xfb\\\\x0f\\\\xbe\\\\xfc\\\\x8e\\\\xc4\\\\xbc0\\\\xed-\\\\xbd\\\\x8a\\\\xdeS\\\\xbdPl0=0#!\\\\xbck\\\\xce@<d\\\\xba\\\\xab=\\\\xe5\\\\x951<\\\\x9b\\\\xd2\\\\xe9<n\\\\xbf\\\\xc6;f\\\\'\\\\xa2=\\\\x88\\\\x94\\\\xb5=\\\\xc5\\\\x94%=o\\\\r\\\\x87\\\\xbd\\\\xb8\\\\xc1\\\\xc1=\\\\xc0\\\\x97N\\\\xbb)\\\\x1a\\\\xce\\\\xbc86?<3\\\\xefp\\\\xbdIQ\\\\xe3=l\\\\xbe\\\\xe9\\\\xbb\\\\n\\\\xdd&=\\\\xc8{\\\\x91\\\\xbdV\\\\xd3!8\\\\xf5\\\\xf9\\\\x84\\\\xbd\\\\xbfC\\\\xcf\\\\xbbx\\\\xaf\\\\x06=\\\\xbf\\\\n\\\\xbe\\\\xbc\\\\x9e\\\\x0f/=\\\\xea\\\\x86\\\\x0f\\\\xbd\\\\x17d\\\\x91\\\\xbd6\\\\x13X\\\\xbd\\\\xca\\\\xc6\\\\xbb\\\\xbd\\\\x8cb\\\\x7f;\\\\xe0V\\\\x8b\\\\xbc\\\\xd0v\\\\x9a\\\\xbd\\\\x99P{\\\\xbd\\\\xe8\\\\x94\\\\x02\\\\xbe\\\\xd5!L=\\\\x93\\\\xc2\\\\xc1\\\\xbcT\\\\x80\\\\xb4\\\\xbd%\\\\x9d\\\\x11\\\\xbd\\\\x91\\\\xfa\\\\x05=D\\\\x98J\\\\xbcd\\\\xd2\\\\x11<0\\\\x18?=\\\\xf1\\\\xab\\\\xe7\\\\xbc#\\\\\\\\v\\\\xbc gC\\\\xbd\\\\x96X\\\\x85=\\\\xdds\\\\xbf:\\\\xbb4\\\\r=`\\\\xb8\\\\'<\\\\x1bPR\\\\xbdT;-<\\\\x0fvz\\\\xbb\\\\x9d\\\\x19|=<\\\\x83\\\\xfa<\\\\x8b\\\\x93\\\\xf5\\\\xbb^\\\\xbeB;2\\\\xc7\\\\xc5<\\\\x9dB1\\\\xbd\\\\xd7=\\\\x9e=~\\\\xe4)=\\\\x86\\\\xef\\\\xc6<\\\\xa9\\\\xa4h<;\\\\xfd\\\\x88<\\\\x9b?\\\\xbb<\\\\xb7f\\\\x98\\\\xbcF+\\\\xc1=\\\\x01\\\\xb0\\\\xeb=\\\\xae\\\\xbb\\\\xea<\\\\n.&\\\\xbd\\\\\\\\n\\\\xdb<\\\\xe7G\\\\xa1\\\\xbd\\\\xf4\\\\xbc\\\\xd3\\\\xbc\\\\xb0\\\\x95\\\\x82\\\\xbd\\\\x9ar\\\\xd1\\\\x88T\\\\\\\\\\\\xec\\\\xbc\\\\xcf\\\\xe1\\\\x83\\\\xbc\\\\xd3*F\\\\xbc\\\\x05\\\\xc4G=\\\\x0b\\\\x18\\\\x0b=\\\\xd1\\\\x93A:\\\\x82\\\\xf0y<\\\\x9c:\\\\x93\\\\xbdv\\\\x00\\\\x99\\\\xbc\\\\xe5\\\\x8c\\\\x8b=6V2\\\\xbdPwn\\\\xbd\\\\x8b\\\\xc3\\\\xa4\\\\xbd/\\\\x0f\\\\xad<\\\\xfd\\\\x93\\\\xbb\\\\xbd\\\\x8fEC<8\\\\xc4.\\\\xbd\\\\xb9\\\\xb7\\\\xad\\\\xbc\\\\xd3\\\\x1b\\\\xae=\\\\x8f\\\\x02.=\\\\x065]\\\\xbd\\\\xc0%\\\\x0f>\\\\xa5\\\\x9f\\\\x0c\\\\xbc\\\\x07Q\\\\x9a\\\\xbd\\\\xb3\\\\x08y\\\\xbd\\\\xdaAT;\\\\xddT\\\\xe2<\\\\xfe\\\\xff\\\\x1c\\\\xbd\\\\x8b\\\\xe4\\\\x9e=\\\\x8c-\\\\x0c;\\\\xc3\\\\x0f>;[8\\\\xea=>\\\\xb7\\\\xd5\\\\xbcN\\\\x8c\\\\xf9\\\\xbc\\\\xd7\\\\xc7\\\\xd2\\\\xbaa8\\\\t<\\\\t\\\\x8a\\\\x17\\\\xbdP\\\\x12A\\\\xbd\\\\x90\\\\x89\\\\x82\\\\xbbFy\\\\xc7=,\\\\xddy\\\\xbd\\\\xd2\\\\xf1\\\\x82<\\\\x1c\\\\xe0\\\\xb0<\\\\xdd\\\\x12\\\\xc8<\\\\xd5M\\\\xdf\\\\xbc\\\\x9f\\\\x16\\\\x9a=\\\\xa2W\\\\xb2<\\\\xcbab;\\\\x9di\\\\x96\\\\xbco\\\\x00W<\\\\'\\\\xb6\\\\xe4\\\\xbc\\\\x07 \\\\xb8;^\\\\x0bI\\\\xbdQ\\\\xc0\\\\xbe\\\\xbc\\\\x92n\\\\x95\\\\xbc\\\\x9f\\\\x11\\\\x83=\\\\xd2\\\\xb0\\\\xf5\\\\xbc\\\\xc7g\\\\x8a<?9i=\\\\x04\\\\xcbT\\\\xbd\\\\xcbn\\\\xdf=\\\\xa4\\\\xe4\\\\xc3\\\\xbd\\\\xaa\\\\xdb\\\\xe6\\\\xbc&\\\\x1fI\\\\xbcC]\\\\x9b=\\\\r\\\\xd3y\\\\xbcb\\\\xc8\\\\xdb=\\\\xd9N\\\\xb8<\\\\xcf^%\\\\xbd\\\\xdeh\\\\xd9<\\\\xe5\\\\x88\\\\xd1\\\\xbd\\\\xce/\\\\t=\\\\xfc\\\\xa7A\\\\xbc\\\\xb6c1=\\\\xf5\\\\xc7R\\\\xbd\\\\xb9\\\\x00G\\\\xbdN\\\\xd1\\\\xbe=\\\\xf9X\\\\x17<\\\\xd4\\\\xea\\\\xd4\\\\xbc\\\\xe3\\\\x96\\\\x8c\\\\xbdx\\\\xd3\\\\xcd;\\\\xab/\\\\xdb<\\\\xd8L\\\\x80<ER\\\\xd4<.9\\\\xa8\\\\xbd\\\\xc4\\\\xa8\\\\xef\\\\xbc\\\\xce\\\\xe8\\\\x0e=\\\\xe5\\\\xf6\\\\x03\\\\xbe\\\\x88\\\\xe9\\\\xc6<@\\\\xbc\\\\x97=\\\\xba\\\\x18d=Gj\\\\x7f\\\\xbd\\\\xa1\\\\x0f\\\\x00\\\\xbdM\\\\x98w;\\\\x95~1\\\\xbc\\\\xd2\\\\x13\\\\xf1\\\\x88\\\\xf4\\\\xc1\\\\x16\\\\xbc\\\\xeb*\\\\xf0\\\\xbd\\\\x9ds?\\\\xbc\\\\n\\\\x9a\\\\xcb<\\\\xb8-\\\\x90=[\\\\xee\\\\'\\\\xbd\\\\xfb*\\\\xf2\\\\xbd \\\\xe2\\\\xf4\\\\xbc{B\\\\xf2<\\\\xa8(f=\\\\x02\\\\xa5\\\\xc4\\\\xbd\\\\xadG\\\\x8b\\\\xbdk\\\\xd7}=k.\\\\xe6;OC:=\\\\xc6\\\\tJ\\\\xbd\\\\x88o\\\\xf8<\\\\x86\\\\xd7\\\\xa8\\\\xbc\\\\xf2\\\\xc5\\\\xc8\\\\xbc\\\\x7f#\\\\xa5;\\\\xb4\\\\x81\\\\xaa=\\\\x02\\\\x7f\\\\xbd=:\\\\xaf=\\\\xbc\\\\xea\\\\xea\\\\xd3<\\\\tM\\\\x91:m\\\\xc5\\\\x17<C_\\\\x12\\\\xbcz\\\\x83\\\\x1c<\\\\x0b\\\\xa5\\\\x05\\\\xbe\\\\x19%{=p\\\\xa9\\\\x00\\\\xbd.\\\\xe2\\\\x94\\\\xbb\\\\t\\\\xb8Z\\\\xbc\\\\xee\\\\x8d,=\\\\x8f\\\\xa2\\\\xa7\\\\xbd\\\\xa8\\\\x9b\\\\xbd<\\\\xfa\\\\x83\\\\xb4\\\\xbc\\\\xce\\\\xce3\\\\xbd]\\\\x05d\\\\xbcWR\\\\xc3<\\\\x95T\\\\xe3\\\\xbcLKh\\\\xb2$\\\\xd4\\\\x86=B\\\\x17\\\\xb3;\\\\xa4\\\\xce\\\\x18\\\\xbd\\\\x02\\\\x19+=9j[=\\\\xf4\\\\x19\\\\xfb=\\\\x07\\\\xde\\\"=\\\\xaa\\\\xfa\\\\xa2<\\\\x989\\\\xcc\\\\xbbV\\\\x0c\\\\xf3<j\\\\xe9\\\\x94\\\\xbdu\\\\xf8\\\\x06\\\\xbd\\\\xa8\\\\x1f+\\\\xba\\\\x9df\\\\x0f\\\\xbd\\\\x15o\\\\x8f=@\\\\x87\\\\x14\\\\xbd+\\\\xd1\\\\x80=\\\\xb7\\\\xc8s=C{k\\\\xbd\\\\xb6m\\\\xcb\\\\xbb\\\\x9b\\\\xdeL\\\\xbdTM{=\\\\x97\\\\x01\\\\x1b\\\\xbd\\\\x86\\\\xe7X=L<;\\\\xbd\\\\xe6`\\\\r\\\\xbd\\\\xd2\\\\\\\\\\\\xde\\\\xbcr\\\\x0fn<\\\\xf8x\\\\xe0<\\\\x86\\\\xfa\\\\xa2\\\\xbdv.\\\\x90\\\\xbd\\\\x9d\\\\x06\\\\x13\\\\xbd\\\\xdf)\\\\xfb<\\\\x0fr\\\\x03\\\\xbc\\\\x1c\\\\x04\\\\xcf\\\\xbd\\\\xdfz\\\\xb4\\\\xbc\\\\x9b\\\\xad\\\\x88\\\\xbdl\\\\xc4\\\\xc9\\\\xbd\\\\x7fNg<o\\\\xc1\\\\xae\\\\xbd\\\\xe2c\\\\'=9\\\\xe5\\\\xf8<\\\\xef\\\"x\\\\xbd\\\\xca\\\\x07\\\\xcc<_\\\\x89\\\\x82=\\\\x10\\\\x95\\\\xe0=|\\\\x80F<\\\\xd1o\\\\xad\\\\xbc\\\\xe9J`\\\\xbcn\\\"\\\\x91\\\\xbd\\\\x16\\\\xef\\\\x8a=]\\\\xbc\\\\x8d\\\\xbd\\\\x81\\\\x8b9\\\\xbbh\\\\x0c\\\\xfe\\\\xb2c\\\\xe5\\\\xcc\\\\xbc\\\\xf1%2=\\\\x86\\\\xb0\\\\xaa\\\\xbd`=\\\\x95\\\\xbd\\\\xca\\\\x8f%\\\\xbd\\\\xc8Uo<\\\\xa1\\\\xd8\\\\xc3\\\\xbd\\\\x0e\\\\x08\\\\xa2\\\\xbc3\\\\xcc\\\\x95;\\\\xf0\\\\xa3\\\\x93=\\\\x1e\\\\x90\\\\x13\\\\xbd\\\\xd0\\\\xb5\\\\x1a=\\\\\\\\K/=\\\\xc8\\\\xc1\\\\xd7\\\\xbc\\\\xe2\\\\x14\\\\x8a=\\\\xfc5\\\\xc3<Ph\\\\xeb=\\\\xfb=J\\\\xbd\\\\\\\\\\\\xb1x\\\\xbc\\\\x8a&h\\\\xbc\\\\x0e\\\\xefL<C\\\\x1a\\\\x88=,S\\\\r=\\\\x05\\\\xd3:\\\\xbc\\\\xfcv\\\\x0c\\\\xbdaJ\\\\x00=\\\\xa6\\\\x85\\\\xd5;z\\\\xc1\\\\xc1<\\\\xc9\\\\xa5\\\\xc7\\\\xbc\\\\x9f\\\\t\\\\xd4=\\\\xd15\\\\xc3<\\\\xfc\\\"\\\\x9e=`Q\\\\x9b<\\\\x0f\\\\xb6\\\\x1d=\\\\xda\\\\x9f\\\\xc3<\\\\xee\\\\xb4T=\\\\xde\\\\x8c\\\\x01\\\\xbd\\\\xcc2F=\\\\x07\\\\xac.=\\\\xb7\\\\xf0k\\\\xbd;8\\\\xe2<\\\\xe2y&\\\\xbdV\\\\xa9\\\\x9a\\\\xbd\\\\x1d\\\\xcd\\\\xe4\\\\xbc\\\\x17\\\\xc0\\\\xae\\\\xbco\\\\xb3\\\\xae\\\\xbc0y/=\\\\x92\\\\x9a{\\\\xbc\\\\t\\\\x03\\\\xd9<-\\\\xe6\\\\xef\\\\xbb|\\\\xe5R\\\\xbc\\\\'\\\\xb84:\\\\xfd\\\\xb6\\\\x1e=\\\\xae\\\\xaf\\\\x9a<7\\\\xa2\\\\xee=\\\\x03\\\\xe6\\\\xb0\\\\xbd*\\\\xe5\\\\xd2\\\\xbb\\\\xc5\\\\xcb\\\\x03=\\\\xc1Q*:e\\\\xd9f\\\\xbc\\\\xf49\\\\xcf=\\\\x117\\\\x83=\\\\xda\\\\x80\\\\x80=\\\\xf9\\\\xe1\\\\xa3\\\\xbd'\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe",
              "variable_name": "df"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-500ca84f-2943-44e7-b891-3603831d4423\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>title</th>\n",
              "      <th>genre</th>\n",
              "      <th>rating</th>\n",
              "      <th>description</th>\n",
              "      <th>vector</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Explosive Pursuit</td>\n",
              "      <td>action</td>\n",
              "      <td>7</td>\n",
              "      <td>A daring cop chases a notorious criminal acros...</td>\n",
              "      <td>b'\\x9bf|=\\na\\n;\\xbf\\x91\\xb7;\\x19\\xcb~\\xbd\\xd9d...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Skyfall</td>\n",
              "      <td>action</td>\n",
              "      <td>8</td>\n",
              "      <td>James Bond returns to track down a dangerous n...</td>\n",
              "      <td>b'\\x9aD\\x9e\\xbd0\\x9b\\x89\\xbc\\xc3\\x16\\x95\\xbc\\x...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Fast &amp; Furious 9</td>\n",
              "      <td>action</td>\n",
              "      <td>6</td>\n",
              "      <td>Dom and his crew face off against a high-tech ...</td>\n",
              "      <td>b'*\\xa5\\xc7\\xbc\\xf6,\\xa2=?\\x19H\\xbcK\\xc6t\\xbd\\...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>Black Widow</td>\n",
              "      <td>action</td>\n",
              "      <td>7</td>\n",
              "      <td>Natasha Romanoff confronts her dark past and f...</td>\n",
              "      <td>b'u\\xeb\\x85\\xbd\\x0e\\xcdo\\xbd&amp;\\xe8\\xc2\\xbb6\\xcf...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>John Wick</td>\n",
              "      <td>action</td>\n",
              "      <td>8</td>\n",
              "      <td>A retired hitman seeks vengeance against those...</td>\n",
              "      <td>b'\\xaf&lt;x\\xbb\\xfb.\\xc5=B\\x86:;\\xce\\xd0\\x94&lt;\\xf9...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-500ca84f-2943-44e7-b891-3603831d4423')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-500ca84f-2943-44e7-b891-3603831d4423 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-500ca84f-2943-44e7-b891-3603831d4423');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-b9fa390c-e837-4cd5-9ca8-e5e0bcd135ca\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-b9fa390c-e837-4cd5-9ca8-e5e0bcd135ca')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-b9fa390c-e837-4cd5-9ca8-e5e0bcd135ca button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "               title   genre  rating  \\\n",
              "0  Explosive Pursuit  action       7   \n",
              "1            Skyfall  action       8   \n",
              "2   Fast & Furious 9  action       6   \n",
              "3        Black Widow  action       7   \n",
              "4          John Wick  action       8   \n",
              "\n",
              "                                         description  \\\n",
              "0  A daring cop chases a notorious criminal acros...   \n",
              "1  James Bond returns to track down a dangerous n...   \n",
              "2  Dom and his crew face off against a high-tech ...   \n",
              "3  Natasha Romanoff confronts her dark past and f...   \n",
              "4  A retired hitman seeks vengeance against those...   \n",
              "\n",
              "                                              vector  \n",
              "0  b'\\x9bf|=\\na\\n;\\xbf\\x91\\xb7;\\x19\\xcb~\\xbd\\xd9d...  \n",
              "1  b'\\x9aD\\x9e\\xbd0\\x9b\\x89\\xbc\\xc3\\x16\\x95\\xbc\\x...  \n",
              "2  b'*\\xa5\\xc7\\xbc\\xf6,\\xa2=?\\x19H\\xbcK\\xc6t\\xbd\\...  \n",
              "3  b'u\\xeb\\x85\\xbd\\x0e\\xcdo\\xbd&\\xe8\\xc2\\xbb6\\xcf...  \n",
              "4  b'\\xaf<x\\xbb\\xfb.\\xc5=B\\x86:;\\xce\\xd0\\x94<\\xf9...  "
            ]
          },
          "execution_count": 51,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "# Generate vectors\n",
        "df[\"vector\"] = hf.embed_many(df[\"description\"].tolist(), as_buffer=True)\n",
        "\n",
        "df.head()"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "d7e99897",
      "metadata": {
        "id": "d7e99897"
      },
      "source": [
        "## Define Redis index schema"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 52,
      "id": "2ac53ebd",
      "metadata": {
        "id": "2ac53ebd"
      },
      "outputs": [],
      "source": [
        "from redisvl.schema import IndexSchema\n",
        "from redisvl.index import SearchIndex\n",
        "\n",
        "\n",
        "index_name = \"movies\"\n",
        "\n",
        "schema = IndexSchema.from_dict({\n",
        "  \"index\": {\n",
        "    \"name\": index_name,\n",
        "    \"prefix\": index_name,\n",
        "    \"storage_type\": \"hash\"\n",
        "  },\n",
        "  \"fields\": [\n",
        "    {\n",
        "        \"name\": \"title\",\n",
        "        \"type\": \"text\",\n",
        "    },\n",
        "    {\n",
        "        \"name\": \"description\",\n",
        "        \"type\": \"text\",\n",
        "    },\n",
        "    {\n",
        "        \"name\": \"genre\",\n",
        "        \"type\": \"tag\",\n",
        "        \"attrs\": {\n",
        "            \"sortable\": True\n",
        "        }\n",
        "    },\n",
        "    {\n",
        "        \"name\": \"rating\",\n",
        "        \"type\": \"numeric\",\n",
        "        \"attrs\": {\n",
        "            \"sortable\": True\n",
        "        }\n",
        "    },\n",
        "    {\n",
        "        \"name\": \"vector\",\n",
        "        \"type\": \"vector\",\n",
        "        \"attrs\": {\n",
        "            \"dims\": 384,\n",
        "            \"distance_metric\": \"cosine\",\n",
        "            \"algorithm\": \"flat\",\n",
        "            \"datatype\": \"float32\"\n",
        "        }\n",
        "    }\n",
        "  ]\n",
        "})\n",
        "\n",
        "\n",
        "index = SearchIndex(schema, client)\n",
        "index.create(overwrite=True, drop=True)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 53,
      "id": "kXbcEV-5BcE1",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "kXbcEV-5BcE1",
        "outputId": "fb0fd245-9e1c-43a4-9102-60fcd6305f77"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "\n",
            "\n",
            "Index Information:\n",
            "╭──────────────┬────────────────┬────────────┬─────────────────┬────────────╮\n",
            "│ Index Name   │ Storage Type   │ Prefixes   │ Index Options   │   Indexing │\n",
            "├──────────────┼────────────────┼────────────┼─────────────────┼────────────┤\n",
            "│ movies       │ HASH           │ ['movies'] │ []              │          0 │\n",
            "╰──────────────┴────────────────┴────────────┴─────────────────┴────────────╯\n",
            "Index Fields:\n",
            "╭─────────────┬─────────────┬─────────┬────────────────┬────────────────┬────────────────┬────────────────┬────────────────┬────────────────┬─────────────────┬────────────────╮\n",
            "│ Name        │ Attribute   │ Type    │ Field Option   │ Option Value   │ Field Option   │ Option Value   │ Field Option   │   Option Value │ Field Option    │ Option Value   │\n",
            "├─────────────┼─────────────┼─────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼────────────────┼─────────────────┼────────────────┤\n",
            "│ title       │ title       │ TEXT    │ WEIGHT         │ 1              │                │                │                │                │                 │                │\n",
            "│ description │ description │ TEXT    │ WEIGHT         │ 1              │                │                │                │                │                 │                │\n",
            "│ genre       │ genre       │ TAG     │ SEPARATOR      │ ,              │                │                │                │                │                 │                │\n",
            "│ rating      │ rating      │ NUMERIC │ SORTABLE       │ UNF            │                │                │                │                │                 │                │\n",
            "│ vector      │ vector      │ VECTOR  │ algorithm      │ FLAT           │ data_type      │ FLOAT32        │ dim            │            384 │ distance_metric │ COSINE         │\n",
            "╰─────────────┴─────────────┴─────────┴────────────────┴────────────────┴────────────────┴────────────────┴────────────────┴────────────────┴─────────────────┴────────────────╯\n"
          ]
        }
      ],
      "source": [
        "!rvl index info -i movies -u {REDIS_URL}"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "24d3ea9c",
      "metadata": {
        "id": "24d3ea9c"
      },
      "source": [
        "## Populate index"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 54,
      "id": "169ebb93",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "169ebb93",
        "outputId": "303291ef-e9f9-4477-90a4-0dfafcb5cce3"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "['movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG',\n",
              " 'movies:01JSHDN7Q40Z6PQ3VQDBY80Q7A',\n",
              " 'movies:01JSHDN7Q4GG029M45HQY8Q5T2',\n",
              " 'movies:01JSHDN7Q4QFMK2MGNKJHTFT9E',\n",
              " 'movies:01JSHDN7Q4E7S8094JET0DHC5P',\n",
              " 'movies:01JSHDN7Q40QYH6Q6TD7ES4TSG',\n",
              " 'movies:01JSHDN7Q4ZG1SBF02A9SMV6DB',\n",
              " 'movies:01JSHDN7Q4YW9PSZ346M3N9JQ0',\n",
              " 'movies:01JSHDN7Q481PGAEDBX0QG75RP',\n",
              " 'movies:01JSHDN7Q4031K8AS44WJ3J9ZR',\n",
              " 'movies:01JSHDN7Q4FW8FEX1RTR92QSF7',\n",
              " 'movies:01JSHDN7Q4AS7C9VT582PWK14J',\n",
              " 'movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8',\n",
              " 'movies:01JSHDN7Q4W57N6NMRBG9FZY4E',\n",
              " 'movies:01JSHDN7Q4Y009NXBPM25YDZDV',\n",
              " 'movies:01JSHDN7Q4JARJS5Q4HQZ90RRX',\n",
              " 'movies:01JSHDN7Q4W21S96KMMBZ2X6KY',\n",
              " 'movies:01JSHDN7Q4W1NYVVAEBTV91X9X',\n",
              " 'movies:01JSHDN7Q4T84F0E8XQX82VY4Q',\n",
              " 'movies:01JSHDN7Q4W3ZWAJGWT7YQPKVR']"
            ]
          },
          "execution_count": 54,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "index.load(df.to_dict(orient=\"records\"))"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "87ba1dfd",
      "metadata": {
        "id": "87ba1dfd"
      },
      "source": [
        "## Search techniques\n",
        "\n",
        "### Standard vector search"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 55,
      "id": "9454e60d",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 143
        },
        "id": "9454e60d",
        "outputId": "c1903d62-7224-4b9b-e69f-2b6701a7368f"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 3,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"movies:01JSHDN7Q4GG029M45HQY8Q5T2\",\n          \"movies:01JSHDN7Q40QYH6Q6TD7ES4TSG\",\n          \"movies:01JSHDN7Q4AS7C9VT582PWK14J\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"0.64973795414\",\n          \"0.763235092163\",\n          \"0.792449712753\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"Fast & Furious 9\",\n          \"Mad Max: Fury Road\",\n          \"The Lego Movie\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"comedy\",\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-803f068b-4a06-433d-801e-6785d267ae23\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>genre</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4GG029M45HQY8Q5T2</td>\n",
              "      <td>0.64973795414</td>\n",
              "      <td>Fast &amp; Furious 9</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q40QYH6Q6TD7ES4TSG</td>\n",
              "      <td>0.763235092163</td>\n",
              "      <td>Mad Max: Fury Road</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q4AS7C9VT582PWK14J</td>\n",
              "      <td>0.792449712753</td>\n",
              "      <td>The Lego Movie</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-803f068b-4a06-433d-801e-6785d267ae23')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-803f068b-4a06-433d-801e-6785d267ae23 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-803f068b-4a06-433d-801e-6785d267ae23');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-e4ed1191-12d8-408a-8f2e-df1b8786b80e\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-e4ed1191-12d8-408a-8f2e-df1b8786b80e')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-e4ed1191-12d8-408a-8f2e-df1b8786b80e button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance               title  \\\n",
              "0  movies:01JSHDN7Q4GG029M45HQY8Q5T2   0.64973795414    Fast & Furious 9   \n",
              "1  movies:01JSHDN7Q40QYH6Q6TD7ES4TSG  0.763235092163  Mad Max: Fury Road   \n",
              "2  movies:01JSHDN7Q4AS7C9VT582PWK14J  0.792449712753      The Lego Movie   \n",
              "\n",
              "    genre  \n",
              "0  action  \n",
              "1  action  \n",
              "2  comedy  "
            ]
          },
          "execution_count": 55,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query import VectorQuery\n",
        "\n",
        "user_query = \"High tech and action packed movie\"\n",
        "\n",
        "embedded_user_query = hf.embed(user_query)\n",
        "\n",
        "vec_query = VectorQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    num_results=3,\n",
        "    return_fields=[\"title\", \"genre\"],\n",
        "    return_score=True,\n",
        ")\n",
        "\n",
        "result = index.query(vec_query)\n",
        "pd.DataFrame(result)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "ef5e1997",
      "metadata": {
        "id": "ef5e1997"
      },
      "source": [
        "### Vector search with filters\n",
        "\n",
        "Redis allows you to combine filter searches on fields within the index object allowing us to create more specific searches."
      ]
    },
    {
      "cell_type": "markdown",
      "id": "kKCzyMUDDw10",
      "metadata": {
        "id": "kKCzyMUDDw10"
      },
      "source": [
        "Search for top 3 movies specifically in the action genre:\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 56,
      "id": "d499dcad",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 143
        },
        "id": "d499dcad",
        "outputId": "ab410048-da42-4b1e-a5fb-fbd6430ba437"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 3,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"movies:01JSHDN7Q4GG029M45HQY8Q5T2\",\n          \"movies:01JSHDN7Q40QYH6Q6TD7ES4TSG\",\n          \"movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"0.64973795414\",\n          \"0.763235092163\",\n          \"0.796153008938\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"Fast & Furious 9\",\n          \"Mad Max: Fury Road\",\n          \"Explosive Pursuit\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 1,\n        \"samples\": [\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-50934fde-f89e-456f-a985-017b693353a3\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>genre</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4GG029M45HQY8Q5T2</td>\n",
              "      <td>0.64973795414</td>\n",
              "      <td>Fast &amp; Furious 9</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q40QYH6Q6TD7ES4TSG</td>\n",
              "      <td>0.763235092163</td>\n",
              "      <td>Mad Max: Fury Road</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG</td>\n",
              "      <td>0.796153008938</td>\n",
              "      <td>Explosive Pursuit</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-50934fde-f89e-456f-a985-017b693353a3')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-50934fde-f89e-456f-a985-017b693353a3 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-50934fde-f89e-456f-a985-017b693353a3');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-878aa609-3c58-46d9-aad1-fac4b3de726f\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-878aa609-3c58-46d9-aad1-fac4b3de726f')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-878aa609-3c58-46d9-aad1-fac4b3de726f button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance               title  \\\n",
              "0  movies:01JSHDN7Q4GG029M45HQY8Q5T2   0.64973795414    Fast & Furious 9   \n",
              "1  movies:01JSHDN7Q40QYH6Q6TD7ES4TSG  0.763235092163  Mad Max: Fury Road   \n",
              "2  movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG  0.796153008938   Explosive Pursuit   \n",
              "\n",
              "    genre  \n",
              "0  action  \n",
              "1  action  \n",
              "2  action  "
            ]
          },
          "execution_count": 56,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query.filter import Tag\n",
        "\n",
        "tag_filter = Tag(\"genre\") == \"action\"\n",
        "\n",
        "vec_query.set_filter(tag_filter)\n",
        "\n",
        "result=index.query(vec_query)\n",
        "pd.DataFrame(result)"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "YAh3GDS4Dudu",
      "metadata": {
        "id": "YAh3GDS4Dudu"
      },
      "source": [
        "Search for top 3 movies specifically in the action genre with ratings at or above a 7:\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 57,
      "id": "f59fff2c",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 143
        },
        "id": "f59fff2c",
        "outputId": "d6909c59-a947-4e58-a13a-8d0c2169a6b3"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 3,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"movies:01JSHDN7Q40QYH6Q6TD7ES4TSG\",\n          \"movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG\",\n          \"movies:01JSHDN7Q481PGAEDBX0QG75RP\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"0.763235092163\",\n          \"0.796153008938\",\n          \"0.87649422884\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"Mad Max: Fury Road\",\n          \"Explosive Pursuit\",\n          \"Inception\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"8\",\n          \"7\",\n          \"9\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 1,\n        \"samples\": [\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-5237c319-49fa-40a5-a888-f7f7802812ac\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>rating</th>\n",
              "      <th>genre</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q40QYH6Q6TD7ES4TSG</td>\n",
              "      <td>0.763235092163</td>\n",
              "      <td>Mad Max: Fury Road</td>\n",
              "      <td>8</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG</td>\n",
              "      <td>0.796153008938</td>\n",
              "      <td>Explosive Pursuit</td>\n",
              "      <td>7</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q481PGAEDBX0QG75RP</td>\n",
              "      <td>0.87649422884</td>\n",
              "      <td>Inception</td>\n",
              "      <td>9</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-5237c319-49fa-40a5-a888-f7f7802812ac')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-5237c319-49fa-40a5-a888-f7f7802812ac button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-5237c319-49fa-40a5-a888-f7f7802812ac');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-b94e590d-4e53-43a0-83d9-98a6f9c8d10a\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-b94e590d-4e53-43a0-83d9-98a6f9c8d10a')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-b94e590d-4e53-43a0-83d9-98a6f9c8d10a button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance               title  \\\n",
              "0  movies:01JSHDN7Q40QYH6Q6TD7ES4TSG  0.763235092163  Mad Max: Fury Road   \n",
              "1  movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG  0.796153008938   Explosive Pursuit   \n",
              "2  movies:01JSHDN7Q481PGAEDBX0QG75RP   0.87649422884           Inception   \n",
              "\n",
              "  rating   genre  \n",
              "0      8  action  \n",
              "1      7  action  \n",
              "2      9  action  "
            ]
          },
          "execution_count": 57,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query.filter import Num\n",
        "\n",
        "# build combined filter expressions\n",
        "tag_filter = Tag(\"genre\") == \"action\"\n",
        "num_filter = Num(\"rating\") >= 7\n",
        "combined_filter = tag_filter & num_filter\n",
        "\n",
        "# build vector query\n",
        "vec_query = VectorQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    num_results=3,\n",
        "    return_fields=[\"title\", \"rating\", \"genre\"],\n",
        "    return_score=True,\n",
        "    filter_expression=combined_filter\n",
        ")\n",
        "\n",
        "result = index.query(vec_query)\n",
        "pd.DataFrame(result)"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "yJ6TkwEVDsbN",
      "metadata": {
        "id": "yJ6TkwEVDsbN"
      },
      "source": [
        "Search with full text search for movies that directly mention \"criminal mastermind\" in the description:\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 58,
      "id": "7dab26c2",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 146
        },
        "id": "7dab26c2",
        "outputId": "da366f10-d07d-4a1e-8da5-725e6a37827a"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 2,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"movies:01JSHDN7Q4ZG1SBF02A9SMV6DB\",\n          \"movies:01JSHDN7Q4W1NYVVAEBTV91X9X\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"0.990856587887\",\n          \"0.827254056931\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"The Dark Knight\",\n          \"Despicable Me\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"9\",\n          \"7\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"action\",\n          \"comedy\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"description\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"Batman faces off against the Joker, a criminal mastermind who threatens to plunge Gotham into chaos.\",\n          \"When a criminal mastermind uses a trio of orphan girls as pawns for a grand scheme, he finds their love is profoundly changing him for the better.\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-21f0c740-bc16-4ddc-8ad1-0946822d9ca5\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>rating</th>\n",
              "      <th>genre</th>\n",
              "      <th>description</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4W1NYVVAEBTV91X9X</td>\n",
              "      <td>0.827254056931</td>\n",
              "      <td>Despicable Me</td>\n",
              "      <td>7</td>\n",
              "      <td>comedy</td>\n",
              "      <td>When a criminal mastermind uses a trio of orph...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q4ZG1SBF02A9SMV6DB</td>\n",
              "      <td>0.990856587887</td>\n",
              "      <td>The Dark Knight</td>\n",
              "      <td>9</td>\n",
              "      <td>action</td>\n",
              "      <td>Batman faces off against the Joker, a criminal...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-21f0c740-bc16-4ddc-8ad1-0946822d9ca5')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-21f0c740-bc16-4ddc-8ad1-0946822d9ca5 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-21f0c740-bc16-4ddc-8ad1-0946822d9ca5');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-1cd1efa0-4f66-43fa-93c2-59b47c0d2ef8\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-1cd1efa0-4f66-43fa-93c2-59b47c0d2ef8')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-1cd1efa0-4f66-43fa-93c2-59b47c0d2ef8 button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance            title rating  \\\n",
              "0  movies:01JSHDN7Q4W1NYVVAEBTV91X9X  0.827254056931    Despicable Me      7   \n",
              "1  movies:01JSHDN7Q4ZG1SBF02A9SMV6DB  0.990856587887  The Dark Knight      9   \n",
              "\n",
              "    genre                                        description  \n",
              "0  comedy  When a criminal mastermind uses a trio of orph...  \n",
              "1  action  Batman faces off against the Joker, a criminal...  "
            ]
          },
          "execution_count": 58,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query.filter import Text\n",
        "\n",
        "text_filter = Text(\"description\") % \"criminal mastermind\"\n",
        "\n",
        "vec_query = VectorQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    num_results=3,\n",
        "    return_fields=[\"title\", \"rating\", \"genre\", \"description\"],\n",
        "    return_score=True,\n",
        "    filter_expression=text_filter\n",
        ")\n",
        "\n",
        "result = index.query(vec_query)\n",
        "pd.DataFrame(result)"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "UWQkD69fECJv",
      "metadata": {
        "id": "UWQkD69fECJv"
      },
      "source": [
        "Vector search with wildcard text match:\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 59,
      "id": "e39e5e5c",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 195
        },
        "id": "e39e5e5c",
        "outputId": "d9d476dc-8d80-4743-dc14-02e64f9c570d"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 3,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG\",\n          \"movies:01JSHDN7Q4JARJS5Q4HQZ90RRX\",\n          \"movies:01JSHDN7Q4W1NYVVAEBTV91X9X\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"0.796153008938\",\n          \"0.807471334934\",\n          \"0.827254056931\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"Explosive Pursuit\",\n          \"The Incredibles\",\n          \"Despicable Me\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"8\",\n          \"7\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"comedy\",\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"description\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"A daring cop chases a notorious criminal across the city in a high-stakes game of cat and mouse.\",\n          \"A family of undercover superheroes, while trying to live the quiet suburban life, are forced into action to save the world. Bob Parr (Mr. Incredible) and his wife Helen (Elastigirl) were among the world's greatest crime fighters, but now they must assume civilian identities and retreat to the suburbs to live a 'normal' life with their three children. However, the family's desire to help the world pulls them back into action when they face a new and dangerous enemy.\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-b0a00d73-57c7-4d15-a0f5-911e709721d2\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>rating</th>\n",
              "      <th>genre</th>\n",
              "      <th>description</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG</td>\n",
              "      <td>0.796153008938</td>\n",
              "      <td>Explosive Pursuit</td>\n",
              "      <td>7</td>\n",
              "      <td>action</td>\n",
              "      <td>A daring cop chases a notorious criminal acros...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q4JARJS5Q4HQZ90RRX</td>\n",
              "      <td>0.807471334934</td>\n",
              "      <td>The Incredibles</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "      <td>A family of undercover superheroes, while tryi...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q4W1NYVVAEBTV91X9X</td>\n",
              "      <td>0.827254056931</td>\n",
              "      <td>Despicable Me</td>\n",
              "      <td>7</td>\n",
              "      <td>comedy</td>\n",
              "      <td>When a criminal mastermind uses a trio of orph...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-b0a00d73-57c7-4d15-a0f5-911e709721d2')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-b0a00d73-57c7-4d15-a0f5-911e709721d2 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-b0a00d73-57c7-4d15-a0f5-911e709721d2');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-3a4fadbd-481d-4ddd-bbba-83b036415170\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-3a4fadbd-481d-4ddd-bbba-83b036415170')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-3a4fadbd-481d-4ddd-bbba-83b036415170 button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance              title  \\\n",
              "0  movies:01JSHDN7Q4AHFG0J8D7Q8QS1BG  0.796153008938  Explosive Pursuit   \n",
              "1  movies:01JSHDN7Q4JARJS5Q4HQZ90RRX  0.807471334934    The Incredibles   \n",
              "2  movies:01JSHDN7Q4W1NYVVAEBTV91X9X  0.827254056931      Despicable Me   \n",
              "\n",
              "  rating   genre                                        description  \n",
              "0      7  action  A daring cop chases a notorious criminal acros...  \n",
              "1      8  comedy  A family of undercover superheroes, while tryi...  \n",
              "2      7  comedy  When a criminal mastermind uses a trio of orph...  "
            ]
          },
          "execution_count": 59,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "text_filter = Text(\"description\") % \"crim*\"\n",
        "\n",
        "vec_query = VectorQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    num_results=3,\n",
        "    return_fields=[\"title\", \"rating\", \"genre\", \"description\"],\n",
        "    return_score=True,\n",
        "    filter_expression=text_filter\n",
        ")\n",
        "\n",
        "result = index.query(vec_query)\n",
        "pd.DataFrame(result)"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "CGyNAr70EGLg",
      "metadata": {
        "id": "CGyNAr70EGLg"
      },
      "source": [
        "Vector search with fuzzy match filter\n",
        "\n",
        "> Note: fuzzy match is based on Levenshtein distance. Therefore, \"hero\" might return result for \"her\" as an example.\n",
        "\n",
        "See docs for more info https://redis.io/docs/latest/develop/interact/search-and-query/advanced-concepts/query_syntax/\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 60,
      "id": "3450e07d",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 195
        },
        "id": "3450e07d",
        "outputId": "93b5ea52-3735-4b81-ad51-17c487d1132c"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 3,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"movies:01JSHDN7Q4QFMK2MGNKJHTFT9E\",\n          \"movies:01JSHDN7Q4031K8AS44WJ3J9ZR\",\n          \"movies:01JSHDN7Q4W3ZWAJGWT7YQPKVR\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"0.889985799789\",\n          \"0.893866717815\",\n          \"0.943198204041\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"Black Widow\",\n          \"The Avengers\",\n          \"The Princess Diaries\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"7\",\n          \"8\",\n          \"6\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"comedy\",\n          \"action\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"description\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 3,\n        \"samples\": [\n          \"Natasha Romanoff confronts her dark past and family ties as she battles a new enemy.\",\n          \"Earth's mightiest heroes come together to stop an alien invasion that threatens the entire planet.\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-75e60a29-5dcd-4d66-84f5-d5b02a2dfed0\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>rating</th>\n",
              "      <th>genre</th>\n",
              "      <th>description</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4QFMK2MGNKJHTFT9E</td>\n",
              "      <td>0.889985799789</td>\n",
              "      <td>Black Widow</td>\n",
              "      <td>7</td>\n",
              "      <td>action</td>\n",
              "      <td>Natasha Romanoff confronts her dark past and f...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q4031K8AS44WJ3J9ZR</td>\n",
              "      <td>0.893866717815</td>\n",
              "      <td>The Avengers</td>\n",
              "      <td>8</td>\n",
              "      <td>action</td>\n",
              "      <td>Earth's mightiest heroes come together to stop...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q4W3ZWAJGWT7YQPKVR</td>\n",
              "      <td>0.943198204041</td>\n",
              "      <td>The Princess Diaries</td>\n",
              "      <td>6</td>\n",
              "      <td>comedy</td>\n",
              "      <td>Mia Thermopolis has just found out that she is...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-75e60a29-5dcd-4d66-84f5-d5b02a2dfed0')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-75e60a29-5dcd-4d66-84f5-d5b02a2dfed0 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-75e60a29-5dcd-4d66-84f5-d5b02a2dfed0');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-b2f33037-8801-4625-9a4a-d4f9d65193d0\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-b2f33037-8801-4625-9a4a-d4f9d65193d0')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-b2f33037-8801-4625-9a4a-d4f9d65193d0 button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance                 title  \\\n",
              "0  movies:01JSHDN7Q4QFMK2MGNKJHTFT9E  0.889985799789           Black Widow   \n",
              "1  movies:01JSHDN7Q4031K8AS44WJ3J9ZR  0.893866717815          The Avengers   \n",
              "2  movies:01JSHDN7Q4W3ZWAJGWT7YQPKVR  0.943198204041  The Princess Diaries   \n",
              "\n",
              "  rating   genre                                        description  \n",
              "0      7  action  Natasha Romanoff confronts her dark past and f...  \n",
              "1      8  action  Earth's mightiest heroes come together to stop...  \n",
              "2      6  comedy  Mia Thermopolis has just found out that she is...  "
            ]
          },
          "execution_count": 60,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "\n",
        "text_filter = Text(\"description\") % \"%hero%\"\n",
        "\n",
        "vec_query = VectorQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    num_results=3,\n",
        "    return_fields=[\"title\", \"rating\", \"genre\", \"description\"],\n",
        "    return_score=True,\n",
        "    filter_expression=text_filter\n",
        ")\n",
        "\n",
        "result = index.query(vec_query)\n",
        "pd.DataFrame(result)"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "6bd27cb3",
      "metadata": {
        "id": "6bd27cb3"
      },
      "source": [
        "### Range queries\n",
        "\n",
        "Range queries allow you to set a pre defined distance \"threshold\" for which we want to return documents. This is helpful when you only want documents with a certain \"radius\" from the search query."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 61,
      "id": "cafe1795",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 237
        },
        "id": "cafe1795",
        "outputId": "c86063ac-e0e5-4975-c08a-2b8cc71c8f79"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 6,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 6,\n        \"samples\": [\n          \"movies:01JSHDN7Q4JARJS5Q4HQZ90RRX\",\n          \"movies:01JSHDN7Q4QFMK2MGNKJHTFT9E\",\n          \"movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 6,\n        \"samples\": [\n          \"0.644702494144\",\n          \"0.747987031937\",\n          \"0.778580129147\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 6,\n        \"samples\": [\n          \"The Incredibles\",\n          \"Black Widow\",\n          \"Aladdin\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"7\",\n          \"8\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 2,\n        \"samples\": [\n          \"action\",\n          \"comedy\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-4f55d8fd-390c-41d5-871a-7d1a0bd95b7f\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>rating</th>\n",
              "      <th>genre</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4JARJS5Q4HQZ90RRX</td>\n",
              "      <td>0.644702494144</td>\n",
              "      <td>The Incredibles</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q4QFMK2MGNKJHTFT9E</td>\n",
              "      <td>0.747987031937</td>\n",
              "      <td>Black Widow</td>\n",
              "      <td>7</td>\n",
              "      <td>action</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q4W1NYVVAEBTV91X9X</td>\n",
              "      <td>0.750915527344</td>\n",
              "      <td>Despicable Me</td>\n",
              "      <td>7</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>movies:01JSHDN7Q4Y009NXBPM25YDZDV</td>\n",
              "      <td>0.751298904419</td>\n",
              "      <td>Shrek</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>movies:01JSHDN7Q4W21S96KMMBZ2X6KY</td>\n",
              "      <td>0.761669397354</td>\n",
              "      <td>Monsters, Inc.</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <td>movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8</td>\n",
              "      <td>0.778580129147</td>\n",
              "      <td>Aladdin</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-4f55d8fd-390c-41d5-871a-7d1a0bd95b7f')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-4f55d8fd-390c-41d5-871a-7d1a0bd95b7f button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-4f55d8fd-390c-41d5-871a-7d1a0bd95b7f');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-be9e7f38-b49c-4ee0-a6da-90ae4b728931\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-be9e7f38-b49c-4ee0-a6da-90ae4b728931')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-be9e7f38-b49c-4ee0-a6da-90ae4b728931 button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance            title rating  \\\n",
              "0  movies:01JSHDN7Q4JARJS5Q4HQZ90RRX  0.644702494144  The Incredibles      8   \n",
              "1  movies:01JSHDN7Q4QFMK2MGNKJHTFT9E  0.747987031937      Black Widow      7   \n",
              "2  movies:01JSHDN7Q4W1NYVVAEBTV91X9X  0.750915527344    Despicable Me      7   \n",
              "3  movies:01JSHDN7Q4Y009NXBPM25YDZDV  0.751298904419            Shrek      8   \n",
              "4  movies:01JSHDN7Q4W21S96KMMBZ2X6KY  0.761669397354   Monsters, Inc.      8   \n",
              "5  movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8  0.778580129147          Aladdin      8   \n",
              "\n",
              "    genre  \n",
              "0  comedy  \n",
              "1  action  \n",
              "2  comedy  \n",
              "3  comedy  \n",
              "4  comedy  \n",
              "5  comedy  "
            ]
          },
          "execution_count": 61,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query import RangeQuery\n",
        "\n",
        "user_query = \"Family friendly fantasy movies\"\n",
        "\n",
        "embedded_user_query = hf.embed(user_query)\n",
        "\n",
        "range_query = RangeQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    return_fields=[\"title\", \"rating\", \"genre\"],\n",
        "    return_score=True,\n",
        "    distance_threshold=0.8  # find all items with a semantic distance of less than 0.8\n",
        ")\n",
        "\n",
        "result = index.query(range_query)\n",
        "pd.DataFrame(result)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "a1586ea7",
      "metadata": {
        "id": "a1586ea7"
      },
      "source": [
        "Like the queries above, we can also chain additional filters and conditional operators with range queries. The following adds an `and` condition that returns vector search within the defined range and with a rating at or above 8."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 62,
      "id": "d3110324",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 174
        },
        "id": "d3110324",
        "outputId": "dff98df9-60ea-4325-f1c9-1e57c5139014"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 4,\n  \"fields\": [\n    {\n      \"column\": \"id\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"movies:01JSHDN7Q4Y009NXBPM25YDZDV\",\n          \"movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8\",\n          \"movies:01JSHDN7Q4JARJS5Q4HQZ90RRX\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_distance\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"0.751298904419\",\n          \"0.778580129147\",\n          \"0.644702494144\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"Shrek\",\n          \"Aladdin\",\n          \"The Incredibles\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"rating\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 1,\n        \"samples\": [\n          \"8\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"genre\",\n      \"properties\": {\n        \"dtype\": \"category\",\n        \"num_unique_values\": 1,\n        \"samples\": [\n          \"comedy\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-6e346b2e-15aa-4425-a1e6-b1205c35f458\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>id</th>\n",
              "      <th>vector_distance</th>\n",
              "      <th>title</th>\n",
              "      <th>rating</th>\n",
              "      <th>genre</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>movies:01JSHDN7Q4JARJS5Q4HQZ90RRX</td>\n",
              "      <td>0.644702494144</td>\n",
              "      <td>The Incredibles</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>movies:01JSHDN7Q4Y009NXBPM25YDZDV</td>\n",
              "      <td>0.751298904419</td>\n",
              "      <td>Shrek</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>movies:01JSHDN7Q4W21S96KMMBZ2X6KY</td>\n",
              "      <td>0.761669397354</td>\n",
              "      <td>Monsters, Inc.</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8</td>\n",
              "      <td>0.778580129147</td>\n",
              "      <td>Aladdin</td>\n",
              "      <td>8</td>\n",
              "      <td>comedy</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-6e346b2e-15aa-4425-a1e6-b1205c35f458')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-6e346b2e-15aa-4425-a1e6-b1205c35f458 button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-6e346b2e-15aa-4425-a1e6-b1205c35f458');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-e5dee4c1-9775-4acc-b72f-23433f27cd5c\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-e5dee4c1-9775-4acc-b72f-23433f27cd5c')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-e5dee4c1-9775-4acc-b72f-23433f27cd5c button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "                                  id vector_distance            title rating  \\\n",
              "0  movies:01JSHDN7Q4JARJS5Q4HQZ90RRX  0.644702494144  The Incredibles      8   \n",
              "1  movies:01JSHDN7Q4Y009NXBPM25YDZDV  0.751298904419            Shrek      8   \n",
              "2  movies:01JSHDN7Q4W21S96KMMBZ2X6KY  0.761669397354   Monsters, Inc.      8   \n",
              "3  movies:01JSHDN7Q4H6JSC5Y2FKT7SWJ8  0.778580129147          Aladdin      8   \n",
              "\n",
              "    genre  \n",
              "0  comedy  \n",
              "1  comedy  \n",
              "2  comedy  \n",
              "3  comedy  "
            ]
          },
          "execution_count": 62,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "range_query = RangeQuery(\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    return_fields=[\"title\", \"rating\", \"genre\"],\n",
        "    distance_threshold=0.8\n",
        ")\n",
        "\n",
        "numeric_filter = Num(\"rating\") >= 8\n",
        "\n",
        "range_query.set_filter(numeric_filter)\n",
        "\n",
        "# in this case we want to do a simple filter search or the vector so we execute as a joint filter directly\n",
        "result = index.query(range_query)\n",
        "pd.DataFrame(result)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "qABIlUpQE4lT",
      "metadata": {
        "id": "qABIlUpQE4lT"
      },
      "source": [
        "### Full text search"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 74,
      "id": "AOU0Sqx3FCFN",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 174
        },
        "id": "AOU0Sqx3FCFN",
        "outputId": "eba96774-147f-4f8f-901f-abc9dc53cf48"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 4,\n  \"fields\": [\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"The Incredibles\",\n          \"Toy Story\",\n          \"Fast & Furious 9\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"score\",\n      \"properties\": {\n        \"dtype\": \"number\",\n        \"std\": 1.6009737514689841,\n        \"min\": 1.6300968940970675,\n        \"max\": 5.157031817943228,\n        \"num_unique_values\": 4,\n        \"samples\": [\n          4.022877021342021,\n          1.6300968940970675,\n          5.157031817943228\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-6e44f992-f11e-4455-8ab0-38b43fe4ccbd\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>title</th>\n",
              "      <th>score</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Fast &amp; Furious 9</td>\n",
              "      <td>5.157032</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>The Incredibles</td>\n",
              "      <td>4.022877</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Explosive Pursuit</td>\n",
              "      <td>2.335427</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>Toy Story</td>\n",
              "      <td>1.630097</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-6e44f992-f11e-4455-8ab0-38b43fe4ccbd')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-6e44f992-f11e-4455-8ab0-38b43fe4ccbd button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-6e44f992-f11e-4455-8ab0-38b43fe4ccbd');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-c502534c-98dd-4f65-8373-27ee9116c32e\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-c502534c-98dd-4f65-8373-27ee9116c32e')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-c502534c-98dd-4f65-8373-27ee9116c32e button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "               title     score\n",
              "0   Fast & Furious 9  5.157032\n",
              "1    The Incredibles  4.022877\n",
              "2  Explosive Pursuit  2.335427\n",
              "3          Toy Story  1.630097"
            ]
          },
          "execution_count": 74,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query import TextQuery\n",
        "\n",
        "user_query = \"High tech, action packed, superheros fight scenes\"\n",
        "\n",
        "text_query = TextQuery(\n",
        "    text=user_query,\n",
        "    text_field_name=\"description\",\n",
        "    text_scorer=\"BM25STD\",\n",
        "    num_results=20,\n",
        "    return_fields=[\"title\", \"description\"],\n",
        ")\n",
        "\n",
        "result = index.query(text_query)[:4]\n",
        "pd.DataFrame(result)[[\"title\", \"score\"]]"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "pIZ-RiuyFAJP",
      "metadata": {
        "id": "pIZ-RiuyFAJP"
      },
      "source": [
        "### Hybrid search"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 77,
      "id": "fjJwWyQe02T1",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 174
        },
        "id": "fjJwWyQe02T1",
        "outputId": "399a0f70-089c-4d82-968c-1cc0adf0e7fb"
      },
      "outputs": [
        {
          "data": {
            "application/vnd.google.colaboratory.intrinsic+json": {
              "summary": "{\n  \"name\": \"pd\",\n  \"rows\": 4,\n  \"fields\": [\n    {\n      \"column\": \"title\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"Fast & Furious 9\",\n          \"Black Widow\",\n          \"The Incredibles\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"vector_similarity\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"0.537397742271\",\n          \"0.626006484032\",\n          \"0.677648752928\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"text_score\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"0.498220622181\",\n          \"0\",\n          \"0.398671082609\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    },\n    {\n      \"column\": \"hybrid_score\",\n      \"properties\": {\n        \"dtype\": \"string\",\n        \"num_unique_values\": 4,\n        \"samples\": [\n          \"0.525644606244\",\n          \"0.438204538822\",\n          \"0.593955451832\"\n        ],\n        \"semantic_type\": \"\",\n        \"description\": \"\"\n      }\n    }\n  ]\n}",
              "type": "dataframe"
            },
            "text/html": [
              "\n",
              "  <div id=\"df-ccedb171-770a-44ef-91a8-3308ac5086ff\" class=\"colab-df-container\">\n",
              "    <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>title</th>\n",
              "      <th>vector_similarity</th>\n",
              "      <th>text_score</th>\n",
              "      <th>hybrid_score</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>The Incredibles</td>\n",
              "      <td>0.677648752928</td>\n",
              "      <td>0.398671082609</td>\n",
              "      <td>0.593955451832</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Fast &amp; Furious 9</td>\n",
              "      <td>0.537397742271</td>\n",
              "      <td>0.498220622181</td>\n",
              "      <td>0.525644606244</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Toy Story</td>\n",
              "      <td>0.553009659052</td>\n",
              "      <td>0.213523123792</td>\n",
              "      <td>0.451163698474</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>Black Widow</td>\n",
              "      <td>0.626006484032</td>\n",
              "      <td>0</td>\n",
              "      <td>0.438204538822</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "    <div class=\"colab-df-buttons\">\n",
              "\n",
              "  <div class=\"colab-df-container\">\n",
              "    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-ccedb171-770a-44ef-91a8-3308ac5086ff')\"\n",
              "            title=\"Convert this dataframe to an interactive table.\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n",
              "    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n",
              "  </svg>\n",
              "    </button>\n",
              "\n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    .colab-df-buttons div {\n",
              "      margin-bottom: 4px;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "    <script>\n",
              "      const buttonEl =\n",
              "        document.querySelector('#df-ccedb171-770a-44ef-91a8-3308ac5086ff button.colab-df-convert');\n",
              "      buttonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "      async function convertToInteractive(key) {\n",
              "        const element = document.querySelector('#df-ccedb171-770a-44ef-91a8-3308ac5086ff');\n",
              "        const dataTable =\n",
              "          await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                    [key], {});\n",
              "        if (!dataTable) return;\n",
              "\n",
              "        const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "          + ' to learn more about interactive tables.';\n",
              "        element.innerHTML = '';\n",
              "        dataTable['output_type'] = 'display_data';\n",
              "        await google.colab.output.renderOutput(dataTable, element);\n",
              "        const docLink = document.createElement('div');\n",
              "        docLink.innerHTML = docLinkHtml;\n",
              "        element.appendChild(docLink);\n",
              "      }\n",
              "    </script>\n",
              "  </div>\n",
              "\n",
              "\n",
              "<div id=\"df-19cd4107-8dc4-4413-85e6-59f156459080\">\n",
              "  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-19cd4107-8dc4-4413-85e6-59f156459080')\"\n",
              "            title=\"Suggest charts\"\n",
              "            style=\"display:none;\">\n",
              "\n",
              "<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "     width=\"24px\">\n",
              "    <g>\n",
              "        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n",
              "    </g>\n",
              "</svg>\n",
              "  </button>\n",
              "\n",
              "<style>\n",
              "  .colab-df-quickchart {\n",
              "      --bg-color: #E8F0FE;\n",
              "      --fill-color: #1967D2;\n",
              "      --hover-bg-color: #E2EBFA;\n",
              "      --hover-fill-color: #174EA6;\n",
              "      --disabled-fill-color: #AAA;\n",
              "      --disabled-bg-color: #DDD;\n",
              "  }\n",
              "\n",
              "  [theme=dark] .colab-df-quickchart {\n",
              "      --bg-color: #3B4455;\n",
              "      --fill-color: #D2E3FC;\n",
              "      --hover-bg-color: #434B5C;\n",
              "      --hover-fill-color: #FFFFFF;\n",
              "      --disabled-bg-color: #3B4455;\n",
              "      --disabled-fill-color: #666;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart {\n",
              "    background-color: var(--bg-color);\n",
              "    border: none;\n",
              "    border-radius: 50%;\n",
              "    cursor: pointer;\n",
              "    display: none;\n",
              "    fill: var(--fill-color);\n",
              "    height: 32px;\n",
              "    padding: 0;\n",
              "    width: 32px;\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart:hover {\n",
              "    background-color: var(--hover-bg-color);\n",
              "    box-shadow: 0 1px 2px rgba(60, 64, 67, 0.3), 0 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "    fill: var(--button-hover-fill-color);\n",
              "  }\n",
              "\n",
              "  .colab-df-quickchart-complete:disabled,\n",
              "  .colab-df-quickchart-complete:disabled:hover {\n",
              "    background-color: var(--disabled-bg-color);\n",
              "    fill: var(--disabled-fill-color);\n",
              "    box-shadow: none;\n",
              "  }\n",
              "\n",
              "  .colab-df-spinner {\n",
              "    border: 2px solid var(--fill-color);\n",
              "    border-color: transparent;\n",
              "    border-bottom-color: var(--fill-color);\n",
              "    animation:\n",
              "      spin 1s steps(1) infinite;\n",
              "  }\n",
              "\n",
              "  @keyframes spin {\n",
              "    0% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "      border-left-color: var(--fill-color);\n",
              "    }\n",
              "    20% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    30% {\n",
              "      border-color: transparent;\n",
              "      border-left-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    40% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-top-color: var(--fill-color);\n",
              "    }\n",
              "    60% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "    }\n",
              "    80% {\n",
              "      border-color: transparent;\n",
              "      border-right-color: var(--fill-color);\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "    90% {\n",
              "      border-color: transparent;\n",
              "      border-bottom-color: var(--fill-color);\n",
              "    }\n",
              "  }\n",
              "</style>\n",
              "\n",
              "  <script>\n",
              "    async function quickchart(key) {\n",
              "      const quickchartButtonEl =\n",
              "        document.querySelector('#' + key + ' button');\n",
              "      quickchartButtonEl.disabled = true;  // To prevent multiple clicks.\n",
              "      quickchartButtonEl.classList.add('colab-df-spinner');\n",
              "      try {\n",
              "        const charts = await google.colab.kernel.invokeFunction(\n",
              "            'suggestCharts', [key], {});\n",
              "      } catch (error) {\n",
              "        console.error('Error during call to suggestCharts:', error);\n",
              "      }\n",
              "      quickchartButtonEl.classList.remove('colab-df-spinner');\n",
              "      quickchartButtonEl.classList.add('colab-df-quickchart-complete');\n",
              "    }\n",
              "    (() => {\n",
              "      let quickchartButtonEl =\n",
              "        document.querySelector('#df-19cd4107-8dc4-4413-85e6-59f156459080 button');\n",
              "      quickchartButtonEl.style.display =\n",
              "        google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "    })();\n",
              "  </script>\n",
              "</div>\n",
              "\n",
              "    </div>\n",
              "  </div>\n"
            ],
            "text/plain": [
              "              title vector_similarity      text_score    hybrid_score\n",
              "0   The Incredibles    0.677648752928  0.398671082609  0.593955451832\n",
              "1  Fast & Furious 9    0.537397742271  0.498220622181  0.525644606244\n",
              "2         Toy Story    0.553009659052  0.213523123792  0.451163698474\n",
              "3       Black Widow    0.626006484032               0  0.438204538822"
            ]
          },
          "execution_count": 77,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "from redisvl.query import HybridQuery\n",
        "\n",
        "hybrid_query = HybridQuery(\n",
        "    text=user_query,\n",
        "    text_field_name=\"description\",\n",
        "    text_scorer=\"BM25\",\n",
        "    vector=embedded_user_query,\n",
        "    vector_field_name=\"vector\",\n",
        "    alpha=0.7,\n",
        "    num_results=20,\n",
        "    return_fields=[\"title\", \"description\"],\n",
        ")\n",
        "\n",
        "result = index.query(hybrid_query)[:4]\n",
        "pd.DataFrame(result)[[\"title\", \"vector_similarity\", \"text_score\", \"hybrid_score\"]]"
      ]
    },
    {
      "cell_type": "markdown",
      "id": "5fa7cdfb",
      "metadata": {
        "id": "5fa7cdfb"
      },
      "source": [
        "### Next steps\n",
        "\n",
        "For more query examples with redisvl: [see here](https://github.com/redis/redis-vl-python/blob/main/docs/user_guide/hybrid_queries_02.ipynb)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 78,
      "id": "915c2cef",
      "metadata": {
        "id": "915c2cef"
      },
      "outputs": [],
      "source": [
        "# clean up!\n",
        "index.delete()"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "gpuType": "T4",
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.11.9"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 5
}