Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: triton-inference-server/triton_cli
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: triton-inference-server/triton_cli
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: jwyman/aslb-mn
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 3 commits
  • 5 files changed
  • 1 contributor

Commits on May 22, 2024

  1. import: Add options to control data-type and parallelism when importi… 

    …ng a model

This change adds the ability to specify '--data-type' when running 'triton import'.
This value will be used to determine the data type used when compiling and optimizing the model for TRT-LLM.

This change adds the ability to specify '--pipeline-parallelism' and '--tensor-parallelism' when running 'triton import'.
This value will be used to determine the parallelism options used when compiling and optimizing the model for TRT-LLM.
    @whoisj
    whoisj committed May 22, 2024
    Configuration menu
    Copy the full SHA
    447792a View commit details
    Browse the repository at this point in the history

  2. import: add support for 70B version of models

    @whoisj
    whoisj committed May 22, 2024
    Configuration menu
    Copy the full SHA
    6da67d6 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. WIP

    @whoisj
    whoisj committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    f881126 View commit details
    Browse the repository at this point in the history
Loading