Commits

Branch selector

 main

User selector

KuntaiDu

Datepicker

All time

Commit History

Commits on Dec 29, 2024

• [Misc] KV cache transfer connector registry (vllm-project#11481)

  Show description for faef77c
  KuntaiDu

  authored
  faef77c

  Copy full SHA for faef77c

Commits on Dec 15, 2024

• [Doc] add documentation for disaggregated prefilling (vllm-project#11197)

  Show description for 38e599d
  KuntaiDu

  authored
  38e599d

  Copy full SHA for 38e599d

Commits on Dec 2, 2024

• [Core] Implement disagg prefill by StatelessProcessGroup (vllm-project#10502)

  Show description for 0590ec3
  KuntaiDu

  authored
  0590ec3

  Copy full SHA for 0590ec3

Commits on Oct 22, 2024

• [Core] Remove evictor_v1 (vllm-project#9572)

  KuntaiDu

  authored
  ca30c3c

  Copy full SHA for ca30c3c

Commits on Oct 21, 2024

• [CI] Make format checker error message more user-friendly by using emoji (vllm-project#9564)

  Show description for 575dceb
  KuntaiDu

  authored
  575dceb

  Copy full SHA for 575dceb

Commits on Oct 17, 2024

• [Core] Deprecating block manager v1 and make block manager v2 default (vllm-project#8704)

  Show description for 81ede99
  KuntaiDu

  authored
  81ede99

  Copy full SHA for 81ede99

Commits on Oct 7, 2024

• [Doc] Include performance benchmark in README (vllm-project#9135)

  KuntaiDu

  authored
  c0d9a98

  Copy full SHA for c0d9a98

Commits on Oct 4, 2024

• [CI] Update performance benchmark: upgrade trt-llm to r24.07, and add SGLang (vllm-project#7412)

  KuntaiDu

  authored
  fbb7442

  Copy full SHA for fbb7442

Commits on Sep 19, 2024

• [Bugfix] fixing sonnet benchmark bug in benchmark_serving.py (vllm-project#8616)

  KuntaiDu

  authored
  c52ec5f

  Copy full SHA for c52ec5f

Commits on Aug 20, 2024

• [CI] Organizing performance benchmark files (vllm-project#7616)

  KuntaiDu

  authored
  3d8a5f0

  Copy full SHA for 3d8a5f0

Commits on Aug 16, 2024

• [CI] Fix crashes of performance benchmark (vllm-project#7500)

  KuntaiDu

  authored
  6fc5b0f

  Copy full SHA for 6fc5b0f

Commits on Aug 3, 2024

• [CI] Temporarily turn off H100 performance benchmark (vllm-project#7104)

  KuntaiDu

  authored
  67d745c

  Copy full SHA for 67d745c

Commits on Jul 25, 2024

• [Doc] Add documentations for nightly benchmarks (vllm-project#6412)

  KuntaiDu

  authored
  6a1e25b

  Copy full SHA for 6a1e25b

Commits on Jul 11, 2024

• [CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (vllm-project#5362)

  KuntaiDu

  authored
  a4feba9

  Copy full SHA for a4feba9

Commits on Jun 18, 2024

• [CI] Avoid naming different metrics with the same name in performance benchmark (vllm-project#5615)

  KuntaiDu

  authored
  114d727

  Copy full SHA for 114d727

Commits on Jun 17, 2024

• [CI] the readability of benchmarking and prepare for dashboard (vllm-project#5571)

  Show description for 9e4e6fe
  KuntaiDu

  authored
  9e4e6fe

  Copy full SHA for 9e4e6fe

Commits on Jun 14, 2024

• [CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with perf-benchmarks label (vllm-project#5073)

  Show description for 319ad7f
  

  KuntaiDu

  and

  simon-mo

  authored
  319ad7f

  Copy full SHA for 319ad7f

Commits on Jun 11, 2024

• [Doc] Add an automatic prefix caching section in vllm documentation (vllm-project#5324)

  Show description for 9fde251
  

  KuntaiDu

  and

  simon-mo

  authored
  9fde251

  Copy full SHA for 9fde251

Commits on May 20, 2024

• [Doc]Add documentation to benchmarking script when running TGI (vllm-project#4920)

  KuntaiDu

  authored
  c3af447

  Copy full SHA for c3af447

Commits on May 14, 2024

• [Core][Hash][Automatic Prefix caching] Accelerating the hashing function by avoiding deep copies (vllm-project#4696)

  KuntaiDu

  authored
  ccb63a8

  Copy full SHA for ccb63a8