1 Release published by 1 person

• v1.6.1

  published Mar 28, 2025

19 Pull requests merged by 6 people

• Make sliding_window for Qwen2 optional

  #546 merged Apr 2, 2025

• Fix linking bis

  #549 merged Mar 31, 2025

• Fixing the static-linking.

  #547 merged Mar 29, 2025

• Upgrade candle3

  #545 merged Mar 28, 2025

• Upgrade candle2

  #543 merged Mar 28, 2025

• Moving cublaslt into TEI extension for easier upgrade of candle globally

  #542 merged Mar 28, 2025

• Prepare for release.

  #540 merged Mar 27, 2025

• Fix FromAsCasing warning in Dockerfile-intel

  #541 merged Mar 27, 2025

• Fixing the impure flake devShell to be able to run python code.

  #539 merged Mar 26, 2025

• Add missing match on onnx/model.onnx download

  #472 merged Mar 26, 2025

• make a WA in case Bert model do not have safetensor file

  #515 merged Mar 26, 2025

• Fix VarBuilder handling in GTE e.g. gte-multilingual-reranker-base

  #538 merged Mar 26, 2025

• Small fixup.

  #537 merged Mar 26, 2025

• feat: support HF_ENDPOINT environment when downloading model

  #505 merged Mar 26, 2025

• add CLI flag disable-spans to toggle span trace logging

  #481 merged Mar 26, 2025

• Support classification head for DistilBERT

  #487 merged Mar 26, 2025

• Fixing the tests.

  #531 merged Mar 26, 2025

• Use --hf-token instead of --hf-api-token

  #535 merged Mar 26, 2025

• Add HF_HUB_USER_AGENT_ORIGIN

  #534 merged Mar 26, 2025

2 Pull requests opened by 2 people

• add related docs for intel cpu/xpu/hpu container

  #550 opened Apr 1, 2025

• Fix typos / formatting in CLI args in Markdown files

  #552 opened Apr 2, 2025

2 Issues closed by 1 person

• Support env `HF_ENDPOINT`?

  #416 closed Mar 26, 2025

• Support for DistilBERT Classifier

  #484 closed Mar 26, 2025

4 Issues opened by 4 people

• can be model lazy load?

  #553 opened Apr 2, 2025

• Support for architecture: CodeXEmbedModel2B

  #551 opened Apr 2, 2025

• cannot find tensor cls.predictions.decoder.weight

  #548 opened Mar 29, 2025

• Error occurs when using ONNX model with text-embeddings-inference turing image

  #544 opened Mar 27, 2025

5 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Implement the `ModernBert` model

  #459 commented on Mar 31, 2025 • 18 new comments

• Support for GPU and CPU in one Docker image

  #495 commented on Mar 31, 2025 • 0 new comments

• Move `batch`, `sort_embeddings` into `backends/candle`

  #321 commented on Mar 26, 2025 • 0 new comments

• edit logging functionality with configurable OpenTelemetry integration

  #412 commented on Mar 26, 2025 • 0 new comments

• Refine model file download for python backend

  #526 commented on Mar 28, 2025 • 0 new comments