Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 31, 2023

• error out on exllama_set_max_input_length call without exllama backend, safetensors is default (AutoGPTQ#389)

  fxmarty

  authored
  0d9beff

Commits on Oct 27, 2023

• use_safetensors defaults to True, allow loading a model with basename (AutoGPTQ#383)

  fxmarty

  authored
  741bd48

Commits on Aug 9, 2023

• add disable_exllama argument

  PanQiWei

  committed
  db9eabf

Commits on Jul 26, 2023

• remove argument 'save_dir' in method from_quantized

  PanQiWei

  committed
  ff1f100

• simplified code

  PanQiWei

  committed
  722a621

Commits on Jun 19, 2023

• Fix usage of device

  casper-hansen

  committed
  1949e86

• Create example of how to evaluate perplexity

  casper-hansen

  committed
  5b88f03

Commits on Jun 5, 2023

• Merge pull request AutoGPTQ#134 from TheBloke/TB_benchmark

  Show description for bf521cb
  PanQiWei

  authored
  bf521cb

Commits on Jun 3, 2023

• Default inject_fused_attention and mlp to True, matching defaults

  TheBloke

  committed
  edb13d4

• Support setting inject_fused_attention and inject_fused_mlp to False

  TheBloke

  committed
  4617629

Commits on May 28, 2023

• update example script

  PanQiWei

  committed
  801b1c1

Commits on May 27, 2023

• update generation_speed.py

  PanQiWei

  committed
  f703c9a

• add generation speed benchmark example script

  PanQiWei

  committed
  e8bd3c3

Loading