Commits

Branch selector

 master

User selector

turboderp

Datepicker

All time

Commit History

Commits on Sep 12, 2023

• Merge remote-tracking branch 'origin/master'

  turboderp

  committed
  3b013cd

  Copy full SHA for 3b013cd

• ExLlamaV2 announcement

  turboderp

  committed
  0558dea

  Copy full SHA for 0558dea

Commits on Sep 9, 2023

• Switch use of SMEM in kernel based on ROCm and CUDA version

  turboderp

  committed
  8a1d330

  Copy full SHA for 8a1d330

• Fix display name for sharded model file

  turboderp

  committed
  85b009c

  Copy full SHA for 85b009c

• Merge branch 'master' into master2

  turboderp

  committed
  766e582

  Copy full SHA for 766e582

Commits on Sep 8, 2023

• Support for sharded models

  turboderp

  committed
  2a2ef8f

  Copy full SHA for 2a2ef8f

• Merge remote-tracking branch 'quarticcat/master' into master2

  Show description for b12acc6
  turboderp

  committed
  b12acc6

  Copy full SHA for b12acc6

Commits on Sep 1, 2023

• Command line argument to override rope_theta from config.json

  turboderp

  committed
  a544085

  Copy full SHA for a544085

• Update re: CodeLlama rope_theta

  turboderp

  committed
  b7f3fac

  Copy full SHA for b7f3fac

• Merge remote-tracking branch 'origin/master'

  turboderp

  committed
  b8541ad

  Copy full SHA for b8541ad

• Read rope_theta from config.json

  turboderp

  committed
  6020a1b

  Copy full SHA for 6020a1b

Commits on Aug 30, 2023

• Fix: Allow cache.max_seq_len < model.config.max_seq_len when fused_attn = False

  turboderp

  committed
  69216d9

  Copy full SHA for 69216d9

Commits on Aug 20, 2023

• Fix: Allow rep penalty length = -1 to work as intended

  turboderp

  committed
  21f4a12

  Copy full SHA for 21f4a12

Commits on Aug 19, 2023

• Fix: Always print the last output chunk

  turboderp

  committed
  9d4712b

  Copy full SHA for 9d4712b

• Alternative generator with streaming and flexible stop conditions, plus example for using it

  turboderp

  committed
  3cada7b

  Copy full SHA for 3cada7b

• Alternative generator with streaming and flexible stop conditions, plus example for using it

  turboderp

  committed
  4afd9c9

  Copy full SHA for 4afd9c9

Commits on Aug 6, 2023

• Merge remote-tracking branch 'origin/master'

  turboderp

  committed
  e9da620

  Copy full SHA for e9da620

• Option to set processor affinity

  turboderp

  committed
  0dacadb

  Copy full SHA for 0dacadb

Commits on Aug 5, 2023

• Fix chunking logic when bsz > 1

  turboderp

  committed
  c16cf49

  Copy full SHA for c16cf49

Commits on Jul 26, 2023

• Fix merge glitch

  turboderp

  committed
  91b9b12

  Copy full SHA for 91b9b12

Commits on Jul 24, 2023

• Update logit mixing example, rename to CFG

  turboderp

  committed
  e8a544f

  Copy full SHA for e8a544f

Commits on Jul 23, 2023

• Clean up mixing example a bit

  turboderp

  committed
  b2e3982

  Copy full SHA for b2e3982

• Logit mixing (CFG?) example

  turboderp

  committed
  d4fae4f

  Copy full SHA for d4fae4f

• Bit of refactoring, some utility functions for generator

  turboderp

  committed
  72b8c76

  Copy full SHA for 72b8c76

• Apply input mask to batched generations

  turboderp

  committed
  899aaa0

  Copy full SHA for 899aaa0

• Force zero embedding vector for padding tokens

  Show description for a2e0c3c
  turboderp

  committed
  a2e0c3c

  Copy full SHA for a2e0c3c

• Allow returning padding mask batch

  turboderp

  committed
  5dc01d9

  Copy full SHA for 5dc01d9

• Revert automatic input mask

  turboderp

  committed
  9359a82

  Copy full SHA for 9359a82

• Automatically mask out padding tokens

  turboderp

  committed
  72aa3c7

  Copy full SHA for 72aa3c7

Commits on Jul 22, 2023

• Support LoRA saved in bfloat16

  turboderp

  committed
  3f83ebb

  Copy full SHA for 3f83ebb

• Fix for batch size < max batch size

  turboderp

  committed
  35590f5

  Copy full SHA for 35590f5

Commits on Jul 21, 2023

• Experimental flash-attn-2 support. Probably don't use yet.

  turboderp

  committed
  ce687cd

  Copy full SHA for ce687cd

Commits on Jul 19, 2023

• Update readme etc.

  turboderp

  committed
  39b3541

  Copy full SHA for 39b3541

• Allow partial blocks in web UI context

  turboderp

  committed
  806a12c

  Copy full SHA for 806a12c

• Update FUNDING.yml

  turboderp

  committed
  cade9bc

  Copy full SHA for cade9bc

Pagination

Previous

Next