Commits

Branch selector

 987a43c

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 16, 2024

• q8_k_r8: this change for NEON got lost?

  Kawrakow

  committed
  987a43c

Commits on Dec 15, 2024

• BF16_R16 - 16 interleaved bf16 rows (#142)

  Show description for 85c5a1a
  

  ikawrakow

  and

  Kawrakow

  authored
  85c5a1a

Commits on Dec 14, 2024

• Q8_K_R8: Fastest quantized matrix multiplications (#141)

  Show description for 20758ed
  

  ikawrakow

  and

  Kawrakow

  authored
  20758ed

Commits on Dec 13, 2024

• Faster R4 quants on Zen4 (#139)

  Show description for 12f962d
  

  ikawrakow

  and

  Kawrakow

  authored
  12f962d

• Another fix

  Kawrakow

  committed
  36efbfb

• Adding lost q4_k_r4 case

  Show description for ff425a3
  Kawrakow

  committed
  ff425a3

Commits on Dec 12, 2024

• IQ4_K_R4 (#138)

  Show description for 2700d3a
  

  ikawrakow

  and

  Kawrakow

  authored
  2700d3a

Commits on Dec 11, 2024

• Fix AVX2 implementation of iq4_nl_r4 (#137)

  Show description for aecc95c
  

  ikawrakow

  and

  Kawrakow

  authored
  aecc95c

• Q2_K_R4 (#136)

  Show description for 8c6b842
  

  ikawrakow

  and

  Kawrakow

  authored
  8c6b842

• Better ARM_NEON implementation for R4 quants (#135)

  Show description for 9469af8
  

  ikawrakow

  and

  Kawrakow

  authored
  9469af8

• Q3_K_R4 (#134)

  Show description for e0adb8b
  

  ikawrakow

  and

  Kawrakow

  authored
  e0adb8b

Commits on Dec 10, 2024

• Q5_K_R4 (#132)

  Show description for a63a96b
  

  ikawrakow

  and

  Kawrakow

  authored
  a63a96b

• Slightly faster Q4_K_R4 and IQ4_XS_R4 on Zen4 (#131)

  Show description for c819fa6
  

  ikawrakow

  and

  Kawrakow

  authored
  c819fa6

• Q6_K_R4 (#130)

  Show description for 361174e
  

  ikawrakow

  and

  Kawrakow

  authored
  361174e

Commits on Dec 9, 2024

• Q4_K_R4 (#129)

  Show description for 3ec193b
  

  ikawrakow

  and

  Kawrakow

  authored
  3ec193b

Commits on Dec 8, 2024

• Faster IQ4_XS_R4 on Zen4 (#128)

  Show description for 43e65a6
  

  ikawrakow

  and

  Kawrakow

  authored
  43e65a6

• Rename iq4_nl_x4 to iq4_nl_r4 (#126)

  Show description for fc701ce
  

  ikawrakow

  and

  Kawrakow

  authored
  fc701ce

• R4 improvements on ARM_NEON (#125)

  Show description for ef95b81
  

  ikawrakow

  and

  Kawrakow

  authored
  ef95b81

Commits on Dec 6, 2024

• iq2_bn_r4: fastest Bitnet CPU implementation on the planet (#124)

  Show description for 3682e47
  

  ikawrakow

  and

  Kawrakow

  authored
  3682e47

Commits on Dec 4, 2024

• IQ4_XS_R4 (#123)

  Show description for f64de08
  

  ikawrakow

  and

  Kawrakow

  authored
  f64de08

Commits on Dec 3, 2024

• Q6_0_R4 (#122)

  Show description for f1f4eb9
  

  ikawrakow

  and

  Kawrakow

  authored
  f1f4eb9

• Q5_0_R4 (#121)

  Show description for c5bf589
  

  ikawrakow

  and

  Kawrakow

  authored
  c5bf589

• Q8_0_R4 (#120)

  Show description for ccec009
  

  ikawrakow

  and

  Kawrakow

  authored
  ccec009

Commits on Dec 2, 2024

• Q4_0_R4 (#119)

  Show description for 239a344
  

  ikawrakow

  and

  Kawrakow

  authored
  239a344

• IQ4_NL_X4 (#118)

  Show description for 6d0462d
  

  ikawrakow

  and

  Kawrakow

  authored
  6d0462d

Commits on Nov 21, 2024

• Use Q6_0 instead of Q5_1 for tensors incompatible with IQ5_K/Q5_K (#116)

  

  Nexesenex

  authored and

  Kawrakow

  committed
  8ad84b9

• MMQ for Q6_0 (#115)

  Show description for 4d2fbde
  

  ikawrakow

  and

  Kawrakow

  authored
  4d2fbde

Commits on Oct 31, 2024

• Faster MoE inference (#112)

  Show description for 52874c5
  

  ikawrakow

  and

  Kawrakow

  authored
  52874c5

Commits on Oct 26, 2024

• Use fused mul - unary op also for MoE models (#111)

  Show description for 5ad6439
  

  ikawrakow

  and

  Kawrakow

  authored
  5ad6439

• Bitnet: use the fused mul-silu in the FFN network (#110)

  Show description for 2e5f6db
  

  ikawrakow

  and

  Kawrakow

  authored
  2e5f6db

• Bitnet CUDA improvements (#109)

  Show description for bd309cb
  

  ikawrakow

  and

  Kawrakow

  authored
  bd309cb

• Improve Bitnet PP on Metal (#108)

  Show description for 3805c84
  

  ikawrakow

  and

  Kawrakow

  authored
  3805c84

• Faster IQ1_BN Metal implementation (#107)

  Show description for f7b05a0
  

  ikawrakow

  and

  Kawrakow

  authored
  f7b05a0

Commits on Oct 25, 2024

• Remove forgotten IQ1_TN, IQ2_TN enum values

  Kawrakow

  committed
  19cc332

• Bitnet changes (#106)

  Show description for 6b968f3
  

  ikawrakow

  and

  Kawrakow

  authored
  6b968f3

Pagination

PreviousNext