Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 21, 2023

• mark ModelArgs.hidden_dim as optional and calculate as previously if not provided

  atamurad

  committed
  d7704bd

  Copy full SHA for d7704bd

Commits on Aug 20, 2023

• Added huggingface model loader to export.py

  atamurad

  committed
  09db52c

  Copy full SHA for 09db52c

Commits on Aug 19, 2023

• new model export: versions 0 (legacy) and 1

  karpathy

  committed
  7f551db

  Copy full SHA for 7f551db

Commits on Aug 13, 2023

• bigchange: add multiquery support in run.c. we can now train and inference multiquery models (where n_kv_heads < n_heads). this also means that we, in principle, support Llama 2 34B and 70B models,…

  Show description for 38bfac9
  karpathy

  committed
  38bfac9

  Copy full SHA for 38bfac9

Commits on Aug 11, 2023

• ok i can train and sample a model with a custom tokenizer

  karpathy

  committed
  b0cfa24

  Copy full SHA for b0cfa24

Commits on Aug 6, 2023

• FIX: model.generate()

  Show description for 98b515e
  npinto

  authored
  98b515e

  Copy full SHA for 98b515e

Commits on Aug 5, 2023

• turned on trimTrailingWhitespace in my vscode sorry about that

  karpathy

  committed
  a1037d7

  Copy full SHA for a1037d7

• Merge branch 'mpcusack/jitsave' of https://github.com/mpcusack/llama2.c into mpcusack-mpcusack/jitsave

  karpathy

  committed
  e03d7ec

  Copy full SHA for e03d7ec

• get rid of unneeded comment now

  karpathy

  committed
  837796e

  Copy full SHA for 837796e

Commits on Aug 4, 2023

• Reinline loss function

  mpcusack-color

  committed
  f8d45f1

  Copy full SHA for f8d45f1

• extra line

  mpcusack-color

  committed
  11a8348

  Copy full SHA for 11a8348

• Resolve jit.save errors

  mpcusack-color

  committed
  f2e34e6

  Copy full SHA for f2e34e6

Commits on Aug 3, 2023

• Small changes to ROPE & comments

  

  rahulschand

  committed
  02cf3c7

  Copy full SHA for 02cf3c7

Commits on Aug 1, 2023

• fix freq_cos, freq_sin serialize

  ai-doge

  committed
  883cda1

  Copy full SHA for 883cda1

Commits on Jul 26, 2023

• Refactor freqs_cis into freqs_cos and freqs_sin, and remove complex64 for ONNX export compatibility

  ai-doge

  committed
  36bf904

  Copy full SHA for 36bf904

Commits on Jul 25, 2023

• honestly at this point this is a lot more my nanogpt code than llama code

  karpathy

  committed
  f565089

  Copy full SHA for f565089

Commits on Jul 24, 2023

• add dropout support to model

  karpathy

  committed
  624cdfc

  Copy full SHA for 624cdfc

• Register freqs_cis as non-persistent buffer

  

  Andrew Gu

  committed
  af3b5c0

  Copy full SHA for af3b5c0

Commits on Jul 23, 2023

• tweaks and add a simple test

  karpathy

  committed
  9414e7a

  Copy full SHA for 9414e7a

• somewhere ~20 hours later

  karpathy

  committed
  5b161ab

  Copy full SHA for 5b161ab

Loading