Commits

Breadcrumbs

History for

onrefs/heads/main

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 19, 2025

• gh-111178: Fix function signatures for test_types (#131455)

  vstinner

  authored
  bbe5baa

  Copy full SHA for bbe5baa

Commits on Oct 9, 2024

• gh-115754: Use Py_GetConstant(Py_CONSTANT_EMPTY_STR) (#125194)

  Show description for b9a8ca0
  vstinner

  authored
  b9a8ca0

  Copy full SHA for b9a8ca0

Commits on Jul 16, 2024

• gh-120317: Lock around global state in the tokenize module (#120318)

  Show description for 8549559
  

  lysnikolaou

  and

  pablogsal

  authored
  8549559

  Copy full SHA for 8549559

Commits on Jun 12, 2024

• gh-120343: Fix column offsets of multiline tokens in tokenize (#120391)

  lysnikolaou

  authored
  4b5d3e0

  Copy full SHA for 4b5d3e0

Commits on Jun 11, 2024

• gh-120343: Do not reset byte_col_offset_diff after multiline tokens (#120352)

  Show description for 1b62bce
  

  lysnikolaou

  and

  blurb-it[bot]

  authored
  1b62bce

  Copy full SHA for 1b62bce

Commits on May 29, 2024

• gh-119704: Fix reference leak in the Python/Python-tokenize.c (#119705)

  Eclips4

  authored
  c0faade

  Copy full SHA for c0faade

Commits on May 28, 2024

• gh-119118: Fix performance regression in tokenize module (#119615)

  Show description for d87b015
  

  lysnikolaou

  and

  pablogsal

  authored
  d87b015

  Copy full SHA for d87b015

Commits on May 3, 2024

• gh-116322: Add Py_mod_gil module slot (#116882)

  Show description for c2627d6
  swtaarrs

  authored
  c2627d6

  Copy full SHA for c2627d6

Commits on Dec 11, 2023

• gh-112943: Correctly compute end offsets for multiline tokens in the tokenize module (#112949)

  pablogsal

  authored
  a135a6d

  Copy full SHA for a135a6d

Commits on Nov 2, 2023

• Remove unnecessary includes (GH-111633)

  serhiy-storchaka

  authored
  a12f624

  Copy full SHA for a12f624

Commits on Oct 11, 2023

• gh-104169: Refactor tokenizer into lexer and wrappers (#110684)

  Show description for 01481f2
  

  3 peopleauthored
  01481f2

  Copy full SHA for 01481f2

Commits on Jul 26, 2023

• gh-107015: Remove async_hacks from the tokenizer (#107018)

  pablogsal

  authored
  da8f87b

  Copy full SHA for da8f87b

Commits on Jun 9, 2023

• gh-105564: Don't include artificial newlines in the line attribute of tokens (#105565)

  pablogsal

  authored
  d7f46bc

  Copy full SHA for d7f46bc

Commits on Jun 7, 2023

• gh-105390: Add explicit type cast (#105466)

  Eclips4

  authored
  264a011

  Copy full SHA for 264a011

• gh-105435: Fix spurious NEWLINE token if file ends with comment without a newline (#105442)

  pablogsal

  authored
  7279fb6

  Copy full SHA for 7279fb6

• gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize errors (#105399)

  pablogsal

  authored
  ffd2654

  Copy full SHA for ffd2654

Commits on Jun 6, 2023

• gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (#105364)

  pablogsal

  authored
  c0a6ed3

  Copy full SHA for c0a6ed3

Commits on May 30, 2023

• gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)

  lysnikolaou

  authored
  70f315c

  Copy full SHA for 70f315c

• gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (#105070)

  pablogsal

  authored
  9216e69

  Copy full SHA for 9216e69

Commits on May 28, 2023

• gh-105017: Include CRLF lines in strings and column numbers (#105030)

  Show description for 96fff35
  

  mgmacias95

  and

  pablogsal

  authored
  96fff35

  Copy full SHA for 96fff35

Commits on May 26, 2023

• gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenizer (#104980)

  Show description for 46b52e6
  pablogsal

  authored
  46b52e6

  Copy full SHA for 46b52e6

• gh-104972: Ensure that line attributes in tokens in the tokenize module are correct (#104975)

  pablogsal

  authored
  3fdb55c

  Copy full SHA for 3fdb55c

Commits on May 24, 2023

• gh-104825: Remove implicit newline in the line attribute in tokens emitted in the tokenize module (#104846)

  pablogsal

  authored
  c8cf9b4

  Copy full SHA for c8cf9b4

Commits on May 22, 2023

• gh-104741: Add line number attribute to indentation error exception (#104743)

  mgmacias95

  authored
  729b252

  Copy full SHA for 729b252

• gh-102856: Tokenize performance improvement (#104731)

  mgmacias95

  authored
  8817886

  Copy full SHA for 8817886

Commits on May 21, 2023

• gh-102856: Python tokenizer implementation for PEP 701 (#104323)

  Show description for 6715f91
  

  mgmacias95

  and

  pablogsal

  authored
  6715f91

  Copy full SHA for 6715f91

Commits on May 5, 2023

• gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)

  Show description for a9c6e06
  ericsnowcurrently

  authored
  a9c6e06

  Copy full SHA for a9c6e06

Commits on Apr 19, 2023

• gh-102856: Initial implementation of PEP 701 (#102855)

  Show description for 1ef61cf
  

  5 peopleauthored
  1ef61cf

  Copy full SHA for 1ef61cf

Commits on Oct 6, 2022

• gh-97973: Return all necessary information from the tokenizer (GH-97984)

  Show description for cbf0afd
  lysnikolaou

  authored
  cbf0afd

  Copy full SHA for cbf0afd

Commits on Aug 11, 2022

• gh-90928: Statically Initialize the Keywords Tuple in Clinic-Generated Code (gh-95860)

  Show description for 6f6a4e6
  ericsnowcurrently

  authored
  6f6a4e6

  Copy full SHA for 6f6a4e6

Commits on Feb 11, 2022

• bpo-46613: Add PyType_GetModuleByDef to the public API (GH-31081)

  Show description for 2049469
  

  encukou

  and

  vstinner

  authored
  2049469

  Copy full SHA for 2049469

Commits on Oct 13, 2021

• bpo-45434: Mark the PyTokenizer C API as private (GH-28924)

  Show description for 713bb19
  vstinner

  authored
  713bb19

  Copy full SHA for 713bb19

Commits on Oct 3, 2021

• Remove trailing spaces. (GH-28706)

  serhiy-storchaka

  authored
  a5a5615

  Copy full SHA for a5a5615

Commits on Aug 25, 2021

• Format the Python-tokenize module and fix exit path (GH-27935)

  pablogsal

  authored
  214c2e5

  Copy full SHA for 214c2e5

Commits on Aug 24, 2021

• Add tests for the C tokenizer and expose it as a private module (GH-27924)

  pablogsal

  authored
  a24676b

  Copy full SHA for a24676b

Loading