Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 10, 2024

• [RLlib] IMPALA on new API stack: Add Pong-v5 release test. (ray-project#45803)

  sven1977

  authored
  aee0a0e

Commits on Nov 3, 2024

• [RLlib] New API stack on by default for PPO. (ray-project#48284)

  sven1977

  authored
  62d7f4b

Commits on Oct 27, 2024

• [RLlib] Fix ConnectorPipelineV2 restoring from checkpoint (by writing information about individual connector pieces to the ctor_args_and_kwargs file). (ray-project#48213)

  simonsays1980

  authored
  6878aa1

Commits on Oct 9, 2024

• [RLlib] New API stack: (Multi)RLModule overhaul vol 04 (deprecate RLModuleConfig; cleanups, DefaultModelConfig dataclass). (ray-project#47908)

  sven1977

  authored
  a62d4bf

Commits on Oct 4, 2024

• [RLlib] New API stack: (Multi)RLModule overhaul vol 01 (some preparatory cleanups). (ray-project#47884)

  sven1977

  authored
  ede8246

Commits on Sep 27, 2024

• [RLlib] Discontinue support for "hybrid" API stack (using RLModule + Learner, but still on RolloutWorker and Policy) (ray-project#46085)

  sven1977

  authored
  c9fa046

Commits on Sep 25, 2024

• [RLlib] Add correct terminated and truncated batch sizes on zero-length episodes (ray-project#46721)

  Mark2000

  authored
  4a5207d

Commits on Sep 17, 2024

• [RLlib] Add "shuffle batch per epoch" option. (ray-project#47458)

  sven1977

  authored
  ed5b382

Commits on Sep 11, 2024

• [RLlib] RLModule API: SelfSupervisedLossAPI for RLModules that bring their own loss (algo independent). (ray-project#47581)

  sven1977

  authored
  f422376

Commits on Aug 30, 2024

• [RLlib] Remove 2nd Learner ConnectorV2 pass from PPO (add new GAE Connector piece). Fix: "State-connector" would use seq_len=20. (ray-project#47401)

  sven1977

  authored
  d1f21a5

Commits on Aug 27, 2024

• [RLlib; ConnectorV2] Minor (backward compatible) ConnectorV2 API changes (in preparation for upcoming ConnectorV2 docs). (ray-project#47334)

  sven1977

  authored
  70f7083

Commits on Aug 22, 2024

• [RLlib] Add APPO/IMPALA multi-agent StatelessCartPole learning tests to CI (+ fix some bugs related to this). (ray-project#47245)

  sven1977

  authored
  746f6b6

Commits on Aug 15, 2024

• [RLlib] Fix bugs in IMPALA/APPO + LSTM (new stack) and activate StatelessCartPole learning tests on new API stack. (ray-project#47132)

  sven1977

  authored
  c1c2c8b

Commits on Aug 12, 2024

• [RLlib] Add ObservationPreprocessor (ConnectorV2) and cleanup ConnectorV2 docstrings. (ray-project#47077)

  sven1977

  authored
  c603541

Commits on Aug 7, 2024

• [RLlib; docs] RLlib docs redo: New API stack Episodes (SingleAgentEpisode). (ray-project#46985)

  sven1977

  authored
  a9a1f0a

Commits on Jul 30, 2024

• [RLlib] Cleanup examples folder 23: Curiosity (inverse dynamics model based) RLModule example. (ray-project#46841)

  sven1977

  authored
  619ea15

• [RLlib] Rename MultiAgent...RLModule... into MultiRL...Module for more generality. (ray-project#46840)

  sven1977

  authored
  3990a0e

Commits on Jul 23, 2024

• [RLlib] Cleanup examples folder 22: Add 2 (count-based) curiosity examples. (ray-project#46737)

  sven1977

  authored
  c1095c7

Commits on Jul 13, 2024

• [RLlib] Make most RLlib components implementers of the new Checkpointable API for unified checkpointing experience. (ray-project#46435)

  sven1977

  authored
  f123607

Commits on Jun 26, 2024

• [RLlib] APPO on new API stack (w/ EnvRunners). (ray-project#46216)

  sven1977

  authored
  3862ab5

Commits on Jun 19, 2024

• [RLlib] IMPALA on new API stack (w/ EnvRunner- and ConnectorV2 APIs). (ray-project#42085)

  sven1977

  authored
  231a013

Commits on Jun 13, 2024

• [RLlib] Cleanup examples folder ray-project#16: Add missing docstrings to 2 connector example scripts. (ray-project#45864)

  sven1977

  authored
  f49557f

Commits on Jun 11, 2024

• [RLlib] Cleanup examples folder ray-project#15: Add example script for policy (RLModule) inference w/ ConnectorV2. (ray-project#45845)

  sven1977

  authored
  333eed3

Commits on Jun 6, 2024

• [RLlib] Stats bug fix: EMA stats w/o window would lead to infinite list mem-leak. (ray-project#45752)

  sven1977

  authored
  cbb1634

Commits on May 24, 2024

• [RLlib] Add support for multi-agent off-policy algorithms in the new API stack. (ray-project#45182)

  simonsays1980

  authored
  7fb0ce1

Commits on May 13, 2024

• [RLlib] Performance booster (cache in- and out-) specs RLModule; MetricsLogger speedups, avoid NestedDict, etc.. (ray-project#45285)

  sven1977

  authored
  04f0267

Commits on May 8, 2024

• [RLlib] Change (prioritized) SA episode buffer to return episode lists (instead of batch) from sample(). (ray-project#45123)

  simonsays1980

  authored
  7589bd5

Commits on Apr 29, 2024

• [RLlib] Use DEFAULT_MODULE_ID instead of DEFAULT_POLICY_ID everywhere on new API stack. (ray-project#45022)

  sven1977

  authored
  8b41666

Commits on Apr 27, 2024

• [RLlib] AlgorithmConfig cleanup 03: Cleaner names and structuring of API-stack config settings. (ray-project#44920)

  sven1977

  authored
  2ca00e0

Commits on Apr 25, 2024

• [RLlib] AlgorithmConfig cleanup 02: Restructure methods and properties. (ray-project#44896)

  sven1977

  authored
  10ec614

Commits on Apr 19, 2024

• [RLlib] Remove staticmethod decorator from ConnectorV2.merge_states() (method NOT static). (ray-project#44867)

  sven1977

  authored
  b668821

• [RLlib] Test and fix eval workers not synched w/ connector state. (ray-project#44845)

  sven1977

  authored
  cb7ddbf

Commits on Apr 2, 2024

• [RLlib] Cleanup examples folder ray-project#1. (ray-project#44067)

  sven1977

  authored
  cb05540

Commits on Mar 5, 2024

• [RLlib] ConnectorV2: Enhance performance of add_n_batch_items() for already batched items. (ray-project#43669)

  sven1977

  authored
  5237e49

• [RLlib] ConnectorV2: Fix bug in AddColumnsFromEpisodesToTrainBatch class (multi-agent related). (ray-project#43680)

  sven1977

  authored
  d1255fd

Pagination

PreviousNext