Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 12, 2024

• Add compositional LLM lf.llms.RandomChoice.

  Show description for 2e12f25
  

  daiyip

  authored and

  langfun authors

  committed
  2e12f25

  Copy full SHA for 2e12f25

• Langfun Evaluation Framework V2

  Show description for 69474a9
  

  daiyip

  authored and

  langfun authors

  committed
  69474a9

  Copy full SHA for 69474a9

Commits on Nov 9, 2024

• Reduce the rpm and tpm for VertexAI Anthropic models.

  Show description for 2dfd905
  

  yifenglou

  authored and

  langfun authors

  committed
  2dfd905

  Copy full SHA for 2dfd905

Commits on Nov 8, 2024

• Add retry on 529 error for REST.

  Show description for 924ace2
  

  yifenglou

  authored and

  langfun authors

  committed
  924ace2

  Copy full SHA for 924ace2

• Enable Google authentication for VertexAI Anthropic models.

  Show description for 7689d97
  

  daiyip

  authored and

  langfun authors

  committed
  7689d97

  Copy full SHA for 7689d97

• Enable Anthropic models on VertexAI.

  Show description for 3f6313c
  

  daiyip

  authored and

  langfun authors

  committed
  3f6313c

  Copy full SHA for 3f6313c

Commits on Nov 7, 2024

• Add role support for lf.templates.Conversation.

  Show description for 42a1b3f
  

  daiyip

  authored and

  langfun authors

  committed
  42a1b3f

  Copy full SHA for 42a1b3f

• Change number of significant figures in scoring eval from 2 to 3, to align with standard conventions.

  Show description for 3d9d8ed
  

  chengrunyang

  authored and

  langfun authors

  committed
  3d9d8ed

  Copy full SHA for 3d9d8ed

Commits on Nov 5, 2024

• Add PDF support for Anthropic.

  Show description for 03136ef
  

  yifenglou

  authored and

  langfun authors

  committed
  03136ef

  Copy full SHA for 03136ef

Commits on Nov 4, 2024

• Introduces pg.HtmlConvertible.

  Show description for 31590c4
  

  daiyip

  authored and

  langfun authors

  committed
  31590c4

  Copy full SHA for 31590c4

Commits on Oct 30, 2024

• lf.concurrent to use pg.object_utils.TimeIt.StatusSummary for progress reporting.

  Show description for 3f6039d
  

  daiyip

  authored and

  langfun authors

  committed
  3f6039d

  Copy full SHA for 3f6039d

• lf.eval.inputs_from to support jsonl format.

  Show description for 1d1ef24
  

  daiyip

  authored and

  langfun authors

  committed
  1d1ef24

  Copy full SHA for 1d1ef24

Commits on Oct 26, 2024

• Tag parsing-llm input and output.

  Show description for f9da7e7
  

  daiyip

  authored and

  langfun authors

  committed
  f9da7e7

  Copy full SHA for f9da7e7

• Eval v1: Use new Message HTML format for message chain.

  Show description for fc91ce9
  

  daiyip

  authored and

  langfun authors

  committed
  fc91ce9

  Copy full SHA for fc91ce9

Commits on Oct 25, 2024

• Add max_retry_interval to lf.concurrent_execute and lf.LanguageModel.

  Show description for baba539
  

  daiyip

  authored and

  langfun authors

  committed
  baba539

  Copy full SHA for baba539

Commits on Oct 24, 2024

• lf.call() to chain messages when parsing is enabled.

  Show description for 9f5149d
  

  daiyip

  authored and

  langfun authors

  committed
  9f5149d

  Copy full SHA for 9f5149d

• Add new Claude3.5Sonnet to Langfun.

  Show description for 0d6c90f
  

  yifenglou

  authored and

  langfun authors

  committed
  0d6c90f

  Copy full SHA for 0d6c90f

Commits on Oct 23, 2024

• Fix vertexai_test break.

  Show description for 6a680c5
  

  daiyip

  authored and

  langfun authors

  committed
  6a680c5

  Copy full SHA for 6a680c5

• chore: Automatically populating Schema.property_ordering in function declaration schemas.

  Show description for e6a927d
  

  terryykoo

  authored and

  langfun authors

  committed
  e6a927d

  Copy full SHA for e6a927d

Commits on Oct 22, 2024

• Enable lf.eval.inputs_from to read csv files.

  Show description for ae7a727
  

  chengrunyang

  authored and

  langfun authors

  committed
  ae7a727

  Copy full SHA for ae7a727

Commits on Oct 18, 2024

• Store example index when auditing.

  Show description for c2c60d3
  

  daiyip

  authored and

  langfun authors

  committed
  c2c60d3

  Copy full SHA for c2c60d3

• Major updates for HTML views.

  Show description for 7d1ffee
  

  daiyip

  authored and

  langfun authors

  committed
  7d1ffee

  Copy full SHA for 7d1ffee

Commits on Oct 11, 2024

• Support cost estimation for LLM calls.

  Show description for 0cc6486
  

  daiyip

  authored and

  langfun authors

  committed
  0cc6486

  Copy full SHA for 0cc6486

• Consolidating global and local collapse_level.

  Show description for 8e29ae3
  

  daiyip

  authored and

  langfun authors

  committed
  8e29ae3

  Copy full SHA for 8e29ae3

• Polish HTML views for common Langfun objects.

  Show description for fbc42cd
  

  daiyip

  authored and

  langfun authors

  committed
  fbc42cd

  Copy full SHA for fbc42cd

Commits on Oct 4, 2024

• factor out VertaxAIGemini1_5 base class. It allows user to pass in any Gemini 1.5 model name.

  Show description for ec3cfbe
  

  yifenglou

  authored and

  langfun authors

  committed
  ec3cfbe

  Copy full SHA for ec3cfbe

• Remove saving matches and mismatches in Matching.save()

  Show description for 0a2a548
  

  yifenglou

  authored and

  langfun authors

  committed
  0a2a548

  Copy full SHA for 0a2a548

Commits on Oct 3, 2024

• internal

  Show description for 5c8fa6a
  

  yifenglou

  authored and

  langfun authors

  committed
  5c8fa6a

  Copy full SHA for 5c8fa6a

Commits on Sep 30, 2024

• Catch all ValueError exceptions from Vertex AI.

  Show description for db0b9be
  

  yifenglou

  authored and

  langfun authors

  committed
  db0b9be

  Copy full SHA for db0b9be

Commits on Sep 28, 2024

• 1. Add support for text/plain, text/csv, and text/html to VertexAI.

  Show description for 900b558
  

  yifenglou

  authored and

  langfun authors

  committed
  900b558

  Copy full SHA for 900b558

Commits on Sep 27, 2024

• Add latest, 001, and 002 versions of Gemini 1.5 Pro and Flash models to Langfun.

  Show description for b80fca0
  

  yifenglou

  authored and

  langfun authors

  committed
  b80fca0

  Copy full SHA for b80fca0

• lf.concurrent_map: support TimeIt summary in progress bar.

  Show description for 1f95b77
  

  daiyip

  authored and

  langfun authors

  committed
  1f95b77

  Copy full SHA for 1f95b77

Commits on Sep 24, 2024

• Updates on pg.format.

  Show description for 9f9cb9f
  

  daiyip

  authored and

  langfun authors

  committed
  9f9cb9f

  Copy full SHA for 9f9cb9f

Commits on Sep 23, 2024

• lf.llms.VertexAI to use _parallel_execute_with_currency_control.

  Show description for 1338397
  

  daiyip

  authored and

  langfun authors

  committed
  1338397

  Copy full SHA for 1338397

• Add timeout to eval.

  Show description for 9ee327e
  

  yifenglou

  authored and

  langfun authors

  committed
  9ee327e

  Copy full SHA for 9ee327e

Pagination

Previous

Next