All pull requests

Pull requests

• fix: allow explicit thread render overrides

  #247·Aryan R. Ganjoo (AryanRG) opened Oct 16, 2026·

  ·

• fix(ragas): join list contexts in Faithfulness before judging

  #246·Yuriy H (jurayh) opened Oct 10, 2026·

  ·

• fix(ragas): score 0 when AnswerCorrectness classification is empty

  #245·Yuriy H (jurayh) opened Oct 8, 2026·

  ·

• feat: add voice task success scorer

  #241·kev (kevchoi) opened Oct 7, 2026·1/3·

  ·
  1

• feat: add speech clarity audio scorer

  #239·kev (kevchoi) opened Oct 7, 2026·3/3·

  ·
  1

• feat: add voice latency and interruptions scorers

  #238·kev (kevchoi) opened Oct 7, 2026·2/3·

  ·
  1

• fix: avoid overflow in NumericDiff for finite inputs

  #237·Deepanshu Pal (deepanshupal) opened Oct 7, 2026·

  ·

• fix: upgrade anyio to 4.14.2 (CVE-2026-63374)

  #236·Anupam Mediratta (anupamme) opened Oct 5, 2026·

  ·

• harden: add path validation in sync_datasets.ts

  #235·Anupam Mediratta (anupamme) opened Oct 5, 2026·

  ·

• Ship a PEP 561 py.typed marker for the Python package

  #234·Adam Hitchcock (NorthIsUp) opened Oct 3, 2026·

  ·

• fix(ragas): score empty retrieval contexts as zero

  #231·Silu Panda (SiluPanda) opened Oct 2, 2026Contributor·

  ·
  1

• Stop HTML-escaping scorer values in the ragas prompts

  #227·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·
  1

• fix(ragas): resolve the judge model through the library default

  #226·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·
  1

• fix(ragas): score 0 when Faithfulness gets no statements

  #225·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·

• fix(json): do not treat booleans as numbers in JSONDiff

  #224·Chen Yufeiyang (feiiiiii5) opened Sep 28, 2026·

  ·
  1

• fix(python): preserve explicit token limits for Responses API

  #222·Kingsley_Li (kingsleyli920) opened Sep 13, 2026·

  ·
  4

• fix(python): honor ValidJSON schemas across scorer call paths

  #221·JianYan (JianYan11) opened Sep 10, 2026·

  ·

• fix: return ExactMatch mismatches for non-JSON primitives

  #220·Andrew Barnes (Bortlesboat) opened Sep 8, 2026·

  ·
  1

• fix: do not crash isWrapped on plain OpenAI-compatible clients

  #214·Yuzhong Zhang (BetterAndBetterII) opened Aug 25, 2026·

  ·
  1

• fix: isolate embedding cache by model and prefix

  #213·Daniel Peng (original4422) opened Aug 19, 2026·

  ·
  1

  3

• fix(json): stop a skipped sub-score being averaged as a mismatch

  #210·Arthi Arumugam (arthi-arumugam-git) opened Aug 2, 2026·

  ·
  2

• fix: AnswerRelevancy silently ignores embedding_model (both sync and async)

  #209·Rehan (spacesheepinternet) opened Jul 31, 2026·

  ·
  1

• feat: Add Agent Behavior scorer for Python and TypeScript

  #208·Abhijeet Prasad (AbhiPrasad) opened Jul 29, 2026Member·

  ·
  4

  

• docs: add ExactMatch score example

  #188·Rul1an (Rul1an) opened Apr 25, 2026Contributor·

  ·
  1

• fix: ContextPrecision now scores by position of relevant context (clo…

  #178·Nishtha Nabya (NishthaNabya) opened Mar 17, 2026·

  ·
  1