Debanjum 703e189979 Deterministically shuffle dataset for consistent data in a eval run ...

Previously eval run across modes would use different dataset shuffles.

This change enables a strict apples to apples perf comparison of the
different khoj modes across the same (random) subset of questions by
using a dataset seed per workflow run to sample questions

2025-08-31 23:40:08 -07:00

28 KiB

Raw Blame History

View Raw