zetaalphavector/RAGElo
VerifiedJev applicationDocumented
RAGElo: set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker. Explore the Jev references, Python source code and similar projects.
Repository description: RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
Clone the repository and follow its README for install and usage. JevHunt has not run this project.
git clone https://github.com/zetaalphavector/RAGElo.gitStars measure the whole repository, including work unrelated to Jev.
Documented records the linked documentation or source. JevHunt has not independently run or benchmarked this project.
Two retrieval evaluators store a fractional score instead. `jev_rdnam` keeps Jev's expected grade, like RDNAM's annotator average. `jev` asks one yes/no question, whether the document would be used in a report on the topic of the user question, and stores the probability of a yes scaled to the top relevance grade. Pass `boolean_question=False` to score over the relevance grades and keep the most likely one. Both Jev providers ask up to `batch_size` (default 10) documents, answers or games of one
Evidence commit: 6f23f0f9ae7cd1053a2d6a3c92e5f7c4785bbd40
Discovered through: github-search.
How we review →Suggest a correction · Claim this listing · Submit a project