Latest

Using a Jury of LLMs Instead of a Single Judge to evaluate LLM generations

Using a Jury of LLMs Instead of a Single Judge to evaluate LLM generations

As LLMs advance, evaluating their quality is increasingly complex. Using a single large model like GPT-4 as a judge is costly and biased. A research paper by the Cohere team suggests using a Panel of LLM evaluators (PoLL) with smaller models for more accurate, unbiased, and cost-effective assessments. What’s

RAFT: Adapting Language Model to Domain Specific RAG

RAFT: Adapting Language Model to Domain Specific RAG

Introduction Large Language Models (LLMs) have transformed many natural language processing tasks, showing impressive abilities in general knowledge reasoning. However, adapting these models to specialized areas like legal documents, medical records, or specific company data is still challenging. This paper aims to enhance the performance of LLMs in domain-specific question-answering