Abstract :

Retrieval-Augmented Generation (RAG) Improves The Factual Accuracy Of Large Language Model (LLM) Chatbots By Grounding Responses In External Knowledge. However, Challenges Such As Hallucinations, Incomplete Answers, And Poor Evaluation Methods Remain. This Project Presents An Enhanced RAG-Based Chatbot With Multi-Metric LLM-Based Answer Evaluation. The Framework Combines Efficient Document Retrieval, Context-aware Response Generation, And Automated Multi-dimensional Evaluation. Using Embedding-based Similarity Search, It Retrieves Relevant Information And Generates Responses With An LLM. A Multi-metric Evaluation Module Assesses Answers Based On Criteria Like Semantic Correctness, Contextual Relevance, Fidelity To Sources, Completeness, And Language Quality, Allowing For Scalable And Consistent Assessments With Minimal Human Input. Experimental Results Show Significant Improvements In Answer Reliability And Evaluation Over Traditional Single-metric RAG Systems, Making It Suitable For Enterprise Knowledge Systems And Domain-specific Applications Where Accuracy Is Essential

Published:

08-4-1-2026

Issue:

Vol. 26 No. 4-1 (2026)

Page Nos:

231-237

Section:

Articles

License:

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

How to Cite