rag_evaluation_framework
Evaluating Retrieval-Augmented Generation (RAG) systems requires a comprehensive approach that measures both retrieval quality and generation performance. This framework provides methodologies, metrics, and tools for systematic RAG evaluation across different stages of the pipeline.
Content Preview
# RAG Evaluation Framework ## Overview Evaluating Retrieval-Augmented Generation (RAG) systems requires a comprehensive approach that measures both retrieval quality and generation performance. This framework provides methodologies, metrics, and tools for systematic RAG evaluation across different stages of the pipeline. ## Evaluation Dimensions ### 1. Retrieval Quality (Information Retrieval Metrics) **Precision@K**: Fraction of retrieved documents that are relevant - Formula: `Precision@K
How to Use
Recommended: Install to project (local)
mkdir -p .claude/skills
curl -o .claude/skills/rag_evaluation_framework.md \
https://raw.githubusercontent.com/alirezarezvani/claude-skills/main/engineering/rag-architect/references/rag_evaluation_framework.mdSkill is scoped to this project only. Add .claude/skills/ to your .gitignoreif you don't want to commit it.
Alternative: Clone full repo
git clone https://github.com/alirezarezvani/claude-skillsThen reference at engineering/rag-architect/references/rag_evaluation_framework.md
Related Skills
Conducting Chaos Engineering
This skill enables Claude to design and execute chaos engineering experiments to test system resilience. It is used when the user requests help with failure injection, latency simulation, resource exhaustion testing, or resilience validation. The skill is triggered by discussions of chaos experiment
skill-adapterconducting chaos engineering
by jeremylongshore · plugins-plus-skills
Engineering Features for Machine Learning
This skill empowers Claude to perform feature engineering tasks for machine learning. It creates, selects, and transforms features to improve model performance. Use this skill when the user requests feature creation, feature selection, feature transformation, or any request that involves improving t
skill-adapterengineering features for machine learning
by jeremylongshore · plugins-plus-skills
engineering_metrics
Engineering Metrics & KPIs Guide
c-level-advisorengineeringmetrics
by alirezarezvani · alirezarezvani-claude-skills
engineering-features-for-machine-learning
Execute create, select, and transform features to improve machine learning model performance. Handles feature scaling, encoding, and importance analysis. Use when asked to "engineer features" or "select features". Trigger with relevant phrases based on skill purpose.
engineering-features-for-machine-learningengineeringfeaturesfor
by jeremylongshore · plugins-plus-skills