Metric collection
Metric collection
Collection of available metrics to test on Maihem
Maihem provides a collection of metrics to test your agents on. These metrics are grouped into two primary categories:
- Quality Assurance (QA)
- CX
- RAG
- Security
- PII leak
- Brand
- Toxicity
Quality Assurance (QA)
Customer Experience (CX)
| Group | Sub Group | Name | ID |
|---|---|---|---|
| Quality Assurance (QA) | Customer Experience (CX) | Goal Completion | qa_cx_goal_completion |
| Quality Assurance (QA) | Customer Experience (CX) | Helpfulness | qa_cx_helpfulness |
| Quality Assurance (QA) | Customer Experience (CX) | NPS | qa_cx_nps |
| Quality Assurance (QA) | Customer Experience (CX) | Retention | qa_cx_retention |
Retrieval-Augmented Generation (RAG)
| Group | Sub Group | Name | ID |
|---|---|---|---|
| Quality Assurance (QA) | RAG | Hallucination | qa_rag_hallucination |
| Quality Assurance (QA) | RAG | Correctness | qa_rag_correctness |
| Quality Assurance (QA) | RAG | Answer Relevance | qa_rag_answer_relevance |
| Quality Assurance (QA) | RAG | Completeness | qa_rag_completeness |
Security
| Group | Sub Group | Name | ID |
|---|---|---|---|
| Security | PII leak | Name | sec_pii_name |
| Security | PII leak | sec_pii_email | |
| Security | PII leak | Phone | sec_pii_phone |
| Security | PII leak | Address | sec_pii_address |
| Security | PII leak | Password | sec_pii_password |
| Security | Brand | Competitor Recommendation | sec_brand_competitor_recommendation |
| Security | Brand | Negative Sentiment | sec_brand_negative_sentiment |
| Security | Toxicity | Profanity | sec_toxicity_profanity |
| Security | Toxicity | Hate Speech | sec_toxicity_hate_speech |
| Security | Toxicity | Harassment | sec_toxicity_harassment |
| Security | Toxicity | Sexual Content | sec_toxicity_sexual_content |
| Security | Toxicity | Violence | sec_toxicity_violence |