Evaluation_binder
This module contains functionality related to the the evaluation_binder
module for common.bootstrap.configuration.pipeline.evaluation
.
Evaluation_binder
EvaluationBinder
Bases: BaseBinder
Binder for the evaluation components.
Source code in src/common/bootstrap/configuration/pipeline/evaluation/evaluation_binder.py
24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 |
|
_bind_judge_embedding_model()
Bind the judge embedding model.
If the judge embedding model configuration is the same as the embedding model configuration bind the same embedding model to judge embedding model.
Source code in src/common/bootstrap/configuration/pipeline/evaluation/evaluation_binder.py
75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 |
|
_bind_judge_llm()
Bind the judge LLM.
If the judge LLM configuration is the same as the LLM configuration or auto retriever LLM bind the the same LLM to judge LLM.
Source code in src/common/bootstrap/configuration/pipeline/evaluation/evaluation_binder.py
34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
|
_bind_langfuse_evaluator()
Bind the Langfuse evaluator.
Source code in src/common/bootstrap/configuration/pipeline/evaluation/evaluation_binder.py
111 112 113 114 115 116 |
|
_bind_ragas_evaluator()
Bind the Ragas evaluator.
Source code in src/common/bootstrap/configuration/pipeline/evaluation/evaluation_binder.py
104 105 106 107 108 109 |
|
bind()
Bind the evaluation components.
Source code in src/common/bootstrap/configuration/pipeline/evaluation/evaluation_binder.py
27 28 29 30 31 32 |
|