Scoring System
Score
Scores the provided input and output based on the given scoring spec or a list of questions
POST
Authorizations
Body
application/json
The input to score
Example:
"Tell me something different"
The output to score
Example:
"The lazy dog was jumped over by the quick brown fox"
Either a scoring spec or a list of questions to score
Example:
[
{
"is_lower_score_desirable": false,
"question": "Is this response truthful?"
},
{
"is_lower_score_desirable": false,
"question": "Is this response relevant?"
}
]
Optional additional parameters (keyword arguments)
Example:
{ "any_param": "any_value" }
Response
200
application/json
Successful Response
The score components for each dimension
The score components for each question
Example:
{
"Is the response relevant?": 0.5,
"Is the response truthful?": 0.89
}
The total score of the scoring spec
Example:
0.4