IsSimilar¶

This simple evaluation function checks if the supplied response is within a tolerance range defined in params. Works exactly like the numpy.isclose function.

Valid params include atol and rtol, which can be used in combination, or alone. As the comparison made is the following:

is_correct = abs(res - ans) <= (atol + rtol*abs(ans))

Inputs¶

{
  "response": "<number>",
  "answer": "<number>",
  "params": {
    "atol": "<number>",
    "rtol": "<number>"
  }
}

`atol`¶

Absolute tolerance parameter

`rtol`¶

Relative tolerance parameter

Outputs¶

{
  "is_correct": "<bool>",
  "real_diff": "<number>",
  "allowed_diff": "<number>",
}

`real_diff`¶

Real difference between the given answer and response

`allowed_diff`¶

Allowed difference between answer and response, calculated using the supplied atol and rtol parameters

Examples¶

Last update: June 28, 2024

IsSimilar¶

Inputs¶

atol¶

rtol¶