Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Forty-six states already use ETS’ suite of Praxis tests to gauge teaching skills and subject-specific content knowledge for teacher certification. The AI test was not specifically developed for ...

A powerful pytest plugin that simplifies testing different forms of parameters through dynamic fixture generation. This plugin is particularly useful for API testing, integration testing, or any ...