Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

This library is not meant to stand-alone. Instead it defines common helpers used by all Google API clients. For more information, see the documentation. Python == 2.7, Python == 3.5, Python == 3.6, ...