Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

I’m a traditional software engineer. Join me for the first in a series of articles chronicling my hands-on journey into AI ...