Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Carolyn Hax writes a daily advice column for The Post and has a weekly live online discussion. Carolyn’s column appears in more than 100 newspapers and includes cartoons by “relationship cartoonist” ...