Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
This project targets the NotebookLM Enterprise API only. Google hasn’t published an API for the consumer edition or general Google Workspace tenants as of 2025-10-25. Prerequisite: a Google Cloud ...