The Vercel AI SDK abstracts against all LLMs, including locally running ones. It even handles file attachments well, which is something people are using more and more. https://sdk.vercel.ai/docs/introduction It uses zod for types and validation, I've loved using it to make my apps swap between models easily.
No discussion yet. Be the first to share your thoughts!