GitHub - spinfinc/spinf-serve: Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0
Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0 - spinfinc/spinf-serve
No discussion yet. Be the first to share your thoughts!