A Cost-Aware Model Router in JavaScript: Routing Between Local Mac Mini Models and Cheap Cloud Tiers
pr0h0•
Build a cost-aware JavaScript router that sends each LLM request to a local Mac Mini model or the cheapest sufficient cloud tier based on prompt complexity, per-token price, and latency budget.
javascriptmodel-routinglocal-inference