Introduction to Routstr
A decentralized LLM routing marketplace powered by Nostr and Bitcoin
Welcome to Routstr
Routstr is a decentralized LLM (Large Language Model) routing marketplace that brings the convenience of centralized AI providers to the permissionless, censorship-resistant world of Nostr and Bitcoin. It enables seamless access to AI models through a unified interface while maintaining privacy, reducing costs, and eliminating traditional payment barriers.
Core Features
Smart Client SDK
One intelligent client that automatically finds the cheapest, fastest model for every prompt
Self-Hosted Proxy
Turn any OpenAI-compatible endpoint into a pay-as-you-go business without Stripe or KYC requirements
Privacy Routing
Built-in SOCKS5 and Tor support for enhanced privacy and censorship resistance
Decentralized Payments
Cashu ecash tokens and BOLT12 Lightning invoices for prepaid, private transactions
How Routstr Works
Routstr creates a decentralized marketplace where:
- AI Model Providers can offer their inference services and receive micropayments without complex payment infrastructure
- End Users can access a wide range of AI models through a single, unified API with automatic routing to the best available option
This approach combines the best of both worlds: the convenience of centralized services with the freedom and privacy of decentralized networks.
Documentation Overview
This documentation is organized into two main sections:
For Users
How to use Routstr to access AI models for your applications, with guides for developers and end-users
For Providers
How to offer your AI models through Routstr and receive micropayments for inference services
Current Status
Routstr is actively being developed according to the following roadmap:
- RIP-01: OpenAI-API Proxy with Cashu micropayments for LLM inference
- RIP-02: Nostr event announcements for inference nodes and capabilities
- RIP-03: Web interface for browsing and filtering available nodes
- RIP-04 & RIP-05: Anonymous evaluations and smart clients with Tor/proxy routing
To get started quickly, head to the Quickstart Guide.