Lepton AI
online
Serverless AI inference. $10 free credits.
LLMest. 2023 · San Jose, CA
87
/ 100 APIVault Score
// At a glance
Free Tier
$10 credits · no card
Category
LLM
Credit Card
Not required
Last Verified
2m ago
// Free tier details
Available Models
Llama 3.1 70BLlama 3.1 8BMixtral
Monthly Requests
$10 free credits
No credit card needed
No phone verification
// Quick start
300">"text-purple-400">from openai 300">"text-purple-400">import OpenAI
client = OpenAI(
api_key=300">"YOUR_LEPTON_KEY",
base_url=300">"https://llama3-1-70b.lepton.run/api/v1",
)
response = client.chat.completions.create(
model=300">"llama3-1-70b",
messages=[{300">"role": 300">"user", 300">"content": 300">"Hello."}],
)
print(response.choices[0].message.content)// Overview
Lepton AI provides serverless hosting for popular open-source LLMs with OpenAI-compatible endpoints. $10 free credits on signup, no credit card needed.
// Pros
- OpenAI-compatible
- $10 free credits no card
- Serverless — no infra
// Cons
- Limited model selection
- Smaller brand
// Score breakdown
Reliability (35%) (from 2m ago health check)100/100
Free Tier Generosity (30%) (computed from quota, no-CC, no-phone fields)85/100
Documentation (20%) (human rating)80/100
Popularity (15%) (GitHub stars (log-normalised), or manual baseline)72/100
Methodology: apivault.dev/methodology
// Best for
Quick prototypingServerless LLMOSS inference