Models

LFM2 1.2B RAG

A GGUF chat model on Autarcho. You pay for the tokens it generates, at the price set for this model.

Model details

Prices can change without a deploy. You can see the current price in the app before you send anything.

Model id
lfm2-1.2b-rag@1.0 or the full hash 5e4d123cd76dd38a1b55f86a5e1f5fa579e452ff89fa636709edbecd3513db0a
Format
GGUF, 697 MB. Checked before it was listed.
Price
1.00 USDC per 1M generated tokens. Input tokens are not billed.
Availability
Answered by an operator who has this model loaded. The app shows what is being served when you send.

Example request

The endpoint is OpenAI-compatible, so the model id is the only thing that changes.

curl -s https://api.autarcho.com/v1/chat/completions \
  -H "Authorization: Bearer ak_..." \
  -H "content-type: application/json" \
  -d '{
    "model": "lfm2-1.2b-rag@1.0",
    "messages": [{ "role": "user", "content": "Hello" }],
    "stream": true
  }'

A key is ak_ followed by 64 hex characters, made on your own machine. The start page covers the key, the credit and this request from a shell. Models are billed per generated token only, so a long document costs what the answer costs.

Serving this model

An operator who runs this model keeps 80% of what each job it serves is charged. The network owns no hardware; a worker is somebody's own machine, making outbound connections only.

Prices and billing