Models

LFM2.5 350M

A GGUF chat model on Autarcho. You pay for the tokens it generates, at the price set for this model.

Model details

Prices can change without a deploy. You can see the current price in the app before you send anything.

Model id
lfm25-350m@1.0 or the full hash 7e6f72643caafc9a68256686638c4d7916f2cec76d1df478d4c3ddcd95a6aed4
Format
GGUF, 219 MB. Checked before it was listed.
Price
1.00 USDC per 1M generated tokens. Input tokens are not billed.
Availability
Answered by an operator who has this model loaded. The app shows what is being served when you send.

Example request

The endpoint is OpenAI-compatible, so the model id is the only thing that changes.

curl -s https://api.autarcho.com/v1/chat/completions \
  -H "Authorization: Bearer ak_..." \
  -H "content-type: application/json" \
  -d '{
    "model": "lfm25-350m@1.0",
    "messages": [{ "role": "user", "content": "Hello" }],
    "stream": true
  }'

A key is ak_ followed by 64 hex characters, made on your own machine. The start page covers the key, the credit and this request from a shell. Models are billed per generated token only, so a long document costs what the answer costs.

Serving this model

An operator who runs this model keeps 80% of what each job it serves is charged. The network owns no hardware; a worker is somebody's own machine, making outbound connections only.

Prices and billing