Models

llama3.1-8b β€” API, Pricing & Context Window | Vivgrid

llama3.1-8b on Vivgrid: Meta's efficient 8B open model with a 128K context window, available through one unified API.

llama3.1-8b is Meta's efficient 8-billion-parameter open model, offering a 128K-token context window and dependable performance for lightweight tasks. Its small size makes it fast and inexpensive for high-volume workloads.

On Vivgrid, llama3.1-8b is available through the unified, OpenAI-compatible API, providing an open-model option alongside the catalog's commercial models under a single key.

Specifications

ProviderMeta
Model IDllama3.1-8b
Best forGeneral-purpose
Context window128,000 tokens
ModalitiesText
Tool / function callingYes
Knowledge cutoff2023-12
Acceleration🌐 Global (Centralized)

Pricing

Pricing for llama3.1-8b matches the provider's published rates. See live pricing in the Vivgrid Console.

Quick start

Call llama3.1-8b through Vivgrid's unified, OpenAI-compatible endpoint. Get an API key from the Vivgrid Console.

curl https://api.vivgrid.com/v1/chat/completions \
  -H "Authorization: Bearer $VIVGRID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama3.1-8b",
    "messages": [
      { "role": "user", "content": "Say hello in English, Chinese and Spanish." }
    ],
    "stream": true
  }'

Ideal use cases

  • Lightweight, high-volume text tasks
  • Cost-sensitive classification and extraction
  • Simple assistants and autocomplete features
  • An open-model baseline for evaluation

On this page