> ## Documentation Index
> Fetch the complete documentation index at: https://docs.stigg.io/llms.txt
> Use this file to discover all available pages before exploring further.

# vLLM

> Wrap vLLM's OpenAI-compatible API to meter and gate calls with Stigg.

vLLM is an open-source server for running models on your own hardware. Its API follows OpenAI's format, so you wrap it with the `OpenAI` client and the SDK meters it with the OpenAI recipe.

## Set up

Point the `OpenAI` client's `baseURL` at vLLM and wrap it:

```typescript theme={null}
import OpenAI from 'openai';

const vllm = stigg.wrap(
  new OpenAI({ baseURL: 'http://localhost:8000/v1', apiKey: process.env.VLLM_API_KEY }),
);

const response = await vllm.chat.completions.create({
  model,
  messages,
  stiggContext: { customerId: 'customer-acme', entitlement: { currencyId: 'credits' } },
});
```

Use the address of your own vLLM server. `http://localhost:8000/v1` is vLLM's default.

## What is reported

vLLM returns a `usage` object in OpenAI's format with the number of tokens each call consumed. Calls are reported under the `openai.chat.completions.create` event name, with the same metrics as [OpenAI](/documentation/ai-agents/llm-wrappers/providers/openai#what-is-reported).

Every usage field the provider returns is also included, with a `raw.` prefix. See [How usage is reported](/documentation/ai-agents/llm-wrappers/supported-providers#how-usage-is-reported).

For details on vLLM's API, see vLLM's [OpenAI-compatible server docs](https://docs.vllm.ai/en/latest/serving/openai_compatible_server/).


## Related topics

- [OpenAI-compatible endpoints](/documentation/ai-agents/llm-wrappers/providers/openai-compatible.md)
- [Supported providers and gateways](/documentation/ai-agents/llm-wrappers/supported-providers.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.