Together AI

Together AI hosts a large catalog of open-source models. Its API follows OpenAI’s format, so you wrap it with the OpenAI client and the SDK meters it with the OpenAI recipe.

Set up

Point the OpenAI client’s baseURL at Together AI and wrap it:

import OpenAI from 'openai';

const together = stigg.wrap(
  new OpenAI({ baseURL: 'https://api.together.ai/v1', apiKey: process.env.TOGETHER_API_KEY }),
);

const response = await together.chat.completions.create({
  model,
  messages,
  stiggContext: { customerId: 'customer-acme', entitlement: { currencyId: 'credits' } },
});

What is reported

Together AI returns a usage object in OpenAI’s format with the number of tokens each call consumed. Calls are reported under the openai.chat.completions.create event name, with the same metrics as OpenAI. Every usage field the provider returns is also included, with a raw. prefix. See How usage is reported. For details on Together AI’s API, see Together AI’s OpenAI compatibility docs.

Getting started

Developer tools

Governance (Beta)

AI agents and LLMs (Beta)

Modeling your pricing in Stigg

Entitlements

Managing customers, subscriptions and contracts

Getting usage data into Stigg

Snap-in widgets

Importing and exporting data

Going live

Workflow automation

Rolling out pricing changes with confidence

Price localization

Managing your account

High-availability and scale

Security & compliance

Set up

What is reported

​Set up

​What is reported

Set up

What is reported