Agent orchestration

An agent framework runs an agent as a series of steps: plan, call a model, call a tool, and so on. Stigg fits into a run in two places:

Every model call inside the run goes through a wrapped client, so it is checked and metered like any other call.
Between steps, you check whether the agent still has budget for the next step, and decide what to do if it does not. Running out then becomes a normal path in the run, such as offering the customer more credits or asking an admin to raise a budget, instead of an error halfway through.

Wrap the model client the framework uses

Create the model client with stigg.wrap(), and pass the wrapped client to the framework wherever it accepts one. Every model call the framework makes is then checked and metered, with no other changes. See LLM and gateway wrappers.

Check the budget between steps

Add a step that checks the budget before an expensive part of the run, and route on the result. In LangGraph, put the check in a node and route with a conditional edge:

async function creditGate(state) {
  const decision = await stigg.check(
    {
      customerId: state.customerId,
      entitlement: { currencyId: 'credits' },
      agentId: state.agentId,
      attributionKey: 'agentId',
    },
    5, // the credits the next step is expected to cost
  );
  return { hasAccess: decision.hasAccess, denial: decision.message };
}

graph
  .addNode('creditGate', creditGate)
  .addNode('offerCredits', offerCredits)
  .addConditionalEdges('creditGate', (s) => (s.hasAccess ? 'generate' : 'offerCredits'));

The check asks for the credits the next step is expected to cost, so a run does not start a step it cannot finish. See Requested usage.

Agent governance: give each agent its own budget.
Gating actions that are not model calls: check and report tool calls.

Getting started

Developer tools

Governance (Beta)

AI agents and LLMs (Beta)

Modeling your pricing in Stigg

Entitlements

Managing customers, subscriptions and contracts

Getting usage data into Stigg

Snap-in widgets

Importing and exporting data

Going live

Workflow automation

Rolling out pricing changes with confidence

Price localization

Managing your account

High-availability and scale

Security & compliance

Wrap the model client the framework uses

Check the budget between steps

​Wrap the model client the framework uses

​Check the budget between steps

​Related

Wrap the model client the framework uses

Check the budget between steps

Related