Organization Model

Intro

In LLMGW, each request is assigned an identity represented by an entity.

Entities help you control and manage actions in LLMGW by setting:

• Detailed spend limits
• User-based tokens for authentication
• Allowed models (UPCOMING)
• Guardrails (UPCOMING)

Entities are also used to track all data related to requests, allowing for advanced statistics and comprehensive audit logs.

Examples of entities include:

• User
• Project
• User group
• Agent

To get started, define your allowed entity types in the configuration.
You can manage individual entities via the admin portal or the admin API at /config/entities.

See more details on:

• Request identity
• Entities
• Spend limits