Organization Entities

LLMGW doesn't have fixed entity model but rather you can define your own suiting the best your business needs.

For each entity you can define

• entity_type: name of entity type
• required: whether entity is required in each LLM request
• allow_multiple: can multiple values of given entity type be set
• spend_limit: optional default spend limit for given entity type, if not set only configured entities are tracked

For more details on entity models and spend limits see Entity model.

Example of spend configuration file:

default_entity_types:
  - entity_type: project
    required: true
    allow_multiple: false
    spend_limit:
      amount: 100
      reset_period: DAY
  - entity_type: user
    required: true
    allow_multiple: false
    spend_limit:
      amount: 100.0
      reset_period: DAY
  - entity_type: groups
    required: false
    allow_multiple: true
    spend_limit:
      amount: 100.0
      reset_period: DAY