cmlabs::LLMConstraints Struct Reference

Per-connection constraints declared on the <llm> element. More...

#include <LLMConnection.h>

Public Member Functions
	LLMConstraints ()

Public Attributes
int32	maxTokensPerRequest
int32	maxRequestsPerMin
int32	maxConcurrent
double	costCeiling

Detailed Description

Per-connection constraints declared on the <llm> element.

Warning

These are parsed and stored ONLY — there is no enforcement logic. Treat them as declared intent and enforce limits in caller code if you depend on them.

Note

Values <= 0 (or < 0 for costCeiling) mean "not set".

Definition at line 190 of file LLMConnection.h.

Constructor & Destructor Documentation

LLMConstraints()

cmlabs::LLMConstraints::LLMConstraints ( )

inline

Definition at line 196 of file LLMConnection.h.

References costCeiling, maxConcurrent, maxRequestsPerMin, and maxTokensPerRequest.

Member Data Documentation

costCeiling

double cmlabs::LLMConstraints::costCeiling

Definition at line 194 of file LLMConnection.h.

Referenced by LLMConstraints().

maxConcurrent

int32 cmlabs::LLMConstraints::maxConcurrent

Definition at line 193 of file LLMConnection.h.

Referenced by LLMConstraints().

maxRequestsPerMin

int32 cmlabs::LLMConstraints::maxRequestsPerMin

Definition at line 192 of file LLMConnection.h.

Referenced by LLMConstraints().

maxTokensPerRequest

int32 cmlabs::LLMConstraints::maxTokensPerRequest

Definition at line 191 of file LLMConnection.h.

Referenced by LLMConstraints().

---

The documentation for this struct was generated from the following file:

• /home/ubuntu/c/partner/psyclone2/CMSDK/include/LLMConnection.h