cmlabs::LLMConstraints Struct Reference

#include <LLMConnection.h>

Public Member Functions
	LLMConstraints ()

Public Attributes
int32	maxTokensPerRequest
int32	maxRequestsPerMin
int32	maxConcurrent
double	costCeiling

Detailed Description

Definition at line 133 of file LLMConnection.h.

Constructor & Destructor Documentation

LLMConstraints()

cmlabs::LLMConstraints::LLMConstraints ( )

inline

Definition at line 139 of file LLMConnection.h.

References costCeiling, maxConcurrent, maxRequestsPerMin, and maxTokensPerRequest.

Member Data Documentation

costCeiling

double cmlabs::LLMConstraints::costCeiling

Definition at line 137 of file LLMConnection.h.

Referenced by LLMConstraints().

maxConcurrent

int32 cmlabs::LLMConstraints::maxConcurrent

Definition at line 136 of file LLMConnection.h.

Referenced by LLMConstraints().

maxRequestsPerMin

int32 cmlabs::LLMConstraints::maxRequestsPerMin

Definition at line 135 of file LLMConnection.h.

Referenced by LLMConstraints().

maxTokensPerRequest

int32 cmlabs::LLMConstraints::maxTokensPerRequest

Definition at line 134 of file LLMConnection.h.

Referenced by LLMConstraints().

---

The documentation for this struct was generated from the following file:

• /home/ubuntu/c/partner/psyclone2/CMSDK/include/LLMConnection.h