cmlabs::LLMStats Struct Reference

Connection statistics: uptime, bytes, requests, tokens and cost. More...

#include <LLMConnection.h>

Public Member Functions
	LLMStats ()

Public Attributes
uint64	uptimeMS
uint64	bytesSent
uint64	bytesReceived
uint64	requestCount
uint64	tokensIn
uint64	tokensOut
uint64	replyChunks
double	cost
bool	ended

Detailed Description

Connection statistics: uptime, bytes, requests, tokens and cost.

Note

Retained after disconnect, with ended set to true, so an owner can take a final snapshot.

Definition at line 203 of file LLMConnection.h.

Constructor & Destructor Documentation

LLMStats()

cmlabs::LLMStats::LLMStats ( )

inline

Definition at line 214 of file LLMConnection.h.

References bytesReceived, bytesSent, cost, ended, replyChunks, requestCount, tokensIn, tokensOut, and uptimeMS.

Member Data Documentation

bytesReceived

uint64 cmlabs::LLMStats::bytesReceived

Definition at line 206 of file LLMConnection.h.

Referenced by LLMStats().

bytesSent

uint64 cmlabs::LLMStats::bytesSent

Definition at line 205 of file LLMConnection.h.

Referenced by LLMStats().

cost

double cmlabs::LLMStats::cost

Definition at line 211 of file LLMConnection.h.

Referenced by LLMStats().

ended

bool cmlabs::LLMStats::ended

Definition at line 212 of file LLMConnection.h.

Referenced by LLMStats().

replyChunks

uint64 cmlabs::LLMStats::replyChunks

Definition at line 210 of file LLMConnection.h.

Referenced by LLMStats().

requestCount

uint64 cmlabs::LLMStats::requestCount

Definition at line 207 of file LLMConnection.h.

Referenced by LLMStats().

tokensIn

uint64 cmlabs::LLMStats::tokensIn

Definition at line 208 of file LLMConnection.h.

Referenced by LLMStats().

tokensOut

uint64 cmlabs::LLMStats::tokensOut

Definition at line 209 of file LLMConnection.h.

Referenced by LLMStats().

uptimeMS

uint64 cmlabs::LLMStats::uptimeMS

Definition at line 204 of file LLMConnection.h.

Referenced by LLMStats(), and cmlabs::LLMConnection::stats().

---

The documentation for this struct was generated from the following file:

• /home/ubuntu/c/partner/psyclone2/CMSDK/include/LLMConnection.h