|
CMSDK 2.0.1
Cross-platform C++ base library and SDK for the Psyclone AIOS platform
|
#include <LLMConnection.h>
Public Member Functions | |
| LLMStats () | |
Public Attributes | |
| uint64 | uptimeMS |
| uint64 | bytesSent |
| uint64 | bytesReceived |
| uint64 | requestCount |
| uint64 | tokensIn |
| uint64 | tokensOut |
| uint64 | replyChunks |
| double | cost |
| bool | ended |
Definition at line 145 of file LLMConnection.h.
|
inline |
Definition at line 156 of file LLMConnection.h.
References bytesReceived, bytesSent, cost, ended, replyChunks, requestCount, tokensIn, tokensOut, and uptimeMS.
| uint64 cmlabs::LLMStats::bytesReceived |
Definition at line 148 of file LLMConnection.h.
Referenced by LLMStats().
| uint64 cmlabs::LLMStats::bytesSent |
Definition at line 147 of file LLMConnection.h.
Referenced by LLMStats().
| double cmlabs::LLMStats::cost |
Definition at line 153 of file LLMConnection.h.
Referenced by LLMStats().
| bool cmlabs::LLMStats::ended |
Definition at line 154 of file LLMConnection.h.
Referenced by LLMStats().
| uint64 cmlabs::LLMStats::replyChunks |
Definition at line 152 of file LLMConnection.h.
Referenced by LLMStats().
| uint64 cmlabs::LLMStats::requestCount |
Definition at line 149 of file LLMConnection.h.
Referenced by LLMStats().
| uint64 cmlabs::LLMStats::tokensIn |
Definition at line 150 of file LLMConnection.h.
Referenced by LLMStats().
| uint64 cmlabs::LLMStats::tokensOut |
Definition at line 151 of file LLMConnection.h.
Referenced by LLMStats().
| uint64 cmlabs::LLMStats::uptimeMS |
Definition at line 146 of file LLMConnection.h.
Referenced by LLMStats(), and cmlabs::LLMConnection::stats().