@zimtsui/brainswitch
Preparing search index...
Throttle
Class Throttle
Index
Constructors
constructor
Methods
input
Tokens
output
Tokens
requests
Constructors
constructor
new
Throttle
(
rpm
:
number
,
tpm
:
number
,
redundancy
?:
number
)
:
Throttle
Parameters
rpm
:
number
tpm
:
number
redundancy
:
number
= .5
Returns
Throttle
Methods
input
Tokens
inputTokens
(
deltaTokenCount
:
number
,
ctx
:
InferenceContext
)
:
Promise
<
void
>
Parameters
deltaTokenCount
:
number
ctx
:
InferenceContext
Returns
Promise
<
void
>
output
Tokens
outputTokens
(
deltaTokenCount
:
number
)
:
void
Parameters
deltaTokenCount
:
number
Returns
void
requests
requests
(
ctx
:
InferenceContext
)
:
Promise
<
void
>
Parameters
ctx
:
InferenceContext
Returns
Promise
<
void
>
Settings
Member Visibility
Inherited
External
Theme
OS
Light
Dark
On This Page
Constructors
constructor
Methods
input
Tokens
output
Tokens
requests
@zimtsui/brainswitch
Loading...