Perform a token counting.
Endpoint
post
https://{service-endpoint}/v1/{endpoint}:countTokens
Where {service-endpoint}
is one of the supported service endpoints.
Path parameters
endpoint
string
Required. The name of the Endpoint requested to perform token counting. Format: projects/{project}/locations/{location}/endpoints/{endpoint}
Request body
The request body contains data with the following structure:
model
string
Optional. The name of the publisher model requested to serve the prediction. Format: projects/{project}/locations/{location}/publishers/*/models/*
instances[]
value (Value
format)
Optional. The instances that are the input to token counting call. Schema is identical to the prediction schema of the underlying model.
contents[]
object (Content
)
Optional. Input content.
tools[]
object (Tool
)
Optional. A list of Tools
the model may use to generate the next response.
A Tool
is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.
systemInstruction
object (Content
)
Optional. The user provided system instructions for the model. Note: only text should be used in parts and content in each part will be in a separate paragraph.
Example request
Text
C#
Go
Java
Node.js
Python
Multi-modal
Go
Python
Response body
If successful, the response body contains an instance of CountTokensResponse
.