WOLFRAM

Wolfram Language & System Documentation Center

"AI21" (Service Connection)

Use the AI21 API with the Wolfram Language.

Connecting & Authenticating

ServiceConnect["AI21"] creates a connection to the AI21 API. If a previously saved connection can be found, it will be used; otherwise, a new authentication request will be launched.
Use of this connection requires internet access and a Groq account.

Requests

ServiceExecute["AI21","request",params] sends a request to the AI21 API, using parameters params. The following gives possible requests.

Text

Request:

"Chat" — create a response for the given chat conversation

Parameters:
  • "Messages"(required)a list of messages in the conversation, each given as an association with "Role" and "Content" keys
    "FrequencyPenalty"Automaticpenalize tokens based on their existing frequency in the text so far (between -2 and 2)
    "MaxTokens"Automaticmaximum number of tokens to generate
    "Model"Automaticname of the model to use
    "N"Automaticnumber of completions to return
    "PresencePenalty"Automaticpenalize new tokens based on whether they appear in the text so far (between -2 and 2)
    "StopTokens"Automaticstrings where the API will stop generating further tokens
    "Stream"Falsereturn the result as server-sent events
    "Temperature"Automaticsampling temperature

    • Model Lists

    Request:

    "ChatModelList" — list models available for the "Chat" request

    Examples

    open all close all

    Basic Examples  (1)

    Create a new connection:

    Generate a response from a chat:

    Scope  (2)

    Text  (2)

    Chat  (1)

    Respond to a chat containing multiple messages:

    ChatModelList  (1)

    Look up the available chat models list: