Bedrock / Client / create_inference_profile

create_inference_profile#

Bedrock.Client.create_inference_profile(**kwargs)#

Creates an application inference profile to track metrics and costs when invoking a model. To create an application inference profile for a foundation model in one region, specify the ARN of the model in that region. To create an application inference profile for a foundation model across multiple regions, specify the ARN of the system-defined inference profile that contains the regions that you want to route requests to. For more information, see Increase throughput and resilience with cross-region inference in Amazon Bedrock. in the Amazon Bedrock User Guide.

See also: AWS API Documentation

Request Syntax

response = client.create_inference_profile(
    inferenceProfileName='string',
    description='string',
    clientRequestToken='string',
    modelSource={
        'copyFrom': 'string'
    },
    tags=[
        {
            'key': 'string',
            'value': 'string'
        },
    ]
)
Parameters:

  • inferenceProfileName (string) –

    [REQUIRED]

    A name for the inference profile.

  • description (string) – A description for the inference profile.

  • clientRequestToken (string) –

    A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.

    This field is autopopulated if not provided.

  • modelSource (dict) –

    [REQUIRED]

    The foundation model or system-defined inference profile that the inference profile will track metrics and costs for.

    Note

    This is a Tagged Union structure. Only one of the following top level keys can be set: copyFrom.

    • copyFrom (string) –

      The ARN of the model or system-defined inference profile that is the source for the inference profile.

  • tags (list) –

    An array of objects, each of which contains a tag and its value. For more information, see Tagging resources in the Amazon Bedrock User Guide.

    • (dict) –

      Definition of the key/value pair for a tag.

      • key (string) – [REQUIRED]

        Key for the tag.

      • value (string) – [REQUIRED]

        Value for the tag.

Return type:

dict

Returns:

Response Syntax

{
    'inferenceProfileArn': 'string',
    'status': 'ACTIVE'
}

Response Structure

  • (dict) –

    • inferenceProfileArn (string) –

      The ARN of the inference profile that you created.

    • status (string) –

      The status of the inference profile. ACTIVE means that the inference profile is ready to be used.

Exceptions