KafkaConnect

Client

class KafkaConnect.Client

A low-level client representing Managed Streaming for Kafka Connect

client = session.create_client('kafkaconnect')

These are the available methods:

can_paginate(operation_name)

Check if an operation can be paginated.

Parameters
operation_name (string) -- The operation name. This is the same name as the method name on the client. For example, if the method name is create_foo, and you'd normally invoke the operation as client.create_foo(**kwargs), if the create_foo operation can be paginated, you can use the call client.get_paginator("create_foo").
Returns
True if the operation can be paginated, False otherwise.
create_connector(**kwargs)

Creates a connector using the specified properties.

See also: AWS API Documentation

Request Syntax

response = client.create_connector(
    capacity={
        'autoScaling': {
            'maxWorkerCount': 123,
            'mcuCount': 123,
            'minWorkerCount': 123,
            'scaleInPolicy': {
                'cpuUtilizationPercentage': 123
            },
            'scaleOutPolicy': {
                'cpuUtilizationPercentage': 123
            }
        },
        'provisionedCapacity': {
            'mcuCount': 123,
            'workerCount': 123
        }
    },
    connectorConfiguration={
        'string': 'string'
    },
    connectorDescription='string',
    connectorName='string',
    kafkaCluster={
        'apacheKafkaCluster': {
            'bootstrapServers': 'string',
            'vpc': {
                'securityGroups': [
                    'string',
                ],
                'subnets': [
                    'string',
                ]
            }
        }
    },
    kafkaClusterClientAuthentication={
        'authenticationType': 'NONE'|'IAM'
    },
    kafkaClusterEncryptionInTransit={
        'encryptionType': 'PLAINTEXT'|'TLS'
    },
    kafkaConnectVersion='string',
    logDelivery={
        'workerLogDelivery': {
            'cloudWatchLogs': {
                'enabled': True|False,
                'logGroup': 'string'
            },
            'firehose': {
                'deliveryStream': 'string',
                'enabled': True|False
            },
            's3': {
                'bucket': 'string',
                'enabled': True|False,
                'prefix': 'string'
            }
        }
    },
    plugins=[
        {
            'customPlugin': {
                'customPluginArn': 'string',
                'revision': 123
            }
        },
    ],
    serviceExecutionRoleArn='string',
    workerConfiguration={
        'revision': 123,
        'workerConfigurationArn': 'string'
    }
)
Parameters
  • capacity (dict) --

    [REQUIRED]

    Information about the capacity allocated to the connector. Exactly one of the two properties must be specified.

    • autoScaling (dict) --

      Information about the auto scaling parameters for the connector.

      • maxWorkerCount (integer) -- [REQUIRED]

        The maximum number of workers allocated to the connector.

      • mcuCount (integer) -- [REQUIRED]

        The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

      • minWorkerCount (integer) -- [REQUIRED]

        The minimum number of workers allocated to the connector.

      • scaleInPolicy (dict) --

        The sacle-in policy for the connector.

        • cpuUtilizationPercentage (integer) -- [REQUIRED]

          Specifies the CPU utilization percentage threshold at which you want connector scale in to be triggered.

      • scaleOutPolicy (dict) --

        The sacle-out policy for the connector.

        • cpuUtilizationPercentage (integer) -- [REQUIRED]

          The CPU utilization percentage threshold at which you want connector scale out to be triggered.

    • provisionedCapacity (dict) --

      Details about a fixed capacity allocated to a connector.

      • mcuCount (integer) -- [REQUIRED]

        The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

      • workerCount (integer) -- [REQUIRED]

        The number of workers that are allocated to the connector.

  • connectorConfiguration (dict) --

    [REQUIRED]

    A map of keys to values that represent the configuration for the connector.

    • (string) --
      • (string) --
  • connectorDescription (string) -- A summary description of the connector.
  • connectorName (string) --

    [REQUIRED]

    The name of the connector.

  • kafkaCluster (dict) --

    [REQUIRED]

    Specifies which Apache Kafka cluster to connect to.

    • apacheKafkaCluster (dict) -- [REQUIRED]

      The Apache Kafka cluster to which the connector is connected.

      • bootstrapServers (string) -- [REQUIRED]

        The bootstrap servers of the cluster.

      • vpc (dict) -- [REQUIRED]

        Details of an Amazon VPC which has network connectivity to the Apache Kafka cluster.

        • securityGroups (list) --

          The security groups for the connector.

          • (string) --
        • subnets (list) -- [REQUIRED]

          The subnets for the connector.

          • (string) --
  • kafkaClusterClientAuthentication (dict) --

    [REQUIRED]

    Details of the client authentication used by the Apache Kafka cluster.

    • authenticationType (string) -- [REQUIRED]

      The type of client authentication used to connect to the Apache Kafka cluster. Value NONE means that no client authentication is used.

  • kafkaClusterEncryptionInTransit (dict) --

    [REQUIRED]

    Details of encryption in transit to the Apache Kafka cluster.

    • encryptionType (string) -- [REQUIRED]

      The type of encryption in transit to the Apache Kafka cluster.

  • kafkaConnectVersion (string) --

    [REQUIRED]

    The version of Kafka Connect. It has to be compatible with both the Apache Kafka cluster's version and the plugins.

  • logDelivery (dict) --

    Details about log delivery.

    • workerLogDelivery (dict) -- [REQUIRED]

      The workers can send worker logs to different destination types. This configuration specifies the details of these destinations.

      • cloudWatchLogs (dict) --

        Details about delivering logs to Amazon CloudWatch Logs.

        • enabled (boolean) -- [REQUIRED]

          Whether log delivery to Amazon CloudWatch Logs is enabled.

        • logGroup (string) --

          The name of the CloudWatch log group that is the destination for log delivery.

      • firehose (dict) --

        Details about delivering logs to Amazon Kinesis Data Firehose.

        • deliveryStream (string) --

          The name of the Kinesis Data Firehose delivery stream that is the destination for log delivery.

        • enabled (boolean) -- [REQUIRED]

          Specifies whether connector logs get delivered to Amazon Kinesis Data Firehose.

      • s3 (dict) --

        Details about delivering logs to Amazon S3.

        • bucket (string) --

          The name of the S3 bucket that is the destination for log delivery.

        • enabled (boolean) -- [REQUIRED]

          Specifies whether connector logs get sent to the specified Amazon S3 destination.

        • prefix (string) --

          The S3 prefix that is the destination for log delivery.

  • plugins (list) --

    [REQUIRED]

    Specifies which plugins to use for the connector.

    • (dict) --

      A plugin is an AWS resource that contains the code that defines your connector logic.

      • customPlugin (dict) -- [REQUIRED]

        Details about a custom plugin.

        • customPluginArn (string) -- [REQUIRED]

          The Amazon Resource Name (ARN) of the custom plugin.

        • revision (integer) -- [REQUIRED]

          The revision of the custom plugin.

  • serviceExecutionRoleArn (string) --

    [REQUIRED]

    The Amazon Resource Name (ARN) of the IAM role used by the connector to access the Amazon Web Services resources that it needs. The types of resources depends on the logic of the connector. For example, a connector that has Amazon S3 as a destination must have permissions that allow it to write to the S3 destination bucket.

  • workerConfiguration (dict) --

    Specifies which worker configuration to use with the connector.

    • revision (integer) -- [REQUIRED]

      The revision of the worker configuration.

    • workerConfigurationArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) of the worker configuration.

Return type

dict

Returns

Response Syntax

{
    'connectorArn': 'string',
    'connectorName': 'string',
    'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED'
}

Response Structure

  • (dict) --

    • connectorArn (string) --

      The Amazon Resource Name (ARN) that Amazon assigned to the connector.

    • connectorName (string) --

      The name of the connector.

    • connectorState (string) --

      The state of the connector.

Exceptions

create_custom_plugin(**kwargs)

Creates a custom plugin using the specified properties.

See also: AWS API Documentation

Request Syntax

response = client.create_custom_plugin(
    contentType='JAR'|'ZIP',
    description='string',
    location={
        's3Location': {
            'bucketArn': 'string',
            'fileKey': 'string',
            'objectVersion': 'string'
        }
    },
    name='string'
)
Parameters
  • contentType (string) --

    [REQUIRED]

    The type of the plugin file.

  • description (string) -- A summary description of the custom plugin.
  • location (dict) --

    [REQUIRED]

    Information about the location of a custom plugin.

    • s3Location (dict) -- [REQUIRED]

      The S3 bucket Amazon Resource Name (ARN), file key, and object version of the plugin file stored in Amazon S3.

      • bucketArn (string) -- [REQUIRED]

        The Amazon Resource Name (ARN) of an S3 bucket.

      • fileKey (string) -- [REQUIRED]

        The file key for an object in an S3 bucket.

      • objectVersion (string) --

        The version of an object in an S3 bucket.

  • name (string) --

    [REQUIRED]

    The name of the custom plugin.

Return type

dict

Returns

Response Syntax

{
    'customPluginArn': 'string',
    'customPluginState': 'CREATING'|'CREATE_FAILED'|'ACTIVE'|'UPDATING'|'UPDATE_FAILED'|'DELETING',
    'name': 'string',
    'revision': 123
}

Response Structure

  • (dict) --

    • customPluginArn (string) --

      The Amazon Resource Name (ARN) that Amazon assigned to the custom plugin.

    • customPluginState (string) --

      The state of the custom plugin.

    • name (string) --

      The name of the custom plugin.

    • revision (integer) --

      The revision of the custom plugin.

Exceptions

create_worker_configuration(**kwargs)

Creates a worker configuration using the specified properties.

See also: AWS API Documentation

Request Syntax

response = client.create_worker_configuration(
    description='string',
    name='string',
    propertiesFileContent='string'
)
Parameters
  • description (string) -- A summary description of the worker configuration.
  • name (string) --

    [REQUIRED]

    The name of the worker configuration.

  • propertiesFileContent (string) --

    [REQUIRED]

    Base64 encoded contents of connect-distributed.properties file.

Return type

dict

Returns

Response Syntax

{
    'creationTime': datetime(2015, 1, 1),
    'latestRevision': {
        'creationTime': datetime(2015, 1, 1),
        'description': 'string',
        'revision': 123
    },
    'name': 'string',
    'workerConfigurationArn': 'string'
}

Response Structure

  • (dict) --

    • creationTime (datetime) --

      The time that the worker configuration was created.

    • latestRevision (dict) --

      The latest revision of the worker configuration.

      • creationTime (datetime) --

        The time that a worker configuration revision was created.

      • description (string) --

        The description of a worker configuration revision.

      • revision (integer) --

        The revision of a worker configuration.

    • name (string) --

      The name of the worker configuration.

    • workerConfigurationArn (string) --

      The Amazon Resource Name (ARN) that Amazon assigned to the worker configuration.

Exceptions

delete_connector(**kwargs)

Deletes the specified connector.

See also: AWS API Documentation

Request Syntax

response = client.delete_connector(
    connectorArn='string',
    currentVersion='string'
)
Parameters
  • connectorArn (string) --

    [REQUIRED]

    The Amazon Resource Name (ARN) of the connector that you want to delete.

  • currentVersion (string) -- The current version of the connector that you want to delete.
Return type

dict

Returns

Response Syntax

{
    'connectorArn': 'string',
    'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED'
}

Response Structure

  • (dict) --

    • connectorArn (string) --

      The Amazon Resource Name (ARN) of the connector that you requested to delete.

    • connectorState (string) --

      The state of the connector that you requested to delete.

Exceptions

describe_connector(**kwargs)

Returns summary information about the connector.

See also: AWS API Documentation

Request Syntax

response = client.describe_connector(
    connectorArn='string'
)
Parameters
connectorArn (string) --

[REQUIRED]

The Amazon Resource Name (ARN) of the connector that you want to describe.

Return type
dict
Returns
Response Syntax
{
    'capacity': {
        'autoScaling': {
            'maxWorkerCount': 123,
            'mcuCount': 123,
            'minWorkerCount': 123,
            'scaleInPolicy': {
                'cpuUtilizationPercentage': 123
            },
            'scaleOutPolicy': {
                'cpuUtilizationPercentage': 123
            }
        },
        'provisionedCapacity': {
            'mcuCount': 123,
            'workerCount': 123
        }
    },
    'connectorArn': 'string',
    'connectorConfiguration': {
        'string': 'string'
    },
    'connectorDescription': 'string',
    'connectorName': 'string',
    'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED',
    'creationTime': datetime(2015, 1, 1),
    'currentVersion': 'string',
    'kafkaCluster': {
        'apacheKafkaCluster': {
            'bootstrapServers': 'string',
            'vpc': {
                'securityGroups': [
                    'string',
                ],
                'subnets': [
                    'string',
                ]
            }
        }
    },
    'kafkaClusterClientAuthentication': {
        'authenticationType': 'NONE'|'IAM'
    },
    'kafkaClusterEncryptionInTransit': {
        'encryptionType': 'PLAINTEXT'|'TLS'
    },
    'kafkaConnectVersion': 'string',
    'logDelivery': {
        'workerLogDelivery': {
            'cloudWatchLogs': {
                'enabled': True|False,
                'logGroup': 'string'
            },
            'firehose': {
                'deliveryStream': 'string',
                'enabled': True|False
            },
            's3': {
                'bucket': 'string',
                'enabled': True|False,
                'prefix': 'string'
            }
        }
    },
    'plugins': [
        {
            'customPlugin': {
                'customPluginArn': 'string',
                'revision': 123
            }
        },
    ],
    'serviceExecutionRoleArn': 'string',
    'workerConfiguration': {
        'revision': 123,
        'workerConfigurationArn': 'string'
    }
}

Response Structure

  • (dict) --
    • capacity (dict) --

      Information about the capacity of the connector, whether it is auto scaled or provisioned.

      • autoScaling (dict) --

        Describes the connector's auto scaling capacity.

        • maxWorkerCount (integer) --

          The maximum number of workers allocated to the connector.

        • mcuCount (integer) --

          The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

        • minWorkerCount (integer) --

          The minimum number of workers allocated to the connector.

        • scaleInPolicy (dict) --

          The sacle-in policy for the connector.

          • cpuUtilizationPercentage (integer) --

            Specifies the CPU utilization percentage threshold at which you want connector scale in to be triggered.

        • scaleOutPolicy (dict) --

          The sacle-out policy for the connector.>

          • cpuUtilizationPercentage (integer) --

            The CPU utilization percentage threshold at which you want connector scale out to be triggered.

      • provisionedCapacity (dict) --

        Describes a connector's provisioned capacity.

        • mcuCount (integer) --

          The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

        • workerCount (integer) --

          The number of workers that are allocated to the connector.

    • connectorArn (string) --

      The Amazon Resource Name (ARN) of the connector.

    • connectorConfiguration (dict) --

      A map of keys to values that represent the configuration for the connector.

      • (string) --
        • (string) --
    • connectorDescription (string) --

      A summary description of the connector.

    • connectorName (string) --

      The name of the connector.

    • connectorState (string) --

      The state of the connector.

    • creationTime (datetime) --

      The time the connector was created.

    • currentVersion (string) --

      The current version of the connector.

    • kafkaCluster (dict) --

      The Apache Kafka cluster that the connector is connected to.

      • apacheKafkaCluster (dict) --

        The Apache Kafka cluster to which the connector is connected.

        • bootstrapServers (string) --

          The bootstrap servers of the cluster.

        • vpc (dict) --

          Details of an Amazon VPC which has network connectivity to the Apache Kafka cluster.

          • securityGroups (list) --

            The security groups for the connector.

            • (string) --
          • subnets (list) --

            The subnets for the connector.

            • (string) --
    • kafkaClusterClientAuthentication (dict) --

      The type of client authentication used to connect to the Apache Kafka cluster. The value is NONE when no client authentication is used.

      • authenticationType (string) --

        The type of client authentication used to connect to the Apache Kafka cluster. Value NONE means that no client authentication is used.

    • kafkaClusterEncryptionInTransit (dict) --

      Details of encryption in transit to the Apache Kafka cluster.

      • encryptionType (string) --

        The type of encryption in transit to the Apache Kafka cluster.

    • kafkaConnectVersion (string) --

      The version of Kafka Connect. It has to be compatible with both the Apache Kafka cluster's version and the plugins.

    • logDelivery (dict) --

      Details about delivering logs to Amazon CloudWatch Logs.

      • workerLogDelivery (dict) --

        The workers can send worker logs to different destination types. This configuration specifies the details of these destinations.

        • cloudWatchLogs (dict) --

          Details about delivering logs to Amazon CloudWatch Logs.

          • enabled (boolean) --

            Whether log delivery to Amazon CloudWatch Logs is enabled.

          • logGroup (string) --

            The name of the CloudWatch log group that is the destination for log delivery.

        • firehose (dict) --

          Details about delivering logs to Amazon Kinesis Data Firehose.

          • deliveryStream (string) --

            The name of the Kinesis Data Firehose delivery stream that is the destination for log delivery.

          • enabled (boolean) --

            Specifies whether connector logs get delivered to Amazon Kinesis Data Firehose.

        • s3 (dict) --

          Details about delivering logs to Amazon S3.

          • bucket (string) --

            The name of the S3 bucket that is the destination for log delivery.

          • enabled (boolean) --

            Specifies whether connector logs get sent to the specified Amazon S3 destination.

          • prefix (string) --

            The S3 prefix that is the destination for log delivery.

    • plugins (list) --

      Specifies which plugins were used for this connector.

      • (dict) --

        The description of the plugin.

        • customPlugin (dict) --

          Details about a custom plugin.

          • customPluginArn (string) --

            The Amazon Resource Name (ARN) of the custom plugin.

          • revision (integer) --

            The revision of the custom plugin.

    • serviceExecutionRoleArn (string) --

      The Amazon Resource Name (ARN) of the IAM role used by the connector to access Amazon Web Services resources.

    • workerConfiguration (dict) --

      Specifies which worker configuration was used for the connector.

      • revision (integer) --

        The revision of the worker configuration.

      • workerConfigurationArn (string) --

        The Amazon Resource Name (ARN) of the worker configuration.

Exceptions

describe_custom_plugin(**kwargs)

A summary description of the custom plugin.

See also: AWS API Documentation

Request Syntax

response = client.describe_custom_plugin(
    customPluginArn='string'
)
Parameters
customPluginArn (string) --

[REQUIRED]

Returns information about a custom plugin.

Return type
dict
Returns
Response Syntax
{
    'creationTime': datetime(2015, 1, 1),
    'customPluginArn': 'string',
    'customPluginState': 'CREATING'|'CREATE_FAILED'|'ACTIVE'|'UPDATING'|'UPDATE_FAILED'|'DELETING',
    'description': 'string',
    'latestRevision': {
        'contentType': 'JAR'|'ZIP',
        'creationTime': datetime(2015, 1, 1),
        'description': 'string',
        'fileDescription': {
            'fileMd5': 'string',
            'fileSize': 123
        },
        'location': {
            's3Location': {
                'bucketArn': 'string',
                'fileKey': 'string',
                'objectVersion': 'string'
            }
        },
        'revision': 123
    },
    'name': 'string'
}

Response Structure

  • (dict) --
    • creationTime (datetime) --

      The time that the custom plugin was created.

    • customPluginArn (string) --

      The Amazon Resource Name (ARN) of the custom plugin.

    • customPluginState (string) --

      The state of the custom plugin.

    • description (string) --

      The description of the custom plugin.

    • latestRevision (dict) --

      The latest successfully created revision of the custom plugin. If there are no successfully created revisions, this field will be absent.

      • contentType (string) --

        The format of the plugin file.

      • creationTime (datetime) --

        The time that the custom plugin was created.

      • description (string) --

        The description of the custom plugin.

      • fileDescription (dict) --

        Details about the custom plugin file.

        • fileMd5 (string) --

          The hex-encoded MD5 checksum of the custom plugin file. You can use it to validate the file.

        • fileSize (integer) --

          The size in bytes of the custom plugin file. You can use it to validate the file.

      • location (dict) --

        Information about the location of the custom plugin.

        • s3Location (dict) --

          The S3 bucket Amazon Resource Name (ARN), file key, and object version of the plugin file stored in Amazon S3.

          • bucketArn (string) --

            The Amazon Resource Name (ARN) of an S3 bucket.

          • fileKey (string) --

            The file key for an object in an S3 bucket.

          • objectVersion (string) --

            The version of an object in an S3 bucket.

      • revision (integer) --

        The revision of the custom plugin.

    • name (string) --

      The name of the custom plugin.

Exceptions

describe_worker_configuration(**kwargs)

Returns information about a worker configuration.

See also: AWS API Documentation

Request Syntax

response = client.describe_worker_configuration(
    workerConfigurationArn='string'
)
Parameters
workerConfigurationArn (string) --

[REQUIRED]

The Amazon Resource Name (ARN) of the worker configuration that you want to get information about.

Return type
dict
Returns
Response Syntax
{
    'creationTime': datetime(2015, 1, 1),
    'description': 'string',
    'latestRevision': {
        'creationTime': datetime(2015, 1, 1),
        'description': 'string',
        'propertiesFileContent': 'string',
        'revision': 123
    },
    'name': 'string',
    'workerConfigurationArn': 'string'
}

Response Structure

  • (dict) --
    • creationTime (datetime) --

      The time that the worker configuration was created.

    • description (string) --

      The description of the worker configuration.

    • latestRevision (dict) --

      The latest revision of the custom configuration.

      • creationTime (datetime) --

        The time that the worker configuration was created.

      • description (string) --

        The description of the worker configuration revision.

      • propertiesFileContent (string) --

        Base64 encoded contents of the connect-distributed.properties file.

      • revision (integer) --

        The description of a revision of the worker configuration.

    • name (string) --

      The name of the worker configuration.

    • workerConfigurationArn (string) --

      The Amazon Resource Name (ARN) of the custom configuration.

Exceptions

generate_presigned_url(ClientMethod, Params=None, ExpiresIn=3600, HttpMethod=None)

Generate a presigned url given a client, its method, and arguments

Parameters
  • ClientMethod (string) -- The client method to presign for
  • Params (dict) -- The parameters normally passed to ClientMethod.
  • ExpiresIn (int) -- The number of seconds the presigned url is valid for. By default it expires in an hour (3600 seconds)
  • HttpMethod (string) -- The http method to use on the generated url. By default, the http method is whatever is used in the method's model.
Returns

The presigned url

get_paginator(operation_name)

Create a paginator for an operation.

Parameters
operation_name (string) -- The operation name. This is the same name as the method name on the client. For example, if the method name is create_foo, and you'd normally invoke the operation as client.create_foo(**kwargs), if the create_foo operation can be paginated, you can use the call client.get_paginator("create_foo").
Raises OperationNotPageableError
Raised if the operation is not pageable. You can use the client.can_paginate method to check if an operation is pageable.
Return type
L{botocore.paginate.Paginator}
Returns
A paginator object.
get_waiter(waiter_name)

Returns an object that can wait for some condition.

Parameters
waiter_name (str) -- The name of the waiter to get. See the waiters section of the service docs for a list of available waiters.
Returns
The specified waiter object.
Return type
botocore.waiter.Waiter
list_connectors(**kwargs)

Returns a list of all the connectors in this account and Region. The list is limited to connectors whose name starts with the specified prefix. The response also includes a description of each of the listed connectors.

See also: AWS API Documentation

Request Syntax

response = client.list_connectors(
    connectorNamePrefix='string',
    maxResults=123,
    nextToken='string'
)
Parameters
  • connectorNamePrefix (string) -- The name prefix that you want to use to search for and list connectors.
  • maxResults (integer) -- The maximum number of connectors to list in one response.
  • nextToken (string) -- If the response of a ListConnectors operation is truncated, it will include a NextToken. Send this NextToken in a subsequent request to continue listing from where the previous operation left off.
Return type

dict

Returns

Response Syntax

{
    'connectors': [
        {
            'capacity': {
                'autoScaling': {
                    'maxWorkerCount': 123,
                    'mcuCount': 123,
                    'minWorkerCount': 123,
                    'scaleInPolicy': {
                        'cpuUtilizationPercentage': 123
                    },
                    'scaleOutPolicy': {
                        'cpuUtilizationPercentage': 123
                    }
                },
                'provisionedCapacity': {
                    'mcuCount': 123,
                    'workerCount': 123
                }
            },
            'connectorArn': 'string',
            'connectorDescription': 'string',
            'connectorName': 'string',
            'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED',
            'creationTime': datetime(2015, 1, 1),
            'currentVersion': 'string',
            'kafkaCluster': {
                'apacheKafkaCluster': {
                    'bootstrapServers': 'string',
                    'vpc': {
                        'securityGroups': [
                            'string',
                        ],
                        'subnets': [
                            'string',
                        ]
                    }
                }
            },
            'kafkaClusterClientAuthentication': {
                'authenticationType': 'NONE'|'IAM'
            },
            'kafkaClusterEncryptionInTransit': {
                'encryptionType': 'PLAINTEXT'|'TLS'
            },
            'kafkaConnectVersion': 'string',
            'logDelivery': {
                'workerLogDelivery': {
                    'cloudWatchLogs': {
                        'enabled': True|False,
                        'logGroup': 'string'
                    },
                    'firehose': {
                        'deliveryStream': 'string',
                        'enabled': True|False
                    },
                    's3': {
                        'bucket': 'string',
                        'enabled': True|False,
                        'prefix': 'string'
                    }
                }
            },
            'plugins': [
                {
                    'customPlugin': {
                        'customPluginArn': 'string',
                        'revision': 123
                    }
                },
            ],
            'serviceExecutionRoleArn': 'string',
            'workerConfiguration': {
                'revision': 123,
                'workerConfigurationArn': 'string'
            }
        },
    ],
    'nextToken': 'string'
}

Response Structure

  • (dict) --

    • connectors (list) --

      An array of connector descriptions.

      • (dict) --

        Summary of a connector.

        • capacity (dict) --

          The connector's compute capacity settings.

          • autoScaling (dict) --

            Describes the connector's auto scaling capacity.

            • maxWorkerCount (integer) --

              The maximum number of workers allocated to the connector.

            • mcuCount (integer) --

              The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

            • minWorkerCount (integer) --

              The minimum number of workers allocated to the connector.

            • scaleInPolicy (dict) --

              The sacle-in policy for the connector.

              • cpuUtilizationPercentage (integer) --

                Specifies the CPU utilization percentage threshold at which you want connector scale in to be triggered.

            • scaleOutPolicy (dict) --

              The sacle-out policy for the connector.>

              • cpuUtilizationPercentage (integer) --

                The CPU utilization percentage threshold at which you want connector scale out to be triggered.

          • provisionedCapacity (dict) --

            Describes a connector's provisioned capacity.

            • mcuCount (integer) --

              The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

            • workerCount (integer) --

              The number of workers that are allocated to the connector.

        • connectorArn (string) --

          The Amazon Resource Name (ARN) of the connector.

        • connectorDescription (string) --

          The description of the connector.

        • connectorName (string) --

          The name of the connector.

        • connectorState (string) --

          The state of the connector.

        • creationTime (datetime) --

          The time that the connector was created.

        • currentVersion (string) --

          The current version of the connector.

        • kafkaCluster (dict) --

          The details of the Apache Kafka cluster to which the connector is connected.

          • apacheKafkaCluster (dict) --

            The Apache Kafka cluster to which the connector is connected.

            • bootstrapServers (string) --

              The bootstrap servers of the cluster.

            • vpc (dict) --

              Details of an Amazon VPC which has network connectivity to the Apache Kafka cluster.

              • securityGroups (list) --

                The security groups for the connector.

                • (string) --
              • subnets (list) --

                The subnets for the connector.

                • (string) --
        • kafkaClusterClientAuthentication (dict) --

          The type of client authentication used to connect to the Apache Kafka cluster. The value is NONE when no client authentication is used.

          • authenticationType (string) --

            The type of client authentication used to connect to the Apache Kafka cluster. Value NONE means that no client authentication is used.

        • kafkaClusterEncryptionInTransit (dict) --

          Details of encryption in transit to the Apache Kafka cluster.

          • encryptionType (string) --

            The type of encryption in transit to the Apache Kafka cluster.

        • kafkaConnectVersion (string) --

          The version of Kafka Connect. It has to be compatible with both the Apache Kafka cluster's version and the plugins.

        • logDelivery (dict) --

          The settings for delivering connector logs to Amazon CloudWatch Logs.

          • workerLogDelivery (dict) --

            The workers can send worker logs to different destination types. This configuration specifies the details of these destinations.

            • cloudWatchLogs (dict) --

              Details about delivering logs to Amazon CloudWatch Logs.

              • enabled (boolean) --

                Whether log delivery to Amazon CloudWatch Logs is enabled.

              • logGroup (string) --

                The name of the CloudWatch log group that is the destination for log delivery.

            • firehose (dict) --

              Details about delivering logs to Amazon Kinesis Data Firehose.

              • deliveryStream (string) --

                The name of the Kinesis Data Firehose delivery stream that is the destination for log delivery.

              • enabled (boolean) --

                Specifies whether connector logs get delivered to Amazon Kinesis Data Firehose.

            • s3 (dict) --

              Details about delivering logs to Amazon S3.

              • bucket (string) --

                The name of the S3 bucket that is the destination for log delivery.

              • enabled (boolean) --

                Specifies whether connector logs get sent to the specified Amazon S3 destination.

              • prefix (string) --

                The S3 prefix that is the destination for log delivery.

        • plugins (list) --

          Specifies which plugins were used for this connector.

          • (dict) --

            The description of the plugin.

            • customPlugin (dict) --

              Details about a custom plugin.

              • customPluginArn (string) --

                The Amazon Resource Name (ARN) of the custom plugin.

              • revision (integer) --

                The revision of the custom plugin.

        • serviceExecutionRoleArn (string) --

          The Amazon Resource Name (ARN) of the IAM role used by the connector to access Amazon Web Services resources.

        • workerConfiguration (dict) --

          The worker configurations that are in use with the connector.

          • revision (integer) --

            The revision of the worker configuration.

          • workerConfigurationArn (string) --

            The Amazon Resource Name (ARN) of the worker configuration.

    • nextToken (string) --

      If the response of a ListConnectors operation is truncated, it will include a NextToken. Send this NextToken in a subsequent request to continue listing from where it left off.

Exceptions

list_custom_plugins(**kwargs)

Returns a list of all of the custom plugins in this account and Region.

See also: AWS API Documentation

Request Syntax

response = client.list_custom_plugins(
    maxResults=123,
    nextToken='string'
)
Parameters
  • maxResults (integer) -- The maximum number of custom plugins to list in one response.
  • nextToken (string) -- If the response of a ListCustomPlugins operation is truncated, it will include a NextToken. Send this NextToken in a subsequent request to continue listing from where the previous operation left off.
Return type

dict

Returns

Response Syntax

{
    'customPlugins': [
        {
            'creationTime': datetime(2015, 1, 1),
            'customPluginArn': 'string',
            'customPluginState': 'CREATING'|'CREATE_FAILED'|'ACTIVE'|'UPDATING'|'UPDATE_FAILED'|'DELETING',
            'description': 'string',
            'latestRevision': {
                'contentType': 'JAR'|'ZIP',
                'creationTime': datetime(2015, 1, 1),
                'description': 'string',
                'fileDescription': {
                    'fileMd5': 'string',
                    'fileSize': 123
                },
                'location': {
                    's3Location': {
                        'bucketArn': 'string',
                        'fileKey': 'string',
                        'objectVersion': 'string'
                    }
                },
                'revision': 123
            },
            'name': 'string'
        },
    ],
    'nextToken': 'string'
}

Response Structure

  • (dict) --

    • customPlugins (list) --

      An array of custom plugin descriptions.

      • (dict) --

        A summary of the custom plugin.

        • creationTime (datetime) --

          The time that the custom plugin was created.

        • customPluginArn (string) --

          The Amazon Resource Name (ARN) of the custom plugin.

        • customPluginState (string) --

          The state of the custom plugin.

        • description (string) --

          A description of the custom plugin.

        • latestRevision (dict) --

          The latest revision of the custom plugin.

          • contentType (string) --

            The format of the plugin file.

          • creationTime (datetime) --

            The time that the custom plugin was created.

          • description (string) --

            The description of the custom plugin.

          • fileDescription (dict) --

            Details about the custom plugin file.

            • fileMd5 (string) --

              The hex-encoded MD5 checksum of the custom plugin file. You can use it to validate the file.

            • fileSize (integer) --

              The size in bytes of the custom plugin file. You can use it to validate the file.

          • location (dict) --

            Information about the location of the custom plugin.

            • s3Location (dict) --

              The S3 bucket Amazon Resource Name (ARN), file key, and object version of the plugin file stored in Amazon S3.

              • bucketArn (string) --

                The Amazon Resource Name (ARN) of an S3 bucket.

              • fileKey (string) --

                The file key for an object in an S3 bucket.

              • objectVersion (string) --

                The version of an object in an S3 bucket.

          • revision (integer) --

            The revision of the custom plugin.

        • name (string) --

          The name of the custom plugin.

    • nextToken (string) --

      If the response of a ListCustomPlugins operation is truncated, it will include a NextToken. Send this NextToken in a subsequent request to continue listing from where the previous operation left off.

Exceptions

list_worker_configurations(**kwargs)

Returns a list of all of the worker configurations in this account and Region.

See also: AWS API Documentation

Request Syntax

response = client.list_worker_configurations(
    maxResults=123,
    nextToken='string'
)
Parameters
  • maxResults (integer) -- The maximum number of worker configurations to list in one response.
  • nextToken (string) -- If the response of a ListWorkerConfigurations operation is truncated, it will include a NextToken. Send this NextToken in a subsequent request to continue listing from where the previous operation left off.
Return type

dict

Returns

Response Syntax

{
    'nextToken': 'string',
    'workerConfigurations': [
        {
            'creationTime': datetime(2015, 1, 1),
            'description': 'string',
            'latestRevision': {
                'creationTime': datetime(2015, 1, 1),
                'description': 'string',
                'revision': 123
            },
            'name': 'string',
            'workerConfigurationArn': 'string'
        },
    ]
}

Response Structure

  • (dict) --

    • nextToken (string) --

      If the response of a ListWorkerConfigurations operation is truncated, it will include a NextToken. Send this NextToken in a subsequent request to continue listing from where the previous operation left off.

    • workerConfigurations (list) --

      An array of worker configuration descriptions.

      • (dict) --

        The summary of a worker configuration.

        • creationTime (datetime) --

          The time that a worker configuration was created.

        • description (string) --

          The description of a worker configuration.

        • latestRevision (dict) --

          The latest revision of a worker configuration.

          • creationTime (datetime) --

            The time that a worker configuration revision was created.

          • description (string) --

            The description of a worker configuration revision.

          • revision (integer) --

            The revision of a worker configuration.

        • name (string) --

          The name of the worker configuration.

        • workerConfigurationArn (string) --

          The Amazon Resource Name (ARN) of the worker configuration.

Exceptions

update_connector(**kwargs)

Updates the specified connector.

See also: AWS API Documentation

Request Syntax

response = client.update_connector(
    capacity={
        'autoScaling': {
            'maxWorkerCount': 123,
            'mcuCount': 123,
            'minWorkerCount': 123,
            'scaleInPolicy': {
                'cpuUtilizationPercentage': 123
            },
            'scaleOutPolicy': {
                'cpuUtilizationPercentage': 123
            }
        },
        'provisionedCapacity': {
            'mcuCount': 123,
            'workerCount': 123
        }
    },
    connectorArn='string',
    currentVersion='string'
)
Parameters
  • capacity (dict) --

    [REQUIRED]

    The target capacity.

    • autoScaling (dict) --

      The target auto scaling setting.

      • maxWorkerCount (integer) -- [REQUIRED]

        The target maximum number of workers allocated to the connector.

      • mcuCount (integer) -- [REQUIRED]

        The target number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

      • minWorkerCount (integer) -- [REQUIRED]

        The target minimum number of workers allocated to the connector.

      • scaleInPolicy (dict) -- [REQUIRED]

        The target sacle-in policy for the connector.

        • cpuUtilizationPercentage (integer) -- [REQUIRED]

          The target CPU utilization percentage threshold at which you want connector scale in to be triggered.

      • scaleOutPolicy (dict) -- [REQUIRED]

        The target sacle-out policy for the connector.

        • cpuUtilizationPercentage (integer) -- [REQUIRED]

          The target CPU utilization percentage threshold at which you want connector scale out to be triggered.

    • provisionedCapacity (dict) --

      The target settings for provisioned capacity.

      • mcuCount (integer) -- [REQUIRED]

        The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

      • workerCount (integer) -- [REQUIRED]

        The number of workers that are allocated to the connector.

  • connectorArn (string) --

    [REQUIRED]

    The Amazon Resource Name (ARN) of the connector that you want to update.

  • currentVersion (string) --

    [REQUIRED]

    The current version of the connector that you want to update.

Return type

dict

Returns

Response Syntax

{
    'connectorArn': 'string',
    'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED'
}

Response Structure

  • (dict) --

    • connectorArn (string) --

      The Amazon Resource Name (ARN) of the connector.

    • connectorState (string) --

      The state of the connector.

Exceptions

Client Exceptions

Client exceptions are available on a client instance via the exceptions property. For more detailed instructions and examples on the exact usage of client exceptions, see the error handling user guide.

The available client exceptions are:

class KafkaConnect.Client.exceptions.BadRequestException

HTTP Status Code 400: Bad request due to incorrect input. Correct your request and then retry it.

Example

try:
  ...
except client.exceptions.BadRequestException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 400: Bad request due to incorrect input. Correct your request and then retry it.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.ConflictException

HTTP Status Code 409: Conflict. A resource with this name already exists. Retry your request with another name.

Example

try:
  ...
except client.exceptions.ConflictException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 409: Conflict. A resource with this name already exists. Retry your request with another name.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.ForbiddenException

HTTP Status Code 403: Access forbidden. Correct your credentials and then retry your request.

Example

try:
  ...
except client.exceptions.ForbiddenException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 403: Access forbidden. Correct your credentials and then retry your request.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.InternalServerErrorException

HTTP Status Code 500: Unexpected internal server error. Retrying your request might resolve the issue.

Example

try:
  ...
except client.exceptions.InternalServerErrorException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 500: Unexpected internal server error. Retrying your request might resolve the issue.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.NotFoundException

HTTP Status Code 404: Resource not found due to incorrect input. Correct your request and then retry it.

Example

try:
  ...
except client.exceptions.NotFoundException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 404: Resource not found due to incorrect input. Correct your request and then retry it.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.ServiceUnavailableException

HTTP Status Code 503: Service Unavailable. Retrying your request in some time might resolve the issue.

Example

try:
  ...
except client.exceptions.ServiceUnavailableException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 503: Service Unavailable. Retrying your request in some time might resolve the issue.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.TooManyRequestsException

HTTP Status Code 429: Limit exceeded. Resource limit reached.

Example

try:
  ...
except client.exceptions.TooManyRequestsException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 429: Limit exceeded. Resource limit reached.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class KafkaConnect.Client.exceptions.UnauthorizedException

HTTP Status Code 401: Unauthorized request. The provided credentials couldn't be validated.

Example

try:
  ...
except client.exceptions.UnauthorizedException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    HTTP Status Code 401: Unauthorized request. The provided credentials couldn't be validated.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.

Paginators

The available paginators are:

class KafkaConnect.Paginator.ListConnectors
paginator = client.get_paginator('list_connectors')
paginate(**kwargs)

Creates an iterator that will paginate through responses from KafkaConnect.Client.list_connectors().

See also: AWS API Documentation

Request Syntax

response_iterator = paginator.paginate(
    connectorNamePrefix='string',
    PaginationConfig={
        'MaxItems': 123,
        'PageSize': 123,
        'StartingToken': 'string'
    }
)
Parameters
  • connectorNamePrefix (string) -- The name prefix that you want to use to search for and list connectors.
  • PaginationConfig (dict) --

    A dictionary that provides parameters to control pagination.

    • MaxItems (integer) --

      The total number of items to return. If the total number of items available is more than the value specified in max-items then a NextToken will be provided in the output that you can use to resume pagination.

    • PageSize (integer) --

      The size of each page.

    • StartingToken (string) --

      A token to specify where to start paginating. This is the NextToken from a previous response.

Return type

dict

Returns

Response Syntax

{
    'connectors': [
        {
            'capacity': {
                'autoScaling': {
                    'maxWorkerCount': 123,
                    'mcuCount': 123,
                    'minWorkerCount': 123,
                    'scaleInPolicy': {
                        'cpuUtilizationPercentage': 123
                    },
                    'scaleOutPolicy': {
                        'cpuUtilizationPercentage': 123
                    }
                },
                'provisionedCapacity': {
                    'mcuCount': 123,
                    'workerCount': 123
                }
            },
            'connectorArn': 'string',
            'connectorDescription': 'string',
            'connectorName': 'string',
            'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED',
            'creationTime': datetime(2015, 1, 1),
            'currentVersion': 'string',
            'kafkaCluster': {
                'apacheKafkaCluster': {
                    'bootstrapServers': 'string',
                    'vpc': {
                        'securityGroups': [
                            'string',
                        ],
                        'subnets': [
                            'string',
                        ]
                    }
                }
            },
            'kafkaClusterClientAuthentication': {
                'authenticationType': 'NONE'|'IAM'
            },
            'kafkaClusterEncryptionInTransit': {
                'encryptionType': 'PLAINTEXT'|'TLS'
            },
            'kafkaConnectVersion': 'string',
            'logDelivery': {
                'workerLogDelivery': {
                    'cloudWatchLogs': {
                        'enabled': True|False,
                        'logGroup': 'string'
                    },
                    'firehose': {
                        'deliveryStream': 'string',
                        'enabled': True|False
                    },
                    's3': {
                        'bucket': 'string',
                        'enabled': True|False,
                        'prefix': 'string'
                    }
                }
            },
            'plugins': [
                {
                    'customPlugin': {
                        'customPluginArn': 'string',
                        'revision': 123
                    }
                },
            ],
            'serviceExecutionRoleArn': 'string',
            'workerConfiguration': {
                'revision': 123,
                'workerConfigurationArn': 'string'
            }
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • connectors (list) --

      An array of connector descriptions.

      • (dict) --

        Summary of a connector.

        • capacity (dict) --

          The connector's compute capacity settings.

          • autoScaling (dict) --

            Describes the connector's auto scaling capacity.

            • maxWorkerCount (integer) --

              The maximum number of workers allocated to the connector.

            • mcuCount (integer) --

              The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

            • minWorkerCount (integer) --

              The minimum number of workers allocated to the connector.

            • scaleInPolicy (dict) --

              The sacle-in policy for the connector.

              • cpuUtilizationPercentage (integer) --

                Specifies the CPU utilization percentage threshold at which you want connector scale in to be triggered.

            • scaleOutPolicy (dict) --

              The sacle-out policy for the connector.>

              • cpuUtilizationPercentage (integer) --

                The CPU utilization percentage threshold at which you want connector scale out to be triggered.

          • provisionedCapacity (dict) --

            Describes a connector's provisioned capacity.

            • mcuCount (integer) --

              The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.

            • workerCount (integer) --

              The number of workers that are allocated to the connector.

        • connectorArn (string) --

          The Amazon Resource Name (ARN) of the connector.

        • connectorDescription (string) --

          The description of the connector.

        • connectorName (string) --

          The name of the connector.

        • connectorState (string) --

          The state of the connector.

        • creationTime (datetime) --

          The time that the connector was created.

        • currentVersion (string) --

          The current version of the connector.

        • kafkaCluster (dict) --

          The details of the Apache Kafka cluster to which the connector is connected.

          • apacheKafkaCluster (dict) --

            The Apache Kafka cluster to which the connector is connected.

            • bootstrapServers (string) --

              The bootstrap servers of the cluster.

            • vpc (dict) --

              Details of an Amazon VPC which has network connectivity to the Apache Kafka cluster.

              • securityGroups (list) --

                The security groups for the connector.

                • (string) --
              • subnets (list) --

                The subnets for the connector.

                • (string) --
        • kafkaClusterClientAuthentication (dict) --

          The type of client authentication used to connect to the Apache Kafka cluster. The value is NONE when no client authentication is used.

          • authenticationType (string) --

            The type of client authentication used to connect to the Apache Kafka cluster. Value NONE means that no client authentication is used.

        • kafkaClusterEncryptionInTransit (dict) --

          Details of encryption in transit to the Apache Kafka cluster.

          • encryptionType (string) --

            The type of encryption in transit to the Apache Kafka cluster.

        • kafkaConnectVersion (string) --

          The version of Kafka Connect. It has to be compatible with both the Apache Kafka cluster's version and the plugins.

        • logDelivery (dict) --

          The settings for delivering connector logs to Amazon CloudWatch Logs.

          • workerLogDelivery (dict) --

            The workers can send worker logs to different destination types. This configuration specifies the details of these destinations.

            • cloudWatchLogs (dict) --

              Details about delivering logs to Amazon CloudWatch Logs.

              • enabled (boolean) --

                Whether log delivery to Amazon CloudWatch Logs is enabled.

              • logGroup (string) --

                The name of the CloudWatch log group that is the destination for log delivery.

            • firehose (dict) --

              Details about delivering logs to Amazon Kinesis Data Firehose.

              • deliveryStream (string) --

                The name of the Kinesis Data Firehose delivery stream that is the destination for log delivery.

              • enabled (boolean) --

                Specifies whether connector logs get delivered to Amazon Kinesis Data Firehose.

            • s3 (dict) --

              Details about delivering logs to Amazon S3.

              • bucket (string) --

                The name of the S3 bucket that is the destination for log delivery.

              • enabled (boolean) --

                Specifies whether connector logs get sent to the specified Amazon S3 destination.

              • prefix (string) --

                The S3 prefix that is the destination for log delivery.

        • plugins (list) --

          Specifies which plugins were used for this connector.

          • (dict) --

            The description of the plugin.

            • customPlugin (dict) --

              Details about a custom plugin.

              • customPluginArn (string) --

                The Amazon Resource Name (ARN) of the custom plugin.

              • revision (integer) --

                The revision of the custom plugin.

        • serviceExecutionRoleArn (string) --

          The Amazon Resource Name (ARN) of the IAM role used by the connector to access Amazon Web Services resources.

        • workerConfiguration (dict) --

          The worker configurations that are in use with the connector.

          • revision (integer) --

            The revision of the worker configuration.

          • workerConfigurationArn (string) --

            The Amazon Resource Name (ARN) of the worker configuration.

    • NextToken (string) --

      A token to resume pagination.

class KafkaConnect.Paginator.ListCustomPlugins
paginator = client.get_paginator('list_custom_plugins')
paginate(**kwargs)

Creates an iterator that will paginate through responses from KafkaConnect.Client.list_custom_plugins().

See also: AWS API Documentation

Request Syntax

response_iterator = paginator.paginate(
    PaginationConfig={
        'MaxItems': 123,
        'PageSize': 123,
        'StartingToken': 'string'
    }
)
Parameters
PaginationConfig (dict) --

A dictionary that provides parameters to control pagination.

  • MaxItems (integer) --

    The total number of items to return. If the total number of items available is more than the value specified in max-items then a NextToken will be provided in the output that you can use to resume pagination.

  • PageSize (integer) --

    The size of each page.

  • StartingToken (string) --

    A token to specify where to start paginating. This is the NextToken from a previous response.

Return type
dict
Returns
Response Syntax
{
    'customPlugins': [
        {
            'creationTime': datetime(2015, 1, 1),
            'customPluginArn': 'string',
            'customPluginState': 'CREATING'|'CREATE_FAILED'|'ACTIVE'|'UPDATING'|'UPDATE_FAILED'|'DELETING',
            'description': 'string',
            'latestRevision': {
                'contentType': 'JAR'|'ZIP',
                'creationTime': datetime(2015, 1, 1),
                'description': 'string',
                'fileDescription': {
                    'fileMd5': 'string',
                    'fileSize': 123
                },
                'location': {
                    's3Location': {
                        'bucketArn': 'string',
                        'fileKey': 'string',
                        'objectVersion': 'string'
                    }
                },
                'revision': 123
            },
            'name': 'string'
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --
    • customPlugins (list) --

      An array of custom plugin descriptions.

      • (dict) --

        A summary of the custom plugin.

        • creationTime (datetime) --

          The time that the custom plugin was created.

        • customPluginArn (string) --

          The Amazon Resource Name (ARN) of the custom plugin.

        • customPluginState (string) --

          The state of the custom plugin.

        • description (string) --

          A description of the custom plugin.

        • latestRevision (dict) --

          The latest revision of the custom plugin.

          • contentType (string) --

            The format of the plugin file.

          • creationTime (datetime) --

            The time that the custom plugin was created.

          • description (string) --

            The description of the custom plugin.

          • fileDescription (dict) --

            Details about the custom plugin file.

            • fileMd5 (string) --

              The hex-encoded MD5 checksum of the custom plugin file. You can use it to validate the file.

            • fileSize (integer) --

              The size in bytes of the custom plugin file. You can use it to validate the file.

          • location (dict) --

            Information about the location of the custom plugin.

            • s3Location (dict) --

              The S3 bucket Amazon Resource Name (ARN), file key, and object version of the plugin file stored in Amazon S3.

              • bucketArn (string) --

                The Amazon Resource Name (ARN) of an S3 bucket.

              • fileKey (string) --

                The file key for an object in an S3 bucket.

              • objectVersion (string) --

                The version of an object in an S3 bucket.

          • revision (integer) --

            The revision of the custom plugin.

        • name (string) --

          The name of the custom plugin.

    • NextToken (string) --

      A token to resume pagination.

class KafkaConnect.Paginator.ListWorkerConfigurations
paginator = client.get_paginator('list_worker_configurations')
paginate(**kwargs)

Creates an iterator that will paginate through responses from KafkaConnect.Client.list_worker_configurations().

See also: AWS API Documentation

Request Syntax

response_iterator = paginator.paginate(
    PaginationConfig={
        'MaxItems': 123,
        'PageSize': 123,
        'StartingToken': 'string'
    }
)
Parameters
PaginationConfig (dict) --

A dictionary that provides parameters to control pagination.

  • MaxItems (integer) --

    The total number of items to return. If the total number of items available is more than the value specified in max-items then a NextToken will be provided in the output that you can use to resume pagination.

  • PageSize (integer) --

    The size of each page.

  • StartingToken (string) --

    A token to specify where to start paginating. This is the NextToken from a previous response.

Return type
dict
Returns
Response Syntax
{
    'workerConfigurations': [
        {
            'creationTime': datetime(2015, 1, 1),
            'description': 'string',
            'latestRevision': {
                'creationTime': datetime(2015, 1, 1),
                'description': 'string',
                'revision': 123
            },
            'name': 'string',
            'workerConfigurationArn': 'string'
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --
    • workerConfigurations (list) --

      An array of worker configuration descriptions.

      • (dict) --

        The summary of a worker configuration.

        • creationTime (datetime) --

          The time that a worker configuration was created.

        • description (string) --

          The description of a worker configuration.

        • latestRevision (dict) --

          The latest revision of a worker configuration.

          • creationTime (datetime) --

            The time that a worker configuration revision was created.

          • description (string) --

            The description of a worker configuration revision.

          • revision (integer) --

            The revision of a worker configuration.

        • name (string) --

          The name of the worker configuration.

        • workerConfigurationArn (string) --

          The Amazon Resource Name (ARN) of the worker configuration.

    • NextToken (string) --

      A token to resume pagination.