EventBridgePipes

Client

class EventBridgePipes.Client

A low-level client representing Amazon EventBridge Pipes

Amazon EventBridge Pipes connects event sources to targets. Pipes reduces the need for specialized knowledge and integration code when developing event driven architectures. This helps ensures consistency across your company’s applications. With Pipes, the target can be any available EventBridge target. To set up a pipe, you select the event source, add optional event filtering, define optional enrichment, and select the target for the event data.

client = session.create_client('pipes')

These are the available methods:

can_paginate(operation_name)

Check if an operation can be paginated.

Parameters
operation_name (string) -- The operation name. This is the same name as the method name on the client. For example, if the method name is create_foo, and you'd normally invoke the operation as client.create_foo(**kwargs), if the create_foo operation can be paginated, you can use the call client.get_paginator("create_foo").
Returns
True if the operation can be paginated, False otherwise.
close()

Closes underlying endpoint connections.

create_pipe(**kwargs)

Create a pipe. Amazon EventBridge Pipes connect event sources to targets and reduces the need for specialized knowledge and integration code.

See also: AWS API Documentation

Request Syntax

response = client.create_pipe(
    Description='string',
    DesiredState='RUNNING'|'STOPPED',
    Enrichment='string',
    EnrichmentParameters={
        'HttpParameters': {
            'HeaderParameters': {
                'string': 'string'
            },
            'PathParameterValues': [
                'string',
            ],
            'QueryStringParameters': {
                'string': 'string'
            }
        },
        'InputTemplate': 'string'
    },
    Name='string',
    RoleArn='string',
    Source='string',
    SourceParameters={
        'ActiveMQBrokerParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'QueueName': 'string'
        },
        'DynamoDBStreamParameters': {
            'BatchSize': 123,
            'DeadLetterConfig': {
                'Arn': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'MaximumRecordAgeInSeconds': 123,
            'MaximumRetryAttempts': 123,
            'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
            'ParallelizationFactor': 123,
            'StartingPosition': 'TRIM_HORIZON'|'LATEST'
        },
        'FilterCriteria': {
            'Filters': [
                {
                    'Pattern': 'string'
                },
            ]
        },
        'KinesisStreamParameters': {
            'BatchSize': 123,
            'DeadLetterConfig': {
                'Arn': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'MaximumRecordAgeInSeconds': 123,
            'MaximumRetryAttempts': 123,
            'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
            'ParallelizationFactor': 123,
            'StartingPosition': 'TRIM_HORIZON'|'LATEST'|'AT_TIMESTAMP',
            'StartingPositionTimestamp': datetime(2015, 1, 1)
        },
        'ManagedStreamingKafkaParameters': {
            'BatchSize': 123,
            'ConsumerGroupID': 'string',
            'Credentials': {
                'ClientCertificateTlsAuth': 'string',
                'SaslScram512Auth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'StartingPosition': 'TRIM_HORIZON'|'LATEST',
            'TopicName': 'string'
        },
        'RabbitMQBrokerParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'QueueName': 'string',
            'VirtualHost': 'string'
        },
        'SelfManagedKafkaParameters': {
            'AdditionalBootstrapServers': [
                'string',
            ],
            'BatchSize': 123,
            'ConsumerGroupID': 'string',
            'Credentials': {
                'BasicAuth': 'string',
                'ClientCertificateTlsAuth': 'string',
                'SaslScram256Auth': 'string',
                'SaslScram512Auth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'ServerRootCaCertificate': 'string',
            'StartingPosition': 'TRIM_HORIZON'|'LATEST',
            'TopicName': 'string',
            'Vpc': {
                'SecurityGroup': [
                    'string',
                ],
                'Subnets': [
                    'string',
                ]
            }
        },
        'SqsQueueParameters': {
            'BatchSize': 123,
            'MaximumBatchingWindowInSeconds': 123
        }
    },
    Tags={
        'string': 'string'
    },
    Target='string',
    TargetParameters={
        'BatchJobParameters': {
            'ArrayProperties': {
                'Size': 123
            },
            'ContainerOverrides': {
                'Command': [
                    'string',
                ],
                'Environment': [
                    {
                        'Name': 'string',
                        'Value': 'string'
                    },
                ],
                'InstanceType': 'string',
                'ResourceRequirements': [
                    {
                        'Type': 'GPU'|'MEMORY'|'VCPU',
                        'Value': 'string'
                    },
                ]
            },
            'DependsOn': [
                {
                    'JobId': 'string',
                    'Type': 'N_TO_N'|'SEQUENTIAL'
                },
            ],
            'JobDefinition': 'string',
            'JobName': 'string',
            'Parameters': {
                'string': 'string'
            },
            'RetryStrategy': {
                'Attempts': 123
            }
        },
        'CloudWatchLogsParameters': {
            'LogStreamName': 'string',
            'Timestamp': 'string'
        },
        'EcsTaskParameters': {
            'CapacityProviderStrategy': [
                {
                    'base': 123,
                    'capacityProvider': 'string',
                    'weight': 123
                },
            ],
            'EnableECSManagedTags': True|False,
            'EnableExecuteCommand': True|False,
            'Group': 'string',
            'LaunchType': 'EC2'|'FARGATE'|'EXTERNAL',
            'NetworkConfiguration': {
                'awsvpcConfiguration': {
                    'AssignPublicIp': 'ENABLED'|'DISABLED',
                    'SecurityGroups': [
                        'string',
                    ],
                    'Subnets': [
                        'string',
                    ]
                }
            },
            'Overrides': {
                'ContainerOverrides': [
                    {
                        'Command': [
                            'string',
                        ],
                        'Cpu': 123,
                        'Environment': [
                            {
                                'name': 'string',
                                'value': 'string'
                            },
                        ],
                        'EnvironmentFiles': [
                            {
                                'type': 's3',
                                'value': 'string'
                            },
                        ],
                        'Memory': 123,
                        'MemoryReservation': 123,
                        'Name': 'string',
                        'ResourceRequirements': [
                            {
                                'type': 'GPU'|'InferenceAccelerator',
                                'value': 'string'
                            },
                        ]
                    },
                ],
                'Cpu': 'string',
                'EphemeralStorage': {
                    'sizeInGiB': 123
                },
                'ExecutionRoleArn': 'string',
                'InferenceAcceleratorOverrides': [
                    {
                        'deviceName': 'string',
                        'deviceType': 'string'
                    },
                ],
                'Memory': 'string',
                'TaskRoleArn': 'string'
            },
            'PlacementConstraints': [
                {
                    'expression': 'string',
                    'type': 'distinctInstance'|'memberOf'
                },
            ],
            'PlacementStrategy': [
                {
                    'field': 'string',
                    'type': 'random'|'spread'|'binpack'
                },
            ],
            'PlatformVersion': 'string',
            'PropagateTags': 'TASK_DEFINITION',
            'ReferenceId': 'string',
            'Tags': [
                {
                    'Key': 'string',
                    'Value': 'string'
                },
            ],
            'TaskCount': 123,
            'TaskDefinitionArn': 'string'
        },
        'EventBridgeEventBusParameters': {
            'DetailType': 'string',
            'EndpointId': 'string',
            'Resources': [
                'string',
            ],
            'Source': 'string',
            'Time': 'string'
        },
        'HttpParameters': {
            'HeaderParameters': {
                'string': 'string'
            },
            'PathParameterValues': [
                'string',
            ],
            'QueryStringParameters': {
                'string': 'string'
            }
        },
        'InputTemplate': 'string',
        'KinesisStreamParameters': {
            'PartitionKey': 'string'
        },
        'LambdaFunctionParameters': {
            'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
        },
        'RedshiftDataParameters': {
            'Database': 'string',
            'DbUser': 'string',
            'SecretManagerArn': 'string',
            'Sqls': [
                'string',
            ],
            'StatementName': 'string',
            'WithEvent': True|False
        },
        'SageMakerPipelineParameters': {
            'PipelineParameterList': [
                {
                    'Name': 'string',
                    'Value': 'string'
                },
            ]
        },
        'SqsQueueParameters': {
            'MessageDeduplicationId': 'string',
            'MessageGroupId': 'string'
        },
        'StepFunctionStateMachineParameters': {
            'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
        }
    }
)
Parameters
  • Description (string) -- A description of the pipe.
  • DesiredState (string) -- The state the pipe should be in.
  • Enrichment (string) -- The ARN of the enrichment resource.
  • EnrichmentParameters (dict) --

    The parameters required to set up enrichment on your pipe.

    • HttpParameters (dict) --

      Contains the HTTP parameters to use when the target is a API Gateway REST endpoint or EventBridge ApiDestination.

      If you specify an API Gateway REST API or EventBridge ApiDestination as a target, you can use this parameter to specify headers, path parameters, and query string keys/values as part of your target invoking request. If you're using ApiDestinations, the corresponding Connection can also have these values configured. In case of any conflicting keys, values from the Connection take precedence.

      • HeaderParameters (dict) --

        The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
      • PathParameterValues (list) --

        The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").

        • (string) --
      • QueryStringParameters (dict) --

        The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
    • InputTemplate (string) --

      Valid JSON text passed to the enrichment. In this case, nothing from the event itself is passed to the enrichment. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format.

  • Name (string) --

    [REQUIRED]

    The name of the pipe.

  • RoleArn (string) --

    [REQUIRED]

    The ARN of the role that allows the pipe to send data to the target.

  • Source (string) --

    [REQUIRED]

    The ARN of the source resource.

  • SourceParameters (dict) --

    The parameters required to set up a source for your pipe.

    • ActiveMQBrokerParameters (dict) --

      The parameters for using an Active MQ broker as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • Credentials (dict) -- [REQUIRED]

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: BasicAuth.

        • BasicAuth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • QueueName (string) -- [REQUIRED]

        The name of the destination queue to consume.

    • DynamoDBStreamParameters (dict) --

      The parameters for using a DynamoDB stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • DeadLetterConfig (dict) --

        Define the target queue to send dead-letter queue events to.

        • Arn (string) --

          The ARN of the Amazon SQS queue specified as the target for the dead-letter queue.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • MaximumRecordAgeInSeconds (integer) --

        (Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.

      • MaximumRetryAttempts (integer) --

        (Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.

      • OnPartialBatchItemFailure (string) --

        (Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.

      • ParallelizationFactor (integer) --

        (Streams only) The number of batches to process concurrently from each shard. The default value is 1.

      • StartingPosition (string) -- [REQUIRED]

        (Streams only) The position in a stream from which to start reading.

    • FilterCriteria (dict) --

      The collection of event patterns used to filter events. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .

      • Filters (list) --

        The event patterns.

        • (dict) --

          Filter events using an event pattern. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .

          • Pattern (string) --

            The event pattern.

    • KinesisStreamParameters (dict) --

      The parameters for using a Kinesis stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • DeadLetterConfig (dict) --

        Define the target queue to send dead-letter queue events to.

        • Arn (string) --

          The ARN of the Amazon SQS queue specified as the target for the dead-letter queue.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • MaximumRecordAgeInSeconds (integer) --

        (Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.

      • MaximumRetryAttempts (integer) --

        (Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.

      • OnPartialBatchItemFailure (string) --

        (Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.

      • ParallelizationFactor (integer) --

        (Streams only) The number of batches to process concurrently from each shard. The default value is 1.

      • StartingPosition (string) -- [REQUIRED]

        (Streams only) The position in a stream from which to start reading.

      • StartingPositionTimestamp (datetime) --

        With StartingPosition set to AT_TIMESTAMP , the time from which to start reading, in Unix time seconds.

    • ManagedStreamingKafkaParameters (dict) --

      The parameters for using an MSK stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • ConsumerGroupID (string) --

        The name of the destination queue to consume.

      • Credentials (dict) --

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: ClientCertificateTlsAuth, SaslScram512Auth.

        • ClientCertificateTlsAuth (string) --

          The ARN of the Secrets Manager secret.

        • SaslScram512Auth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • StartingPosition (string) --

        (Streams only) The position in a stream from which to start reading.

      • TopicName (string) -- [REQUIRED]

        The name of the topic that the pipe will read from.

    • RabbitMQBrokerParameters (dict) --

      The parameters for using a Rabbit MQ broker as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • Credentials (dict) -- [REQUIRED]

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: BasicAuth.

        • BasicAuth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • QueueName (string) -- [REQUIRED]

        The name of the destination queue to consume.

      • VirtualHost (string) --

        The name of the virtual host associated with the source broker.

    • SelfManagedKafkaParameters (dict) --

      The parameters for using a self-managed Apache Kafka stream as a source.

      • AdditionalBootstrapServers (list) --

        An array of server URLs.

        • (string) --
      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • ConsumerGroupID (string) --

        The name of the destination queue to consume.

      • Credentials (dict) --

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: BasicAuth, ClientCertificateTlsAuth, SaslScram256Auth, SaslScram512Auth.

        • BasicAuth (string) --

          The ARN of the Secrets Manager secret.

        • ClientCertificateTlsAuth (string) --

          The ARN of the Secrets Manager secret.

        • SaslScram256Auth (string) --

          The ARN of the Secrets Manager secret.

        • SaslScram512Auth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • ServerRootCaCertificate (string) --

        The ARN of the Secrets Manager secret used for certification.

      • StartingPosition (string) --

        (Streams only) The position in a stream from which to start reading.

      • TopicName (string) -- [REQUIRED]

        The name of the topic that the pipe will read from.

      • Vpc (dict) --

        This structure specifies the VPC subnets and security groups for the stream, and whether a public IP address is to be used.

        • SecurityGroup (list) --

          Specifies the security groups associated with the stream. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.

          • (string) --
        • Subnets (list) --

          Specifies the subnets associated with the stream. These subnets must all be in the same VPC. You can specify as many as 16 subnets.

          • (string) --
    • SqsQueueParameters (dict) --

      The parameters for using a Amazon SQS stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

  • Tags (dict) --

    The list of key-value pairs to associate with the pipe.

    • (string) --
      • (string) --
  • Target (string) --

    [REQUIRED]

    The ARN of the target resource.

  • TargetParameters (dict) --

    The parameters required to set up a target for your pipe.

    • BatchJobParameters (dict) --

      The parameters for using an Batch job as a target.

      • ArrayProperties (dict) --

        The array properties for the submitted job, such as the size of the array. The array size can be between 2 and 10,000. If you specify array properties for a job, it becomes an array job. This parameter is used only if the target is an Batch job.

        • Size (integer) --

          The size of the array, if this is an array batch job.

      • ContainerOverrides (dict) --

        The overrides that are sent to a container.

        • Command (list) --

          The command to send to the container that overrides the default command from the Docker image or the task definition.

          • (string) --
        • Environment (list) --

          The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.

          Note

          Environment variables cannot start with " Batch ". This naming convention is reserved for variables that Batch sets.

          • (dict) --

            The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.

            Note

            Environment variables cannot start with " Batch ". This naming convention is reserved for variables that Batch sets.

            • Name (string) --

              The name of the key-value pair. For environment variables, this is the name of the environment variable.

            • Value (string) --

              The value of the key-value pair. For environment variables, this is the value of the environment variable.

        • InstanceType (string) --

          The instance type to use for a multi-node parallel job.

          Note

          This parameter isn't applicable to single-node container jobs or jobs that run on Fargate resources, and shouldn't be provided.

        • ResourceRequirements (list) --

          The type and amount of resources to assign to a container. This overrides the settings in the job definition. The supported resources include GPU , MEMORY , and VCPU .

          • (dict) --

            The type and amount of a resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .

            • Type (string) -- [REQUIRED]

              The type of resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .

            • Value (string) -- [REQUIRED]

              The quantity of the specified resource to reserve for the container. The values vary based on the type specified.

              type="GPU"

              The number of physical GPUs to reserve for the container. Make sure that the number of GPUs reserved for all containers in a job doesn't exceed the number of available GPUs on the compute resource that the job is launched on.

              Note

              GPUs aren't available for jobs that are running on Fargate resources.

              type="MEMORY"

              The memory hard limit (in MiB) present to the container. This parameter is supported for jobs that are running on EC2 resources. If your container attempts to exceed the memory specified, the container is terminated. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run. You must specify at least 4 MiB of memory for a job. This is required but can be specified in several places for multi-node parallel (MNP) jobs. It must be specified for each node at least once. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run.

              Note

              If you're trying to maximize your resource utilization by providing your jobs as much memory as possible for a particular instance type, see Memory management in the Batch User Guide .

              For jobs that are running on Fargate resources, then value is the hard limit (in MiB), and must match one of the supported values and the VCPU values must be one of the values supported for that memory value.

              value = 512

              VCPU = 0.25

              value = 1024

              VCPU = 0.25 or 0.5

              value = 2048

              VCPU = 0.25, 0.5, or 1

              value = 3072

              VCPU = 0.5, or 1

              value = 4096

              VCPU = 0.5, 1, or 2

              value = 5120, 6144, or 7168

              VCPU = 1 or 2

              value = 8192

              VCPU = 1, 2, 4, or 8

              value = 9216, 10240, 11264, 12288, 13312, 14336, or 15360

              VCPU = 2 or 4

              value = 16384

              VCPU = 2, 4, or 8

              value = 17408, 18432, 19456, 21504, 22528, 23552, 25600, 26624, 27648, 29696, or 30720

              VCPU = 4

              value = 20480, 24576, or 28672

              VCPU = 4 or 8

              value = 36864, 45056, 53248, or 61440

              VCPU = 8

              value = 32768, 40960, 49152, or 57344

              VCPU = 8 or 16

              value = 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880

              VCPU = 16

              type="VCPU"

              The number of vCPUs reserved for the container. This parameter maps to CpuShares in the Create a container section of the Docker Remote API and the --cpu-shares option to docker run. Each vCPU is equivalent to 1,024 CPU shares. For EC2 resources, you must specify at least one vCPU. This is required but can be specified in several places; it must be specified for each node at least once.

              The default for the Fargate On-Demand vCPU resource count quota is 6 vCPUs. For more information about Fargate quotas, see Fargate quotas in the Amazon Web Services General Reference .

              For jobs that are running on Fargate resources, then value must match one of the supported values and the MEMORY values must be one of the values supported for that VCPU value. The supported values are 0.25, 0.5, 1, 2, 4, 8, and 16

              value = 0.25

              MEMORY = 512, 1024, or 2048

              value = 0.5

              MEMORY = 1024, 2048, 3072, or 4096

              value = 1

              MEMORY = 2048, 3072, 4096, 5120, 6144, 7168, or 8192

              value = 2

              MEMORY = 4096, 5120, 6144, 7168, 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, or 16384

              value = 4

              MEMORY = 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, 16384, 17408, 18432, 19456, 20480, 21504, 22528, 23552, 24576, 25600, 26624, 27648, 28672, 29696, or 30720

              value = 8

              MEMORY = 16384, 20480, 24576, 28672, 32768, 36864, 40960, 45056, 49152, 53248, 57344, or 61440

              value = 16

              MEMORY = 32768, 40960, 49152, 57344, 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880

      • DependsOn (list) --

        A list of dependencies for the job. A job can depend upon a maximum of 20 jobs. You can specify a SEQUENTIAL type dependency without specifying a job ID for array jobs so that each child array job completes sequentially, starting at index 0. You can also specify an N_TO_N type dependency with a job ID for array jobs. In that case, each index child of this job must wait for the corresponding index child of each dependency to complete before it can begin.

        • (dict) --

          An object that represents an Batch job dependency.

          • JobId (string) --

            The job ID of the Batch job that's associated with this dependency.

          • Type (string) --

            The type of the job dependency.

      • JobDefinition (string) -- [REQUIRED]

        The job definition used by this job. This value can be one of name , name:revision , or the Amazon Resource Name (ARN) for the job definition. If name is specified without a revision then the latest active revision is used.

      • JobName (string) -- [REQUIRED]

        The name of the job. It can be up to 128 letters long. The first character must be alphanumeric, can contain uppercase and lowercase letters, numbers, hyphens (-), and underscores (_).

      • Parameters (dict) --

        Additional parameters passed to the job that replace parameter substitution placeholders that are set in the job definition. Parameters are specified as a key and value pair mapping. Parameters included here override any corresponding parameter defaults from the job definition.

        • (string) --
          • (string) --
      • RetryStrategy (dict) --

        The retry strategy to use for failed jobs. When a retry strategy is specified here, it overrides the retry strategy defined in the job definition.

        • Attempts (integer) --

          The number of times to move a job to the RUNNABLE status. If the value of attempts is greater than one, the job is retried on failure the same number of attempts as the value.

    • CloudWatchLogsParameters (dict) --

      The parameters for using an CloudWatch Logs log stream as a target.

      • LogStreamName (string) --

        The name of the log stream.

      • Timestamp (string) --

        The time the event occurred, expressed as the number of milliseconds after Jan 1, 1970 00:00:00 UTC.

    • EcsTaskParameters (dict) --

      The parameters for using an Amazon ECS task as a target.

      • CapacityProviderStrategy (list) --

        The capacity provider strategy to use for the task.

        If a capacityProviderStrategy is specified, the launchType parameter must be omitted. If no capacityProviderStrategy or launchType is specified, the defaultCapacityProviderStrategy for the cluster is used.

        • (dict) --

          The details of a capacity provider strategy. To learn more, see CapacityProviderStrategyItem in the Amazon ECS API Reference.

          • base (integer) --

            The base value designates how many tasks, at a minimum, to run on the specified capacity provider. Only one capacity provider in a capacity provider strategy can have a base defined. If no value is specified, the default value of 0 is used.

          • capacityProvider (string) -- [REQUIRED]

            The short name of the capacity provider.

          • weight (integer) --

            The weight value designates the relative percentage of the total number of tasks launched that should use the specified capacity provider. The weight value is taken into consideration after the base value, if defined, is satisfied.

      • EnableECSManagedTags (boolean) --

        Specifies whether to enable Amazon ECS managed tags for the task. For more information, see Tagging Your Amazon ECS Resources in the Amazon Elastic Container Service Developer Guide.

      • EnableExecuteCommand (boolean) --

        Whether or not to enable the execute command functionality for the containers in this task. If true, this enables execute command functionality on all containers in the task.

      • Group (string) --

        Specifies an Amazon ECS task group for the task. The maximum length is 255 characters.

      • LaunchType (string) --

        Specifies the launch type on which your task is running. The launch type that you specify here must match one of the launch type (compatibilities) of the target task. The FARGATE value is supported only in the Regions where Fargate with Amazon ECS is supported. For more information, see Fargate on Amazon ECS in the Amazon Elastic Container Service Developer Guide .

      • NetworkConfiguration (dict) --

        Use this structure if the Amazon ECS task uses the awsvpc network mode. This structure specifies the VPC subnets and security groups associated with the task, and whether a public IP address is to be used. This structure is required if LaunchType is FARGATE because the awsvpc mode is required for Fargate tasks.

        If you specify NetworkConfiguration when the target ECS task does not use the awsvpc network mode, the task fails.

        • awsvpcConfiguration (dict) --

          Use this structure to specify the VPC subnets and security groups for the task, and whether a public IP address is to be used. This structure is relevant only for ECS tasks that use the awsvpc network mode.

          • AssignPublicIp (string) --

            Specifies whether the task's elastic network interface receives a public IP address. You can specify ENABLED only when LaunchType in EcsParameters is set to FARGATE .

          • SecurityGroups (list) --

            Specifies the security groups associated with the task. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.

            • (string) --
          • Subnets (list) -- [REQUIRED]

            Specifies the subnets associated with the task. These subnets must all be in the same VPC. You can specify as many as 16 subnets.

            • (string) --
      • Overrides (dict) --

        The overrides that are associated with a task.

        • ContainerOverrides (list) --

          One or more container overrides that are sent to a task.

          • (dict) --

            The overrides that are sent to a container. An empty container override can be passed in. An example of an empty container override is {"containerOverrides": [ ] } . If a non-empty container override is specified, the name parameter must be included.

            • Command (list) --

              The command to send to the container that overrides the default command from the Docker image or the task definition. You must also specify a container name.

              • (string) --
            • Cpu (integer) --

              The number of cpu units reserved for the container, instead of the default value from the task definition. You must also specify a container name.

            • Environment (list) --

              The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.

              • (dict) --

                The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.

                • name (string) --

                  The name of the key-value pair. For environment variables, this is the name of the environment variable.

                • value (string) --

                  The value of the key-value pair. For environment variables, this is the value of the environment variable.

            • EnvironmentFiles (list) --

              A list of files containing the environment variables to pass to a container, instead of the value from the container definition.

              • (dict) --

                A list of files containing the environment variables to pass to a container. You can specify up to ten environment files. The file must have a .env file extension. Each line in an environment file should contain an environment variable in VARIABLE=VALUE format. Lines beginning with # are treated as comments and are ignored. For more information about the environment variable file syntax, see Declare default environment variables in file.

                If there are environment variables specified using the environment parameter in a container definition, they take precedence over the variables contained within an environment file. If multiple environment files are specified that contain the same variable, they're processed from the top down. We recommend that you use unique variable names. For more information, see Specifying environment variables in the Amazon Elastic Container Service Developer Guide .

                This parameter is only supported for tasks hosted on Fargate using the following platform versions:

                • Linux platform version 1.4.0 or later.
                • Windows platform version 1.0.0 or later.
                • type (string) -- [REQUIRED]

                  The file type to use. The only supported value is s3 .

                • value (string) -- [REQUIRED]

                  The Amazon Resource Name (ARN) of the Amazon S3 object containing the environment variable file.

            • Memory (integer) --

              The hard limit (in MiB) of memory to present to the container, instead of the default value from the task definition. If your container attempts to exceed the memory specified here, the container is killed. You must also specify a container name.

            • MemoryReservation (integer) --

              The soft limit (in MiB) of memory to reserve for the container, instead of the default value from the task definition. You must also specify a container name.

            • Name (string) --

              The name of the container that receives the override. This parameter is required if any override is specified.

            • ResourceRequirements (list) --

              The type and amount of a resource to assign to a container, instead of the default value from the task definition. The only supported resource is a GPU.

              • (dict) --

                The type and amount of a resource to assign to a container. The supported resource types are GPUs and Elastic Inference accelerators. For more information, see Working with GPUs on Amazon ECS or Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide

                • type (string) -- [REQUIRED]

                  The type of resource to assign to a container. The supported values are GPU or InferenceAccelerator .

                • value (string) -- [REQUIRED]

                  The value for the specified resource type.

                  If the GPU type is used, the value is the number of physical GPUs the Amazon ECS container agent reserves for the container. The number of GPUs that's reserved for all containers in a task can't exceed the number of available GPUs on the container instance that the task is launched on.

                  If the InferenceAccelerator type is used, the value matches the deviceName for an InferenceAccelerator specified in a task definition.

        • Cpu (string) --

          The cpu override for the task.

        • EphemeralStorage (dict) --

          The ephemeral storage setting override for the task.

          Note

          This parameter is only supported for tasks hosted on Fargate that use the following platform versions:

          • Linux platform version 1.4.0 or later.
          • Windows platform version 1.0.0 or later.
          • sizeInGiB (integer) -- [REQUIRED]

            The total amount, in GiB, of ephemeral storage to set for the task. The minimum supported value is 21 GiB and the maximum supported value is 200 GiB.

        • ExecutionRoleArn (string) --

          The Amazon Resource Name (ARN) of the task execution IAM role override for the task. For more information, see Amazon ECS task execution IAM role in the Amazon Elastic Container Service Developer Guide .

        • InferenceAcceleratorOverrides (list) --

          The Elastic Inference accelerator override for the task.

          • (dict) --

            Details on an Elastic Inference accelerator task override. This parameter is used to override the Elastic Inference accelerator specified in the task definition. For more information, see Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide .

            • deviceName (string) --

              The Elastic Inference accelerator device name to override for the task. This parameter must match a deviceName specified in the task definition.

            • deviceType (string) --

              The Elastic Inference accelerator type to use.

        • Memory (string) --

          The memory override for the task.

        • TaskRoleArn (string) --

          The Amazon Resource Name (ARN) of the IAM role that containers in this task can assume. All containers in this task are granted the permissions that are specified in this role. For more information, see IAM Role for Tasks in the Amazon Elastic Container Service Developer Guide .

      • PlacementConstraints (list) --

        An array of placement constraint objects to use for the task. You can specify up to 10 constraints per task (including constraints in the task definition and those specified at runtime).

        • (dict) --

          An object representing a constraint on task placement. To learn more, see Task Placement Constraints in the Amazon Elastic Container Service Developer Guide.

          • expression (string) --

            A cluster query language expression to apply to the constraint. You cannot specify an expression if the constraint type is distinctInstance . To learn more, see Cluster Query Language in the Amazon Elastic Container Service Developer Guide.

          • type (string) --

            The type of constraint. Use distinctInstance to ensure that each task in a particular group is running on a different container instance. Use memberOf to restrict the selection to a group of valid candidates.

      • PlacementStrategy (list) --

        The placement strategy objects to use for the task. You can specify a maximum of five strategy rules per task.

        • (dict) --

          The task placement strategy for a task or service. To learn more, see Task Placement Strategies in the Amazon Elastic Container Service Service Developer Guide.

          • field (string) --

            The field to apply the placement strategy against. For the spread placement strategy, valid values are instanceId (or host, which has the same effect), or any platform or custom attribute that is applied to a container instance, such as attribute:ecs.availability-zone. For the binpack placement strategy, valid values are cpu and memory. For the random placement strategy, this field is not used.

          • type (string) --

            The type of placement strategy. The random placement strategy randomly places tasks on available candidates. The spread placement strategy spreads placement across available candidates evenly based on the field parameter. The binpack strategy places tasks on available candidates that have the least available amount of the resource that is specified with the field parameter. For example, if you binpack on memory, a task is placed on the instance with the least amount of remaining memory (but still enough to run the task).

      • PlatformVersion (string) --

        Specifies the platform version for the task. Specify only the numeric portion of the platform version, such as 1.1.0 .

        This structure is used only if LaunchType is FARGATE . For more information about valid platform versions, see Fargate Platform Versions in the Amazon Elastic Container Service Developer Guide .

      • PropagateTags (string) --

        Specifies whether to propagate the tags from the task definition to the task. If no value is specified, the tags are not propagated. Tags can only be propagated to the task during task creation. To add tags to a task after task creation, use the TagResource API action.

      • ReferenceId (string) --

        The reference ID to use for the task.

      • Tags (list) --

        The metadata that you apply to the task to help you categorize and organize them. Each tag consists of a key and an optional value, both of which you define. To learn more, see RunTask in the Amazon ECS API Reference.

        • (dict) --

          A key-value pair associated with an Amazon Web Services resource. In EventBridge, rules and event buses support tagging.

          • Key (string) -- [REQUIRED]

            A string you can use to assign a value. The combination of tag keys and values can help you organize and categorize your resources.

          • Value (string) -- [REQUIRED]

            The value for the specified tag key.

      • TaskCount (integer) --

        The number of tasks to create based on TaskDefinition . The default is 1.

      • TaskDefinitionArn (string) -- [REQUIRED]

        The ARN of the task definition to use if the event target is an Amazon ECS task.

    • EventBridgeEventBusParameters (dict) --

      The parameters for using an EventBridge event bus as a target.

      • DetailType (string) --

        A free-form string, with a maximum of 128 characters, used to decide what fields to expect in the event detail.

      • EndpointId (string) --

        The URL subdomain of the endpoint. For example, if the URL for Endpoint is https://abcde.veo.endpoints.event.amazonaws.com, then the EndpointId is abcde.veo .

        Warning

        When using Java, you must include auth-crt on the class path.

      • Resources (list) --

        Amazon Web Services resources, identified by Amazon Resource Name (ARN), which the event primarily concerns. Any number, including zero, may be present.

        • (string) --
      • Source (string) --

        The source of the event.

      • Time (string) --

        The time stamp of the event, per RFC3339. If no time stamp is provided, the time stamp of the PutEvents call is used.

    • HttpParameters (dict) --

      These are custom parameter to be used when the target is an API Gateway REST APIs or EventBridge ApiDestinations.

      • HeaderParameters (dict) --

        The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
      • PathParameterValues (list) --

        The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").

        • (string) --
      • QueryStringParameters (dict) --

        The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
    • InputTemplate (string) --

      Valid JSON text passed to the target. In this case, nothing from the event itself is passed to the target. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format.

    • KinesisStreamParameters (dict) --

      The parameters for using a Kinesis stream as a source.

      • PartitionKey (string) -- [REQUIRED]

        Determines which shard in the stream the data record is assigned to. Partition keys are Unicode strings with a maximum length limit of 256 characters for each key. Amazon Kinesis Data Streams uses the partition key as input to a hash function that maps the partition key and associated data to a specific shard. Specifically, an MD5 hash function is used to map partition keys to 128-bit integer values and to map associated data records to shards. As a result of this hashing mechanism, all data records with the same partition key map to the same shard within the stream.

    • LambdaFunctionParameters (dict) --

      The parameters for using a Lambda function as a target.

      • InvocationType (string) --

        Choose from the following options.

        • RequestResponse (default) - Invoke the function synchronously. Keep the connection open until the function returns a response or times out. The API response includes the function response and additional data.
        • Event - Invoke the function asynchronously. Send events that fail multiple times to the function's dead-letter queue (if it's configured). The API response only includes a status code.
        • DryRun - Validate parameter values and verify that the user or role has permission to invoke the function.
    • RedshiftDataParameters (dict) --

      These are custom parameters to be used when the target is a Amazon Redshift cluster to invoke the Amazon Redshift Data API ExecuteStatement.

      • Database (string) -- [REQUIRED]

        The name of the database. Required when authenticating using temporary credentials.

      • DbUser (string) --

        The database user name. Required when authenticating using temporary credentials.

      • SecretManagerArn (string) --

        The name or ARN of the secret that enables access to the database. Required when authenticating using SageMaker.

      • Sqls (list) -- [REQUIRED]

        The SQL statement text to run.

        • (string) --

          // A single Redshift SQL

      • StatementName (string) --

        The name of the SQL statement. You can name the SQL statement when you create it to identify the query.

      • WithEvent (boolean) --

        Indicates whether to send an event back to EventBridge after the SQL statement runs.

    • SageMakerPipelineParameters (dict) --

      The parameters for using a SageMaker pipeline as a target.

      • PipelineParameterList (list) --

        List of Parameter names and values for SageMaker Model Building Pipeline execution.

        • (dict) --

          Name/Value pair of a parameter to start execution of a SageMaker Model Building Pipeline.

          • Name (string) -- [REQUIRED]

            Name of parameter to start execution of a SageMaker Model Building Pipeline.

          • Value (string) -- [REQUIRED]

            Value of parameter to start execution of a SageMaker Model Building Pipeline.

    • SqsQueueParameters (dict) --

      The parameters for using a Amazon SQS stream as a source.

      • MessageDeduplicationId (string) --

        This parameter applies only to FIFO (first-in-first-out) queues.

        The token used for deduplication of sent messages.

      • MessageGroupId (string) --

        The FIFO message group ID to use as the target.

    • StepFunctionStateMachineParameters (dict) --

      The parameters for using a Step Functions state machine as a target.

      • InvocationType (string) --

        Specify whether to wait for the state machine to finish or not.

Return type

dict

Returns

Response Syntax

{
    'Arn': 'string',
    'CreationTime': datetime(2015, 1, 1),
    'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    'DesiredState': 'RUNNING'|'STOPPED',
    'LastModifiedTime': datetime(2015, 1, 1),
    'Name': 'string'
}

Response Structure

  • (dict) --

    • Arn (string) --

      The ARN of the pipe.

    • CreationTime (datetime) --

      The time the pipe was created.

    • CurrentState (string) --

      The state the pipe is in.

    • DesiredState (string) --

      The state the pipe should be in.

    • LastModifiedTime (datetime) --

      When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

    • Name (string) --

      The name of the pipe.

Exceptions

delete_pipe(**kwargs)

Delete an existing pipe. For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.

See also: AWS API Documentation

Request Syntax

response = client.delete_pipe(
    Name='string'
)
Parameters
Name (string) --

[REQUIRED]

The name of the pipe.

Return type
dict
Returns
Response Syntax
{
    'Arn': 'string',
    'CreationTime': datetime(2015, 1, 1),
    'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    'DesiredState': 'RUNNING'|'STOPPED'|'DELETED',
    'LastModifiedTime': datetime(2015, 1, 1),
    'Name': 'string'
}

Response Structure

  • (dict) --
    • Arn (string) --

      The ARN of the pipe.

    • CreationTime (datetime) --

      The time the pipe was created.

    • CurrentState (string) --

      The state the pipe is in.

    • DesiredState (string) --

      The state the pipe should be in.

    • LastModifiedTime (datetime) --

      When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

    • Name (string) --

      The name of the pipe.

Exceptions

describe_pipe(**kwargs)

Get the information about an existing pipe. For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.

See also: AWS API Documentation

Request Syntax

response = client.describe_pipe(
    Name='string'
)
Parameters
Name (string) --

[REQUIRED]

The name of the pipe.

Return type
dict
Returns
Response Syntax
{
    'Arn': 'string',
    'CreationTime': datetime(2015, 1, 1),
    'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    'Description': 'string',
    'DesiredState': 'RUNNING'|'STOPPED'|'DELETED',
    'Enrichment': 'string',
    'EnrichmentParameters': {
        'HttpParameters': {
            'HeaderParameters': {
                'string': 'string'
            },
            'PathParameterValues': [
                'string',
            ],
            'QueryStringParameters': {
                'string': 'string'
            }
        },
        'InputTemplate': 'string'
    },
    'LastModifiedTime': datetime(2015, 1, 1),
    'Name': 'string',
    'RoleArn': 'string',
    'Source': 'string',
    'SourceParameters': {
        'ActiveMQBrokerParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'QueueName': 'string'
        },
        'DynamoDBStreamParameters': {
            'BatchSize': 123,
            'DeadLetterConfig': {
                'Arn': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'MaximumRecordAgeInSeconds': 123,
            'MaximumRetryAttempts': 123,
            'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
            'ParallelizationFactor': 123,
            'StartingPosition': 'TRIM_HORIZON'|'LATEST'
        },
        'FilterCriteria': {
            'Filters': [
                {
                    'Pattern': 'string'
                },
            ]
        },
        'KinesisStreamParameters': {
            'BatchSize': 123,
            'DeadLetterConfig': {
                'Arn': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'MaximumRecordAgeInSeconds': 123,
            'MaximumRetryAttempts': 123,
            'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
            'ParallelizationFactor': 123,
            'StartingPosition': 'TRIM_HORIZON'|'LATEST'|'AT_TIMESTAMP',
            'StartingPositionTimestamp': datetime(2015, 1, 1)
        },
        'ManagedStreamingKafkaParameters': {
            'BatchSize': 123,
            'ConsumerGroupID': 'string',
            'Credentials': {
                'ClientCertificateTlsAuth': 'string',
                'SaslScram512Auth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'StartingPosition': 'TRIM_HORIZON'|'LATEST',
            'TopicName': 'string'
        },
        'RabbitMQBrokerParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'QueueName': 'string',
            'VirtualHost': 'string'
        },
        'SelfManagedKafkaParameters': {
            'AdditionalBootstrapServers': [
                'string',
            ],
            'BatchSize': 123,
            'ConsumerGroupID': 'string',
            'Credentials': {
                'BasicAuth': 'string',
                'ClientCertificateTlsAuth': 'string',
                'SaslScram256Auth': 'string',
                'SaslScram512Auth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'ServerRootCaCertificate': 'string',
            'StartingPosition': 'TRIM_HORIZON'|'LATEST',
            'TopicName': 'string',
            'Vpc': {
                'SecurityGroup': [
                    'string',
                ],
                'Subnets': [
                    'string',
                ]
            }
        },
        'SqsQueueParameters': {
            'BatchSize': 123,
            'MaximumBatchingWindowInSeconds': 123
        }
    },
    'StateReason': 'string',
    'Tags': {
        'string': 'string'
    },
    'Target': 'string',
    'TargetParameters': {
        'BatchJobParameters': {
            'ArrayProperties': {
                'Size': 123
            },
            'ContainerOverrides': {
                'Command': [
                    'string',
                ],
                'Environment': [
                    {
                        'Name': 'string',
                        'Value': 'string'
                    },
                ],
                'InstanceType': 'string',
                'ResourceRequirements': [
                    {
                        'Type': 'GPU'|'MEMORY'|'VCPU',
                        'Value': 'string'
                    },
                ]
            },
            'DependsOn': [
                {
                    'JobId': 'string',
                    'Type': 'N_TO_N'|'SEQUENTIAL'
                },
            ],
            'JobDefinition': 'string',
            'JobName': 'string',
            'Parameters': {
                'string': 'string'
            },
            'RetryStrategy': {
                'Attempts': 123
            }
        },
        'CloudWatchLogsParameters': {
            'LogStreamName': 'string',
            'Timestamp': 'string'
        },
        'EcsTaskParameters': {
            'CapacityProviderStrategy': [
                {
                    'base': 123,
                    'capacityProvider': 'string',
                    'weight': 123
                },
            ],
            'EnableECSManagedTags': True|False,
            'EnableExecuteCommand': True|False,
            'Group': 'string',
            'LaunchType': 'EC2'|'FARGATE'|'EXTERNAL',
            'NetworkConfiguration': {
                'awsvpcConfiguration': {
                    'AssignPublicIp': 'ENABLED'|'DISABLED',
                    'SecurityGroups': [
                        'string',
                    ],
                    'Subnets': [
                        'string',
                    ]
                }
            },
            'Overrides': {
                'ContainerOverrides': [
                    {
                        'Command': [
                            'string',
                        ],
                        'Cpu': 123,
                        'Environment': [
                            {
                                'name': 'string',
                                'value': 'string'
                            },
                        ],
                        'EnvironmentFiles': [
                            {
                                'type': 's3',
                                'value': 'string'
                            },
                        ],
                        'Memory': 123,
                        'MemoryReservation': 123,
                        'Name': 'string',
                        'ResourceRequirements': [
                            {
                                'type': 'GPU'|'InferenceAccelerator',
                                'value': 'string'
                            },
                        ]
                    },
                ],
                'Cpu': 'string',
                'EphemeralStorage': {
                    'sizeInGiB': 123
                },
                'ExecutionRoleArn': 'string',
                'InferenceAcceleratorOverrides': [
                    {
                        'deviceName': 'string',
                        'deviceType': 'string'
                    },
                ],
                'Memory': 'string',
                'TaskRoleArn': 'string'
            },
            'PlacementConstraints': [
                {
                    'expression': 'string',
                    'type': 'distinctInstance'|'memberOf'
                },
            ],
            'PlacementStrategy': [
                {
                    'field': 'string',
                    'type': 'random'|'spread'|'binpack'
                },
            ],
            'PlatformVersion': 'string',
            'PropagateTags': 'TASK_DEFINITION',
            'ReferenceId': 'string',
            'Tags': [
                {
                    'Key': 'string',
                    'Value': 'string'
                },
            ],
            'TaskCount': 123,
            'TaskDefinitionArn': 'string'
        },
        'EventBridgeEventBusParameters': {
            'DetailType': 'string',
            'EndpointId': 'string',
            'Resources': [
                'string',
            ],
            'Source': 'string',
            'Time': 'string'
        },
        'HttpParameters': {
            'HeaderParameters': {
                'string': 'string'
            },
            'PathParameterValues': [
                'string',
            ],
            'QueryStringParameters': {
                'string': 'string'
            }
        },
        'InputTemplate': 'string',
        'KinesisStreamParameters': {
            'PartitionKey': 'string'
        },
        'LambdaFunctionParameters': {
            'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
        },
        'RedshiftDataParameters': {
            'Database': 'string',
            'DbUser': 'string',
            'SecretManagerArn': 'string',
            'Sqls': [
                'string',
            ],
            'StatementName': 'string',
            'WithEvent': True|False
        },
        'SageMakerPipelineParameters': {
            'PipelineParameterList': [
                {
                    'Name': 'string',
                    'Value': 'string'
                },
            ]
        },
        'SqsQueueParameters': {
            'MessageDeduplicationId': 'string',
            'MessageGroupId': 'string'
        },
        'StepFunctionStateMachineParameters': {
            'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
        }
    }
}

Response Structure

  • (dict) --
    • Arn (string) --

      The ARN of the pipe.

    • CreationTime (datetime) --

      The time the pipe was created.

    • CurrentState (string) --

      The state the pipe is in.

    • Description (string) --

      A description of the pipe.

    • DesiredState (string) --

      The state the pipe should be in.

    • Enrichment (string) --

      The ARN of the enrichment resource.

    • EnrichmentParameters (dict) --

      The parameters required to set up enrichment on your pipe.

      • HttpParameters (dict) --

        Contains the HTTP parameters to use when the target is a API Gateway REST endpoint or EventBridge ApiDestination.

        If you specify an API Gateway REST API or EventBridge ApiDestination as a target, you can use this parameter to specify headers, path parameters, and query string keys/values as part of your target invoking request. If you're using ApiDestinations, the corresponding Connection can also have these values configured. In case of any conflicting keys, values from the Connection take precedence.

        • HeaderParameters (dict) --

          The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

          • (string) --
            • (string) --
        • PathParameterValues (list) --

          The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").

          • (string) --
        • QueryStringParameters (dict) --

          The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

          • (string) --
            • (string) --
      • InputTemplate (string) --

        Valid JSON text passed to the enrichment. In this case, nothing from the event itself is passed to the enrichment. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format.

    • LastModifiedTime (datetime) --

      When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

    • Name (string) --

      The name of the pipe.

    • RoleArn (string) --

      The ARN of the role that allows the pipe to send data to the target.

    • Source (string) --

      The ARN of the source resource.

    • SourceParameters (dict) --

      The parameters required to set up a source for your pipe.

      • ActiveMQBrokerParameters (dict) --

        The parameters for using an Active MQ broker as a source.

        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • Credentials (dict) --

          The credentials needed to access the resource.

          Note

          This is a Tagged Union structure. Only one of the following top level keys will be set: BasicAuth. If a client receives an unknown member it will set SDK_UNKNOWN_MEMBER as the top level key, which maps to the name or tag of the unknown member. The structure of SDK_UNKNOWN_MEMBER is as follows:

          'SDK_UNKNOWN_MEMBER': {'name': 'UnknownMemberName'}
          
          • BasicAuth (string) --

            The ARN of the Secrets Manager secret.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

        • QueueName (string) --

          The name of the destination queue to consume.

      • DynamoDBStreamParameters (dict) --

        The parameters for using a DynamoDB stream as a source.

        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • DeadLetterConfig (dict) --

          Define the target queue to send dead-letter queue events to.

          • Arn (string) --

            The ARN of the Amazon SQS queue specified as the target for the dead-letter queue.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

        • MaximumRecordAgeInSeconds (integer) --

          (Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.

        • MaximumRetryAttempts (integer) --

          (Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.

        • OnPartialBatchItemFailure (string) --

          (Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.

        • ParallelizationFactor (integer) --

          (Streams only) The number of batches to process concurrently from each shard. The default value is 1.

        • StartingPosition (string) --

          (Streams only) The position in a stream from which to start reading.

      • FilterCriteria (dict) --

        The collection of event patterns used to filter events. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .

        • Filters (list) --

          The event patterns.

          • (dict) --

            Filter events using an event pattern. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .

            • Pattern (string) --

              The event pattern.

      • KinesisStreamParameters (dict) --

        The parameters for using a Kinesis stream as a source.

        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • DeadLetterConfig (dict) --

          Define the target queue to send dead-letter queue events to.

          • Arn (string) --

            The ARN of the Amazon SQS queue specified as the target for the dead-letter queue.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

        • MaximumRecordAgeInSeconds (integer) --

          (Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.

        • MaximumRetryAttempts (integer) --

          (Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.

        • OnPartialBatchItemFailure (string) --

          (Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.

        • ParallelizationFactor (integer) --

          (Streams only) The number of batches to process concurrently from each shard. The default value is 1.

        • StartingPosition (string) --

          (Streams only) The position in a stream from which to start reading.

        • StartingPositionTimestamp (datetime) --

          With StartingPosition set to AT_TIMESTAMP , the time from which to start reading, in Unix time seconds.

      • ManagedStreamingKafkaParameters (dict) --

        The parameters for using an MSK stream as a source.

        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • ConsumerGroupID (string) --

          The name of the destination queue to consume.

        • Credentials (dict) --

          The credentials needed to access the resource.

          Note

          This is a Tagged Union structure. Only one of the following top level keys will be set: ClientCertificateTlsAuth, SaslScram512Auth. If a client receives an unknown member it will set SDK_UNKNOWN_MEMBER as the top level key, which maps to the name or tag of the unknown member. The structure of SDK_UNKNOWN_MEMBER is as follows:

          'SDK_UNKNOWN_MEMBER': {'name': 'UnknownMemberName'}
          
          • ClientCertificateTlsAuth (string) --

            The ARN of the Secrets Manager secret.

          • SaslScram512Auth (string) --

            The ARN of the Secrets Manager secret.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

        • StartingPosition (string) --

          (Streams only) The position in a stream from which to start reading.

        • TopicName (string) --

          The name of the topic that the pipe will read from.

      • RabbitMQBrokerParameters (dict) --

        The parameters for using a Rabbit MQ broker as a source.

        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • Credentials (dict) --

          The credentials needed to access the resource.

          Note

          This is a Tagged Union structure. Only one of the following top level keys will be set: BasicAuth. If a client receives an unknown member it will set SDK_UNKNOWN_MEMBER as the top level key, which maps to the name or tag of the unknown member. The structure of SDK_UNKNOWN_MEMBER is as follows:

          'SDK_UNKNOWN_MEMBER': {'name': 'UnknownMemberName'}
          
          • BasicAuth (string) --

            The ARN of the Secrets Manager secret.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

        • QueueName (string) --

          The name of the destination queue to consume.

        • VirtualHost (string) --

          The name of the virtual host associated with the source broker.

      • SelfManagedKafkaParameters (dict) --

        The parameters for using a self-managed Apache Kafka stream as a source.

        • AdditionalBootstrapServers (list) --

          An array of server URLs.

          • (string) --
        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • ConsumerGroupID (string) --

          The name of the destination queue to consume.

        • Credentials (dict) --

          The credentials needed to access the resource.

          Note

          This is a Tagged Union structure. Only one of the following top level keys will be set: BasicAuth, ClientCertificateTlsAuth, SaslScram256Auth, SaslScram512Auth. If a client receives an unknown member it will set SDK_UNKNOWN_MEMBER as the top level key, which maps to the name or tag of the unknown member. The structure of SDK_UNKNOWN_MEMBER is as follows:

          'SDK_UNKNOWN_MEMBER': {'name': 'UnknownMemberName'}
          
          • BasicAuth (string) --

            The ARN of the Secrets Manager secret.

          • ClientCertificateTlsAuth (string) --

            The ARN of the Secrets Manager secret.

          • SaslScram256Auth (string) --

            The ARN of the Secrets Manager secret.

          • SaslScram512Auth (string) --

            The ARN of the Secrets Manager secret.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

        • ServerRootCaCertificate (string) --

          The ARN of the Secrets Manager secret used for certification.

        • StartingPosition (string) --

          (Streams only) The position in a stream from which to start reading.

        • TopicName (string) --

          The name of the topic that the pipe will read from.

        • Vpc (dict) --

          This structure specifies the VPC subnets and security groups for the stream, and whether a public IP address is to be used.

          • SecurityGroup (list) --

            Specifies the security groups associated with the stream. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.

            • (string) --
          • Subnets (list) --

            Specifies the subnets associated with the stream. These subnets must all be in the same VPC. You can specify as many as 16 subnets.

            • (string) --
      • SqsQueueParameters (dict) --

        The parameters for using a Amazon SQS stream as a source.

        • BatchSize (integer) --

          The maximum number of records to include in each batch.

        • MaximumBatchingWindowInSeconds (integer) --

          The maximum length of a time to wait for events.

    • StateReason (string) --

      The reason the pipe is in its current state.

    • Tags (dict) --

      The list of key-value pairs to associate with the pipe.

      • (string) --
        • (string) --
    • Target (string) --

      The ARN of the target resource.

    • TargetParameters (dict) --

      The parameters required to set up a target for your pipe.

      • BatchJobParameters (dict) --

        The parameters for using an Batch job as a target.

        • ArrayProperties (dict) --

          The array properties for the submitted job, such as the size of the array. The array size can be between 2 and 10,000. If you specify array properties for a job, it becomes an array job. This parameter is used only if the target is an Batch job.

          • Size (integer) --

            The size of the array, if this is an array batch job.

        • ContainerOverrides (dict) --

          The overrides that are sent to a container.

          • Command (list) --

            The command to send to the container that overrides the default command from the Docker image or the task definition.

            • (string) --
          • Environment (list) --

            The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.

            Note

            Environment variables cannot start with " Batch ". This naming convention is reserved for variables that Batch sets.

            • (dict) --

              The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.

              Note

              Environment variables cannot start with " Batch ". This naming convention is reserved for variables that Batch sets.

              • Name (string) --

                The name of the key-value pair. For environment variables, this is the name of the environment variable.

              • Value (string) --

                The value of the key-value pair. For environment variables, this is the value of the environment variable.

          • InstanceType (string) --

            The instance type to use for a multi-node parallel job.

            Note

            This parameter isn't applicable to single-node container jobs or jobs that run on Fargate resources, and shouldn't be provided.

          • ResourceRequirements (list) --

            The type and amount of resources to assign to a container. This overrides the settings in the job definition. The supported resources include GPU , MEMORY , and VCPU .

            • (dict) --

              The type and amount of a resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .

              • Type (string) --

                The type of resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .

              • Value (string) --

                The quantity of the specified resource to reserve for the container. The values vary based on the type specified.

                type="GPU"

                The number of physical GPUs to reserve for the container. Make sure that the number of GPUs reserved for all containers in a job doesn't exceed the number of available GPUs on the compute resource that the job is launched on.

                Note

                GPUs aren't available for jobs that are running on Fargate resources.

                type="MEMORY"

                The memory hard limit (in MiB) present to the container. This parameter is supported for jobs that are running on EC2 resources. If your container attempts to exceed the memory specified, the container is terminated. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run. You must specify at least 4 MiB of memory for a job. This is required but can be specified in several places for multi-node parallel (MNP) jobs. It must be specified for each node at least once. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run.

                Note

                If you're trying to maximize your resource utilization by providing your jobs as much memory as possible for a particular instance type, see Memory management in the Batch User Guide .

                For jobs that are running on Fargate resources, then value is the hard limit (in MiB), and must match one of the supported values and the VCPU values must be one of the values supported for that memory value.

                value = 512

                VCPU = 0.25

                value = 1024

                VCPU = 0.25 or 0.5

                value = 2048

                VCPU = 0.25, 0.5, or 1

                value = 3072

                VCPU = 0.5, or 1

                value = 4096

                VCPU = 0.5, 1, or 2

                value = 5120, 6144, or 7168

                VCPU = 1 or 2

                value = 8192

                VCPU = 1, 2, 4, or 8

                value = 9216, 10240, 11264, 12288, 13312, 14336, or 15360

                VCPU = 2 or 4

                value = 16384

                VCPU = 2, 4, or 8

                value = 17408, 18432, 19456, 21504, 22528, 23552, 25600, 26624, 27648, 29696, or 30720

                VCPU = 4

                value = 20480, 24576, or 28672

                VCPU = 4 or 8

                value = 36864, 45056, 53248, or 61440

                VCPU = 8

                value = 32768, 40960, 49152, or 57344

                VCPU = 8 or 16

                value = 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880

                VCPU = 16

                type="VCPU"

                The number of vCPUs reserved for the container. This parameter maps to CpuShares in the Create a container section of the Docker Remote API and the --cpu-shares option to docker run. Each vCPU is equivalent to 1,024 CPU shares. For EC2 resources, you must specify at least one vCPU. This is required but can be specified in several places; it must be specified for each node at least once.

                The default for the Fargate On-Demand vCPU resource count quota is 6 vCPUs. For more information about Fargate quotas, see Fargate quotas in the Amazon Web Services General Reference .

                For jobs that are running on Fargate resources, then value must match one of the supported values and the MEMORY values must be one of the values supported for that VCPU value. The supported values are 0.25, 0.5, 1, 2, 4, 8, and 16

                value = 0.25

                MEMORY = 512, 1024, or 2048

                value = 0.5

                MEMORY = 1024, 2048, 3072, or 4096

                value = 1

                MEMORY = 2048, 3072, 4096, 5120, 6144, 7168, or 8192

                value = 2

                MEMORY = 4096, 5120, 6144, 7168, 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, or 16384

                value = 4

                MEMORY = 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, 16384, 17408, 18432, 19456, 20480, 21504, 22528, 23552, 24576, 25600, 26624, 27648, 28672, 29696, or 30720

                value = 8

                MEMORY = 16384, 20480, 24576, 28672, 32768, 36864, 40960, 45056, 49152, 53248, 57344, or 61440

                value = 16

                MEMORY = 32768, 40960, 49152, 57344, 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880

        • DependsOn (list) --

          A list of dependencies for the job. A job can depend upon a maximum of 20 jobs. You can specify a SEQUENTIAL type dependency without specifying a job ID for array jobs so that each child array job completes sequentially, starting at index 0. You can also specify an N_TO_N type dependency with a job ID for array jobs. In that case, each index child of this job must wait for the corresponding index child of each dependency to complete before it can begin.

          • (dict) --

            An object that represents an Batch job dependency.

            • JobId (string) --

              The job ID of the Batch job that's associated with this dependency.

            • Type (string) --

              The type of the job dependency.

        • JobDefinition (string) --

          The job definition used by this job. This value can be one of name , name:revision , or the Amazon Resource Name (ARN) for the job definition. If name is specified without a revision then the latest active revision is used.

        • JobName (string) --

          The name of the job. It can be up to 128 letters long. The first character must be alphanumeric, can contain uppercase and lowercase letters, numbers, hyphens (-), and underscores (_).

        • Parameters (dict) --

          Additional parameters passed to the job that replace parameter substitution placeholders that are set in the job definition. Parameters are specified as a key and value pair mapping. Parameters included here override any corresponding parameter defaults from the job definition.

          • (string) --
            • (string) --
        • RetryStrategy (dict) --

          The retry strategy to use for failed jobs. When a retry strategy is specified here, it overrides the retry strategy defined in the job definition.

          • Attempts (integer) --

            The number of times to move a job to the RUNNABLE status. If the value of attempts is greater than one, the job is retried on failure the same number of attempts as the value.

      • CloudWatchLogsParameters (dict) --

        The parameters for using an CloudWatch Logs log stream as a target.

        • LogStreamName (string) --

          The name of the log stream.

        • Timestamp (string) --

          The time the event occurred, expressed as the number of milliseconds after Jan 1, 1970 00:00:00 UTC.

      • EcsTaskParameters (dict) --

        The parameters for using an Amazon ECS task as a target.

        • CapacityProviderStrategy (list) --

          The capacity provider strategy to use for the task.

          If a capacityProviderStrategy is specified, the launchType parameter must be omitted. If no capacityProviderStrategy or launchType is specified, the defaultCapacityProviderStrategy for the cluster is used.

          • (dict) --

            The details of a capacity provider strategy. To learn more, see CapacityProviderStrategyItem in the Amazon ECS API Reference.

            • base (integer) --

              The base value designates how many tasks, at a minimum, to run on the specified capacity provider. Only one capacity provider in a capacity provider strategy can have a base defined. If no value is specified, the default value of 0 is used.

            • capacityProvider (string) --

              The short name of the capacity provider.

            • weight (integer) --

              The weight value designates the relative percentage of the total number of tasks launched that should use the specified capacity provider. The weight value is taken into consideration after the base value, if defined, is satisfied.

        • EnableECSManagedTags (boolean) --

          Specifies whether to enable Amazon ECS managed tags for the task. For more information, see Tagging Your Amazon ECS Resources in the Amazon Elastic Container Service Developer Guide.

        • EnableExecuteCommand (boolean) --

          Whether or not to enable the execute command functionality for the containers in this task. If true, this enables execute command functionality on all containers in the task.

        • Group (string) --

          Specifies an Amazon ECS task group for the task. The maximum length is 255 characters.

        • LaunchType (string) --

          Specifies the launch type on which your task is running. The launch type that you specify here must match one of the launch type (compatibilities) of the target task. The FARGATE value is supported only in the Regions where Fargate with Amazon ECS is supported. For more information, see Fargate on Amazon ECS in the Amazon Elastic Container Service Developer Guide .

        • NetworkConfiguration (dict) --

          Use this structure if the Amazon ECS task uses the awsvpc network mode. This structure specifies the VPC subnets and security groups associated with the task, and whether a public IP address is to be used. This structure is required if LaunchType is FARGATE because the awsvpc mode is required for Fargate tasks.

          If you specify NetworkConfiguration when the target ECS task does not use the awsvpc network mode, the task fails.

          • awsvpcConfiguration (dict) --

            Use this structure to specify the VPC subnets and security groups for the task, and whether a public IP address is to be used. This structure is relevant only for ECS tasks that use the awsvpc network mode.

            • AssignPublicIp (string) --

              Specifies whether the task's elastic network interface receives a public IP address. You can specify ENABLED only when LaunchType in EcsParameters is set to FARGATE .

            • SecurityGroups (list) --

              Specifies the security groups associated with the task. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.

              • (string) --
            • Subnets (list) --

              Specifies the subnets associated with the task. These subnets must all be in the same VPC. You can specify as many as 16 subnets.

              • (string) --
        • Overrides (dict) --

          The overrides that are associated with a task.

          • ContainerOverrides (list) --

            One or more container overrides that are sent to a task.

            • (dict) --

              The overrides that are sent to a container. An empty container override can be passed in. An example of an empty container override is {"containerOverrides": [ ] } . If a non-empty container override is specified, the name parameter must be included.

              • Command (list) --

                The command to send to the container that overrides the default command from the Docker image or the task definition. You must also specify a container name.

                • (string) --
              • Cpu (integer) --

                The number of cpu units reserved for the container, instead of the default value from the task definition. You must also specify a container name.

              • Environment (list) --

                The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.

                • (dict) --

                  The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.

                  • name (string) --

                    The name of the key-value pair. For environment variables, this is the name of the environment variable.

                  • value (string) --

                    The value of the key-value pair. For environment variables, this is the value of the environment variable.

              • EnvironmentFiles (list) --

                A list of files containing the environment variables to pass to a container, instead of the value from the container definition.

                • (dict) --

                  A list of files containing the environment variables to pass to a container. You can specify up to ten environment files. The file must have a .env file extension. Each line in an environment file should contain an environment variable in VARIABLE=VALUE format. Lines beginning with # are treated as comments and are ignored. For more information about the environment variable file syntax, see Declare default environment variables in file.

                  If there are environment variables specified using the environment parameter in a container definition, they take precedence over the variables contained within an environment file. If multiple environment files are specified that contain the same variable, they're processed from the top down. We recommend that you use unique variable names. For more information, see Specifying environment variables in the Amazon Elastic Container Service Developer Guide .

                  This parameter is only supported for tasks hosted on Fargate using the following platform versions:

                  • Linux platform version 1.4.0 or later.
                  • Windows platform version 1.0.0 or later.
                  • type (string) --

                    The file type to use. The only supported value is s3 .

                  • value (string) --

                    The Amazon Resource Name (ARN) of the Amazon S3 object containing the environment variable file.

              • Memory (integer) --

                The hard limit (in MiB) of memory to present to the container, instead of the default value from the task definition. If your container attempts to exceed the memory specified here, the container is killed. You must also specify a container name.

              • MemoryReservation (integer) --

                The soft limit (in MiB) of memory to reserve for the container, instead of the default value from the task definition. You must also specify a container name.

              • Name (string) --

                The name of the container that receives the override. This parameter is required if any override is specified.

              • ResourceRequirements (list) --

                The type and amount of a resource to assign to a container, instead of the default value from the task definition. The only supported resource is a GPU.

                • (dict) --

                  The type and amount of a resource to assign to a container. The supported resource types are GPUs and Elastic Inference accelerators. For more information, see Working with GPUs on Amazon ECS or Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide

                  • type (string) --

                    The type of resource to assign to a container. The supported values are GPU or InferenceAccelerator .

                  • value (string) --

                    The value for the specified resource type.

                    If the GPU type is used, the value is the number of physical GPUs the Amazon ECS container agent reserves for the container. The number of GPUs that's reserved for all containers in a task can't exceed the number of available GPUs on the container instance that the task is launched on.

                    If the InferenceAccelerator type is used, the value matches the deviceName for an InferenceAccelerator specified in a task definition.

          • Cpu (string) --

            The cpu override for the task.

          • EphemeralStorage (dict) --

            The ephemeral storage setting override for the task.

            Note

            This parameter is only supported for tasks hosted on Fargate that use the following platform versions:

            • Linux platform version 1.4.0 or later.
            • Windows platform version 1.0.0 or later.
            • sizeInGiB (integer) --

              The total amount, in GiB, of ephemeral storage to set for the task. The minimum supported value is 21 GiB and the maximum supported value is 200 GiB.

          • ExecutionRoleArn (string) --

            The Amazon Resource Name (ARN) of the task execution IAM role override for the task. For more information, see Amazon ECS task execution IAM role in the Amazon Elastic Container Service Developer Guide .

          • InferenceAcceleratorOverrides (list) --

            The Elastic Inference accelerator override for the task.

            • (dict) --

              Details on an Elastic Inference accelerator task override. This parameter is used to override the Elastic Inference accelerator specified in the task definition. For more information, see Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide .

              • deviceName (string) --

                The Elastic Inference accelerator device name to override for the task. This parameter must match a deviceName specified in the task definition.

              • deviceType (string) --

                The Elastic Inference accelerator type to use.

          • Memory (string) --

            The memory override for the task.

          • TaskRoleArn (string) --

            The Amazon Resource Name (ARN) of the IAM role that containers in this task can assume. All containers in this task are granted the permissions that are specified in this role. For more information, see IAM Role for Tasks in the Amazon Elastic Container Service Developer Guide .

        • PlacementConstraints (list) --

          An array of placement constraint objects to use for the task. You can specify up to 10 constraints per task (including constraints in the task definition and those specified at runtime).

          • (dict) --

            An object representing a constraint on task placement. To learn more, see Task Placement Constraints in the Amazon Elastic Container Service Developer Guide.

            • expression (string) --

              A cluster query language expression to apply to the constraint. You cannot specify an expression if the constraint type is distinctInstance . To learn more, see Cluster Query Language in the Amazon Elastic Container Service Developer Guide.

            • type (string) --

              The type of constraint. Use distinctInstance to ensure that each task in a particular group is running on a different container instance. Use memberOf to restrict the selection to a group of valid candidates.

        • PlacementStrategy (list) --

          The placement strategy objects to use for the task. You can specify a maximum of five strategy rules per task.

          • (dict) --

            The task placement strategy for a task or service. To learn more, see Task Placement Strategies in the Amazon Elastic Container Service Service Developer Guide.

            • field (string) --

              The field to apply the placement strategy against. For the spread placement strategy, valid values are instanceId (or host, which has the same effect), or any platform or custom attribute that is applied to a container instance, such as attribute:ecs.availability-zone. For the binpack placement strategy, valid values are cpu and memory. For the random placement strategy, this field is not used.

            • type (string) --

              The type of placement strategy. The random placement strategy randomly places tasks on available candidates. The spread placement strategy spreads placement across available candidates evenly based on the field parameter. The binpack strategy places tasks on available candidates that have the least available amount of the resource that is specified with the field parameter. For example, if you binpack on memory, a task is placed on the instance with the least amount of remaining memory (but still enough to run the task).

        • PlatformVersion (string) --

          Specifies the platform version for the task. Specify only the numeric portion of the platform version, such as 1.1.0 .

          This structure is used only if LaunchType is FARGATE . For more information about valid platform versions, see Fargate Platform Versions in the Amazon Elastic Container Service Developer Guide .

        • PropagateTags (string) --

          Specifies whether to propagate the tags from the task definition to the task. If no value is specified, the tags are not propagated. Tags can only be propagated to the task during task creation. To add tags to a task after task creation, use the TagResource API action.

        • ReferenceId (string) --

          The reference ID to use for the task.

        • Tags (list) --

          The metadata that you apply to the task to help you categorize and organize them. Each tag consists of a key and an optional value, both of which you define. To learn more, see RunTask in the Amazon ECS API Reference.

          • (dict) --

            A key-value pair associated with an Amazon Web Services resource. In EventBridge, rules and event buses support tagging.

            • Key (string) --

              A string you can use to assign a value. The combination of tag keys and values can help you organize and categorize your resources.

            • Value (string) --

              The value for the specified tag key.

        • TaskCount (integer) --

          The number of tasks to create based on TaskDefinition . The default is 1.

        • TaskDefinitionArn (string) --

          The ARN of the task definition to use if the event target is an Amazon ECS task.

      • EventBridgeEventBusParameters (dict) --

        The parameters for using an EventBridge event bus as a target.

        • DetailType (string) --

          A free-form string, with a maximum of 128 characters, used to decide what fields to expect in the event detail.

        • EndpointId (string) --

          The URL subdomain of the endpoint. For example, if the URL for Endpoint is https://abcde.veo.endpoints.event.amazonaws.com, then the EndpointId is abcde.veo .

          Warning

          When using Java, you must include auth-crt on the class path.

        • Resources (list) --

          Amazon Web Services resources, identified by Amazon Resource Name (ARN), which the event primarily concerns. Any number, including zero, may be present.

          • (string) --
        • Source (string) --

          The source of the event.

        • Time (string) --

          The time stamp of the event, per RFC3339. If no time stamp is provided, the time stamp of the PutEvents call is used.

      • HttpParameters (dict) --

        These are custom parameter to be used when the target is an API Gateway REST APIs or EventBridge ApiDestinations.

        • HeaderParameters (dict) --

          The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

          • (string) --
            • (string) --
        • PathParameterValues (list) --

          The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").

          • (string) --
        • QueryStringParameters (dict) --

          The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

          • (string) --
            • (string) --
      • InputTemplate (string) --

        Valid JSON text passed to the target. In this case, nothing from the event itself is passed to the target. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format.

      • KinesisStreamParameters (dict) --

        The parameters for using a Kinesis stream as a source.

        • PartitionKey (string) --

          Determines which shard in the stream the data record is assigned to. Partition keys are Unicode strings with a maximum length limit of 256 characters for each key. Amazon Kinesis Data Streams uses the partition key as input to a hash function that maps the partition key and associated data to a specific shard. Specifically, an MD5 hash function is used to map partition keys to 128-bit integer values and to map associated data records to shards. As a result of this hashing mechanism, all data records with the same partition key map to the same shard within the stream.

      • LambdaFunctionParameters (dict) --

        The parameters for using a Lambda function as a target.

        • InvocationType (string) --

          Choose from the following options.

          • RequestResponse (default) - Invoke the function synchronously. Keep the connection open until the function returns a response or times out. The API response includes the function response and additional data.
          • Event - Invoke the function asynchronously. Send events that fail multiple times to the function's dead-letter queue (if it's configured). The API response only includes a status code.
          • DryRun - Validate parameter values and verify that the user or role has permission to invoke the function.
      • RedshiftDataParameters (dict) --

        These are custom parameters to be used when the target is a Amazon Redshift cluster to invoke the Amazon Redshift Data API ExecuteStatement.

        • Database (string) --

          The name of the database. Required when authenticating using temporary credentials.

        • DbUser (string) --

          The database user name. Required when authenticating using temporary credentials.

        • SecretManagerArn (string) --

          The name or ARN of the secret that enables access to the database. Required when authenticating using SageMaker.

        • Sqls (list) --

          The SQL statement text to run.

          • (string) --

            // A single Redshift SQL

        • StatementName (string) --

          The name of the SQL statement. You can name the SQL statement when you create it to identify the query.

        • WithEvent (boolean) --

          Indicates whether to send an event back to EventBridge after the SQL statement runs.

      • SageMakerPipelineParameters (dict) --

        The parameters for using a SageMaker pipeline as a target.

        • PipelineParameterList (list) --

          List of Parameter names and values for SageMaker Model Building Pipeline execution.

          • (dict) --

            Name/Value pair of a parameter to start execution of a SageMaker Model Building Pipeline.

            • Name (string) --

              Name of parameter to start execution of a SageMaker Model Building Pipeline.

            • Value (string) --

              Value of parameter to start execution of a SageMaker Model Building Pipeline.

      • SqsQueueParameters (dict) --

        The parameters for using a Amazon SQS stream as a source.

        • MessageDeduplicationId (string) --

          This parameter applies only to FIFO (first-in-first-out) queues.

          The token used for deduplication of sent messages.

        • MessageGroupId (string) --

          The FIFO message group ID to use as the target.

      • StepFunctionStateMachineParameters (dict) --

        The parameters for using a Step Functions state machine as a target.

        • InvocationType (string) --

          Specify whether to wait for the state machine to finish or not.

Exceptions

get_paginator(operation_name)

Create a paginator for an operation.

Parameters
operation_name (string) -- The operation name. This is the same name as the method name on the client. For example, if the method name is create_foo, and you'd normally invoke the operation as client.create_foo(**kwargs), if the create_foo operation can be paginated, you can use the call client.get_paginator("create_foo").
Raises OperationNotPageableError
Raised if the operation is not pageable. You can use the client.can_paginate method to check if an operation is pageable.
Return type
L{botocore.paginate.Paginator}
Returns
A paginator object.
get_waiter(waiter_name)

Returns an object that can wait for some condition.

Parameters
waiter_name (str) -- The name of the waiter to get. See the waiters section of the service docs for a list of available waiters.
Returns
The specified waiter object.
Return type
botocore.waiter.Waiter
list_pipes(**kwargs)

Get the pipes associated with this account. For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.

See also: AWS API Documentation

Request Syntax

response = client.list_pipes(
    CurrentState='RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    DesiredState='RUNNING'|'STOPPED',
    Limit=123,
    NamePrefix='string',
    NextToken='string',
    SourcePrefix='string',
    TargetPrefix='string'
)
Parameters
  • CurrentState (string) -- The state the pipe is in.
  • DesiredState (string) -- The state the pipe should be in.
  • Limit (integer) -- The maximum number of pipes to include in the response.
  • NamePrefix (string) -- A value that will return a subset of the pipes associated with this account. For example, "NamePrefix": "ABC" will return all endpoints with "ABC" in the name.
  • NextToken (string) -- If nextToken is returned, there are more results available. The value of nextToken is a unique pagination token for each page. Make the call again using the returned token to retrieve the next page. Keep all other arguments unchanged. Each pagination token expires after 24 hours. Using an expired pagination token will return an HTTP 400 InvalidToken error.
  • SourcePrefix (string) -- The prefix matching the pipe source.
  • TargetPrefix (string) -- The prefix matching the pipe target.
Return type

dict

Returns

Response Syntax

{
    'NextToken': 'string',
    'Pipes': [
        {
            'Arn': 'string',
            'CreationTime': datetime(2015, 1, 1),
            'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
            'DesiredState': 'RUNNING'|'STOPPED',
            'Enrichment': 'string',
            'LastModifiedTime': datetime(2015, 1, 1),
            'Name': 'string',
            'Source': 'string',
            'StateReason': 'string',
            'Target': 'string'
        },
    ]
}

Response Structure

  • (dict) --

    • NextToken (string) --

      If nextToken is returned, there are more results available. The value of nextToken is a unique pagination token for each page. Make the call again using the returned token to retrieve the next page. Keep all other arguments unchanged. Each pagination token expires after 24 hours. Using an expired pagination token will return an HTTP 400 InvalidToken error.

    • Pipes (list) --

      The pipes returned by the call.

      • (dict) --

        An object that represents a pipe. Amazon EventBridgePipes connect event sources to targets and reduces the need for specialized knowledge and integration code.

        • Arn (string) --

          The ARN of the pipe.

        • CreationTime (datetime) --

          The time the pipe was created.

        • CurrentState (string) --

          The state the pipe is in.

        • DesiredState (string) --

          The state the pipe should be in.

        • Enrichment (string) --

          The ARN of the enrichment resource.

        • LastModifiedTime (datetime) --

          When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

        • Name (string) --

          The name of the pipe.

        • Source (string) --

          The ARN of the source resource.

        • StateReason (string) --

          The reason the pipe is in its current state.

        • Target (string) --

          The ARN of the target resource.

Exceptions

list_tags_for_resource(**kwargs)

Displays the tags associated with a pipe.

See also: AWS API Documentation

Request Syntax

response = client.list_tags_for_resource(
    resourceArn='string'
)
Parameters
resourceArn (string) --

[REQUIRED]

The ARN of the pipe for which you want to view tags.

Return type
dict
Returns
Response Syntax
{
    'tags': {
        'string': 'string'
    }
}

Response Structure

  • (dict) --
    • tags (dict) --

      The list of key-value pairs to associate with the pipe.

      • (string) --
        • (string) --

Exceptions

start_pipe(**kwargs)

Start an existing pipe.

See also: AWS API Documentation

Request Syntax

response = client.start_pipe(
    Name='string'
)
Parameters
Name (string) --

[REQUIRED]

The name of the pipe.

Return type
dict
Returns
Response Syntax
{
    'Arn': 'string',
    'CreationTime': datetime(2015, 1, 1),
    'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    'DesiredState': 'RUNNING'|'STOPPED',
    'LastModifiedTime': datetime(2015, 1, 1),
    'Name': 'string'
}

Response Structure

  • (dict) --
    • Arn (string) --

      The ARN of the pipe.

    • CreationTime (datetime) --

      The time the pipe was created.

    • CurrentState (string) --

      The state the pipe is in.

    • DesiredState (string) --

      The state the pipe should be in.

    • LastModifiedTime (datetime) --

      When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

    • Name (string) --

      The name of the pipe.

Exceptions

stop_pipe(**kwargs)

Stop an existing pipe.

See also: AWS API Documentation

Request Syntax

response = client.stop_pipe(
    Name='string'
)
Parameters
Name (string) --

[REQUIRED]

The name of the pipe.

Return type
dict
Returns
Response Syntax
{
    'Arn': 'string',
    'CreationTime': datetime(2015, 1, 1),
    'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    'DesiredState': 'RUNNING'|'STOPPED',
    'LastModifiedTime': datetime(2015, 1, 1),
    'Name': 'string'
}

Response Structure

  • (dict) --
    • Arn (string) --

      The ARN of the pipe.

    • CreationTime (datetime) --

      The time the pipe was created.

    • CurrentState (string) --

      The state the pipe is in.

    • DesiredState (string) --

      The state the pipe should be in.

    • LastModifiedTime (datetime) --

      When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

    • Name (string) --

      The name of the pipe.

Exceptions

tag_resource(**kwargs)

Assigns one or more tags (key-value pairs) to the specified pipe. Tags can help you organize and categorize your resources. You can also use them to scope user permissions by granting a user permission to access or change only resources with certain tag values.

Tags don't have any semantic meaning to Amazon Web Services and are interpreted strictly as strings of characters.

You can use the TagResource action with a pipe that already has tags. If you specify a new tag key, this tag is appended to the list of tags associated with the pipe. If you specify a tag key that is already associated with the pipe, the new tag value that you specify replaces the previous value for that tag.

You can associate as many as 50 tags with a pipe.

See also: AWS API Documentation

Request Syntax

response = client.tag_resource(
    resourceArn='string',
    tags={
        'string': 'string'
    }
)
Parameters
  • resourceArn (string) --

    [REQUIRED]

    The ARN of the pipe.

  • tags (dict) --

    [REQUIRED]

    The list of key-value pairs associated with the pipe.

    • (string) --
      • (string) --
Return type

dict

Returns

Response Syntax

{}

Response Structure

  • (dict) --

Exceptions

untag_resource(**kwargs)

Removes one or more tags from the specified pipes.

See also: AWS API Documentation

Request Syntax

response = client.untag_resource(
    resourceArn='string',
    tagKeys=[
        'string',
    ]
)
Parameters
  • resourceArn (string) --

    [REQUIRED]

    The ARN of the pipe.

  • tagKeys (list) --

    [REQUIRED]

    The list of tag keys to remove from the pipe.

    • (string) --
Return type

dict

Returns

Response Syntax

{}

Response Structure

  • (dict) --

Exceptions

update_pipe(**kwargs)

Update an existing pipe. When you call UpdatePipe , only the fields that are included in the request are changed, the rest are unchanged. The exception to this is if you modify any Amazon Web Services-service specific fields in the SourceParameters , EnrichmentParameters , or TargetParameters objects. The fields in these objects are updated atomically as one and override existing values. This is by design and means that if you don't specify an optional field in one of these Parameters objects, that field will be set to its system-default value after the update.

<p>For more information about pipes, see <a href="https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-pipes.html"> Amazon EventBridge Pipes</a> in the Amazon EventBridge User Guide.</p>

See also: AWS API Documentation

Request Syntax

response = client.update_pipe(
    Description='string',
    DesiredState='RUNNING'|'STOPPED',
    Enrichment='string',
    EnrichmentParameters={
        'HttpParameters': {
            'HeaderParameters': {
                'string': 'string'
            },
            'PathParameterValues': [
                'string',
            ],
            'QueryStringParameters': {
                'string': 'string'
            }
        },
        'InputTemplate': 'string'
    },
    Name='string',
    RoleArn='string',
    SourceParameters={
        'ActiveMQBrokerParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123
        },
        'DynamoDBStreamParameters': {
            'BatchSize': 123,
            'DeadLetterConfig': {
                'Arn': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'MaximumRecordAgeInSeconds': 123,
            'MaximumRetryAttempts': 123,
            'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
            'ParallelizationFactor': 123
        },
        'FilterCriteria': {
            'Filters': [
                {
                    'Pattern': 'string'
                },
            ]
        },
        'KinesisStreamParameters': {
            'BatchSize': 123,
            'DeadLetterConfig': {
                'Arn': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'MaximumRecordAgeInSeconds': 123,
            'MaximumRetryAttempts': 123,
            'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
            'ParallelizationFactor': 123
        },
        'ManagedStreamingKafkaParameters': {
            'BatchSize': 123,
            'Credentials': {
                'ClientCertificateTlsAuth': 'string',
                'SaslScram512Auth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123
        },
        'RabbitMQBrokerParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123
        },
        'SelfManagedKafkaParameters': {
            'BatchSize': 123,
            'Credentials': {
                'BasicAuth': 'string',
                'ClientCertificateTlsAuth': 'string',
                'SaslScram256Auth': 'string',
                'SaslScram512Auth': 'string'
            },
            'MaximumBatchingWindowInSeconds': 123,
            'ServerRootCaCertificate': 'string',
            'Vpc': {
                'SecurityGroup': [
                    'string',
                ],
                'Subnets': [
                    'string',
                ]
            }
        },
        'SqsQueueParameters': {
            'BatchSize': 123,
            'MaximumBatchingWindowInSeconds': 123
        }
    },
    Target='string',
    TargetParameters={
        'BatchJobParameters': {
            'ArrayProperties': {
                'Size': 123
            },
            'ContainerOverrides': {
                'Command': [
                    'string',
                ],
                'Environment': [
                    {
                        'Name': 'string',
                        'Value': 'string'
                    },
                ],
                'InstanceType': 'string',
                'ResourceRequirements': [
                    {
                        'Type': 'GPU'|'MEMORY'|'VCPU',
                        'Value': 'string'
                    },
                ]
            },
            'DependsOn': [
                {
                    'JobId': 'string',
                    'Type': 'N_TO_N'|'SEQUENTIAL'
                },
            ],
            'JobDefinition': 'string',
            'JobName': 'string',
            'Parameters': {
                'string': 'string'
            },
            'RetryStrategy': {
                'Attempts': 123
            }
        },
        'CloudWatchLogsParameters': {
            'LogStreamName': 'string',
            'Timestamp': 'string'
        },
        'EcsTaskParameters': {
            'CapacityProviderStrategy': [
                {
                    'base': 123,
                    'capacityProvider': 'string',
                    'weight': 123
                },
            ],
            'EnableECSManagedTags': True|False,
            'EnableExecuteCommand': True|False,
            'Group': 'string',
            'LaunchType': 'EC2'|'FARGATE'|'EXTERNAL',
            'NetworkConfiguration': {
                'awsvpcConfiguration': {
                    'AssignPublicIp': 'ENABLED'|'DISABLED',
                    'SecurityGroups': [
                        'string',
                    ],
                    'Subnets': [
                        'string',
                    ]
                }
            },
            'Overrides': {
                'ContainerOverrides': [
                    {
                        'Command': [
                            'string',
                        ],
                        'Cpu': 123,
                        'Environment': [
                            {
                                'name': 'string',
                                'value': 'string'
                            },
                        ],
                        'EnvironmentFiles': [
                            {
                                'type': 's3',
                                'value': 'string'
                            },
                        ],
                        'Memory': 123,
                        'MemoryReservation': 123,
                        'Name': 'string',
                        'ResourceRequirements': [
                            {
                                'type': 'GPU'|'InferenceAccelerator',
                                'value': 'string'
                            },
                        ]
                    },
                ],
                'Cpu': 'string',
                'EphemeralStorage': {
                    'sizeInGiB': 123
                },
                'ExecutionRoleArn': 'string',
                'InferenceAcceleratorOverrides': [
                    {
                        'deviceName': 'string',
                        'deviceType': 'string'
                    },
                ],
                'Memory': 'string',
                'TaskRoleArn': 'string'
            },
            'PlacementConstraints': [
                {
                    'expression': 'string',
                    'type': 'distinctInstance'|'memberOf'
                },
            ],
            'PlacementStrategy': [
                {
                    'field': 'string',
                    'type': 'random'|'spread'|'binpack'
                },
            ],
            'PlatformVersion': 'string',
            'PropagateTags': 'TASK_DEFINITION',
            'ReferenceId': 'string',
            'Tags': [
                {
                    'Key': 'string',
                    'Value': 'string'
                },
            ],
            'TaskCount': 123,
            'TaskDefinitionArn': 'string'
        },
        'EventBridgeEventBusParameters': {
            'DetailType': 'string',
            'EndpointId': 'string',
            'Resources': [
                'string',
            ],
            'Source': 'string',
            'Time': 'string'
        },
        'HttpParameters': {
            'HeaderParameters': {
                'string': 'string'
            },
            'PathParameterValues': [
                'string',
            ],
            'QueryStringParameters': {
                'string': 'string'
            }
        },
        'InputTemplate': 'string',
        'KinesisStreamParameters': {
            'PartitionKey': 'string'
        },
        'LambdaFunctionParameters': {
            'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
        },
        'RedshiftDataParameters': {
            'Database': 'string',
            'DbUser': 'string',
            'SecretManagerArn': 'string',
            'Sqls': [
                'string',
            ],
            'StatementName': 'string',
            'WithEvent': True|False
        },
        'SageMakerPipelineParameters': {
            'PipelineParameterList': [
                {
                    'Name': 'string',
                    'Value': 'string'
                },
            ]
        },
        'SqsQueueParameters': {
            'MessageDeduplicationId': 'string',
            'MessageGroupId': 'string'
        },
        'StepFunctionStateMachineParameters': {
            'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
        }
    }
)
Parameters
  • Description (string) -- A description of the pipe.
  • DesiredState (string) -- The state the pipe should be in.
  • Enrichment (string) -- The ARN of the enrichment resource.
  • EnrichmentParameters (dict) --

    The parameters required to set up enrichment on your pipe.

    • HttpParameters (dict) --

      Contains the HTTP parameters to use when the target is a API Gateway REST endpoint or EventBridge ApiDestination.

      If you specify an API Gateway REST API or EventBridge ApiDestination as a target, you can use this parameter to specify headers, path parameters, and query string keys/values as part of your target invoking request. If you're using ApiDestinations, the corresponding Connection can also have these values configured. In case of any conflicting keys, values from the Connection take precedence.

      • HeaderParameters (dict) --

        The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
      • PathParameterValues (list) --

        The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").

        • (string) --
      • QueryStringParameters (dict) --

        The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
    • InputTemplate (string) --

      Valid JSON text passed to the enrichment. In this case, nothing from the event itself is passed to the enrichment. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format.

  • Name (string) --

    [REQUIRED]

    The name of the pipe.

  • RoleArn (string) --

    [REQUIRED]

    The ARN of the role that allows the pipe to send data to the target.

  • SourceParameters (dict) --

    The parameters required to set up a source for your pipe.

    • ActiveMQBrokerParameters (dict) --

      The parameters for using an Active MQ broker as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • Credentials (dict) -- [REQUIRED]

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: BasicAuth.

        • BasicAuth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

    • DynamoDBStreamParameters (dict) --

      The parameters for using a DynamoDB stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • DeadLetterConfig (dict) --

        Define the target queue to send dead-letter queue events to.

        • Arn (string) --

          The ARN of the Amazon SQS queue specified as the target for the dead-letter queue.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • MaximumRecordAgeInSeconds (integer) --

        (Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.

      • MaximumRetryAttempts (integer) --

        (Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.

      • OnPartialBatchItemFailure (string) --

        (Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.

      • ParallelizationFactor (integer) --

        (Streams only) The number of batches to process concurrently from each shard. The default value is 1.

    • FilterCriteria (dict) --

      The collection of event patterns used to filter events. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .

      • Filters (list) --

        The event patterns.

        • (dict) --

          Filter events using an event pattern. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .

          • Pattern (string) --

            The event pattern.

    • KinesisStreamParameters (dict) --

      The parameters for using a Kinesis stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • DeadLetterConfig (dict) --

        Define the target queue to send dead-letter queue events to.

        • Arn (string) --

          The ARN of the Amazon SQS queue specified as the target for the dead-letter queue.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • MaximumRecordAgeInSeconds (integer) --

        (Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.

      • MaximumRetryAttempts (integer) --

        (Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.

      • OnPartialBatchItemFailure (string) --

        (Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.

      • ParallelizationFactor (integer) --

        (Streams only) The number of batches to process concurrently from each shard. The default value is 1.

    • ManagedStreamingKafkaParameters (dict) --

      The parameters for using an MSK stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • Credentials (dict) --

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: ClientCertificateTlsAuth, SaslScram512Auth.

        • ClientCertificateTlsAuth (string) --

          The ARN of the Secrets Manager secret.

        • SaslScram512Auth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

    • RabbitMQBrokerParameters (dict) --

      The parameters for using a Rabbit MQ broker as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • Credentials (dict) -- [REQUIRED]

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: BasicAuth.

        • BasicAuth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

    • SelfManagedKafkaParameters (dict) --

      The parameters for using a self-managed Apache Kafka stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • Credentials (dict) --

        The credentials needed to access the resource.

        Note

        This is a Tagged Union structure. Only one of the following top level keys can be set: BasicAuth, ClientCertificateTlsAuth, SaslScram256Auth, SaslScram512Auth.

        • BasicAuth (string) --

          The ARN of the Secrets Manager secret.

        • ClientCertificateTlsAuth (string) --

          The ARN of the Secrets Manager secret.

        • SaslScram256Auth (string) --

          The ARN of the Secrets Manager secret.

        • SaslScram512Auth (string) --

          The ARN of the Secrets Manager secret.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

      • ServerRootCaCertificate (string) --

        The ARN of the Secrets Manager secret used for certification.

      • Vpc (dict) --

        This structure specifies the VPC subnets and security groups for the stream, and whether a public IP address is to be used.

        • SecurityGroup (list) --

          Specifies the security groups associated with the stream. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.

          • (string) --
        • Subnets (list) --

          Specifies the subnets associated with the stream. These subnets must all be in the same VPC. You can specify as many as 16 subnets.

          • (string) --
    • SqsQueueParameters (dict) --

      The parameters for using a Amazon SQS stream as a source.

      • BatchSize (integer) --

        The maximum number of records to include in each batch.

      • MaximumBatchingWindowInSeconds (integer) --

        The maximum length of a time to wait for events.

  • Target (string) -- The ARN of the target resource.
  • TargetParameters (dict) --

    The parameters required to set up a target for your pipe.

    • BatchJobParameters (dict) --

      The parameters for using an Batch job as a target.

      • ArrayProperties (dict) --

        The array properties for the submitted job, such as the size of the array. The array size can be between 2 and 10,000. If you specify array properties for a job, it becomes an array job. This parameter is used only if the target is an Batch job.

        • Size (integer) --

          The size of the array, if this is an array batch job.

      • ContainerOverrides (dict) --

        The overrides that are sent to a container.

        • Command (list) --

          The command to send to the container that overrides the default command from the Docker image or the task definition.

          • (string) --
        • Environment (list) --

          The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.

          Note

          Environment variables cannot start with " Batch ". This naming convention is reserved for variables that Batch sets.

          • (dict) --

            The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.

            Note

            Environment variables cannot start with " Batch ". This naming convention is reserved for variables that Batch sets.

            • Name (string) --

              The name of the key-value pair. For environment variables, this is the name of the environment variable.

            • Value (string) --

              The value of the key-value pair. For environment variables, this is the value of the environment variable.

        • InstanceType (string) --

          The instance type to use for a multi-node parallel job.

          Note

          This parameter isn't applicable to single-node container jobs or jobs that run on Fargate resources, and shouldn't be provided.

        • ResourceRequirements (list) --

          The type and amount of resources to assign to a container. This overrides the settings in the job definition. The supported resources include GPU , MEMORY , and VCPU .

          • (dict) --

            The type and amount of a resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .

            • Type (string) -- [REQUIRED]

              The type of resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .

            • Value (string) -- [REQUIRED]

              The quantity of the specified resource to reserve for the container. The values vary based on the type specified.

              type="GPU"

              The number of physical GPUs to reserve for the container. Make sure that the number of GPUs reserved for all containers in a job doesn't exceed the number of available GPUs on the compute resource that the job is launched on.

              Note

              GPUs aren't available for jobs that are running on Fargate resources.

              type="MEMORY"

              The memory hard limit (in MiB) present to the container. This parameter is supported for jobs that are running on EC2 resources. If your container attempts to exceed the memory specified, the container is terminated. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run. You must specify at least 4 MiB of memory for a job. This is required but can be specified in several places for multi-node parallel (MNP) jobs. It must be specified for each node at least once. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run.

              Note

              If you're trying to maximize your resource utilization by providing your jobs as much memory as possible for a particular instance type, see Memory management in the Batch User Guide .

              For jobs that are running on Fargate resources, then value is the hard limit (in MiB), and must match one of the supported values and the VCPU values must be one of the values supported for that memory value.

              value = 512

              VCPU = 0.25

              value = 1024

              VCPU = 0.25 or 0.5

              value = 2048

              VCPU = 0.25, 0.5, or 1

              value = 3072

              VCPU = 0.5, or 1

              value = 4096

              VCPU = 0.5, 1, or 2

              value = 5120, 6144, or 7168

              VCPU = 1 or 2

              value = 8192

              VCPU = 1, 2, 4, or 8

              value = 9216, 10240, 11264, 12288, 13312, 14336, or 15360

              VCPU = 2 or 4

              value = 16384

              VCPU = 2, 4, or 8

              value = 17408, 18432, 19456, 21504, 22528, 23552, 25600, 26624, 27648, 29696, or 30720

              VCPU = 4

              value = 20480, 24576, or 28672

              VCPU = 4 or 8

              value = 36864, 45056, 53248, or 61440

              VCPU = 8

              value = 32768, 40960, 49152, or 57344

              VCPU = 8 or 16

              value = 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880

              VCPU = 16

              type="VCPU"

              The number of vCPUs reserved for the container. This parameter maps to CpuShares in the Create a container section of the Docker Remote API and the --cpu-shares option to docker run. Each vCPU is equivalent to 1,024 CPU shares. For EC2 resources, you must specify at least one vCPU. This is required but can be specified in several places; it must be specified for each node at least once.

              The default for the Fargate On-Demand vCPU resource count quota is 6 vCPUs. For more information about Fargate quotas, see Fargate quotas in the Amazon Web Services General Reference .

              For jobs that are running on Fargate resources, then value must match one of the supported values and the MEMORY values must be one of the values supported for that VCPU value. The supported values are 0.25, 0.5, 1, 2, 4, 8, and 16

              value = 0.25

              MEMORY = 512, 1024, or 2048

              value = 0.5

              MEMORY = 1024, 2048, 3072, or 4096

              value = 1

              MEMORY = 2048, 3072, 4096, 5120, 6144, 7168, or 8192

              value = 2

              MEMORY = 4096, 5120, 6144, 7168, 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, or 16384

              value = 4

              MEMORY = 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, 16384, 17408, 18432, 19456, 20480, 21504, 22528, 23552, 24576, 25600, 26624, 27648, 28672, 29696, or 30720

              value = 8

              MEMORY = 16384, 20480, 24576, 28672, 32768, 36864, 40960, 45056, 49152, 53248, 57344, or 61440

              value = 16

              MEMORY = 32768, 40960, 49152, 57344, 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880

      • DependsOn (list) --

        A list of dependencies for the job. A job can depend upon a maximum of 20 jobs. You can specify a SEQUENTIAL type dependency without specifying a job ID for array jobs so that each child array job completes sequentially, starting at index 0. You can also specify an N_TO_N type dependency with a job ID for array jobs. In that case, each index child of this job must wait for the corresponding index child of each dependency to complete before it can begin.

        • (dict) --

          An object that represents an Batch job dependency.

          • JobId (string) --

            The job ID of the Batch job that's associated with this dependency.

          • Type (string) --

            The type of the job dependency.

      • JobDefinition (string) -- [REQUIRED]

        The job definition used by this job. This value can be one of name , name:revision , or the Amazon Resource Name (ARN) for the job definition. If name is specified without a revision then the latest active revision is used.

      • JobName (string) -- [REQUIRED]

        The name of the job. It can be up to 128 letters long. The first character must be alphanumeric, can contain uppercase and lowercase letters, numbers, hyphens (-), and underscores (_).

      • Parameters (dict) --

        Additional parameters passed to the job that replace parameter substitution placeholders that are set in the job definition. Parameters are specified as a key and value pair mapping. Parameters included here override any corresponding parameter defaults from the job definition.

        • (string) --
          • (string) --
      • RetryStrategy (dict) --

        The retry strategy to use for failed jobs. When a retry strategy is specified here, it overrides the retry strategy defined in the job definition.

        • Attempts (integer) --

          The number of times to move a job to the RUNNABLE status. If the value of attempts is greater than one, the job is retried on failure the same number of attempts as the value.

    • CloudWatchLogsParameters (dict) --

      The parameters for using an CloudWatch Logs log stream as a target.

      • LogStreamName (string) --

        The name of the log stream.

      • Timestamp (string) --

        The time the event occurred, expressed as the number of milliseconds after Jan 1, 1970 00:00:00 UTC.

    • EcsTaskParameters (dict) --

      The parameters for using an Amazon ECS task as a target.

      • CapacityProviderStrategy (list) --

        The capacity provider strategy to use for the task.

        If a capacityProviderStrategy is specified, the launchType parameter must be omitted. If no capacityProviderStrategy or launchType is specified, the defaultCapacityProviderStrategy for the cluster is used.

        • (dict) --

          The details of a capacity provider strategy. To learn more, see CapacityProviderStrategyItem in the Amazon ECS API Reference.

          • base (integer) --

            The base value designates how many tasks, at a minimum, to run on the specified capacity provider. Only one capacity provider in a capacity provider strategy can have a base defined. If no value is specified, the default value of 0 is used.

          • capacityProvider (string) -- [REQUIRED]

            The short name of the capacity provider.

          • weight (integer) --

            The weight value designates the relative percentage of the total number of tasks launched that should use the specified capacity provider. The weight value is taken into consideration after the base value, if defined, is satisfied.

      • EnableECSManagedTags (boolean) --

        Specifies whether to enable Amazon ECS managed tags for the task. For more information, see Tagging Your Amazon ECS Resources in the Amazon Elastic Container Service Developer Guide.

      • EnableExecuteCommand (boolean) --

        Whether or not to enable the execute command functionality for the containers in this task. If true, this enables execute command functionality on all containers in the task.

      • Group (string) --

        Specifies an Amazon ECS task group for the task. The maximum length is 255 characters.

      • LaunchType (string) --

        Specifies the launch type on which your task is running. The launch type that you specify here must match one of the launch type (compatibilities) of the target task. The FARGATE value is supported only in the Regions where Fargate with Amazon ECS is supported. For more information, see Fargate on Amazon ECS in the Amazon Elastic Container Service Developer Guide .

      • NetworkConfiguration (dict) --

        Use this structure if the Amazon ECS task uses the awsvpc network mode. This structure specifies the VPC subnets and security groups associated with the task, and whether a public IP address is to be used. This structure is required if LaunchType is FARGATE because the awsvpc mode is required for Fargate tasks.

        If you specify NetworkConfiguration when the target ECS task does not use the awsvpc network mode, the task fails.

        • awsvpcConfiguration (dict) --

          Use this structure to specify the VPC subnets and security groups for the task, and whether a public IP address is to be used. This structure is relevant only for ECS tasks that use the awsvpc network mode.

          • AssignPublicIp (string) --

            Specifies whether the task's elastic network interface receives a public IP address. You can specify ENABLED only when LaunchType in EcsParameters is set to FARGATE .

          • SecurityGroups (list) --

            Specifies the security groups associated with the task. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.

            • (string) --
          • Subnets (list) -- [REQUIRED]

            Specifies the subnets associated with the task. These subnets must all be in the same VPC. You can specify as many as 16 subnets.

            • (string) --
      • Overrides (dict) --

        The overrides that are associated with a task.

        • ContainerOverrides (list) --

          One or more container overrides that are sent to a task.

          • (dict) --

            The overrides that are sent to a container. An empty container override can be passed in. An example of an empty container override is {"containerOverrides": [ ] } . If a non-empty container override is specified, the name parameter must be included.

            • Command (list) --

              The command to send to the container that overrides the default command from the Docker image or the task definition. You must also specify a container name.

              • (string) --
            • Cpu (integer) --

              The number of cpu units reserved for the container, instead of the default value from the task definition. You must also specify a container name.

            • Environment (list) --

              The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.

              • (dict) --

                The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.

                • name (string) --

                  The name of the key-value pair. For environment variables, this is the name of the environment variable.

                • value (string) --

                  The value of the key-value pair. For environment variables, this is the value of the environment variable.

            • EnvironmentFiles (list) --

              A list of files containing the environment variables to pass to a container, instead of the value from the container definition.

              • (dict) --

                A list of files containing the environment variables to pass to a container. You can specify up to ten environment files. The file must have a .env file extension. Each line in an environment file should contain an environment variable in VARIABLE=VALUE format. Lines beginning with # are treated as comments and are ignored. For more information about the environment variable file syntax, see Declare default environment variables in file.

                If there are environment variables specified using the environment parameter in a container definition, they take precedence over the variables contained within an environment file. If multiple environment files are specified that contain the same variable, they're processed from the top down. We recommend that you use unique variable names. For more information, see Specifying environment variables in the Amazon Elastic Container Service Developer Guide .

                This parameter is only supported for tasks hosted on Fargate using the following platform versions:

                • Linux platform version 1.4.0 or later.
                • Windows platform version 1.0.0 or later.
                • type (string) -- [REQUIRED]

                  The file type to use. The only supported value is s3 .

                • value (string) -- [REQUIRED]

                  The Amazon Resource Name (ARN) of the Amazon S3 object containing the environment variable file.

            • Memory (integer) --

              The hard limit (in MiB) of memory to present to the container, instead of the default value from the task definition. If your container attempts to exceed the memory specified here, the container is killed. You must also specify a container name.

            • MemoryReservation (integer) --

              The soft limit (in MiB) of memory to reserve for the container, instead of the default value from the task definition. You must also specify a container name.

            • Name (string) --

              The name of the container that receives the override. This parameter is required if any override is specified.

            • ResourceRequirements (list) --

              The type and amount of a resource to assign to a container, instead of the default value from the task definition. The only supported resource is a GPU.

              • (dict) --

                The type and amount of a resource to assign to a container. The supported resource types are GPUs and Elastic Inference accelerators. For more information, see Working with GPUs on Amazon ECS or Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide

                • type (string) -- [REQUIRED]

                  The type of resource to assign to a container. The supported values are GPU or InferenceAccelerator .

                • value (string) -- [REQUIRED]

                  The value for the specified resource type.

                  If the GPU type is used, the value is the number of physical GPUs the Amazon ECS container agent reserves for the container. The number of GPUs that's reserved for all containers in a task can't exceed the number of available GPUs on the container instance that the task is launched on.

                  If the InferenceAccelerator type is used, the value matches the deviceName for an InferenceAccelerator specified in a task definition.

        • Cpu (string) --

          The cpu override for the task.

        • EphemeralStorage (dict) --

          The ephemeral storage setting override for the task.

          Note

          This parameter is only supported for tasks hosted on Fargate that use the following platform versions:

          • Linux platform version 1.4.0 or later.
          • Windows platform version 1.0.0 or later.
          • sizeInGiB (integer) -- [REQUIRED]

            The total amount, in GiB, of ephemeral storage to set for the task. The minimum supported value is 21 GiB and the maximum supported value is 200 GiB.

        • ExecutionRoleArn (string) --

          The Amazon Resource Name (ARN) of the task execution IAM role override for the task. For more information, see Amazon ECS task execution IAM role in the Amazon Elastic Container Service Developer Guide .

        • InferenceAcceleratorOverrides (list) --

          The Elastic Inference accelerator override for the task.

          • (dict) --

            Details on an Elastic Inference accelerator task override. This parameter is used to override the Elastic Inference accelerator specified in the task definition. For more information, see Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide .

            • deviceName (string) --

              The Elastic Inference accelerator device name to override for the task. This parameter must match a deviceName specified in the task definition.

            • deviceType (string) --

              The Elastic Inference accelerator type to use.

        • Memory (string) --

          The memory override for the task.

        • TaskRoleArn (string) --

          The Amazon Resource Name (ARN) of the IAM role that containers in this task can assume. All containers in this task are granted the permissions that are specified in this role. For more information, see IAM Role for Tasks in the Amazon Elastic Container Service Developer Guide .

      • PlacementConstraints (list) --

        An array of placement constraint objects to use for the task. You can specify up to 10 constraints per task (including constraints in the task definition and those specified at runtime).

        • (dict) --

          An object representing a constraint on task placement. To learn more, see Task Placement Constraints in the Amazon Elastic Container Service Developer Guide.

          • expression (string) --

            A cluster query language expression to apply to the constraint. You cannot specify an expression if the constraint type is distinctInstance . To learn more, see Cluster Query Language in the Amazon Elastic Container Service Developer Guide.

          • type (string) --

            The type of constraint. Use distinctInstance to ensure that each task in a particular group is running on a different container instance. Use memberOf to restrict the selection to a group of valid candidates.

      • PlacementStrategy (list) --

        The placement strategy objects to use for the task. You can specify a maximum of five strategy rules per task.

        • (dict) --

          The task placement strategy for a task or service. To learn more, see Task Placement Strategies in the Amazon Elastic Container Service Service Developer Guide.

          • field (string) --

            The field to apply the placement strategy against. For the spread placement strategy, valid values are instanceId (or host, which has the same effect), or any platform or custom attribute that is applied to a container instance, such as attribute:ecs.availability-zone. For the binpack placement strategy, valid values are cpu and memory. For the random placement strategy, this field is not used.

          • type (string) --

            The type of placement strategy. The random placement strategy randomly places tasks on available candidates. The spread placement strategy spreads placement across available candidates evenly based on the field parameter. The binpack strategy places tasks on available candidates that have the least available amount of the resource that is specified with the field parameter. For example, if you binpack on memory, a task is placed on the instance with the least amount of remaining memory (but still enough to run the task).

      • PlatformVersion (string) --

        Specifies the platform version for the task. Specify only the numeric portion of the platform version, such as 1.1.0 .

        This structure is used only if LaunchType is FARGATE . For more information about valid platform versions, see Fargate Platform Versions in the Amazon Elastic Container Service Developer Guide .

      • PropagateTags (string) --

        Specifies whether to propagate the tags from the task definition to the task. If no value is specified, the tags are not propagated. Tags can only be propagated to the task during task creation. To add tags to a task after task creation, use the TagResource API action.

      • ReferenceId (string) --

        The reference ID to use for the task.

      • Tags (list) --

        The metadata that you apply to the task to help you categorize and organize them. Each tag consists of a key and an optional value, both of which you define. To learn more, see RunTask in the Amazon ECS API Reference.

        • (dict) --

          A key-value pair associated with an Amazon Web Services resource. In EventBridge, rules and event buses support tagging.

          • Key (string) -- [REQUIRED]

            A string you can use to assign a value. The combination of tag keys and values can help you organize and categorize your resources.

          • Value (string) -- [REQUIRED]

            The value for the specified tag key.

      • TaskCount (integer) --

        The number of tasks to create based on TaskDefinition . The default is 1.

      • TaskDefinitionArn (string) -- [REQUIRED]

        The ARN of the task definition to use if the event target is an Amazon ECS task.

    • EventBridgeEventBusParameters (dict) --

      The parameters for using an EventBridge event bus as a target.

      • DetailType (string) --

        A free-form string, with a maximum of 128 characters, used to decide what fields to expect in the event detail.

      • EndpointId (string) --

        The URL subdomain of the endpoint. For example, if the URL for Endpoint is https://abcde.veo.endpoints.event.amazonaws.com, then the EndpointId is abcde.veo .

        Warning

        When using Java, you must include auth-crt on the class path.

      • Resources (list) --

        Amazon Web Services resources, identified by Amazon Resource Name (ARN), which the event primarily concerns. Any number, including zero, may be present.

        • (string) --
      • Source (string) --

        The source of the event.

      • Time (string) --

        The time stamp of the event, per RFC3339. If no time stamp is provided, the time stamp of the PutEvents call is used.

    • HttpParameters (dict) --

      These are custom parameter to be used when the target is an API Gateway REST APIs or EventBridge ApiDestinations.

      • HeaderParameters (dict) --

        The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
      • PathParameterValues (list) --

        The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").

        • (string) --
      • QueryStringParameters (dict) --

        The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.

        • (string) --
          • (string) --
    • InputTemplate (string) --

      Valid JSON text passed to the target. In this case, nothing from the event itself is passed to the target. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format.

    • KinesisStreamParameters (dict) --

      The parameters for using a Kinesis stream as a source.

      • PartitionKey (string) -- [REQUIRED]

        Determines which shard in the stream the data record is assigned to. Partition keys are Unicode strings with a maximum length limit of 256 characters for each key. Amazon Kinesis Data Streams uses the partition key as input to a hash function that maps the partition key and associated data to a specific shard. Specifically, an MD5 hash function is used to map partition keys to 128-bit integer values and to map associated data records to shards. As a result of this hashing mechanism, all data records with the same partition key map to the same shard within the stream.

    • LambdaFunctionParameters (dict) --

      The parameters for using a Lambda function as a target.

      • InvocationType (string) --

        Choose from the following options.

        • RequestResponse (default) - Invoke the function synchronously. Keep the connection open until the function returns a response or times out. The API response includes the function response and additional data.
        • Event - Invoke the function asynchronously. Send events that fail multiple times to the function's dead-letter queue (if it's configured). The API response only includes a status code.
        • DryRun - Validate parameter values and verify that the user or role has permission to invoke the function.
    • RedshiftDataParameters (dict) --

      These are custom parameters to be used when the target is a Amazon Redshift cluster to invoke the Amazon Redshift Data API ExecuteStatement.

      • Database (string) -- [REQUIRED]

        The name of the database. Required when authenticating using temporary credentials.

      • DbUser (string) --

        The database user name. Required when authenticating using temporary credentials.

      • SecretManagerArn (string) --

        The name or ARN of the secret that enables access to the database. Required when authenticating using SageMaker.

      • Sqls (list) -- [REQUIRED]

        The SQL statement text to run.

        • (string) --

          // A single Redshift SQL

      • StatementName (string) --

        The name of the SQL statement. You can name the SQL statement when you create it to identify the query.

      • WithEvent (boolean) --

        Indicates whether to send an event back to EventBridge after the SQL statement runs.

    • SageMakerPipelineParameters (dict) --

      The parameters for using a SageMaker pipeline as a target.

      • PipelineParameterList (list) --

        List of Parameter names and values for SageMaker Model Building Pipeline execution.

        • (dict) --

          Name/Value pair of a parameter to start execution of a SageMaker Model Building Pipeline.

          • Name (string) -- [REQUIRED]

            Name of parameter to start execution of a SageMaker Model Building Pipeline.

          • Value (string) -- [REQUIRED]

            Value of parameter to start execution of a SageMaker Model Building Pipeline.

    • SqsQueueParameters (dict) --

      The parameters for using a Amazon SQS stream as a source.

      • MessageDeduplicationId (string) --

        This parameter applies only to FIFO (first-in-first-out) queues.

        The token used for deduplication of sent messages.

      • MessageGroupId (string) --

        The FIFO message group ID to use as the target.

    • StepFunctionStateMachineParameters (dict) --

      The parameters for using a Step Functions state machine as a target.

      • InvocationType (string) --

        Specify whether to wait for the state machine to finish or not.

Return type

dict

Returns

Response Syntax

{
    'Arn': 'string',
    'CreationTime': datetime(2015, 1, 1),
    'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    'DesiredState': 'RUNNING'|'STOPPED',
    'LastModifiedTime': datetime(2015, 1, 1),
    'Name': 'string'
}

Response Structure

  • (dict) --

    • Arn (string) --

      The ARN of the pipe.

    • CreationTime (datetime) --

      The time the pipe was created.

    • CurrentState (string) --

      The state the pipe is in.

    • DesiredState (string) --

      The state the pipe should be in.

    • LastModifiedTime (datetime) --

      When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

    • Name (string) --

      The name of the pipe.

Exceptions

Client Exceptions

Client exceptions are available on a client instance via the exceptions property. For more detailed instructions and examples on the exact usage of client exceptions, see the error handling user guide.

The available client exceptions are:

class EventBridgePipes.Client.exceptions.ConflictException

An action you attempted resulted in an exception.

Example

try:
  ...
except client.exceptions.ConflictException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'resourceId': 'string',
    'resourceType': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    An action you attempted resulted in an exception.

    • message (string) --

    • resourceId (string) --

      The ID of the resource that caused the exception.

    • resourceType (string) --

      The type of resource that caused the exception.

    • Error (dict) -- Normalized access to common exception attributes.

      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class EventBridgePipes.Client.exceptions.InternalException

This exception occurs due to unexpected causes.

Example

try:
  ...
except client.exceptions.InternalException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'retryAfterSeconds': 123,
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    This exception occurs due to unexpected causes.

    • message (string) --

    • retryAfterSeconds (integer) --

      The number of seconds to wait before retrying the action that caused the exception.

    • Error (dict) -- Normalized access to common exception attributes.

      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class EventBridgePipes.Client.exceptions.NotFoundException

An entity that you specified does not exist.

Example

try:
  ...
except client.exceptions.NotFoundException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    An entity that you specified does not exist.

    • message (string) --
    • Error (dict) -- Normalized access to common exception attributes.
      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class EventBridgePipes.Client.exceptions.ServiceQuotaExceededException

A quota has been exceeded.

Example

try:
  ...
except client.exceptions.ServiceQuotaExceededException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'quotaCode': 'string',
    'resourceId': 'string',
    'resourceType': 'string',
    'serviceCode': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    A quota has been exceeded.

    • message (string) --

    • quotaCode (string) --

      The identifier of the quota that caused the exception.

    • resourceId (string) --

      The ID of the resource that caused the exception.

    • resourceType (string) --

      The type of resource that caused the exception.

    • serviceCode (string) --

      The identifier of the service that caused the exception.

    • Error (dict) -- Normalized access to common exception attributes.

      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class EventBridgePipes.Client.exceptions.ThrottlingException

An action was throttled.

Example

try:
  ...
except client.exceptions.ThrottlingException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'message': 'string',
    'quotaCode': 'string',
    'retryAfterSeconds': 123,
    'serviceCode': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    An action was throttled.

    • message (string) --

    • quotaCode (string) --

      The identifier of the quota that caused the exception.

    • retryAfterSeconds (integer) --

      The number of seconds to wait before retrying the action that caused the exception.

    • serviceCode (string) --

      The identifier of the service that caused the exception.

    • Error (dict) -- Normalized access to common exception attributes.

      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.
class EventBridgePipes.Client.exceptions.ValidationException

Indicates that an error has occurred while performing a validate operation.

Example

try:
  ...
except client.exceptions.ValidationException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'fieldList': [
        {
            'message': 'string',
            'name': 'string'
        },
    ],
    'message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) --

    Indicates that an error has occurred while performing a validate operation.

    • fieldList (list) --

      The list of fields for which validation failed and the corresponding failure messages.

      • (dict) --

        Indicates that an error has occurred while performing a validate operation.

        • message (string) --

          The message of the exception.

        • name (string) --

          The name of the exception.

    • message (string) --

    • Error (dict) -- Normalized access to common exception attributes.

      • Code (string) -- An identifier specifying the exception type.
      • Message (string) -- A descriptive message explaining why the exception occured.

Paginators

The available paginators are:

class EventBridgePipes.Paginator.ListPipes
paginator = client.get_paginator('list_pipes')
paginate(**kwargs)

Creates an iterator that will paginate through responses from EventBridgePipes.Client.list_pipes().

See also: AWS API Documentation

Request Syntax

response_iterator = paginator.paginate(
    CurrentState='RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
    DesiredState='RUNNING'|'STOPPED',
    NamePrefix='string',
    SourcePrefix='string',
    TargetPrefix='string',
    PaginationConfig={
        'MaxItems': 123,
        'PageSize': 123,
        'StartingToken': 'string'
    }
)
Parameters
  • CurrentState (string) -- The state the pipe is in.
  • DesiredState (string) -- The state the pipe should be in.
  • NamePrefix (string) -- A value that will return a subset of the pipes associated with this account. For example, "NamePrefix": "ABC" will return all endpoints with "ABC" in the name.
  • SourcePrefix (string) -- The prefix matching the pipe source.
  • TargetPrefix (string) -- The prefix matching the pipe target.
  • PaginationConfig (dict) --

    A dictionary that provides parameters to control pagination.

    • MaxItems (integer) --

      The total number of items to return. If the total number of items available is more than the value specified in max-items then a NextToken will be provided in the output that you can use to resume pagination.

    • PageSize (integer) --

      The size of each page.

    • StartingToken (string) --

      A token to specify where to start paginating. This is the NextToken from a previous response.

Return type

dict

Returns

Response Syntax

{
    'Pipes': [
        {
            'Arn': 'string',
            'CreationTime': datetime(2015, 1, 1),
            'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED',
            'DesiredState': 'RUNNING'|'STOPPED',
            'Enrichment': 'string',
            'LastModifiedTime': datetime(2015, 1, 1),
            'Name': 'string',
            'Source': 'string',
            'StateReason': 'string',
            'Target': 'string'
        },
    ]
}

Response Structure

  • (dict) --

    • Pipes (list) --

      The pipes returned by the call.

      • (dict) --

        An object that represents a pipe. Amazon EventBridgePipes connect event sources to targets and reduces the need for specialized knowledge and integration code.

        • Arn (string) --

          The ARN of the pipe.

        • CreationTime (datetime) --

          The time the pipe was created.

        • CurrentState (string) --

          The state the pipe is in.

        • DesiredState (string) --

          The state the pipe should be in.

        • Enrichment (string) --

          The ARN of the enrichment resource.

        • LastModifiedTime (datetime) --

          When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).

        • Name (string) --

          The name of the pipe.

        • Source (string) --

          The ARN of the source resource.

        • StateReason (string) --

          The reason the pipe is in its current state.

        • Target (string) --

          The ARN of the target resource.