Comprehend / Client / create_entity_recognizer

create_entity_recognizer#

Comprehend.Client.create_entity_recognizer(**kwargs)#

Creates an entity recognizer using submitted files. After your CreateEntityRecognizer request is submitted, you can check job status using the DescribeEntityRecognizer API.

See also: AWS API Documentation

Request Syntax

response = client.create_entity_recognizer(
    RecognizerName='string',
    VersionName='string',
    DataAccessRoleArn='string',
    Tags=[
        {
            'Key': 'string',
            'Value': 'string'
        },
    ],
    InputDataConfig={
        'DataFormat': 'COMPREHEND_CSV'|'AUGMENTED_MANIFEST',
        'EntityTypes': [
            {
                'Type': 'string'
            },
        ],
        'Documents': {
            'S3Uri': 'string',
            'TestS3Uri': 'string',
            'InputFormat': 'ONE_DOC_PER_FILE'|'ONE_DOC_PER_LINE'
        },
        'Annotations': {
            'S3Uri': 'string',
            'TestS3Uri': 'string'
        },
        'EntityList': {
            'S3Uri': 'string'
        },
        'AugmentedManifests': [
            {
                'S3Uri': 'string',
                'Split': 'TRAIN'|'TEST',
                'AttributeNames': [
                    'string',
                ],
                'AnnotationDataS3Uri': 'string',
                'SourceDocumentsS3Uri': 'string',
                'DocumentType': 'PLAIN_TEXT_DOCUMENT'|'SEMI_STRUCTURED_DOCUMENT'
            },
        ]
    },
    ClientRequestToken='string',
    LanguageCode='en'|'es'|'fr'|'de'|'it'|'pt'|'ar'|'hi'|'ja'|'ko'|'zh'|'zh-TW',
    VolumeKmsKeyId='string',
    VpcConfig={
        'SecurityGroupIds': [
            'string',
        ],
        'Subnets': [
            'string',
        ]
    },
    ModelKmsKeyId='string',
    ModelPolicy='string'
)
Parameters:

  • RecognizerName (string) –

    [REQUIRED]

    The name given to the newly created recognizer. Recognizer names can be a maximum of 256 characters. Alphanumeric characters, hyphens (-) and underscores (_) are allowed. The name must be unique in the account/Region.

  • VersionName (string) – The version name given to the newly created recognizer. Version names can be a maximum of 256 characters. Alphanumeric characters, hyphens (-) and underscores (_) are allowed. The version name must be unique among all models with the same recognizer name in the account/Region.

  • DataAccessRoleArn (string) –

    [REQUIRED]

    The Amazon Resource Name (ARN) of the IAM role that grants Amazon Comprehend read access to your input data.

  • Tags (list) –

    Tags to associate with the entity recognizer. A tag is a key-value pair that adds as a metadata to a resource used by Amazon Comprehend. For example, a tag with “Sales” as the key might be added to a resource to indicate its use by the sales department.

    • (dict) –

      A key-value pair that adds as a metadata to a resource used by Amazon Comprehend. For example, a tag with the key-value pair ‘Department’:’Sales’ might be added to a resource to indicate its use by a particular department.

      • Key (string) – [REQUIRED]

        The initial part of a key-value pair that forms a tag associated with a given resource. For instance, if you want to show which resources are used by which departments, you might use “Department” as the key portion of the pair, with multiple possible values such as “sales,” “legal,” and “administration.”

      • Value (string) –

        The second part of a key-value pair that forms a tag associated with a given resource. For instance, if you want to show which resources are used by which departments, you might use “Department” as the initial (key) portion of the pair, with a value of “sales” to indicate the sales department.

  • InputDataConfig (dict) –

    [REQUIRED]

    Specifies the format and location of the input data. The S3 bucket containing the input data must be located in the same Region as the entity recognizer being created.

    • DataFormat (string) –

      The format of your training data:

      • COMPREHEND_CSV: A CSV file that supplements your training documents. The CSV file contains information about the custom entities that your trained model will detect. The required format of the file depends on whether you are providing annotations or an entity list. If you use this value, you must provide your CSV file by using either the Annotations or EntityList parameters. You must provide your training documents by using the Documents parameter.

      • AUGMENTED_MANIFEST: A labeled dataset that is produced by Amazon SageMaker Ground Truth. This file is in JSON lines format. Each line is a complete JSON object that contains a training document and its labels. Each label annotates a named entity in the training document. If you use this value, you must provide the AugmentedManifests parameter in your request.

      If you don’t specify a value, Amazon Comprehend uses COMPREHEND_CSV as the default.

    • EntityTypes (list) – [REQUIRED]

      The entity types in the labeled training data that Amazon Comprehend uses to train the custom entity recognizer. Any entity types that you don’t specify are ignored.

      A maximum of 25 entity types can be used at one time to train an entity recognizer. Entity types must not contain the following invalid characters: n (line break), \n (escaped line break), r (carriage return), \r (escaped carriage return), t (tab), \t (escaped tab), space, and , (comma).

      • (dict) –

        An entity type within a labeled training dataset that Amazon Comprehend uses to train a custom entity recognizer.

        • Type (string) – [REQUIRED]

          An entity type within a labeled training dataset that Amazon Comprehend uses to train a custom entity recognizer.

          Entity types must not contain the following invalid characters: n (line break), \n (escaped line break, r (carriage return), \r (escaped carriage return), t (tab), \t (escaped tab), and , (comma).

    • Documents (dict) –

      The S3 location of the folder that contains the training documents for your custom entity recognizer.

      This parameter is required if you set DataFormat to COMPREHEND_CSV.

      • S3Uri (string) – [REQUIRED]

        Specifies the Amazon S3 location where the training documents for an entity recognizer are located. The URI must be in the same Region as the API endpoint that you are calling.

      • TestS3Uri (string) –

        Specifies the Amazon S3 location where the test documents for an entity recognizer are located. The URI must be in the same Amazon Web Services Region as the API endpoint that you are calling.

      • InputFormat (string) –

        Specifies how the text in an input file should be processed. This is optional, and the default is ONE_DOC_PER_LINE. ONE_DOC_PER_FILE - Each file is considered a separate document. Use this option when you are processing large documents, such as newspaper articles or scientific papers. ONE_DOC_PER_LINE - Each line in a file is considered a separate document. Use this option when you are processing many short documents, such as text messages.

    • Annotations (dict) –

      The S3 location of the CSV file that annotates your training documents.

      • S3Uri (string) – [REQUIRED]

        Specifies the Amazon S3 location where the annotations for an entity recognizer are located. The URI must be in the same Region as the API endpoint that you are calling.

      • TestS3Uri (string) –

        Specifies the Amazon S3 location where the test annotations for an entity recognizer are located. The URI must be in the same Region as the API endpoint that you are calling.

    • EntityList (dict) –

      The S3 location of the CSV file that has the entity list for your custom entity recognizer.

      • S3Uri (string) – [REQUIRED]

        Specifies the Amazon S3 location where the entity list is located. The URI must be in the same Region as the API endpoint that you are calling.

    • AugmentedManifests (list) –

      A list of augmented manifest files that provide training data for your custom model. An augmented manifest file is a labeled dataset that is produced by Amazon SageMaker Ground Truth.

      This parameter is required if you set DataFormat to AUGMENTED_MANIFEST.

      • (dict) –

        An augmented manifest file that provides training data for your custom model. An augmented manifest file is a labeled dataset that is produced by Amazon SageMaker Ground Truth.

        • S3Uri (string) – [REQUIRED]

          The Amazon S3 location of the augmented manifest file.

        • Split (string) –

          The purpose of the data you’ve provided in the augmented manifest. You can either train or test this data. If you don’t specify, the default is train.

          TRAIN - all of the documents in the manifest will be used for training. If no test documents are provided, Amazon Comprehend will automatically reserve a portion of the training documents for testing.

          TEST - all of the documents in the manifest will be used for testing.

        • AttributeNames (list) – [REQUIRED]

          The JSON attribute that contains the annotations for your training documents. The number of attribute names that you specify depends on whether your augmented manifest file is the output of a single labeling job or a chained labeling job.

          If your file is the output of a single labeling job, specify the LabelAttributeName key that was used when the job was created in Ground Truth.

          If your file is the output of a chained labeling job, specify the LabelAttributeName key for one or more jobs in the chain. Each LabelAttributeName key provides the annotations from an individual job.

          • (string) –

        • AnnotationDataS3Uri (string) –

          The S3 prefix to the annotation files that are referred in the augmented manifest file.

        • SourceDocumentsS3Uri (string) –

          The S3 prefix to the source files (PDFs) that are referred to in the augmented manifest file.

        • DocumentType (string) –

          The type of augmented manifest. PlainTextDocument or SemiStructuredDocument. If you don’t specify, the default is PlainTextDocument.

          • PLAIN_TEXT_DOCUMENT A document type that represents any unicode text that is encoded in UTF-8.

          • SEMI_STRUCTURED_DOCUMENT A document type with positional and structural context, like a PDF. For training with Amazon Comprehend, only PDFs are supported. For inference, Amazon Comprehend support PDFs, DOCX and TXT.

  • ClientRequestToken (string) –

    A unique identifier for the request. If you don’t set the client request token, Amazon Comprehend generates one.

    This field is autopopulated if not provided.

  • LanguageCode (string) –

    [REQUIRED]

    You can specify any of the following languages: English (“en”), Spanish (“es”), French (“fr”), Italian (“it”), German (“de”), or Portuguese (“pt”). If you plan to use this entity recognizer with PDF, Word, or image input files, you must specify English as the language. All training documents must be in the same language.

  • VolumeKmsKeyId (string) –

    ID for the Amazon Web Services Key Management Service (KMS) key that Amazon Comprehend uses to encrypt data on the storage volume attached to the ML compute instance(s) that process the analysis job. The VolumeKmsKeyId can be either of the following formats:

    • KMS Key ID: "1234abcd-12ab-34cd-56ef-1234567890ab"

    • Amazon Resource Name (ARN) of a KMS Key: "arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab"

  • VpcConfig (dict) –

    Configuration parameters for an optional private Virtual Private Cloud (VPC) containing the resources you are using for your custom entity recognizer. For more information, see Amazon VPC.

    • SecurityGroupIds (list) – [REQUIRED]

      The ID number for a security group on an instance of your private VPC. Security groups on your VPC function serve as a virtual firewall to control inbound and outbound traffic and provides security for the resources that you’ll be accessing on the VPC. This ID number is preceded by “sg-”, for instance: “sg-03b388029b0a285ea”. For more information, see Security Groups for your VPC.

      • (string) –

    • Subnets (list) – [REQUIRED]

      The ID for each subnet being used in your private VPC. This subnet is a subset of the a range of IPv4 addresses used by the VPC and is specific to a given availability zone in the VPC’s Region. This ID number is preceded by “subnet-”, for instance: “subnet-04ccf456919e69055”. For more information, see VPCs and Subnets.

      • (string) –

  • ModelKmsKeyId (string) –

    ID for the KMS key that Amazon Comprehend uses to encrypt trained custom models. The ModelKmsKeyId can be either of the following formats:

    • KMS Key ID: "1234abcd-12ab-34cd-56ef-1234567890ab"

    • Amazon Resource Name (ARN) of a KMS Key: "arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab"

  • ModelPolicy (string) –

    The JSON resource-based policy to attach to your custom entity recognizer model. You can use this policy to allow another Amazon Web Services account to import your custom model.

    Provide your JSON as a UTF-8 encoded string without line breaks. To provide valid JSON for your policy, enclose the attribute names and values in double quotes. If the JSON body is also enclosed in double quotes, then you must escape the double quotes that are inside the policy:

    "{\"attribute\": \"value\", \"attribute\": [\"value\"]}"

    To avoid escaping quotes, you can use single quotes to enclose the policy and double quotes to enclose the JSON names and values:

    '{"attribute": "value", "attribute": ["value"]}'

Return type:

dict

Returns:

Response Syntax

{
    'EntityRecognizerArn': 'string'
}

Response Structure

  • (dict) –

    • EntityRecognizerArn (string) –

      The Amazon Resource Name (ARN) that identifies the entity recognizer.

Exceptions