IoTAnalytics / Client / create_datastore

create_datastore#

IoTAnalytics.Client.create_datastore(**kwargs)#

Creates a data store, which is a repository for messages.

Request Syntax

response = client.create_datastore(
    datastoreName='string',
    datastoreStorage={
        'serviceManagedS3': {}
        ,
        'customerManagedS3': {
            'bucket': 'string',
            'keyPrefix': 'string',
            'roleArn': 'string'
        },
        'iotSiteWiseMultiLayerStorage': {
            'customerManagedS3Storage': {
                'bucket': 'string',
                'keyPrefix': 'string'
            }
        }
    },
    retentionPeriod={
        'unlimited': True|False,
        'numberOfDays': 123
    },
    tags=[
        {
            'key': 'string',
            'value': 'string'
        },
    ],
    fileFormatConfiguration={
        'jsonConfiguration': {}
        ,
        'parquetConfiguration': {
            'schemaDefinition': {
                'columns': [
                    {
                        'name': 'string',
                        'type': 'string'
                    },
                ]
            }
        }
    },
    datastorePartitions={
        'partitions': [
            {
                'attributePartition': {
                    'attributeName': 'string'
                },
                'timestampPartition': {
                    'attributeName': 'string',
                    'timestampFormat': 'string'
                }
            },
        ]
    }
)

Parameters:

datastoreName (string) –
[REQUIRED]

The name of the data store.
datastoreStorage (dict) –
Where data in a data store is stored.. You can choose serviceManagedS3 storage, customerManagedS3 storage, or iotSiteWiseMultiLayerStorage storage. The default is serviceManagedS3. You can’t change the choice of Amazon S3 storage after your data store is created.
- serviceManagedS3 (dict) –
  
  Used to store data in an Amazon S3 bucket managed by IoT Analytics. You can’t change the choice of Amazon S3 storage after your data store is created.
- customerManagedS3 (dict) –
  
  S3-customer-managed; When you choose customer-managed storage, the retentionPeriod parameter is ignored. You can’t change the choice of Amazon S3 storage after your data store is created.
  - bucket (string) – [REQUIRED]
    
    The name of the Amazon S3 bucket where your data is stored.
  - keyPrefix (string) –
    
    (Optional) The prefix used to create the keys of the data store data objects. Each object in an Amazon S3 bucket has a key that is its unique identifier in the bucket. Each object in a bucket has exactly one key. The prefix must end with a forward slash (/).
  - roleArn (string) – [REQUIRED]
    
    The ARN of the role that grants IoT Analytics permission to interact with your Amazon S3 resources.
- iotSiteWiseMultiLayerStorage (dict) –
  
  Used to store data used by IoT SiteWise in an Amazon S3 bucket that you manage. You can’t change the choice of Amazon S3 storage after your data store is created.
  - customerManagedS3Storage (dict) – [REQUIRED]
    
    Used to store data used by IoT SiteWise in an Amazon S3 bucket that you manage.
    - bucket (string) – [REQUIRED]
      
      The name of the Amazon S3 bucket where your data is stored.
    - keyPrefix (string) –
      
      (Optional) The prefix used to create the keys of the data store data objects. Each object in an Amazon S3 bucket has a key that is its unique identifier in the bucket. Each object in a bucket has exactly one key. The prefix must end with a forward slash (/).
retentionPeriod (dict) –
How long, in days, message data is kept for the data store. When customerManagedS3 storage is selected, this parameter is ignored.
- unlimited (boolean) –
  
  If true, message data is kept indefinitely.
- numberOfDays (integer) –
  
  The number of days that message data is kept. The unlimited parameter must be false.
tags (list) –
Metadata which can be used to manage the data store.
- (dict) –
  
  A set of key-value pairs that are used to manage the resource.
  - key (string) – [REQUIRED]
    
    The tag’s key.
  - value (string) – [REQUIRED]
    
    The tag’s value.
fileFormatConfiguration (dict) –
Contains the configuration information of file formats. IoT Analytics data stores support JSON and Parquet.

The default file format is JSON. You can specify only one format.

You can’t change the file format after you create the data store.
- jsonConfiguration (dict) –
  
  Contains the configuration information of the JSON format.
- parquetConfiguration (dict) –
  
  Contains the configuration information of the Parquet format.
  - schemaDefinition (dict) –
    
    Information needed to define a schema.
    - columns (list) –
      
      Specifies one or more columns that store your data.
      
      Each schema can have up to 100 columns. Each column can have up to 100 nested types.
      - (dict) –
        
        Contains information about a column that stores your data.
        
        name (string) – [REQUIRED]
        
        The name of the column.
        
        type (string) – [REQUIRED]
        
        The type of data. For more information about the supported data types, see Common data types in the Glue Developer Guide.
datastorePartitions (dict) –
Contains information about the partition dimensions in a data store.
- partitions (list) –
  
  A list of partition dimensions in a data store.
  - (dict) –
    
    A single dimension to partition a data store. The dimension must be an AttributePartition or a TimestampPartition.
    - attributePartition (dict) –
      
      A partition dimension defined by an attributeName.
      - attributeName (string) – [REQUIRED]
        
        The name of the attribute that defines a partition dimension.
    - timestampPartition (dict) –
      
      A partition dimension defined by a timestamp attribute.
      - attributeName (string) – [REQUIRED]
        
        The attribute name of the partition defined by a timestamp.
      - timestampFormat (string) –
        
        The timestamp format of a partition defined by a timestamp. The default format is seconds since epoch (January 1, 1970 at midnight UTC time).

Return type:

dict

Returns:

Response Syntax

{
    'datastoreName': 'string',
    'datastoreArn': 'string',
    'retentionPeriod': {
        'unlimited': True|False,
        'numberOfDays': 123
    }
}

Response Structure

(dict) –
- datastoreName (string) –
  
  The name of the data store.
- datastoreArn (string) –
  
  The ARN of the data store.
- retentionPeriod (dict) –
  
  How long, in days, message data is kept for the data store.
  - unlimited (boolean) –
    
    If true, message data is kept indefinitely.
  - numberOfDays (integer) –
    
    The number of days that message data is kept. The unlimited parameter must be false.

create_datastore#

Request Syntax

Response Syntax

Response Structure

Exceptions