Connecting to AWS S3

AWS S3 is a storage system that is used to store all of your data and analyze it. One can think of it as an infinite hard disk that Explorium uses for storage.

There are three options to connect to AWS S3:

• Create a new project
• Edit an existing project connection
• Export data from the Export >Run recipe button

For Example: if my project name is 'My Project', and the file path value is 'Desktop_{date}/{project}_{date}', then the prediction file will be stored at 'Desktop_2019-02-19_15-20' directory, and the file name will be 'myProject_2019-02-19_15-20'

Connecting to AWS S3 when Creating a New Project

1. Click Enrich. The Enrich page is displayed.
2. Click  in the upper-right hand corner. The Create a new project window is displayed.
   
3. Type in a new project name. The project name needs to be unique.
4. Select a use case from the drop-down. 
5. Click Create project. The Upload a dataset window appears.
   
6. Select AWS S3.
   
7. All fields are mandatory, enter the connection name.
8. Type in the Access key.
   Note: Scroll below to see how you can obtain the Access Key, Secret Key and Bucket Name.
9. Type in the Secret Key.
10. Type in the Bucket Name, which is the name of the root folder within S3 where the file resides.
11. Click Test Connection to make sure the connection is successful.
    A message is displayed informing you if the connection was successfully created or not. If the test connection failed, then you are unable to create a connection.
    Note: Before creating a new connection, a Test Connection must be run. If the test failed, or a parameter was changed, the Create button will be disabled, and you need to create a new connection.
12. After the test connection has succeeded, click Create in order to create the connection.
13. Select the database connection.
14. Type in the file name. which is the filename within the bucket selected during the creation of the connection. For example, the full path would be explorium-output/file-name.csv If the folder resides within a subfolder, this must be included before the file-name - for example: subfolder-name/file-name.csv. In this scenario the full path would be explorium-output/subfolder-name/file-name.csv.
15. Click Save.
    

Connecting to AWS S3 when Editing a Dataset

1. Click Enrich. The Enrich page is displayed.
2. Create or search for a project.
3. Click .
   The Change data and edit data dataset window appears.
   
4. Click Continue. The Upload a dataset window appears.
   
5. Select AWS S3.
   
6. All fields are mandatory. Select the connection name.
7. Type in the Access key.
   Note: Scroll below to see how you can obtain the Access Key, Secret Key and Bucket Name.
8. Type in the Secret Key.
9. Type in the Bucket Name, which is the name of the root folder within S3 where the file resides.
10. Click Create to test the connection before creating the connector.
11. Click Test Connection. A message is displayed informing you if the connection was successfully created or not. If the test connection failed, then you are unable to create a connection.
    Note: Before creating a new connection, a Test Connection must be run. If the test failed, or a parameter was changed, the Create button will be disabled, and you need to create a new connection.
12. After the test connection has succeeded, click Create in order to create the connection.
13. Select the database connection.
14. Type in the file name which is the filename within the bucket selected during the creation of the connection. For example, the full path would be explorium-output/file-name.csv If the folder resides within a subfolder, this must be included before the file-name- for example: subfolder-name/file-name.csv. In this scenario the full path would be explorium-output/subfolder-name/file-name.csv.
15. Click Save.
    

 Exporting Data

1. Click Enrich. The Enrich page is displayed. 
2. Create, search or edit a project.
3. Click the Export >Run Recipe.
   
4. The Schedule Recipe Run window is displayed.
   
5. Select the input connection (optional).
6. Select the output connection.

How can you obtain the Access Key, Secret Key and Bucket name from the client’s S3?

1. Within the AWS console, click on your personal account settings > My Security Credentials.
   
2. copy an existing access key + secret access key or create a new set of keys: