How to integrate S3 with QuickSight for analysis

Big Data – Blog by YY

Introduction to Data

In this blog, I am gonna provide instructions regarding the integration between QuickSight and S3 for data analysis.

 

As a cloud solutions company, we must catch up every updated released from aws.
Hence, this post is to introduction all the instructions for assisting clients to integrate aws storage services with the newly released powerful visualization service, QuickSight.

 

 

 

 

 

 

 

 

 

 

 

 

 

step One:

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

step Two:

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

step Three:

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

step Four:

 

  • Data source name

–       naming any preferred name.

 

  • Upload a manifest file

       manifest file, a kind of communication configuration file between QuickSight and S3.

–       manifest file, a “JSON” file format file

 

AWS provides the following means of providing manifest file,

  1. URL, provides a S3 URL for QuickSight to recognize.
  2. Upload, upload manifest file from local to QuickSight.

 

The following part is how to manipulate customized manifest file.

 

Required:

–       fileLocations: URIs and URIPrefixed are valid fileLocation in QuickSight.

 

URIs (single-file based):

–       https://s3.amazonaws.com/<bucket name>/<file name>

–       s3://<bucket name>/<file name>

–       https://<bucket name>.s3.amazonaws.com/<file name>

–       https://s3-<region name>.amazonaws.com/<bucket name>/<file name>

–       https://<bucket name>.s3-<region name>.amazonaws.com/<file name>

 

URIPrefixed (multi-file based):

–       https://s3.amazonaws.com/<bucket name>/

–       https://s3.amazonaws.com/<bucket name>/<folder name1>/(<folder name2>/etc.)

–       s3://<bucket name>

–       s3://<bucket name>/<folder name1>/(<folder name2>/etc.)

–       https://<bucket name>.s3.amazonaws.com

–       https://s3-<region name>.amazonaws.com/<bucket name>/

–       https://s3-<region name>.amazonaws.com/<bucket name>/<folder name1>/(<folder name2>/etc.)

–       https://<bucket name>.s3-<region name>.amazonaws.com

 

 

Optional:

–       globalUploadSettings:

  • format, data source format. Only “CSV”, “TSV”, “CLF”, “ELF” in support.
  • delimiter, the delimiter in data source.
  • containsHeader, whether for QuickSight contains data source headers for better recognition.
  • textqualifier, Only “ single quote “ and “ double quote “ are valid in textqualifier.
Posted in ICG Blog.