AWS Redshift

Setup instructions

Configure connection Type

Direct Connection - Please configure firewall and/or other access control systems to allow incoming connections to your host and port from Gravity's IP addresses

SSH Tunnel or Reverse SSH Tunnel - Please see our guide on setting up a SSH Tunnel or Reverse SSH Tunnel

Obtain Redshift Details

Open the Redshift console.

1. In the left menu, click Clusters.

2. Select the cluster you want Gravity to connect to.

3. Click Properties.

4. In the Connection details pane's Endpoint field, click Copy to copy the endpoint details. You will need them to complete the destination setup in Gravity.

   Be sure to separate the port and remove the preceding colon (:) from the host string.

Allow Gravity to connect to your Redshift Cluster

1. In the Redshift console, click Clusters.

2. Select the cluster you want Gravity to connect to.

3. Click Properties.

4. Scroll down to the Network and security section.

5. In the VPC security group field, click the security group to open it. Make a note of the security group ID.

6. In the Security Groups window, click Inbound rules.

   The security group you clicked in the previous view should be pre-selected here. Ensure that you selected the same security group from the previous screen.

7. Click Edit inbound rules.

8. In the Edit Inbound rules window, follow the steps below to create custom TCP rules for each of Gravity IP Addresses.

   • Select Custom TCP in the drop-down menu.

   • Enter your Redshift port number.

   • Enter the Gravity IP address.

   • Click Add rule.

Allocate query concurrency

You must allocate a query concurrency of 4 or above to Gravity. To modify the query concurrency of an existing queue:

1. Open the Redshift console and click Configurations > Workload management.

2. In the Workload management window, select the parameter group.

3. In the Workload queues pane, click Edit workload queues to change the query concurrency. Use one of the following methods:

   • Modify the Concurrency on main column value for the queue.

   • In the JSON section, edit the configuration and modify the query_concurrency parameter for the queue.

Create User

In the Redshift console, select the cluster you want Gravity to connect to.

1. Click Properties.

2. In the Properties tab, scroll down to the Database configurations section.

3. Copy Database name and the user name values. You will need them to complete the destination setup in Gravity.

(Optional) Create VPC endpoint if you use Enhanced VPC Routing to allow access to the S3 buckets and copy data in to the tables.

Sign in to the AWS Management Console and open the Amazon VPC console.

1. Click Endpoints.

2. Click Create Endpoint.

3. In the Service category options, select AWS services.

4. In the Service Name section, select your S3 service to grant access.

5. In the VPC dropdown menu, select the VPC you use in the Redshift cluster.

6. In the Configure route tables section, select the Route Table ID associated with the VPC.

7. In the Policy section, select Full Access to allow access to S3 services.

8. Click Create endpoint.

Setup Redshift Destination in Gravity

1. Log in to your Gravity, choose Destinations, Choose Redshift

2. Insert Host, Port and Database

3. Insert Username and Password

4. Click Save and Test. Your Redshift cluster is now connected.

   • Test checks connectivity to Redshift and permission to create schemas and tables on your Redshift database.

Gravity has now validated the destination and if successful you can add sources or create jobs. If unsuccessful, please go back through the steps above or contact Gravity Support.

Composite Key Restriction

Gravity does not support columns with data type GEOMETRY, GEOGRAPHY, or VARBYTE as a composite key.