Post on 12-Jul-2015
transcript
www.flydata.com
Creating a Redshift
Cluster with FlyData
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Step 1: Select a
Region and Create
a Security Group
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Sign into the AWS Console at aws.amazon.com
Copyright © 2014 FlyData Inc. All rights reserved.
1. <todo1>
2. <todo2>
3. ...
http://flydata.com/
Under the “Database” section,
click on “Redshift”
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Before we set your cluster up, we first need to
select an appropriate region and create a security
group.
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
But wait!
1. Your newly created group isn’t authorized!
2. This makes sense, given that we haven’t even authorized any IPs to access the
cluster.
3. In the drop-down menu, select “CIDR/IP” and enter the IP addresses of the
machines you want to authorize. In this demo, we simply want to give our own
computer access, so we will just paste the IP address of our own computer.
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Step 2: Configure
Your Cluster!
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
The following is straightforward.
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Types of Nodes
1. On the “Node Configuration” page, you’ll notice that there are
four different types of nodes! Make sure you a choose a type
according to what your organization requires.
- dw1.xlarge: 4.4 EC2 Compute Units per node, 15GB of
memory, and 2TB HDD storage per node; moderate I/O
performance
- dw1.8xlarge: 35 EC2 Compute Units per node, 120GB of
memory, and 16TB HDD storage per node; very high I/O
performance
- dw2.large: 7 EC2 Compute Units per node, 15GB of memory,
and 160GB SSD storage; moderate I/O performance
- dw2.8xlarge: 104 EC2 Compute Units per node, 244GB of
memory, and 2.56TB SSD storage; very high I/O performance
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Additional Configuration
- On the “Additional Configuration” page, we will be
using “default.redshift-1.0” as our cluster parameter
group. This group will apply all of its parameters to
all of the databases you create on this cluster.
- For more information on managing parameter
groups, check out this AWS guide on parameter
groups. As for encryption, we will be selecting “none”
for tutorial purposes but if you have a hardware
security module or will want to use Amazon Web
Services’ “key management service”, choose
accordingly.
- On the bottom section, choose the security group
you created earlier!
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Additional Configuration
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
CloudWatch
- On this page you will also have the
option to create an alarm
(CloudWatch) to monitor your disk
usage and alert you when the nodes
reach a certain percentage, but we
will be leaving it off in this tutorial.
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Additional Configuration
- After additional configuration, you will
finally reach the review page. Here,
there is a summary of all the settings
you configured for this cluster. At the
bottom, there will also be the hourly
rate for your cluster. Once you’re
done reviewing, you are ready to
launch!
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Review of Configuration
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Hourly Rate
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Step 3: Launch!
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
It will take a few minutes...
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
Finished!
Copyright © 2014 FlyData Inc. All rights reserved.
- Once it’s finished, click on the name and you will see a
summary of the properties and status of your cluster.
- You will also see ODBC and JDBC URLs that you will use
to connect to your cluster.
- On the top left, there is a drop-down box with options to
reboot, resize, shutdown, or reboot your cluster.
http://flydata.com/
Summary
Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/
That’s all!
Copyright © 2014 FlyData Inc. All rights reserved. https://www.flydata.com/
Moving Your Data, on the Fly!
You should now have a Redshift cluster configured and running!
Now that your setup is complete, you can start loading data to
your cluster!
At FlyData we offer data integration solutions to Amazon
Redshift. As an AWS partner, our mission is to securely and
seamlessly integrate your data with our solutions, so you can
easily access fresh data when you need it. If you’d like to read
further on how to setup FlyData with your Redshift cluster,
please proceed to the appropriate guide below:
- Syncing with MySQL
- Syncing with RDS MySQL
- Getting Started with FlyData Autoload
- FlyData Heroku Gem
Copyright © 2014 FlyData Inc. All rights reserved. https://www.flydata.com/
www.flydata.com www.flydata.com
Check us out!
-> http://flydata.com
sales@flydata.com
Toll Free: 1-855-427-9787
http://flydata.com
We are an official data integration
partner of Amazon Redshift