Using Managed Storage

Follow

Managed Storage is an Amazon Redshift database, designed to suit all levels of expertise. For users comfortable with database management, your Managed Storage instance can be accessed externally using an ETL or SQL client. For the less comfortable, it can be managed entirely through the BIME UI.

Managed Storage has two main uses:

First, it is a larger data store than Déjà Vu. Managed Storage is capable of holding millions of rows per table. You can use a Managed Storage instance to stack multiple datasets together or store datasets that you do not want to go live.

It can also be used to join connections in a deeper way than the Query Blender can. Most types of data connections can be loaded into your Managed Storage instance as tables. After connections are added to the same Managed Storage instance, they can be joined using SQL.

This article covers the following topics:

Creating a new Managed Storage instance

Before you connect to your Managed Storage instance, you need to create a Managed Storage instance. Only admins can create a new Managed Storage instance.

To create a new Managed Storage instance

  1. Click the Admin icon () on the left panel.
  2. Select the Managed Storage option.
  3. If you have not created any Managed Storage instances, click Let's create one.

  4. Select either the Standard or Analytics option.
  5. If you are on a trial account, you can test Managed Storage by obtaining a coupon code from our support team. If you are on a paid account, you can activate a Managed Storage instance at any time. After activating your Managed Storage instance, new charges will be added to your subscription costs.
  6. Name your instance, and select a location for your data.
  7. Specify your security settings.
  8. Click Launch.

     

    After you receive an email notification, your Managed Storage instance will be available.

Storing connections in your Managed Storage instance

After you create a Managed Storage instance, you can begin to store data in the database. While most connections can be stored in your Managed Storage instance, some delegated connections cannot.

Storing connections in your Managed Storage instance

If you would like to store a connection in your Managed Storage instance, please follow the steps below.

To store a connection in Managed Storage
  1. In the Storage step of the Data source Builder, select Managed Storage as your storage option.
  2. Select your Managed Storage instance, then enter a table name.
  3. Select a refresh option. There are two refresh options available:
    • Erase and replace the existing data on each import.
    • Append data on top of existing data after each import. This option stacks files into a single table. You can achieve this by editing the filepath or table specified in the query. For example, you can use the append option to change Januarysales.csv to Februarysales.csv.

  4. Click the Save button to establish the connection.

If you build queries or load the dataset saved in your Managed Storage instance, you will be connecting to the table you created, not the original source. If you are only using your Managed Storage instance as your data store, you will not need to do anything else. If you are using Managed Storage to join tables, you will need to add your Managed Storage instance as a connection.

Connections that cannot be stored in your Managed Storage instance

Below is a list of connections that cannot be stored in your Managed Storage instance:

  • Bing Ads
  • DoubleClick
  • Elastic Search
  • Facebook Ads
  • Google Adwords
  • Google Analytics connections
  • Google Search
  • Hive
  • Impala
  • LinkedIn
  • Omniture
  • Presto
  • Radian6
  • Spark
  • Youtube

Adding your Managed Storage instance as a connection

To join tables stored in your Managed Storage instance, you need to connect to Managed Storage. Materializing the join with source tables will result in better performance. Joins in Managed Storage will create a new master table containing all the information from the original connections.

To create a new connection to your Managed Storage instance
  1. In the Data sources library click the + icon to add a new connection.
  2. Click the Managed Storage icon ().
  3. Enter the connection name, then select an instance and database.

  4. Click Select to select a table. You can select a single table from the Single Table tab.
    Note: If you would like to select multiple tables, you must use the Custom SQL or SQL Designer options (see Selecting multiple tables from a database connection).

  5. Click the Next button to edit your dataset schema.
  6. Leave the storage as None, and you will have access to the Managed Storage tables and joins.

 

Using an alternative client to connect to your Managed Storage instance

You also have the option to access your Managed Storage isntance independently of the BimeUI.

To access your Managed Storage instance without the BIME UI
  1. Navigate to Admin > Manage storage.
  2. Select your Managed Storage instance.
  3. Click Show Database Access.

  4. A window will appear with information on the database properties. You will need a compatible postgreSQL client to access your Managed Storage instance.
  5. Click Okay when you are finished viewing the credentials.
Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk