Skip to Content

Use Smart Data Integration to Virtualise Data from On-Premise to the Cloud

Virtualize data from SAP HANA on-premise to SAP HANA Cloud, SAP HANA database using Smart Data Integration (SDI) and the Data Provisioning Agent.
You will learn
  • How to set up and configure the Data Provisioning Agent
  • How to create a remote source to an SAP HANA Cloud, SAP HANA database instance in your SAP HANA on-premise system using Smart Data Integration
  • How to then virtualise data from an SAP HANA on-premise database to SAP HANA Cloud, SAP HANA database
chriskollhedChristopher KollhedMarch 21, 2022
Created by
VijayKrishnanSR
August 15, 2021
Contributors
VijayKrishnanSR
chriskollhed

Prerequisites

  • A running instance of SAP HANA Cloud, SAP HANA database.
  • An SAP HANA on-premise database that contains data.
  • The SAP HANA on-premise database should be running on SAP HANA platform edition. Alternatively, you can download and install the latest SAP HANA express edition either as binary in Linux or as VM (Virtual Machine) locally or in any cloud provider like Amazon Web Services, Microsoft Azure or Google Cloud Platform.
  • An instance of the SAP HANA Database Explorer or SAP HANA Studio connected to the SAP HANA on-premise database.
  • Lastly, you need to install the Data Provisioning Agent, which you can download here.

If you want to virtualise and replicate data from an SAP HANA on-premise database to SAP HANA Cloud, SAP HANA database, Smart Data Integration (SDI) is the best method to use.

Infographic SDI

SDI may also be used to virtualise and replicate data in the other direction, from SAP HANA Cloud, SAP HANA database to SAP HANA on-premise, which offers more advanced replication capabilities but is more complicated to deploy. Therefore, for virtualising data from SAP HANA Cloud, SAP HANA database to SAP HANA on-premise, SDA is the preferred method. To learn more about using SDA you can check out the previous tutorial in this group if you have not done so yet.

SDI is an ETL (Extract Transform and Load) tool and it comes as part of SAP HANA Cloud, SAP HANA database. This means that you can easily integrate various kinds of source systems into SAP HANA Cloud, SAP HANA database without installing an ETL application. You can also develop ETL jobs just like you develop tables and views.

In this tutorial, you will learn step by step how to virtualise and replicate data from SAP HANA on-premise to SAP HANA Cloud, SAP HANA database by creating an SDI connection and setting up the Data Provisioning Agent.

  • Step 1

    Before you can virtualise data from SAP HANA on-premise to an SAP HANA Cloud, SAP HANA database, you need to set up the Data Provisioning Agent (DPA), which will allow data to be securely transmitted from the on-premise system.

    You have two options to complete this step:

    1. Follow a video tutorial

    2. Follow the written instructions

    Select the option you prefer by clicking on “Video” or “Written instructions” below this step title.

    Tab Option

    Watch this video to see all the steps needed to install and configure the Data Provisioning Agent using the Command Line Interface:

    Now that the DP Agent is configured, you can virtualise and replicate data from the on-premise database to the SAP HANA Cloud, SAP HANA database instance. You can either virtualise or replicate data using this connection. The next steps will describe how to create virtual objects.

    Log in to complete tutorial
  • Step 2
    1. In the SAP HANA Database Explorer connected to your SAP HANA Cloud, SAP HANA database instance, right-click on Remote Sources in the Catalog of your database and select Add Remote Source.

    2. A new dialogue will open to create the remote source. Name the remote source, we recommend naming it LOCAL.

    3. For the Adapter Name, select HanaAdapter, which is the adapter you have registered in the DP Agent of your SAP HANA on-premise previously.

    4. In the field Host, insert hxehost, which is the local host name of your on-premise system.

    5. Type in the Port Number. For the SAP HANA Express Edition, the default Port Number is 39015.

      DBX Remote Source 1
    6. Scroll down to the section Connection Security and enable the SSL connection.

    7. Leave the other settings in this section as is. Normally, you would want to enable Validate Server Certificate, but for the purposes of this tutorial, you can disable it.

    8. In the section Credentials, change the credentials mode to Technical User, and enter the username and password for the user, which you have previously set up.

    9. Click on Create to finish this step.

      DBX Remote Source 2
    10. Now, when you click on Remote Sources in your catalog, the remote source should appear at the bottom left panel.

    Log in to complete tutorial
  • Step 3
    1. Double-click on the remote source to load it.

      DBX Remote Source 3
    2. In the dialogue that opens, you can see all the metadata of the remote source based on the authorization of the user you specified.

    3. Expand the node on your schema object and do the same for Tables.

    4. There, check the box in the row of the table you want to virtualise data from and then click Create Virtual Object(s) in the top right corner.

      DBX Remote Source Test Table
    5. A new dialogue will open asking for the Object Name and Schema. To indicate the virtual table, we recommend you prefix the object name with VT_ (VT_SOURCE_TABLE).

    6. Select your schema to have the virtual table created in it.

    7. Click Create.

    8. In the Catalog of your SAP HANA Cloud, SAP HANA database, click on Tables. In the bottom left corner, you can see that the virtual table has been successfully created in your schema.

    9. Double-click on the table to show the columns in the table.

    10. Click on Open Data in the top right corner, and your data will be queried from the remote source you have connected to your SAP HANA Cloud, SAP HANA database instance. This data is now successfully virtualised in your SAP HANA Cloud, SAP HANA database instance without needing extra storage space.

      DBX Remote Source VT Test Table

    To continue to learn more about SDI connections, you can take a look at the documentation on what components to install, deploy and configure SDI here.

    Well done!

    You have completed the third tutorial of this group! Now, you know how to set up an SDI connection and create a virtual table using this connection.

    In the next tutorial you can get to know a different way to set up a connection between SAP HANA on-premise and SAP HANA Cloud, SAP HANA database: Using the cloud connector.

    Log in to complete tutorial
  • Step 4

    What is the default port number for SAP HANA on-premise that you need in order to establish a remote source connection?

    Log in to complete tutorial
Back to top