SAP Hana EIM (SDI/SDQ) setup

  • A+
所属分类:日志

In my documentation I’ll explain how to setup and configure SAP Hana SP10 EIM (SDI/SDQ) with Sybase IQ database and ERP on Hana database schema source system to replicated data for realtime data replication.

I will show in detail step and configuration point to achieve it.

In order execution

  • Create Sybase IQ database
  • Enable DP server for SDI
  • Enable Script server for SDQ
  • Install SDQ cleanse and geocode directory
  • Install DU HANA_IM_DP (Data provisioning)
  • Install and Register Data Provisioning Agent
  • Create remote source
  • Data replication and monitoring

Configuration required on SP9

The xsengine needs to be turn to true (if not done)

The statistic server needs to be turn to true (if not done)

The DU HANA_IM_ESS needs to be imported

Guide used

SAP Hana EIM Administration Guide SP10
SAP Hana EIM Configuration guide SP10

Note used

179583 – SAP HANA Enterprise Information Management SPS 10 Central Release Note

Link used

http://help.sap.com/hana_platform

Overview Architecture

SAP Hana EIM (SDI/SDQ) setup

Starting Hana SP9 the new features call SDI (Smart Data Integration) and SDQ (Smart Data Quality) has been introduce.

The purpose of these new features is to leverage an integrated ETL mechanism directly into Hana over SDA

To make it simple:

  • Smart Data Integration provide data replication and transformation services
  • Smart Data Quality provide an advanced transformation to support data quality functionality

Create Sybase IQ database

In order to have a dedicated database to work with I’ll create my own database into IQ server:

From the SCC go to administration and proceed as follow
SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

SCC agent password: the password define during the IQ server installation
Utility server password: auto fill do not change it
IQ server port: use an unused port, I already have 2 db running so I pic the next number
Database path: .db
IQ main dbspace path: .iq
SAP Hana EIM (SDI/SDQ) setup

Check mark ok

SAP Hana EIM (SDI/SDQ) setup

Execute
SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

My database now available I’ll create 3 simple tables for this test, I’ll use interactive SQL
SAP Hana EIM (SDI/SDQ) setup

With the following syntax

SAP Hana EIM (SDI/SDQ) setup

 

Enable Data Provisioning server for SDI

When Hana is installed, by default the DP server is note activate, in order to have the ability to use SDI it needs to be enabled. The value needs to be change to 1
SAP Hana EIM (SDI/SDQ) setup

Enable Script server for SDQ

To take advantage of the SDQ functionality the script server value needs to be change to 1
SAP Hana EIM (SDI/SDQ) setup

Install SDQ cleanse and geocode directory

The Cleanse and Geocode nodes rely on reference data found in directories where we download and deploy to the SAP HANA server.

To download those directories go on the SMP and select the one you need
You can download several directories depending on what you are licensed for.
SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

Once downloaded decompress it at the following location:
/usr/sap/<SID/SYS/global/hdb/IM/reference_data
SAP Hana EIM (SDI/SDQ) setup

Install delivery unit HANA_IM_DP (Data Provisioning)

The specific delivery unit needs to be downloading and upload from the studio or the web interface, this will provide you:

  • The monitoring functionality
  • The proxy application to provide a way to communicate with the DPA (cloud scenario)
  • The admin application for DPA configuration (cloud scenario)

SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

Upload from the studio

SAP Hana EIM (SDI/SDQ) setup

Once done assign the monitoring role and add the view from the cockpit

SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

Install and register Data Provisioning Agent

The Data Provisioning Agent is used to make the bridge between Hana and source system where the driver can’t be run from Hana (DPS) over a pre-build adapter, in some case it allow Hana to write back data into source system.
Use the DPA allow live replication.

The agent is part of the package download earlier

SAP Hana EIM (SDI/SDQ) setup

Run and installed it as needed

SAP Hana EIM (SDI/SDQ) setup

Once installed open the cockpit agent

SAP Hana EIM (SDI/SDQ) setup

Make sure the agent is started, connect and register it to Hana with the necessary adapter

SAP Hana EIM (SDI/SDQ) setup

Let create the source system in Hana now.

Create remote source

Now that my IQ db is in place and my Hana adapter is installed I will create my source system in SDA where I need to get the data from.

Let start with my IQ database, before create the connection in SDA install and set the lib on Hana server. To create my connection I will use the following statement:

create remote source I841035 adapter iqodbc configuration‘Driver=libdbodbc16_r.so;ServerName=HANAIQ03;CommLinks=tcpip(host=usphlvm1789:1113)’ with CREDENTIALTYPE ‘PASSWORD’ USING ‘user=I841035;password=xxxxxxx’;

Once done refresh the provisioning

SAP Hana EIM (SDI/SDQ) setup

And create the ERP on Hana schema source system by selecting the adapter added earlier

SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

 

And check the remote subscription form the cockpit

SAP Hana EIM (SDI/SDQ) setup

Data replication and monitoring

My remote source connect I will now define which table I want to replicate and how I want it to look like once loaded.

Make sure your user schema is part of _SYS_REPO with “CREATE ANY” granted.

From the development workbench go to “Editor” and select your package and create a new replication task

SAP Hana EIM (SDI/SDQ) setup

SAP Hana EIM (SDI/SDQ) setup

And fill the necessary information, target schema, virtual table schema, table prefix and so on.

From detail perspective several option are possible

Add/remove/edit table

SAP Hana EIM (SDI/SDQ) setup

Set filter

Define the load behavior in order to have a certain level of detail on the change that encore on the table.

SAP Hana EIM (SDI/SDQ) setup

 

Partition data for better performance

SAP Hana EIM (SDI/SDQ) setup

Once you preference are set, save the configuration to activate it.

SAP Hana EIM (SDI/SDQ) setup

From the monitoring side check the task log

SAP Hana EIM (SDI/SDQ) setup

Once activate go on the catalog view and check if the procedure is crated as well as the virtual tables/views and table, and invoke the procedure to start the replication

SAP Hana EIM (SDI/SDQ) setup

I did repeat the same procedure for my ERP on Hana schema, once the procedure is invoked on the remote Hana db we can see additional table created and trigger for the relevant table replicated

SAP Hana EIM (SDI/SDQ) setup

From a monitoring side, I did add 4 additional user and we can see the apply count

SAP Hana EIM (SDI/SDQ) setup

The replication is now operational, in my next document I’ll explain how to configure several datasource and construct one realtime report with the input of different table.

Williams.

发表评论

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

目前评论:1   其中:访客  1   博主  0

    • ag 9

      From: https://blogs.sap.com/2015/07/15/sap-hana-eim-sdisdq-setup/