Oracle Data Integrator (ODI)/Sunopsis – Architecture & Installation overview

Oracle Data Integrator (ODI) is  – product from Sunopsis acquired by Oracle in 2006 and now part of Oracle Fusion Middleware Family.
1. ODI is built on E-LT(Extract , Load and Transform) Architecture.
2. Oracle Data Integrator 10g (10.1.3.5.0) suite includes three products
a) Oracle Data Integrator
b) Oracle Data Quality and
c)  Oracle Data Profiling
3. ODI uses Database as ETL (Extract, Transform & Load) engine thus eliminates requirement of proprietary ELT engine
4. Oracle Data Integrator Enterprise Edition (ODIEE) is combination of ODI (Oracle Data Integrator) and OWB (Oracle Warehouse Builder)

Oracle Data Integrator Architecture
 
Oracle Data Integrator (ODI) consists of following products

1. Repository – is relational Databases to store objects used/configured or developed by ODI. There are two type of Repository Master Repository (one and only one) and Work Repository (one or more)
a) Master Repository – There is only one Master repository and used to store security information, topology information (servers..) and versions of the Objects. All Modules (designer, operator, topology & security) have access to master repository.
b) Work Repository– Work related objects (project objects) are stored in Work Repository like Models, Projects and run-time information. There could be multiple work repository per installation and all linked to single master repository. Work Repository is accessed by Designer/Operator Module and run time agent.

2. Graphical Modules
a) Designer (designer.sh|bat)– All project development takes place in this module and this is the place where database and application metadata are imported and defined.
b) Operator (operator.sh|bat) – usually to monitor production ODI instance and shows execution logs, rows processed and execution statistics
c) Topology Manager (topology.sh|bat)– To register servers, schema and agents in master repository.
d) Security Manager (security.sh|bat) – To manage user profiles and their access privileges.

3. Runtime Component / Scheduler Agent – scheduler agent coordinates execution of scenarios. Scheduler Agent retrieves code from execution repository and then requests database server, scripting engine or operating system server to execute that code.

4. Metadata Navigator (MN)– is Web (JSP/Servlet) application (available as oracledimn.war) that enables access to repository through Web Interface (Web Browser). MetaData Navigator (MN) requires Application Server and you deploy MN application oracledimn.war on pre-installed application server (Tom Cat, OAS, WebLogic). This is optional component.

.
ODI Server Installation

1. Download ODI 10.1.3.4 software from here

2.
Unzip software

3.
Start Installation using $unizp_location/ setup/ <your_os>/ Disk1/ install/ runInstaller or

$unzip_location/ setup/ <your_os>/ setup.sh for Unix or setup.exe for windows

4. Select a product to install, options are
  a) Oracle Data Integrator, Oracle Data Profiling, Oracle Data Quality
  b) Oracle Data Integrator
  c) Oracle Data Profiling
  d) Oracle Data Quality for Oracle Data Integrator

5. Select Installation Type , options are (depending on above selection)
  a) Complete – covers client and server components for ODI Suite
  b) Client – User Interfaces for ODI suite
  c) Server – run time agent for ODI, Metabase and Servers for Data Profiling and Data Quality

6. Specify Oracle Home – location to install ODI software binaries (code set)

7. Provide repository & Schedule Port and UserName password to administer Repository – This step is applicable only for option b), c) or d) from 4) Select a product to install

8. Run root.sh from root account (on Unix environment)

.
ODI Metadata Navigator Installation

Metadata Navigator (MN) is Web (JSP/Servlet) application (available as oracledimn.war) that enables access to repository through Web Interface (Web Browser). MetaData Navigator (MN) requires Application Server and you deploy MN application oracledimn.war on pre-installed application server (Tom Cat, OAS, WebLogic).

1. Install Application Server – Tomcat, OAS, WebLogic, IBM Websphere ….
2. Deploy oracledimn.war($SOFTWARE/ setup/ Manual/ oracledimn.war) to application server
3. Install JDBC Driver
4. Configure Metadata Navigator Connection to connect to your ODI repository (snps_login_work.xml)

.

What next after installation ?

1.Create mater and work repository using $ORACLE_HOME/oracledi/bin/repcreate.sh
and then access them using Topology Manager or Designer using $ORACLE_HOME/oracledi/bin/  topology.sh & designer.sh resp.

How to create Master & Work Repository coming soon !!

Refereces/Documentation

About the Author Masroof Ahmad

Leave a Comment:

31 comments
SHAKIR says October 5, 2009

hi
i am begginer
i am put in the project where odi is used to integrate the data

i have no idea how to use this tool

i have just downloaded the software thats it

can u tell me how to use the tool and how to integrate data

kindly let me with understable examples pls

thanks

Reply
Siddhart says October 16, 2009

Hi Atul,
Thanks for the useful information.
I am doing a proof of Concept(POC) on ODI for our organisation.
I have to validate ODI(data profiling and data quality also) in our LAB environment.

Could you please let me know all the hardware i have to request for installation.

1) Graphical modules, i will be installing on my system.
2) For repository,i will request my DBA for DB space.
3) scheduler Agent — ? what i need .
4) Metadata navigator/lightweight Des — ?
5) data profiling and data quality —- ?

Please throw some light
Thanks
Siddhart.

Reply
Braga, Mauricio says February 9, 2010

Hi Atul,

An initial question:
Oracle Data Integrator 10g (10.1.3.5.0) is incorpored by Fusion Middleware or is there a new ODI version called 11g (what number)?

The ODI has the Operator tool to handle its environment incidents (error handling), and we actually use Operator for ODI implementations. However, considering that ODI is not a component of SOA Suite 11g, there is a specific question regarding its Architecture of Operation:

Is it possible monitor and manage ODI E-TL instances through Oracle Enterprise Manager 11g Fusion Middleware Control (FMC)?

If yes, do you have any material about?

Thanks,
Mauricio.

Reply
Atul Kumar says February 9, 2010

@ Mauricio,
In theory ODI is part of FMW (Fusion Middleware) but it ois still
Standalone product. Hopefully with ODI 11g (not yet out) we should see
and next version of FMW 11g R2 (not yet out) We should see more tight integration.

About monitoring using EM grid control or FMC – I don’t think it is possible to monitor
However it is better to raise support call with oracle support EM grid control or FMW control team

Reply
Sateesh says February 10, 2010

Hi Atul,

i am installing odi on vista, after giving the master repository details i am getting error
“java.io.FileNotFoundException: .\snps_login_work.xml(Access denied)”.

Pls help me in resolving this issue.

thanks,
Sateesh.

Reply
Atul Kumar says February 15, 2010

@ Sateesh,

Do you see this file in $ODI_HOME\oracledi\bin and if yes do you have write permission

Reply
» Upgrade Oracle Data Integrator 10.1.3.5 to 10.1.3.6 (9377717) Online Apps DBA: One Stop Shop for Apps DBA’s says March 24, 2010

[…] Upgrade Oracle Data Integrator 10.1.3.5 to 10.1.3.6 (9377717) Posted in March 24th, 2010 byAtul Kumar in odi, odq  Print This Post If you are new to ODI (Oracle Data Integrator) then first look at ODI Architecture and Installation here […]

Reply
swathi says April 5, 2010

Particularly, I didnt understand KMs. How can we create steps in DETAIL tab in creating a KM? and need what is meant by KM in simple terms.

Reply
Mani says July 8, 2010

Hi Atul,

Do we need root for installing ODI on Linux or any normal account would do? what groups should ODI user belong to ?

Reply
Atul Kumar says July 8, 2010

@ Mani,
You would install ODI using non-root account like oracle database but in the end you will have to run root.sh from root account

Reply
niall says August 18, 2010

hi Atul

Do u know when ODI 11 is coming out? or is it already out?

Thanks

Reply
Rajendran says August 19, 2010

ODI 11g is released and waiting for the free download as status says ‘comming soon’

Reply
sugato says August 24, 2010

Hi,

Is there any difference between Oracle Data Integrator 10.1.3.5 and ODIEE? Is ODIEE a separate software?

Thanks

Reply
raghuram says March 15, 2011

hi,
i have install odi 11g software in windows as client and unix platform as server.In odi 11g how can i know which is client and which is server .

Reply
lesly_natasha@hotmail.com says April 20, 2011

./root.sh

WARNING: NIS Detected.
Please ensure that the services entry uses files,
otherwise this installation of the Metabase may not
function correctly.
ERROR: This port number is in use.
ERROR: Invalid port id.
while executing
“if { [catch {

#—————————-
# Handle command-line options

set optlist [list {
nochecks “Don’t do checks”} {
version …”
(file “setup.tcl” line 1027)

🙁

Reply
Atul Kumar says April 21, 2011

@ lesly_natasha@hotmail.com

Which version of ODI you are installing ?

Your issue is that port is in USE.

To find port it is trying to use, open root.sh and see if port is mentioned in this file . If not open any other sh filw which root.sh is invoking

Reply
lesly_natasha@hotmail.com says April 21, 2011

Works!

root.sh

#!/bin/sh
/usr/lib/oracle/ODI/install/Metabase_Manager/unix/Linux/setup -root -user yair -home /home/yair -instdir /usr/lib/oracle/ODI/oracledq/metabase_server -clientPort 7610 -schedPort 7611

./root.sh

Writing installation log to: /usr/lib/oracle/ODI/oracledq/metabase_server/metabase/etc/setup.log
calculating service labels…
installing services…
restarting inetd…
Root installation finished.

thank you very much friend!

Reply
Srinivas says June 8, 2011

Hi all,

We are doing POC on ODI

The requirement like this : Need to connect ODI with Siebel.

Earl response please

Reg
Srinivas.N

Reply
Atul Kumar says June 8, 2011

@ Srinivas,

Check this for Oracle Siebel CRM Knowledge Modules in Oracle Data Integrator http://download.oracle.com/docs/cd/E17904_01/doc.1111/e17466/oracle_siebel.htm#BEICCFEB

Reply
Srinivas says June 8, 2011

can you share me the how to integrate ODI with siebel EIM

Early response appreciated.

Reg
Srinivas.n
snarava@gmail.com

Reply
Atul Kumar says June 8, 2011

@ Srinivas,
I don;t think you looked at link given by me in previous update.

Is your integration requirement not covered in

http://download.oracle.com/docs/cd/E17904_01/doc.1111/e17466/oracle_siebel.htm#sthref32 ?

Reply
Srinivas N says July 1, 2011

Hi Atul,

Thanks for replying.. I have seen the document.it’s a good one.

I have Installed ODI 11 version i.e. latest one. in Red Hat Linux

For this i have installed the below softwares

—Oracle Database 11.2.0.1.0
—RCU
—ODI 11g
—Weblogic application server 10.3.5.0.
—Linux OS version : Red Hat Enterprise Linux Server release 5.5

The above software are perfectly installed and all are up and running.

Queries :

1 . Is it Data quality and Data profile are mandatory to install in linux ?

As per my knowledge these two s/w’s are available for the windows OS only.

Note : I am very new to the O D I.

2. Topology.sh file was not created in the oracle home directory in which ODI was installed.

How to we create the above file in Oracle home directory if it was not created.

3. Could you share me some ideas about how to integrate the ODI with EIM.

Could you please clarify my doubts and get back to me soon.

Regards
Srinivas

Reply
» Oracle Data Integrator (ODI) 11g : Architecture & Installation Overview Online Apps DBA: One Stop Shop for Apps DBA’s says August 18, 2011

[…] Oracle Data Integrator (ODI) is an E-LT (Extract – Load & Transform) based data transformation and integration tool. This post covers overview (and architecture) of ODI 11g, for ODI 10g (earlier Sunopsis) click here […]

Reply
Srini says November 10, 2011

Hi

I installed the ODI 10.1.3.5 and applied the patch 10.1.3.6. Lauched the designer and created the connection. The test connection was successful. I clicked OK , the window is not closing. can anyone plz help.

Thanks
Srini

Reply
RAJ says May 31, 2012

Hi Atul – I have read through 4-5 of your articles , need some help and pointers regarding how to install ODI 11g (11.1.1.5.0) on Linux environment. We need High Availability feature as well, so we have a Linux box where Weblogic is installed – which steps should be followed to install ODI on Linux box, what are the options we need to select during installation. Can you please guide me and send me an email.

Thanks

Really appreciate your help.

Regards

Reply
rocky77 says March 3, 2013

I am having trouble while connecting installed Oracle Data Int.

I installed Oracle weblogic 10.3.6 and create domain and Installed ODI and include it with the domain.
I installed Java EE installtion type for ODI.

Installation goes OK.
But later on i try to connect agent from ODI studio to the server. and the test failed.

I also figure out there is no directory with name “agent” inside oracle_common in the server. I am not able to open ODI console also (only admin console ; admin server and odi_server is running).

I think Missing agent directory is the key thing i am not able to connect with server.
I don’t know how come this directory is not inside oracle_common in the server.
Please, anyone tell me the process and suggestion.
I already cross deadline so it’s giving so much stress.

Thank you very much,

Reply
Shivakkumar says December 23, 2013

Hi. Mr. Atul.
Iam basically an Oracle Certified DBA
Having interest in Data Mining / Warehouseing and Data Integration.
Started setting up the Environment for Oracle Data Integrator with the following options.
Operating System: Redhat Linux 5.4 32bit
1. Oracle Database 11gR2 (11.2.0.1)
2. Used RCU to create ODI Master and Work Repositories
3. Installed Oracle WebLogic Server 11g using wls1030_linux32.bin
Created AdminServer. Able the Start and Stop
4. JDK is jdk160_29. located in MW_HOME
5. Installed Oracle ODI 11.1.1.6 32 bit

Issue: $ODI_HOME/oracledi/agent/bin/encode.sh utility fails with the following errors.

infact encode.sh was edited for odiparams.sh
(original content is $ODI_HOME/bin/odiparams.sh)
. “$ODI_HOME”/oracledi/agent/bin/odiparams.sh

$ ./encode.sh oracle1 fails
Exception in thread “Main Thread” java.lang.NoClassDefFoundError: oracle/odi/Encode
Caused by: java.lang.ClassNotFoundException: oracle.odi.Encode
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: oracle.odi.Encode. Program will exit.

Could not understand what was the Issue and what settings i have been missing with.

Grateful if you can help in this regard. This really makes me MAD and struggling for more that 1 week

Thanks in Advance.

Reply
subbu says January 30, 2014

please send me odi interview questions and answers,

with answers

Reply
kesav says January 20, 2015

Hi Atul,

we are planning to set Oracle ResultSetCache for OID. we are using Oracle 11gR2. Can you guide us to how to set this using Console/Unix commands.

Reply
Add Your Reply