Loading Phase LKM Overview of the SOA XREF KM Process
30.3.2 Setting up the Project
Import the following KMs into your project, if they are not already in your project: ■ IKM SQL Control Append SOA XREF ■ LKM SQL to SQL SOA XREF or LKM MSSQL to SQL SOA XREF if using Microsoft SQL Server30.3.3 Designing an Interface with the Cross-References KMs
To create an integration interface, which both loads a target table from several source tables and handles cross references between one of the sources and the target, run the following steps: 1. Create an interface with the source and target datastores which will have the cross references. 2. Create joins, filters and mappings as usual. Mapping the Common ID : If you want to map in a target column the Common ID generated for the cross reference table, check the UD1 flag for this column and enter a dummy mapping. For example a constant value such as’X’. 3. In the Flow tab of the interface, select the source set containing the source table to cross reference, and select the LKM SQL to SQL SOA XREF or LKM MSSQL to SQL SOA XREF if the source data store is in Microsoft SQL Server. 4. Specify the KM options as follows: ■ Specify in SRC_PK_EXPRESSION the expression representing the Source Primary Key value that you want to store in the XREF table. If the source table has just one column defined as a key, enter the column name for example SEQ_NO. If the source key has multiple columns, specify the expression to use for deriving the key value. For example, if there are two key columns SEQ_NO and DOC_DATE in the table and you want to store the concatenated value of those columns as your source value in the XREF table enter SEQ_NO || DOC_ DATE. This option is mandatory. ■ Optionally set the SRC_UPDATE_DELETE_ACTION to impact the source table, as described in Section 30.1.3.3, UpdatingDeleting Processed Records LKM5. Select your staging area in the Flow tab of the interface and select the IKM SQL
Control Append SOA XREF . 6. Specify the KM options as follows: ■ XREF_DATA_STRUCTURE: Enter New to use the new XREF_DATA Table structure. Otherwise enter Legacy to use legacy XREF_DATA Table. Default is New. Configure the options depending on the table structure you are using, as specified in Section 30.1.1.3, Handling Cross Reference Table Structures 30-8 Oracle® Fusion Middleware Connectivity and Knowledge Modules Guide for Oracle Data Integrator ■ XREF_SYS_GUID_EXPRESSION: Enter the expression to be used to computing the Common ID. This expression can be for example: – a database sequence SEQUENCE_NAME.NEXTVAL – a function returning a global unique Id SYS_GUID for Oracle and NewID for SQL Server ■ XREF_ROWNUMBER_EXPRESSION: This is the value that is pushed into the Row Number column. Use the default value of GUID unless you have the need to change it to a sequence. ■ FLOW_CONTROL: Set to YES in order to be able to use the CKM Oracle.30.4 Knowledge Module Options Reference
This section lists the KM options for the following Knowledge Modules: ■ LKM SQL to SQL SOA XREF ■ LKM MSSQL to SQL SOA XREF ■ IKM SQL Control Append SOA XREF Note: If the target table doesnt have any placeholder for the Common ID and you are for example planning to populate the source identifier in one of the target columns, you must use the standard mapping rules of ODI to indicate which source identifier to populate in which column. If the target column that you want to load with the Common ID is a unique key of the target table, it needs to be mapped. You must put a dummy mapping on that column. At runtime, this dummy mapping will be overwritten with the generated common identifier by the integration knowledge module. Make sure to flag this target column with UD1.Parts
» Oracle Fusion Middleware Online Documentation Library
» Terminology Using This Guide
» Concepts Knowledge Modules Introduction
» System Requirements and Certifications
» Using External Tables Technology Specific Requirements
» Using Oracle Streams Technology Specific Requirements
» Connectivity Requirements Installation and Configuration
» Creating an Oracle Physical Schema
» Setting Up an Integration Project
» Reverse-engineer an Oracle Model
» Setting up Changed Data Capture
» Designing an ETL-Style Interface
» Troubleshooting Oracle Database Errors Common Problems and Solutions
» System Requirements and Certifications Technology Specific Requirements
» Creating a File Physical Schema
» In the Models accordion, right click your File Model and select New Datastore.
» In the editor toolbar, click Reverse-Engineer.The Columns Setup Wizard is
» Click OK when the columns definition is complete. From the File main menu, select Save.
» In the Definition Tab, enter the following fields:
» Go to the Files tab to describe the type of file. Set the fields as follows:
» In the toolbar menu, click Reverse Engineer COBOL CopyBook.
» Click OK. COBOL Copybook reverse-engineering
» Create an ODBC Datasource for the Excel Spreadsheet
» Define the Data Server, Physical and Logical Schema for the Microsoft Excel
» Run the customized reverse-engineering
» Select the Microsoft Excel Driver .xls driver.
» Name the data source: ODI_EXCEL_FILE_REPO and select the file
» In Topology Navigator, add a Microsoft Excel data server with the following
» From the File main menu, select Save.
» Add a physical schema to this data server. Leave the default values in the
» In the Context tab of the physical schema, click Add.
» In the new line, select the context that will be used for reverse engineering and
» In the Reverse-Engineer Tab, set the following parameters:
» In the toolbar menu, click Reverse-Engineer.
» Technology-Specific Requirements Installation and Configuration
» Reverse-engineer a Data Model
» Loading Data from an ANSI SQL-92 Compliant Technology
» Loading Data to an ANSI SQL-92 Compliant Technology
» Integrating Data in an ANSI SQL-92 Compliant Technology
» System Requirements Installation and Configuration
» Technologic Specific Requirements Installation and Configuration
» Creating a Physical Schema for XML
» Reverse-Engineering an XML Model
» Synchronizing XML File and Schema
» Loading Data from an XML Schema
» Loading Data to an XML Schema
» Detect the Errors Coming from XML Common Errors
» Creating a Complex File Physical Schema
» Designing an Interface Oracle Fusion Middleware Online Documentation Library
» Using the BULK INSERT Command
» Using Linked Servers Technology Specific Requirements
» Creating a Microsoft SQL Server Physical Schema
» Create a Microsoft SQL Server Model
» Reverse-engineer a Microsoft SQL Server Model
» Loading Data from Microsoft SQL Server
» Integrating Data in Microsoft SQL Server
» Creating a Microsoft Excel Data Server
» Creating a Microsoft Excel Physical Schema
» Setting up Data Quality Setting Up an Integration Project
» Create a Microsoft Excel Model
» Reverse-engineer a Microsoft Excel Model
» Loading Data from Microsoft Excel
» Loading Data to Microsoft Excel
» Decoding Error Messages Common Problems and Solutions
» Specific Requirements Oracle Fusion Middleware Online Documentation Library
» Creating a Netezza Physical Schema
» Reverse-engineer a Netezza Model
» Loading Data from Netezza Loading Data to Netezza
» Creating a Teradata Physical Schema
» Reverse-engineer a Teradata Model
» Loading Data from Teradata Loading Data to Teradata
» Integrating Data in Teradata
» Primary Indexes and Statistics
» Support for Teradata Utilities Support for Named Pipes Optimized Management of Temporary Tables
» Creating a Hypersonic SQL Data Server
» Creating a Hypersonic SQL Physical Schema
» Setting up Changed Data Capture Setting up Data Quality Designing an Interface
» Introduction Oracle Fusion Middleware Online Documentation Library
» Concepts Knowledge Modules Oracle Fusion Middleware Online Documentation Library
» Creating a DB2400 Physical Schema
» Reverse-engineer an IBM DB2400 Model
» Setting up Trigger-Based CDC
» CDCRTVJRN Program Details Setting up Log-Based CDC
» Using the CDC with the Native Journals
» Problems While Reading Journals
» Loading Data from IBM DB2 for iSeries
» Loading Data to IBM DB2 for iSeries
» Integrating Data in IBM DB2 for iSeries
» Installing the Run-Time Agent on iSeries
» Using Client Access Alternative Connectivity Methods for iSeries
» Change the driver and URL to your AS400 server with the following information:
» Set the following java properties for the java machine the run-time agent deployed
» Troubleshooting Error messages Troubleshooting
» Connection Errors Common Problems and Solutions
» Integrating Data in Oracle BI
» Extracts the OBIEE Metadata from a OBIEE Instance
» Using the Lineage Lineage Lifecycle
» Installation Overview Installing the Lineage in an OBIEE Server
» Requirements Installing the Lineage in an OBIEE Server
» Post-Installation Tasks Installing the Lineage in an OBIEE Server
» Exporting the OBIEE Repository Documentation to a Text File
» Exporting the OBIEE Web Catalog Report to a Text File
» Refreshing the OBIEE Lineage From Existing Exports
» Configuring the Scripts Automating the Lineage Tasks
» Automating Lineage Deployment Automating Lineage Refresh
» Viewing Execution Statistics Viewing and Filtering Lineage Data
» Using the Dashboard Using the Lineage in OBIEE Dashboards
» Using Lineage and Hierarchy Using Contextual Lineage
» Reverse-engineer an Essbase Model
» Loading Metadata Designing an Interface
» Loading Data Designing an Interface
» Data Extraction Methods for Essbase
» Extracting Essbase Data Extracting Data
» Extracting Members from Metadata
» Creating an Hyperion Financial Management Data Server
» Creating an Hyperion Financial Management Physical Schema
» Create an Financial Management Model
» Reverse-Engineer an Financial Management Model
» Extracting Financial Management Data
» Extracting Members from Member Lists
» Data Store Tables Oracle Fusion Middleware Online Documentation Library
» Creating an Hyperion Planning Data Server
» Creating an Hyperion Planning Physical Schema
» Reverse-engineer a Planning Model
» Log on to Planning Web. Select Administration Data Load Administration.
» Accounts Datastore Tables and Data Load Columns
» Employee Datastore Tables and Data Load Columns
» Entities Datastore Tables and Data Load Columns
» User-Defined Dimensions Datastore Tables and Data Load Columns
» Attribute Dimensions Datastore Tables and Data Load Columns
» JMS Message Structure Concepts
» Creating a JMS Physical Schema
» Create a JMS Model Defining the JMS Datastores
» Loading Data from a JMS Source Integrating Data in a JMS Target
» Declaring JMS Properties Using JMS Properties
» Using Property Values as Source Data
» Setting Properties when Sending a Message
» Creating a JMS XML Physical Schema
» Reverse-Engineering a JMS XML Model
» Loading Data from a JMS XML Source Integrating Data in a JMS XML Target
» Creating a Physical Schema for LDAP
» Reverse-Engineering an LDAP Model
» Loading Data from an LDAP Directory
» Loading Data to an LDAP Directory
» Integrating Data in an LDAP Directory
» Setting Up an Integration Project Troubleshooting
» Creating a TimesTen Physical Schema
» Reverse-engineer a TimesTen Model
» Setting Up an Integration Project Setting up Data Quality
» Integrating Data in TimesTen
» Create an Attunity Stream Model Reverse-engineer an Attunity Stream Model
» Setting Up an Integration Project Designing an Interface Using the LKM Attunity to SQL
» Overview of the GoldeGate CDC Process
» Create the Staging Physical Schema
» Define the Source Data Server
» Create the Source Physical Schema
» Create the Replicated Tables
» Set Up an Integration Project
» Configure CDC for the Replicated Tables
» Configure and Start Oracle GoldenGate Processes
» Design Interfaces Using Replicated Data
» Initial Load Method Advanced Configuration
» Tuning Replication Performances Advanced Configuration
» One Source Multiple Staging Configuration
» Cross Reference Table Structures
» Loading Phase LKM Overview of the SOA XREF KM Process
» Defining the Topology Working with XREF using the SOA Cross References KMs
Show more