Category: Informatica

Where to use Informatica and DataStage

Datastage and Informatica

DataStage is an ETL tool that extracts data, transforms and loads data from source to the target. DataStage facilitates business analysis by providing quality data to help in gaining business intelligence. Informatica is used for Data integration. Informatica offers the capability to connect & fetch data from different heterogeneous sources and processing of data. These are the major differences between Informatica and DataStage, you can select the relevant tool based on the requirement: ● Multiple Partitions: Informatica offers partitioning as dynamic partitioning which defaults a workflow, not at every Stage. It also offers other partitioning choices as well at the workflow level. Whereas, DataStage offers 7 different types of multi-processing partitions. ● User Interface: Informatica offers access to the development and monitoring effort through its 4 GUIs – offered as Informatica PowerDesigner, Repository Manager, WorkflowDesigner, Workflow Manager. Whereas, DataStage caters to development and monitoring its jobs through 3 GUIs – IBM DataStage Designer(for development), Job Sequence Designer(workflow design) and Director(for monitoring). ● Type of Link: To link two components in Informatica, link at the column level and connect each and every column between the two components. While, In DataStage, link at the component level, and then map individual columns. This […]

Read More +

Advantages of Informatica PowerCenter

Infornmatica Powercenter

Informatica PowerCenter has an excellent GUI for administration, ETL design, and other features. It also has access to various data sources such as relational data, mainframe data, third party applications and so on. Informatica PowerCenter adopts and integrates with other vendors for data handling utilities such as Oracle direct path load, Teradata pump and so on. It provides a grid option which is cost effective to meet high processing demand with linear scalability and high availability. DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. We are flexible in working hours and do not need any long-term binding contracts.

Read More +

Benefits of using SQL override in Informatica

Powwercenter

Informatica allows SQL to be executed in the source database and the results can be pulled by the PowerCenter. By using SQL Override in Informatica, you can read only the required columns from the table instead of reading all columns from a table and can remove all unnecessary ports. You can also use customized logic in the SQL override.DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. We are flexible in working hours and do not need any long-term binding contracts.

Read More +

Integration services in Informatica

Informatica Powercenter

PowerCenter integration service in Informatica moves data from sources to targets based on workflow, session and mapping related metadata stored in the repository. The Integration Service can combine data from different platforms and source types. The Integration service also performs certain tasks such as  Managing workflow schedule. Lock and read the workflow. Reading the parameter file. Creating the workflow log. Run workflow tasks and evaluate the conditional links connecting tasks. Start the Data Transformation Manager (DTM) process or processes to run the session. Write historical run information to the repository. Send post-­session email in the event of a DTM failure. DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. We are flexible in working hours and do not need any long-term binding contracts.

Read More +

Overview of Grid processing in Informatica

informatica

When an Informatica PowerCenter domain has multiple nodes, workflows and sessions can be configured to run on the grid. The performance and scalability in Informatica can be increased by running the service on each available node of the grid. The integration service distributes workflow and sessions based on the configuration done on the workflow or the sessions. When it comes to workflow it distributes the Session, Command and predefined Event-Wait tasks within workflows across the nodes in a grid. The integration service in Informatica distributes session threads across nodes in a grid. It is important to note that you must have the server grid option to run workflows and sessions on grid DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. We are flexible in working hours and do not need any long-term binding contracts.

Read More +

Parsing Data Using Data Processor Transformation in Informatica

Parsing in Informatica

The Data Processor transformation in Informatica PowerCenter processes unstructured and semi-structured file formats in a mapping. A mapping uses a Data Processor transformation to change documents from one format to another. The Data Processor transformation processes files of any format in a mapping. When you create a Data Processor transformation, you define components that convert the data. It also has following options Parser – It converts source documents to XML but the input can be in any format such as text, HTML, Word, PDF or HL7 Serializer – It converts an XML file to an output document of any format such as text document, an HTML document or a PDF. Mapper – It converts XML source documents to another XML structure or schema and same XML documents as in an XMap. Transformer – Modification such as adding, removing, converting or changing text can be done for any format and it can be run as a stand-alone component or with other options like Parser, Mapper or Serializer. Streamer – It splits large input documents such as multi-gigabyte into many segments and it also processes documents that have multiple messages or records in them such as HIPAA or EDI files. DataTerrain, with […]

Read More +

Overview of External Loading in Informatica

Informatica

Sessions in Informatica can be configured to use IBM DB2, Oracle, Sybase IQ and Teradata external loaders to load target files into their respective database. Certain rules need to be followed before you begin to run external loaders. Disable Constraints – You disable constraints built into the tables receiving the data before performing the load. Turn off or disable database logging – By increasing the commit intervals and turning off the database logging you can preserve high performance in the database; but to perform database recovery on failed sessions, you must have database logging turned on. Configuring the code pages – All the external database servers must use the same code page as the target flat file code page. The integration services in Informatica create the control files and target flat files using the target flat file code page. Configuring the external loader connection as a resource – If the integration service is configured to run on a grid then configure the external loader connection as a resource on the node where the external loader is available. DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and […]

Read More +

Developing Global and Local repositories in Informatica

informatica

Informatica repository is used to store metadata information which will reside in a relational database. We can develop local and global repositories to share metadata information. Global Repository is the hub of the repository domain which is used to store common objects that multiple developers can use through shortcuts. A global repository cannot be converted to local repository and these objects may include operational or application source definitions, reusable transformations, mapplets and mappings. Informatica local repository is any repository within the domain that is not the global repository and it is used for development. These local repositories can create shortcuts to objects in shared folders in the global repository and can promote local repository to global repository. DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. We are flexible in working hours and do not need any long-term binding contracts.

Read More +

What are Partition Points in Informatica

Informatica

The partition points in Informatica mark the thread boundaries in a pipeline and divide the pipeline into stages. These can be retained or deleted based on the following transformations in the pipeline. ● Source Qualifier and Normalizer Transformation – controls the integration service in Informatica to extract data from source and passes it to the source qualifier and deletion cannot be done for this partition point. ● Rank and Unsorted Aggregator Transformation – ensures that the integration service in Informatica groups rows properly before sending it to the transformation and you can delete the partition points if the pipeline contains only one partition or it passes all rows in a group to a single partition before they enter the transformation. ● Target Instances – controls how the writer passes data to the targets and cannot delete this partition point. ● Multiple Input Group Transformation – ensures that the integration service uses one thread to process each partition at a custom transformation that requires one thread per partition and cannot delete this partition point. DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. […]

Read More +

Factors that affect Grid Recovery in Informatica

Informatica Integration

When an Informatica workflow is run on a grid, service processes and DTM processes run on different nodes and behavior also depends on flowing factors. ● High availability option – Workflows fail over to another node if the node or service shuts down, if availability is not high, a workflow can be manually restarted on another node to recover it. ● Recovery strategy – A recovery strategy can be configured for tasks within the workflow and when the workflow suspends the recovery, behavior depends on the recovery strategy configured for each task. ● Shutdown mode – When an Informatica Integration Service can specify that the service completes, aborts, or stops processes running on the service, the failover and recovery behavior depend on which service process is shut down. ● Running mode – If the workflow runs on the grid, the Informatica Integration Service can recover workflows and tasks on another node. ● Operating mode – If the Informatica Integration Service runs in safe mode, recovery is disabled for sessions and workflows. DataTerrain, with years of experience and reliable experts, is ready to assist. We have served more than 250 customers in the US and over 70 customers worldwide. We are […]

Read More +