Building a Sound ETL Infrastructure
LoganBritton has built a very successful Center of Excellence around Informatica’s PowerCenter and it’s related products. The Center of Excellence provides our clients with a high level of assurance in the quality and integrity of their PowerCenter environments and development efforts.
The Center of Excellence encapsulates the combined experience that we have gained in delivering hundreds of Data Warehouse solutions over the past years. This engagement also focuses on building expertise within your organization through the implementation of ‘Best Practices’, development and deployment methodologies. The Center of Excellence is delivered in modules according to your specific requirements. Each module also provides complete system documentation of your PowerCenter environment.
Center of Excellence Modules
ETL Architecture and Configuration
Sever optimization is critical to overall system performance. Each server in your environment is closely inspected for optimum installation parameters. Recommendations are provided for every aspect of your PowerCenter installation. This includes the PowerCenter and Repository servers, and Database servers.
Unix Server Environment
Consultants specializing in Unix processor configuration examine your Unix systems and provide recommendations for hardware and operating system configuration and specific ideas for the Unix file system directory structures.
A well architected PowerCenter server environment guarantees flexible deployment and migration paths. The structure of the PowerCenter repository is carefully configured to your requirements as well as best practices. We provide Unix scripts to automatically configure the PowerCenter process accounts and other administrative tasks.
Implementation of PowerCenter repository schema strategies. We will work with the DBA to properly configure table spaces, implement correct and flexible naming conventions, create environment variables, and create security profiles.
PowerCenter Installation and Security
There are many decisions that must be made governing the installation of Informatica PowerCenter. Our consultants will work directly with your ETL Administrators in hands-on fashion to properly install, configure and document every aspect of your ETL installation for optimum performance.
We will work with your systems administrator to implement a detailed security plan for the entire ETL environment. A carefully planned and executed security model is absolutely required for a successful and flexible PowerCenter implementation. This section of the COE guides administrators in several security components for PowerCenter. Including repository security, subject-area security, host security, and database security. This includes repository folder configuration strategy and permissions, setting up profiles and defining group security.
Development Standards and Best Practices
When designing mappings and workflows, developers are often overwhelmed with the abundance of available transformations objects, tools and options that PowerCenter offers. Consequently development tasks can take on a wide variety of methods leading to design inconsistency within projects, among developers, and development groups.
We provide actual mapping templates that can be copied and adapted to you environment. These mapping templates are fully documented and follow proven methods for organizing logical tasks within a mapping. These templates also provide error management and facilitate the collection of data-load statistics.
Administrators will work with our consultant to configure and apply naming standards to the PowerCenter repository structure including folders and users.
Various aspects of server management are reviewed including server monitoring methods, step-by-step start/stop procedures, XML export procedures, and repository RDBMS and binary backup procedures.
We will work with your administrators to configure the various environments for development, integration, QA and production, and fully document the detailed step-by-step process of migrating your ETL code and managing shared objects. In planning for new projects, a proactive approach instructs administrators how to enforce these guidelines and how to participate in the overall project planning effort.
There are many factors to consider when faced with the task of tuning PowerCenter processes and processing environment. A good understanding of both relational database concepts and server-side process performance is important. The process of tuning is not unlike the development process or the testing process in that it is iterative and should follow a structured approach. This engagement will cover administrative tasks that will help fine tune the environment for optimal performance. It also details dozens performance enhancing development techniques that should be employed as part of your own development standards.
The best practices surrounding the project lifecycle will be addressed differently for each client as we incorporate best practices into your overall project methodology. Organizational structures are provided and are used as an initial guide for projects getting started. This methodology will be an iterative process and will undergo regular review and modifications. This document includes functional roles for a typical ETL development effort. It also gives a step-by-step approach to planning, development, testing and migration strategies investigating every step required for the successful completion of a project. This review will help your team formulate a project lifecycle methodology tailored to your requirements based on documented best practices.
The Following are optional modules which can be customized to your requirements