• The Four Hundred
  • Subscribe
  • Media Kit
  • Contributors
  • About Us
  • Contact
Menu
  • The Four Hundred
  • Subscribe
  • Media Kit
  • Contributors
  • About Us
  • Contact
  • Options Abound for IBM i Data Replication

    October 14, 2014 Alex Woodie

    As an IBM i system administrator, it’s your job to ensure that data in DB2 for i is available where it’s needed. No server is an island these days, not even the IBM i-based Power Systems servers, and so that means replicating data to external databases is a requirement. But what’s the best way to power data integration? Should you build it yourself or buy off the shelf? We’ll try to provide you some answers.

    At many organizations, the IBM i server might house the core ERP application and be the system of record, but there are plenty of other databases and programs that need data from the central record keeper. For example, Oracle-based business intelligence systems or SQL Server-based reporting systems are commonly fed from production IBM i systems.

    Keeping the systems in-synch and up-to-date is not always easy, and the difficulty level goes up as your latency requirements go down. It doesn’t take a tech genius to use FTP to initiate batch dumps from a source database to a target on an ad-hoc basis. Managed file transfer (MFT) tools have taken some of the risk out of using barebones FTP.

    If you’re looking to maintain a separate warehouse on a semi-regular basis, there are also extract, transform, and load (ETL) tools that will pull data from DB2 for i, translate it into the correct format, and move it into a target system, such as a data warehouse. Coglin Mill, developer of the RPG-based RODIN tool, probably has the highest functioning ETL tool on the IBM i market. Informatica also has some native capabilities, and Talend has been known to play in the IBM i arena. If you like to roll your own, you could develop a DB2 for i SQL stored procedure that allows an external database to pull data on demand via ODBC or JDBC.

    The complexity level and the risks go up a notch if you’re looking to do real-time integration. If you’re handy with DB2 for i and feel comfortable using triggers and journaling, you could develop your own system that monitors the journal receiver for changes to files. If you want something with more bells and whistles–not to mention professional technical support to call when something goes wrong–then you’re probably in the market for change data capture (CDC) software.

    IBM offers CDC capabilities with its InfoSphere product that was formerly based on DataMirror Transformation Server. Because high availability and data replication are so closely related, other HA software vendors, such as Vision Solutions, also support database replication among multiple, non-similar databases, such as DB2 for i, SQL Server, Oracle, MySQL, Sybase, and the others.

    There are also dedicated CDC products from Oracle, HiT Software, and Attunity. Oracle added DB2 for i support to its GoldenGate offering just a couple of years ago. Pricing for GoldenGate is not cheap, however.

    You will probably get a better deal for CDC software from HiT or Attunity than Oracle or IBM. HiT Software (which is now owned by BackOffice Associates) has a good thing going with DBMoto, a Windows-based CDC engine that can move data in real time among more than 20 different databases, including relational databases like DB2 and Oracle, but also the databases powering massively parallel column-oriented data warehouse offerings, such as those from Actian, as well as Amazon Web Services‘ RedShift cloud-based warehouse.

    Attunity can also keep IBM i-resident data moving in real time among a variety of different systems with Replicate, its log-based CDC offering. In addition to providing a trickle-feed of updates from source databases, the product can replicate entire database schemas and supports a “snapshot” extract-and-load option that gives customers the capability to replicate entire databases to their target systems. Like HiT, Attunity has been moving to support “big data” analytics platforms recently, such as Teradata, IBM Netezza, and EMC Greenplum MPP databases.

    Coglin Mill, by the way, also offers CDC functionality as part of its “real-time ETL” functionality in RODIN. Coglin Mill was recently bought by HelpSystems, which has several business intelligence tools in its stable now, with ShowCase and SEQUEL Software. If you’re looking to do data warehousing and BI on the IBM i platform, this combination of tools offers some advantages.

    Data is the lifeblood of business these days, but moving it still requires time and effort. There’s no one-size-fits-all answer for data integration and replication. You may pick one solution over another depending on your speed, latency, and budget requirements. Carefully analyzing all the factors is the only way to help you make the right decision.

    RELATED STORIES

    New HiT Software Moves Data To Google App Engine

    Oracle Completes DB2/400 Support in Data Replication Tool

    Coglin Mill’s ETL Makes Data Warehousing on IBM i More Attractive

    Vision Updates Database Replication Solution



                         Post this story to del.icio.us
                   Post this story to Digg
        Post this story to Slashdot

    Share this:

    • Reddit
    • Facebook
    • LinkedIn
    • Twitter
    • Email

    Tags:

    Sponsored by
    PERFSCAN

    Revolutionary Performance Management Software

    At Greymine, we recognize there is a void in the IT world for a dedicated performance management company and also for a performance management tool that’s modern, easy to use, and doesn’t cost an arm and a leg. That’s why we created PERFSCAN.

    PERFSCAN is designed to make your job easier. With revolutionary technology, an easy-to-read report and graphics engine, and real time monitoring, tasks that used to take days can now take minutes. This means you will know your system better and will be able to provide better service to your customers.

    OUR FEATURES

    PERFSCAN is full of robust features that don’t require you to take a three-day class in order to use the product effectively.

    Customizable Performance Reporting

    Whether you are troubleshooting a major system problem or simply creating a monthly report, PERFSCAN lets you select any combination of desired performance metrics (CPU, Disk, and Memory).

    User Defined Performance Guidelines

    No matter if you are a managed service provider managing complex systems in the cloud or a customer analyzing your on-premises solution, PERFSCAN gives you the flexibility to define all mission critical guidelines how they need to be.

    Understanding The Impact Of Change

    Tired of all the finger pointing when performance is suffering? PERFSCAN’s innovative What’s Changed and Period vs. Period analysis creates a culture of proof by correlating known environmental changes with system performance metrics.

    Comprehensive Executive Summary

    Creating performance graphs is easy. Understanding what they mean is another thing. With one mouse click, PERFSCAN includes an easy-to-understand executive summary for each core metric analyzed.

    Combined Real-Time Monitor And Performance Analysis Tool

    With PERFSCAN’s combined built in enterprise real-time monitor and historical performance analysis capability, you will always know how your mission-critical systems are performing.

    Cloud Performance Reporting Is Easy

    Managing performance for production systems in the cloud can be a black hole to many system administrators. The good news is PERFSCAN analyzes all core metrics regardless of the location. That’s why MSPs and customers love PERFSCAN.

    Detailed Job Analysis

    PERFSCAN shows detailed top job analysis for any desired period. All metrics are displayed in two ways: Traditional Report and Percentage Breakdown Pie Chart. This toggle capability instantly shows the jobs using the most system resources.

    Save Report Capability

    Your boss lost the report you gave to him on Friday. Now what do you do? With PERFSCAN’s save report capability, any report can be retrieved in a matter of seconds.

    Professional PDF Reporting With Branding

    Creating professional looking reports for your customers has never been easier with PERFSCAN. Branding for our partners and service provider customers is easy with PERFSCAN.

    Check it out at perfscan.com

    Share this:

    • Reddit
    • Facebook
    • LinkedIn
    • Twitter
    • Email

    Sponsored Links

    BCD:  Webinar: Deliver First-Rate IBM i Mobile Applications Quickly. October 16
    COMMON:  Join us at the COMMON 2014 Fall Conference & Expo in Indianapolis, Oct 27-29
    MiNET:  Automate PDF, email, Fax, Archiving & more with ArtForm400. Try us for a FREE Redbox code!

    More IT Jungle Resources:

    System i PTF Guide: Weekly PTF Updates
    IBM i Events Calendar: National Conferences, Local Events, and Webinars
    Breaking News: News Hot Off The Press
    TPM @ EnterpriseTech: High Performance Computing Industry News From ITJ EIC Timothy Prickett Morgan

    Integration Not The Least Of IBM i Mobile Challenges Sharing Power Systems: An IBM i And Linux Story

    Leave a Reply Cancel reply

Volume 14, Number 19 -- October 14, 2014
THIS ISSUE SPONSORED BY:

Enforcive
New Generation Software
HiT Software
Computer Keyes
MiNET Communications, Inc.

Table of Contents

  • IBM Gives RDi 9.1.1 ‘Push to Client’ Feature
  • BRMS Learns New Tricks
  • IBM Navigator for i Increases Web and Mobile Effort
  • City Touts PowerHA Install
  • IBM Delivers Node.js Runtime to IBM i 7.1 and 7.2
  • Golden Nugget Taps Agilysys to Supply Software for New Casino
  • Dropbox and IBM i: Love It Or Leave It?
  • IntelliChief Delivers Deeper ERP Integration
  • Options Abound for IBM i Data Replication
  • IBM i Performance Concerns? Supermon to the Rescue!

Content archive

  • The Four Hundred
  • Four Hundred Stuff
  • Four Hundred Guru

Recent Posts

  • Fortra Issues 20th State of IBM i Security Report
  • FNTS Launches Managed Services for Power Servers in IBM Cloud
  • Total LTO Shipped Capacity Up Slightly in 2022
  • Four Hundred Monitor, May 24
  • Update On Critical Security Vulnerability In PowerVM
  • Critical Security Vulnerability In PowerVM Hypervisor
  • IBM Power: Hosted On-Premises Or In The Cloud?
  • Guru: Watch Out For This Pitfall When Working With Integer Columns
  • As I See It: Bob-the-Bot
  • IBM i PTF Guide, Volume 25, Number 21

Subscribe

To get news from IT Jungle sent to your inbox every week, subscribe to our newsletter.

Pages

  • About Us
  • Contact
  • Contributors
  • Four Hundred Monitor
  • IBM i PTF Guide
  • Media Kit
  • Subscribe

Search

Copyright © 2023 IT Jungle