HiT Bolsters DBMoto Data Engine with Support for HP Vertica
June 25, 2013 Alex Woodie
IBM i shops that are interested in pumping their latest DB2/400 database transactions into a Vertica data warehouse for analysis may want to check out the latest release of DBMoto from HiT Software. The San Jose, California, company added Vertica Analytics Database, Hewlett-Packard‘s big data platform and Hadoop killer, as a supported target with version 8 of DBMoto.
Vertica is a column-oriented database designed to manage large volumes of data as part of a data warehouse or other query-oriented workload. HP bought the company behind the product for an undisclosed sum back in 2011 to go up against Hadoop, the open source product that is similar to Vertica in what it ultimately does (crunch big data sets) if not in how it actually works.
While everybody is scrambling to collect and make sense of “big data,” just moving it around causes its share of problems. What good is 10 TB of metadata, customer sentiment data, or click-stream data if it’s stuck on a file server somewhere in the back room? Too often, organizations rely on the “sneakernet” to get this data to where it needs to be.
This is where products like DBMoto come in handy. While the product can’t move data any faster than the underlying data pipes can stream it, DBMoto can do a whole bunch of other things to make the process easier on administrators, including: managing multiple database replications from a single point of control; moving changed-data in real time or batch; compressing data; keeping a record of the move; and automating the movements through APIs that can be embedded directly into business applications.
HiT already supported the transactional databases, such as DB2/400, DB2 for LUW, SQL Server, MySQL, Oracle, Informix, and Sybase, with DBMoto and related products. Now it’s building out those products’ capabilities by supporting the various big data platforms that are coming into vogue, such as IBM Netezza, Actian Vectorwise, EMC Greenplum, and Teradata. HiT, which is a subsidiary of Backoffice Associates, also supports the movement of data to cloud-based big data warehouses, such as Google App Engine (GAE), a NoSQL-based datastore.
“We believe that analytic databases such HP Vertica, Actian Vectorwise, and of course IBM Netezza and SAP HANA will be used more and more by IBM i users to move data in quasi-real time for BI, analytics and reporting,” Giacomo Lorenzin, managing director of HiT Software, tells IT Jungle. “This is an activity our IBM i customers have been doing for many years using standard databases such as MS SQL Server, Oracle, MySQL and others. However, in the last few years columnar databases such as HP Vertica have emerged promising better performance and scalability for BI activities. Users are slowly but steadily digesting the new platforms and starting to use them.”
In addition to supporting Vertica, DBMoto 8 brings other features, such as:
DBMoto does not yet support Hadoop, the big data framework that is generating a lot of interest for its capability to deliver powerful analytics and relatively easy administration. Lorenzin says HiT is “closely monitoring” Hadoop for possible support in a future release of DBMoto.
For more information, see www.hitsw.com.