PERSPECTIVES

BLOGS & NOTES

Jan
10
THE DATA INTEGRATION PORTFOLIO - PART 1: VIRTUALIZATION

The challenges facing organizations to integrate and make sense of the plethora of internal and external data continue to grow. Not only is there diversity in data sources, but the requirements from business units involve a mix of batch, real-time, on-demand and virtualized capabilities, often from the same source for different use cases. It is rare to find a "one-stop-shop" solution to these varied data integration needs, so organizations end up with a hodgepodge of redundant, overlapping products, or worse, rely on custom internal coding with no traceability or modularity.

In this series of blog posts, we will examine the "hybrid data integration portfolio" as a planned approach to handling multiple data integration requirements with a...


Sep
28
AGILE AND ETL? LIKE PEAS AND CARROTS.

Data Architecture, SAP Data Services, Agile data mart, ETL Development

Can ETL Be Agile?

Business intelligence projects benefit greatly from an agile development approach. Since BI closely aligns IT with business, an iterative delivery model ensures that business stakeholders are always involved in the design process and that a constant dialogue is maintained. The objectives and benefits of agile project management include:

  • Response to rapidly changing requirements

  • High degree of customer involvement

  • Quick results

  • Progress measurement

  • Team motivation

This approach has traditionally applied to the development of the presentation, or “customer-facing” layer of BI. But how does an agile project manager make “upstream” processes like data architecture and ETL part of the iterative deliverable? Much of the “data plumbing” remains ...