The Warehouse

BLOG & NOTES

Mar
23
Where's the "T?" A look at ETL vs. ELT

In a previous blog post, we examined the differences between traditional ETL (extract, transform and load) and ELT, where the “heavy-lifting” of data transformation is handled by the robust and scalable (usually cloud-hosted) target platform. In today’s modern cloud data warehouse environment, ELT maximizes the speed at which data is staged and ingested, while leveraging massive computing power in the cloud to cleanse, aggregate and otherwise prepare that data for general consumption. But where is the best place to manage that transformation piece? Is it using cloud-friendly ETL tools, or is it within the management consoles of the cloud DWs themselves?


A common perception a...


Aug
01
Pandata Group Partners with ThoughtSpot to Deliver Search and AI-driven Analytics

Pandata Group is pleased to announce a partnership with ThoughtSpot, to deliver search and AI-driven analytics to reshape the way mid-market and enterprise organizations are able to answer data questions, find insights and make decisions.



ThoughtSpot was recently positioned in the Leaders quadrant of the Gartner 2019 Magic Quadrant for Analytics and Business Intelligence Platforms. The software platform is a spark to what Gartner recognizes as the third wave of disruption to traditional BI in the form of augmented analytics. With ThoughtSpot, business people can type a simple Google-like search in natural language to instantly analyze billions of rows of data, and leverage artificial intelli...


May
28
Approaching an ERP Migration with Analytics in mind

Growth companies today rely on Enterprise Resource Planning (ERP) systems to manage their daily operations and collect and retain vital business data. The ERP space continues to evolve . . . cloud-hosted ERP, AI-based automation, digital transformation, etc.; eventually an organization will find itself upgrading or migrating to a more modern enterprise platform. This move will likely involve a Systems Integrator (SI) specialist to drive the effort, and an SI’s focus may need to incorporate more than just the operational systems at hand . . . the organization’s approach to data integration and analytics should be accounted for as well.



Your SI and internal migration team will init...


Mar
15
Data Integration Roadmap Series - Part Two: Master Data Management

When planning your integrated enterprise data environment, it is impossible to understate the importance of master data management. Much has been written about MDM, and it encompasses a broad range of (mostly non-technical) disciplines that are beyond the scope of a single blog entry. Here we will provide a broad overview of the four main areas of MDM to start your journey towards enterprise data governance. We will also examine the relationship between MDM and recent developments around other enterprise management programs such as Product Information Management.


What is master data management? Quite simply it is the administrative oversight of organizational “data as an asset” to...


Aug
15
The Data Integration Portfolio - Part Three: Streaming Data

In previous installments of this series we examined recent trends in data integration, specifically data replication and synchronization, as well as data abstraction through virtualization. Taken individually, all of these approaches are suited for high data latency requirements around historical reporting and trending analysis. In this chapter, we look at real-time streaming data, and how it can complement high-latency data integration approaches to create a complete enterprise data foundation.


Streaming data delivery is often perceived to be the "holy grail" of data integration in that it provides users with immediate and actionable insight into current business operations. In reality, st...


Jun
11
Pandata Group Snowflake Partner Announcement


temp-post-image



Pandata Group's partners help us empower our clients and deliver value from data and analytics using the best technology for their particular business needs, which is why we're excited to announce we've added Snowflake to that list. After getting to know the Snowflake team and the ins and outs of their product, we see the immediate value Snowflake can bring to clients in search of a modern data warehousing solution.



Why Snowflake?



  • A fully managed, born-in-the-cloud data warehouse that delivers power, flexibility, and simplicity.

  • Hosted on Amazon Web Services (AWS), the platform is elastic as you need it to be. Start small and scale as you grow. Conversley you can scale back, on-the-fly, as ...

Feb
25
DATA INTEGRATION PORTFOLIO- PART TWO: REPLICATON

In our previous installment on the hybrid data integration portfolio, we looked at the role of data virtualization in a unified, multi-platform approach to creating a managed enterprise data foundation. In this chapter, we examine data replication and synchronization, i.e. the ongoing copying of data (without massaging or transformation) from one physical location to another, usually in conjunction with change data capture (CDC).


Data replication is often considered ETL without the "T", though where ETL is usually a batch-based delivery process, replication is often driven by "update-upon-change". Through this process, the target database only updates when changes occur to the source. Often r...


Jan
18
ENTERPRISE DATA AND ANALYTICS (EDA) FOR HEALTH PLANS

What can EDA do?



EDA is the governed integration of disparate data collection applications, into a centralized “source of truth”, for enhancing business acumen to improve and optimize decisions and performance. EDA allows health plans to easily:





  • Analyze provider performance in order to optimize pay-for-performance




  • Evaluate treatment patterns across providers and better tailor care management program




  • Identify underlying opportunities for health education and intervention with high-risk members





Sustaining fixed EDA support and overhead costs can allow an organization to continue growth and improvement, thus providing an infinite return on investment (ROI).



Why do you need an EDA?





  • How...


Dec
28
FOUR ENGAGEMENT MODELS PANDATA GROUP OFFERS TO OUR CLIENTS

Pandata Group works with clients all over the Midwest who have begun the journey of being data-driven. These clients each have different needs, require different resources, and expect different levels of control and responsibility in their relationships with us.



To meet the requirements of each unique client, Pandata Group offers four distinct engagement models, which are frameworks that define collaboration between us and our clients for projects such as data mart implementation or BI application development. We call these engagement models Extended Team, Specialized Team, Managed Product and Managed Services. All four models ensure the right mix of expertise and transparency during the dev...


Sep
15
TWO DV'S IN TANDEM: DATA VAULT AND DATA VIRTUALIZATION

Two DV's in Tandem: Data Vaults and Data Virtualization



There has been growing interest in data vaults as an architecture suited for the archiving and preservation of all enterprise-wide data. The normalized, "hub-and-link" structure is suited for parallel loading from multiple operational systems, and the philosophy of "all the data, all the time", regardless of quality, lends itself to the rapid population of the vault without cumbersome governance and oversight. However, the data vault is ill-suited as a source for reporting and analytic querying, since it separates keys from descriptive metadata, propagates many-to-many joins, and makes no distinction between high-quality and low-quality...


Pandata GroupLessLess
Pandata GroupLess

Madison

Pandata Group, LLC

316 W. Washington Avenue

Suite 525

Madison, WI 53704

Madison

Pandata Group, LLC

316 W. Washington Avenue

Suite 525

Madison, WI 53704

Less

Pandata Group © 2020

Pandata Group © 2020

Less


Chicago

WeWork/ Fulton Market

220 N. Green Street

Second Floor

Chicago, IL 60607


Chicago

WeWork/ Fulton Market

220 N. Green Street

Second Floor

Chicago, IL 60607

Less