Best Practices Around Cloud Data Integration

A couple of weeks ago, I witnessed a very interesting webinar panel discussion around people’s experience around data integration in the cloud. The panel was moderated by Jeff Kaplan of THINKstrategies, an analyst firm and the panel members included Andrew Bartels of PSA Insurance & Financial Services, Tom Carlock of Dun & Bradstreet, Aaron Mieswinkel of Astadia, and Darren Cunningham of Informatica.
I found this collection of panelists especially interesting because they represented constituents from several ends of the data integration spectrum – PSA was a consumer of cloud data integration services, Dun & Bradstreet was a provider of data quality services, Astadia was a System Integrator with deep experience in cloud integration, and Informatica was an ISV that specialized in out of the box data integration and application integration software.
Amongst the other interesting predictions I learned about on the webinar:
  • IDC predicts that 80% of new software offerings will be available as cloud  services and that by 2014, over one-third of software purchases will be via the cloud
  • More than 85% of Fortune 500 organizations will fail to effectively exploit big data for competitive advantage through 2015
  • 33% executives in a survey conducted by Saugatuck Technology identified integration as their top concern regarding SaaS deployment and use
  • On the SaaS vendor side, a THINKstrategies survey found that 88% of SaaS companies identify integration as important in winning new customers and a common sales hurdle.
These predictions seem quite telling about the main obstacle towards moving to the cloud – data integration. Many CIOs are still hesitant towards moving to the cloud because they believe that doing so would result in a massive strain on IT resources when it came to data integration, that the cost savings for moving to the cloud itself would be shot.
In the first wave of cloud computing adoption, businesses merely used companies such as Amazon Web Services for testing and development of their applications. CRM, and email then followed in the second and most recent wave of cloud adoption. However, when it comes to the third wave of cloud adoption, of moving mission critical systems such as ERP or proprietary financial applications to the cloud, there is still resistance to the idea because of the complex nature of these deployments.
This is where cloud data integration plays a huge part in taking away the complexity of integrating these various on-premise and cloud applications. When you have your systems on separate islands, it is extremely hard to benefit from the real-time BI that cloud computing can offer. Cloud data integration that can be done without the aid of IT personnel, while still following the procedures and rules around IT governance is the solution towards achieving real-time insight into your company’s operations. 
Cloud data integration also serves as a first step towards eventually achieving MDM nirvana – that state where your data workflows, procedures, and processes move seamlessly from system to system, with all personnel having insights into data that’s relevant to them. Cloud data integration can also serve as a catalyst
for cloud analytics, data-as-a-service (a.k.a. DaaS), and PaaS. 
Accelerating PaaS adoption is an area I’m especially interested in, given some work I’ve done in this space with past companies. A lot of application development in the cloud still takes place on two ends of the spectrum – on one end, there are developers who use a cloud application (such as and need certain customizations built into it – they then use to perform those customizations. In other instances, you have indie developers who use Windows Azure, or VMware’s Cloud Foundry to develop “nice to have” applications from scratch. But by and large, mission critical application development still occurs on-premise. 
I strongly believe that cloud data integration that can be performed by non-technical business users, will leave more time for IT personnel to develop mission critical applications in the cloud. With the PaaS space gaining more importance, and consolidating further, the time is ripe to take PaaS development to the next level. This in-turn will lead to cloud data integration morphing into “iPaaS” (or Integration Platform-as-a-Service). This interdependence between iPaas and PaaS will eventually lead to true SOA where we have open systems working hand-in-hand with each other, all in the cloud.
You can view the entire webinar below, and also check out Hollis Tibbetts blog on cloud data integration


About ashwinviswanath

I've worked at Microsoft, Sun Microsystems, Oracle, and at a SaaS company in the field of product marketing & product management. My platform experience has given me a great understanding of Windows Azure,, Heroku, & Cloud Foundry. I'm an active member of the Silicon Valley Forum and the Silicon Valley Product Management Association.

Share your thoughts

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: