Skip to main content

The BBBT Sessions: WhereScape

Originally founded in 1997 in Auckland, NZ as a data warehouse consulting company, WhereScape has evolved to become a solution provider and —especially in the last five years— a key player in the data management market and especially in the data warehousing and big data spaces.

During a great session with the BBBT, WhereScape showed their “latest and greatest” news and innovations, triggering meaningful discussions and interactions with the analysts of the BBBT.

Here, a summary and commentary of that cool session.

WhereScape at a glance

As mentioned before, during an evolution process that expands for more than 20 years, WhereScape became a solution provider of data infrastructure and automation solutions, it currently offers three main solutions:
  • WhereScape 3D. A solution to assist in planning, modeling and designing data infrastructure projects as well as enabling rapid prototyping.
  • WhereScape RED. A solution to enable fast-track development, deployment and operation of data infrastructure projects and reduce delivery times, effort, cost and risk of new projects.
  • WhereScape Data Vault Express. A solution especially designed to enable the automation of the entire life cycle of a modern database modeling method Data Vault 2.0-based project delivery.
Along with its vast experience in the consulting field and later with its software solutions, WhereScape has become a major player that navigates in the frontline of the data warehouse and data infrastructure automation market.

Is in the context of “automation” that the BBBT session with WhereScape was focused on, centering on the software company’s advances within its data infrastructure software.

Today and especially since the last couple of years, it comes as no surprise that automation is becoming increasingly important for almost all major software technology footprints, including the data warehousing and data management markets.

Why? 
Well, because as Neil Barton —WhereScape’s chief technology officer— explains neatly during the briefing: automation in a data infrastructure can provide great value to an organization which can be translated into many aspects of its operation, from cost, development time and risk reduction, to enabling IT to keep the pace with business needs.
This is especially true when data warehousing has traditionally been done in a complicated and cumbersome way (Figure 1).

Figure 1.  The traditional data warehousing development/maintenance cycle (Image courtesy of WhereScape)

Consequently, WhereScape aims to provide automation and simplification of most, if not all, the process data warehousing process by incorporating not just plain automation of tasks but encapsulation of methodologies, the best practices and industry standards within to enhance simplification, provide time reduction and yet, ensuring compliance with internal and external data management regulations.

One of what I think is a unique aspect of WhereScape is the company’s “holistic” view to automation in which all the data cycle is considered via a metadata driven approach, making it possible for WhereScape to easily provide documentation and lineage and have a full cycle management approach within a single solution (Figure 2), and more so, to bring integration to WhereScape’s own set of solution.

Figure 2. Simplification and automation with WhereScape (Image courtesy of WhereScape)

Interestingly, while not trying to “reinvent the wheel”, and remaining loyal to a well proven life cycle (Figure 3.) WhereScape developed and made this life cycle an intelligent and automated one by aiming to improve all its faces from the discovery to the rest of its stages to reduce time, effort and augment efficiency.

By being metadata-driven and having an integrated structure within all its components, WhereScape  incorporates automation to the entire life cycle process and enable smoother documentation.

This is especially true under the design and operation processes —normally a complex and tedious stages— in which WhereScape introduces, for the first one, an automated model generation engine which allows speeding the common iterative design cycle as well as the ability to manage efficiency by enabling solid dependency management and integrated scheduling and logging to ensure efficient auditing and operation analysis.

Figure 3. WhereScape’s automation life cycle (Image courtesy of WhereScape)

Additionally, to showing efficient automation control and management, WhereScape also shows flexibility by offering support for a set of projects, including:
  • Data Warehouses
  • Data Marts
  • Data Vaults
  • Cloud deployments and
  • Big data support
Making WhereScape to count as an important emerging player in the data management automation market.

WhereScape at the BBBT

After a summary of what WhereScape is all about, allow me to highlight some of the most relevant aspects of what was a great presentation conducted by Neil Barton, WhereScape’s Chief Technology Officer (CTO).

The briefing gave us good info about what WhereScape has been working in recent months and what is now up to for the future, some of which include:
  • Increasing data platform coverage. WhereScape has been working to expand its set of “data infrastructure automation” solutions to a wider number of data platforms, which now includes:
    • Amazon Redshift
    • Microsoft Azure SQL Data Warehouse
    • Snowflake
    • EXASOL
    • SAP HANA
    • PostgreSQL
  • Extensive support for Data Vaults.  WhereScape has worked on providing extensive support for Data Vault —a database modeling method designed to provide long-term historical storage of data coming in from multiple operational systems— and more specifically engineered for Data Vault 2.0.
  • Support for Data Streaming. The briefing included an interesting discussion about WhereScape’s new support for data streaming a feature aimed to help IT teams to manage hybrid flows of streaming real-time and traditional batch-based data by enabling the design, development and deployment of more advanced data infrastructures.
  • Reinforcing Support for Cloud Data Platforms. Within the company’s efforts expand support for data platforms it can be highlighted the continuous support for cloud-based data platforms which includes direct support for cloud-based data management engines including Snowflake, Amazon’s Redshift, and Microsoft SQL Azure.
  • Addressing a Hybrid Reality. WhereScape has taken steps to address a reality for companies that now navigate data that exist both on cloud and on-premises sources making it possible to move data between both world and to ease this transition.   

On another key moment during WhereScape’s presentation, WhereScape guided us towards what the company has developed to enable organizations to, via its solutions combined with key partners including StreamSets, include support for streaming IoT integration.

Real-time data flows, or “streaming” data sources, can now be collected from many areas within an organization’s data landscape, including from in-field units sharing sensor-based data, social media feeds to support sentiment analysis, or from internal systems feeds.

Utilizing industry-leading dataflow management technology developed by StreamSets and the proven efficiencies of WhereScape automation solutions WhereScape RED or WhereScape Data Vault Express, WhereScape automation with Streaming minimizes the learning curve for IT teams working with these new data sources and ensures best practice integration of streaming data (Figure 4).

Figure 4. WhereScape’s Streaming IoT Integration (Image courtesy of WhereScape)

Serving as a central element, WhereScape aims to provide all the necessary tools to complete the full IoT cycle from data collection to the provision of insights and information for users, automating the event queuing transformation and storage and administration stages and according to WhereScape:
  • New analytic opportunities
  • Speed up pipeline development
  • Hide complexity of underlying technologies
  • Minimize the learning curve for teams
  • Integrate with batch-based data
  • Ease ongoing management
The briefing portrays a great environment to help us confirm WhereScape’s role in the market as well as what the company is doing to improve all their solutions to adapt to new technologies and needs. A great, clear and concise briefing by WhereScape.

WhereScape: A Tough a Couple of Final Thoughts

From we can see, WhereScape has been interestingly evolving, from being a data warehouse automation solution to become what the company calls: a data infrastructure automation solution.

Interestingly, the company has shown savviness to evolve its solutions so that, via a model driven design, to incorporate not just connectors to new data sources but the necessary tools and design to enable organizations to modernize full data management platforms in complete hybrid environments.

Figure 5. WhereScape’s RED Multiple Data Model Architecture Overview (Image courtesy of WhereScape)

Of course, even though WhereScape has grown a solid and intelligent solution strategy, from a market perspective, gaining market share hasn’t and will not be a walk in the park.

As automation technologies continue to gain steam in all main software areas, a larger number of software companies are now incorporating increasingly sophisticated mechanisms to their data management and analytics solutions thus, making automation another key feature in an already extremely competitive market, such is the case for Oracle and its new Oracle Autonomous Data Warehouse Cloud Service or offerings by other competitors like Attunity Compose or Panoply

So, does WhereScape can lead in data infrastructure automation?

Of course, but will need to make it can consistently deliver IT organizations with the means to achieve effective automation within all faces —design, development, and deployment— of, especially, a data warehouse and, generally, a full fledge data infrastructure.

This includes, achieving seamless collection and processing of multiple source types and of course effective complexity cutting.

From the briefing, it seems WhereScape is, if not there, on a right way to achieve some or many of these goals, making it one of those companies up to the challenge for gaining the favor of companies with complex data infrastructures to deal with.

WhereScape is rapidly realigning to serve a new generation of data management systems and needs.


Comments

  1. I am definitely enjoying your website. You definitely have some great insight and great stories.
    Windows VPS Hosting India

    ReplyDelete
  2. This post is so informative and makes a piece of very nice information on the topic in my mind. It is the first time I visit your blog, but I was extremely impressed. Keep posting as I am gonna come to read it every day. salesforce to redshift

    ReplyDelete
  3. Virtually every organization wants to be more data driven. A data warehouse provides a central repository for extracting insights and informing decisions. The challenge is how to deliver and update data warehouses at the speed the business needs. There are lots of Amazon Redshift consulting companies are providing training to understand the data platforms.

    ReplyDelete
  4. Very interesting blog. Alot of blogs I see these days don't really provide anything that I'm interested in, but I'm most definately interested in this one. Just thought that I would post and let you know. best instagram likes app reddit

    ReplyDelete
  5. That was super interesting ! As a college student, it is hard to make time to write and be active on social media. I’ve been thinking about planning but didn’t really know how to do it, so thank you for sharing !
    digital marketing course in chennai

    ReplyDelete
  6. Incredibly conventional blog and articles. I am realy very happy to visit your blog. Directly I am found which I truly need. Thankful to you and keeping it together for your new post…

    AWS Training in Hyderabad

    ReplyDelete
  7. Excellent content ,Thanks for sharing this .,
    Leanpitch provides online training in CSPO everyone can use it wisely.,
    Join Leanpitch 2 Days CSPO Certification Workshop in different cities
    CSPO TRAINING

    CSPO certification online

    ReplyDelete
  8. Excellent content ,Thanks for sharing this .,
    Leanpitch provides online training in CSPO everyone can use it wisely.,
    Join Leanpitch 2 Days CSPO Certification Workshop in different cities.

    Certified scrum product owner

    CSPO online certification

    ReplyDelete
  9. Excellent content ,Thanks for sharing this .,
    Leanpitch provides online training in CSPO everyone can use it wisely.,
    Join Leanpitch 2 Days CSPO Certification Workshop in different cities.
    CSPO ONLINE TRAINING

    CSPO ONLINE

    ReplyDelete
  10. virtual event platform This has led many to consider multi-hub hybrid events that involve smaller live components in disparate destinations linked together through a common brand, theme, and digital layer. introducing a speaker, thank you for registering for our event and email invite with rsvp

    ReplyDelete
  11. Thanks for sharing this.,
    Leanpitch provides online training in Scrum Master, everyone can use it wisely.
    Join Leanpitch 2 Days CSM Certification Workshop in different cities.
    certified scrum master certification

    agile scrum master certification

    ReplyDelete
  12. Thanks for the useful information, give more updates like First time I visit your channel really nice, here after a daily visit. gutter installation

    ReplyDelete
  13. Online Digital Marketing Services and Course in Hyderabad https://www.startupicons.in/

    ReplyDelete
  14. The proliferation of digital channels and the proliferation of data at a level never seen before in the history of humanity, called big data, has become extremely difficult to manage. I hope that the WhereScape data management platform will be an effective tool for collecting and managing user data. Best Dissertation Writing Services

    ReplyDelete
  15. Gratitude for the valuable data, give more updates like First time I visit your channel truly pleasant, here after a day to day visit.
    https://www.bestbookmarks.win/click-here-for-info-18

    ReplyDelete
  16. A very detailed explanation was provided on this topic. Your writing technique is impressive, as is your knowledge of this kind of topic. The BBBT sessions were extremely informative and provided us with valuable information. Thanks for sharing your thoughts with us.
    Now it's time to get taxi Manchester Airport for more information.

    ReplyDelete
  17. Yes, I really apricate your well written article. You done very nice work for us. I hope in future you share more good article. Now it's time to avail EXFOLIATING SCRUB for more information.

    ReplyDelete
  18. Thanks for sharing this information. This is so informative! arb compressor

    ReplyDelete

Post a Comment

Popular posts from this blog

Machine Learning and Cognitive Systems, Part 2: Big Data Analytics

In the first part of this series, I described a bit of what machine learning is and its potential to become a mainstream technology in the industry of enterprise software, and serve as the basis for many other advances in the incorporation of other technologies related to artificial intelligence and cognitive computing. I also mentioned briefly how machine language is becoming increasingly important for many companies in the business intelligence and analytics industry. In this post I will discuss further the importance that machine learning already has and can have in the analytics ecosystem, especially from a Big Data perspective. Machine learning in the context of BI and Big Data analytics Just as in the lab, and other areas, one of the reasons why machine learning became extremely important and useful in enterprise software is its potential to deal not just with huge amounts of data and extract knowledge from it—which can somehow be addressed with disciplines such as data

Next-generation Business Process Management (BPM)—Achieving Process Effectiveness, Pervasiveness, and Control

The range of what we think and do is limited by what we fail to notice. And because we fail to notice that we fail to notice there is little we can do to change until we notice how failing to notice shapes our thoughts and deeds. —R.D. Laing Amid the hype surrounding technology trends such as big data, cloud computing, or the Internet of Things, for a vast number of organizations, a quiet, persistent question remains unanswered: how do we ensure efficiency and control of our business operations? Business process efficiency and proficiency are essential ingredients for ensuring business growth and competitive advantage. Every day, organizations are discovering that their business process management (BPM) applications and practices are insufficient to take them to higher levels of effectiveness and control. Consumers of BPM technology are now pushing the limits of BPM practices, and BPM software providers are urging the technology forward. So what can we expect from the next

Teradata Open its Data Lake Management Strategy with Kylo: Literally

Still distilling good results from the acquisition of former consultancy company Think Big Analytics , Teradata , a powerhouse in the data management market took one step further to expand its data management stack and to make an interesting contribution to the open source community. Fully developed by the team at Think Big Analytics, in March of 2017 the company launched Kylo –a full data lake management solution– but with an interesting twist: as a contribution to the open source community. Offered as an open source project under the Apache 2.0 license Kylo is, according to Teradata, a new enterprise-ready data lake management platform that enables self-service data ingestion and preparation, as well the necessary functionality for managing metadata, governance and security. One appealing aspect of Kylo is it was developed over an eight year period, as the result of number of internal projects with Fortune 1000 customers which has enabled Teradata to incorporate several be