Category: Uncategorized

Snapshots Are a Feature, Not a Solution

The time has finally come. You’ve poured your blood, sweat, and tears into your most recent content piece, and it’s ready to be packaged up and sent to the client to be pushed live. After a few final checks and only…

Read More
12/02/2019 0 Comments

We’re Accelerating SQL Server Clones at Pure //Accelerate 2017

Catalogic is excited about showcasing our application-aware snapshot and replication solutions at the upcoming Pure //Accelerate 2017 show next week. Join us at Booth #2 and meet our technical team to discuss how we can add value to your environments or your customers.

The focus of this blog will be on some specific capabilities within Catalogic that allow you to maximize your Pure Storage investments, particularly around SQL Server (though much of this applies to other databases we support as well). We often see customers try to automate some of the snapshots and cloning through scripts, but scripts suffer from a variety of problems:

1. Error Recovery/Handling

I cannot emphasize this enough. The enterprise risk you are exposing your organizations to is exactly the kind of risk that results in lost jobs when things go wonky. This is also the primary reason for data sprawl. Clean-up logic is almost always an after-thought with scripts, and copies often get made but never deleted.

2. Application Awareness

Crash consistency is not application consistency. Application consistency is not application awareness. Being able to integrate with the SQL stack and the server stack seamlessly is important to deliver a reliable mechanism to deliver copies.

3. Security

How many scripts still use important passwords in plain text? Don’t even get started on AD integration and RBAC.

4. Language

It took me 12+ years in the United States to get about a quarter of the folks to understand the English out of my mouth 😊. Computer Languages aren’t that different. Python guys don’t always get PERL and vice versa, and neither of them are particularly proficient at JavaScript or PowerShell. This is where an interface takes over and establishes a common language for all to work with.


Running these scripts on an enterprise FlashArray from Pure Storage is like buying a Formula1 car and saving money by fitting it with 4 bald tires. Penny wise, pound foolish.  In fact, we’ve found so many concerns with scripts that we’re even giving away “No More Scripts!” buttons at //Accelerate.

Drop by to grab your button. We’ll be randomly selecting folks wearing the buttons to win one of the many remote-control cars we’re giving away.

Other than addressing these blatant issues with promoting and using scripts, what are some of the scenarios where Catalogic can really help deliver a better outcome for your organization, especially in regards to Microsoft SQL Server?

SQL Server Failover Cluster Aware Cloning:

Disk Signatures are thumbprints that Microsoft uses to identify disks and it helps them deal with knowing what physical disks belong to which volume during boot time, as well as when it sees new devices. Windows Clustering especially relies on this mechanism to ensure it avoids “split-brain” scenarios for shared drives. When you want to restore a clone of your DB back to a cluster, the volume will show up with the same signature and can confuse Windows and Clustering. This is why scripts often fail to restore back to the original cluster, unless the original shared volumes are destroyed.

Catalogic will allow you to define a proxy SQL server that can be used to re-signature the disks before we mount it back to the original clusters. One of our Catalogeeks, @Martin Phan, explains this in a demo video.

VSS Consistent Replicas

Pure Storage provides a hardware VSS provider for physical SQL workloads, but this provider only works for VSS consistent snapshots on the local array. This provider predates Protection Groups and there is no easy way to get an application consistent copy over to your replica array. Some script-based solutions use a workaround that takes a snap, creates a new volume off it and replicates it. The problem with this approach is the amount of data that needs to be transferred every time – it’s the full copy, which is a colossal waste of bandwidth. On top of it, the clean-up logic is inefficient and can create sprawl within your organization. This is one reason why “snapshot assisted backups” from some of the new backup appliances are popular among Pure customers, because they can at least ship only the incremental changes, even if it means losing the compression/deduplication savings in-flight.

The most efficient solution requires building a VSS hardware provider that integrates with Pure Storage’s Protection Groups. Catalogic delivers that. We’ve built a hardware VSS provider for SQL that also handles replication. It does one better than purpose-built snap assisted backup solutions by moving data at the storage layer, thereby preserving the 5:1 data reduction Pure Storage customers are getting. As a recent joint Pure/Catalogic customer told us, “A storage dollar not spent on Pure is a dollar wasted.” We agree! Don’t buy low performant backup appliances just to get an app-consistent offsite copy.

AlwaysON Instant Seeding or Remote Replicas

AlwaysON Availability Groups from Microsoft SQL Server have been a revelation for many users that can’t afford much downtime. The swift adoption of AlwaysON shows that HA configurations are a core requirement in most companies. However, establishing an availability group across multiple sites may be a concern. It requires sending all the data over the wire and it requires the Pure Storage array to have to work on deduplication and compression of the same blocks again. We see customers often use replica DBs for testing and after every test, reseeding those databases can be a pain for the administrators and places a lot of burden for your network and storage to achieve a net zero effect.

Catalogic has an instant seeding option for remote sites. Using it, you can reseed the replica database from an existing snapshot in the replica site. Any unhealthy/uninitiated replica copy can be recovered and brought back in synch with its primary database with little to no additional data transfer over the wire. Pure Storage also doesn’t have to spin its wheels trying to compress these blocks. This is much quicker, requires less network bandwidth and is more efficient on the storage.


This is just a small sampling of the unique SQL Server features built into the Catalogic Copy Data Management platform to allow you to leverage and maximize your investments in Pure Storage. We would welcome the opportunity to interact with your teams and discuss how we can help improve your processes around:

  • Test/Dev automation and test data management
  • Instant backups and cloned recoveries with a catalog
  • DevOps transition and integration with Chef, Puppet, Ansible, etc.
  • Automation of DR for physical and virtual servers

Drop by to meet us at Booth #2 next week, where we’ll be able to show you all these features via live product demos.  Or feel free to email us anytime at

Read More
06/08/2017 0 Comments

VMworld 2016: Are You Ready for the Game of Clones?

When it comes to IT and storage consumption, database clones are the White Walkers of the data center. And at VMworld 2016 we’re not hiding behind The Wall anymore: we’re taking them head on! Our Copy Data Management solution is the Dragon Glass you need to finally put a stop to database clones overrunning you.  Join us this year in booth #721, and you too can be part of the Game of Clones.

We won’t give it all away just yet, but it’s going to be both fun and educational. We have lots of Game of Thrones themed schwag, including some fierce GoT-style tee-shirts. The “Game of Clones” game itself will have several winners awarded Game of Thrones prize packs so schwagalicious that they will make you the envy of all Westeros.

But it’s not just dragons and swords. We’ve got some serious new technology on display this year, including our latest Copy Data Management integration with Oracle and SQL Server databases, which strikes right at the heart of the White Walkers…. Err, I mean the database clone problem. In addition to our own tech Maesters who will be on hand, we’re also having lots of special guests in our booth, so keep a close eye on our booth schedule as we get closer to the show.

If you pre-schedule a meeting at our registration site, you’ll receive one of our exclusive Game of Clones tee-shirts, as well as 10 extra entries for the big box o’ schwag. And fear not, if you can’t make it over the the Narrow Sea from Essos and won’t be at VMworld this year, you can still register on our site for a chance to win one of the prize packs.

Read More
08/18/2016 0 Comments

Delivering Continuous Value to Customers via Agile Software Development and The Marketplace

Common Constraints

In many organizations the question above implies organizational and probably architectural constraints with respect to the timely and continuous delivery of business value. Any software development endeavor involves delivering value to customers in the form of addressing a need in a manner that is very intuitive. But in addition, that value should be delivered in a timely fashion. It is very limiting to think a single product owner or company can identify and address all needs a given market may have.

Imperative in value creation and therefore the offering of continuous business value is the leveraging of a platform and philosophy that enables needs to be identified and met by, not just a small group within a single organization, but a diverse group of people from many disciplines. The alternative to a platform strategy is an all-in-one monolithic solution which is not only an architectural anti-pattern but a strategic product anti-pattern as well. A monolithic approach is far more likely to fall victim to these constraints.

Why a Platform Strategy

Some notable and obvious sources illuminate the point quite well and highlight the power in the “platform”. The Power of Product Platforms,  Invisible Engines, and The Architecture of Open Source Applications all spell out why a platform strategy is critical in today’s approach to delivering continuous customer value through software. The most effective answer to the question posed above will be dictated by whether an organization embraces the platform strategy. The key to a strategic platform approach lies in a fundamental shift, not only in the development organization, but in the business overall, from DevOps to product development, to marketing and financing. We see examples of a platform strategy in diverse companies and industries, one example being Black & Decker, who completely reinvented themselves by establishing a base platform from which multiple tools are produced and sold. More obvious examples are Google and Apple with their apps strategy.

Simplicity is a Virtue

Platforms enable simplicity. Products that take the all-in-one solution approach typically continue to release versions which include more and more features, covering many use cases that get delivered to all customers regardless of the need. Why should enterprise software continue to be bloated with features? We know the issues this brings.

  1. It complicates the solution for the end user.
  2. Full development cycles dictate when customers can get significant, much needed solutions to pain points.
  3. And finally — and most importantly — customers are solely beholden to a product manager’s vision of what customers might require.

The Marketplace

The culmination of a modular platform based strategy is in the delivery vehicle for everything from new features, to documentation, to marketing. At Catalogic, this delivery vehicle is our online Marketplace (shown in the blog illustration). The Marketplace provides a framework that allows our organization to be much more flexible in how it delivers solutions to the market. Apps can be developed by teams and released when they are ready without  having to be tied to a significant platform release. Third parties can contribute to solutions in a timely manner, leveraging documented APIs that enable the integration with the platform. Single point solutions that offer simple and intuitive functionality can be leveraged by only customers who require that capability, thereby keeping the base solution simple for those not requiring the functionality.

Jay Hamilton is Senior Manager of Software Research and Development at Catalogic. 

For further reading, try this Storage Switzerland analyst report, “DevOps for IT Pros: The Key to Addressing Bi-Modal IT.”

Read More
08/16/2016 0 Comments

Catalogic and NetApp Cloud ONTAP: A Match Made In Heaven

Today at #NTAPInsightUS NTAP announced their new Hybrid Cloud utilizing Cloud ONTAP.  This announcement is a very strong move for NTAP.  Today cloud isn’t as much about technology as it is about business agility. The ability to keep IT cost low, the stuff that doesn’t make businesses money, and build agility and flexibility into the data center helps business drive new revenue models which is really important in today’s competitive world.

Also today, Catalogic Software announced that we work seamlessly with NTAP’s Cloud ONTAP to give clients visibility, insight and control over their environment locally, remote and now in the cloud.

Watch this short video demonstration of Catalogic Software and NetApp’s Cloud ONTAP.

Visit our ECX page and learn more about how to get control of your hybrid cloud data.

Read More
10/28/2014 0 Comments

Let us show you around