Close this search box.

Azure Native Qumulo Now available in the EU, UK, and Canada – Learn More

How to Move Your Data to Amazon S3 with Qumulo Shift

Authored by:
See how easy it is to move your file data with Qumulo Shift to Amazon S3 for tighter integration with over 150 cloud native services.

Qumulo has made it simple to replicate unstructured data at scale on Amazon Simple Storage Service or Amazon S3. With Qumulo Shift, once your file data is uploaded to S3, you can modify, analyze, and replicate it as needed using any of Amazon’s native services. 

For purposes of this how to guide, you’ll test drive your data with Amazon Elastic Transcoder service — using Qumulo Shift in an interactive hands-on lab running right in your own browser.

For a quick preview, check out our YouTube video below and see how easy it is to use Qumulo Shift to move your data to Amazon S3 for tighter integration with over 150 cloud-native services.

[qumulo_cta id=”257679″]

How to migrate unstructured data to Amazon S3

For more comprehensive instructions on using Qumulo Shift, see: How to copy objects between S3 buckets and clusters

Amazon S3 enables access to virtually limitless capacity–and it isn’t just for backup and archive anymore. With Amazon S3, you also have access to a broad range of AWS applications and services that can manipulate your data for all kinds of new business purposes. For example, you can analyze your data with an ML/AI engine or convert your media files to other formats for broader client access. Getting the capacity you need is easy– just choose a region, select a storage tier that matches your needs, and… Then what?

If you’re like virtually every other enterprise out there, you have MASSIVE amounts of unstructured data that qualifies for migration to Amazon S3. And for all the power of Amazon S3, you may find that the massive volume of data you need to migrate to Amazon S3 is overwhelming. There are open-source options for moving data to Amazon S3, but they are too slow for today’s data volumes, while higher performance third-party tools are expensive. 

Qumulo Shift – simple data replication to Amazon S3 at scale

The Qumulo Shift data service is built right into the Qumulo file data platform and provides data mobility to Amazon S3. Qumulo Shift is engineered for high-performance throughput to Amazon S3 at scale and it’s free to licensed Qumulo customers.

Qumulo Shift can be used to simplify backup and archive by making copies of your data in Amazon S3, or it can position your data for further processing using Amazon native services and applications.

Take a test drive: Demo Qumulo in our hands-on, interactive lab and see how easy it is to set up Qumulo Shift to migrate data to S3. 

Here’s how the lab works: With a Qumulo Test Drive, everything has been set up in advance. That means you won’t have to spend time setting up a new cluster, or figuring out how to connect to AWS and set up an S3 bucket for the Qumulo Shift tests that you’ll run. 

You’ll copy a 4K media file (follow closely, this will be important later) from your local desktop to the local Qumulo cluster, then watch as it’s replicated to an Amazon S3 bucket in real time.

Like all Qumulo management services, Qumulo Shift can be configured using either Qumulo’s web management interface or the Qumulo API library. With our hands-on lab, you’ll do both – first, you’ll copy the file up to S3 using the web portal; then, you’ll repeat the copy operation via API.

Wait – there’s more?

Here’s where it gets even better. Remember earlier, how Qumulo Shift can position your data for further processing by Amazon native services and applications? The next exercise in the hands-on lab leverages one of those services – Amazon Elastic Transcoder – to create lower-resolution copies of that original 4K media file (see why it mattered earlier?) and then download them back to the local Qumulo cluster.

Here’s why this capability is important: Unstructured data is growing at massive scale and companies need to prepare their infrastructure, storage and unstructured data management systems accordingly. Qumulo Shift makes it easy to replicate file data at scale up to  Amazon S3. Once your data is there, you can use any of the 150+ Amazon native services to get more value from your data. 

Hands-on Labs: a guided tour, on your schedule

If you’ve already experienced a test drive on the Qumulo Hands-on Lab portal, then you’re familiar with the process. After you submit a demo request, you’ll receive an email with a link to your very own lab environment. 

Once connected to your own lab environment, you’ll see a virtual desktop session with everything you need pre-staged for you. You’ll have easy access to a local Qumulo cluster and Amazon S3 bucket for demo purposes. The right side of your browser will give you step-by-step instructions on how to use Qumulo Shift and Amazon Elastic Transcoder services. You can see how easy they are to use, and how well they work together.

Even though your session will be available for several hours, you’ll be able to walk through the entire lab in less than 30 minutes. Plus, you’ll have time to explore the environment on your own. Use it to demo Qumulo’s file data platform to others in your organization’s buying committee. 

The best part? You don’t need to take my word for it. Try it for yourself, and see how radically simple managing unstructured data services on the cloud can be. 

Qumulo hands-on labs

More Qumulo Hands-on Labs will be released in the next few months. In addition to test driving a Qumulo Cluster or Qumulo Shift for Amazon S3, you’ll also be able to try Qumulo Cloud on AWS, and a Qumulo Cluster Upgrade in our interactive portal.

Learn more

Related Posts

Scroll to Top