Blog

How to Scale Remote Production Workflows in a Cloud-based Environment

Remote production workflows for video editing are getting a lot of attention. The technology for remote production kept improving, but the pandemic really sped development up. Within the first week of the pandemic, the video team I led started deploying remote workflows. The technology was almost there then, but within weeks, we got it dialed in. 

The biggest challenge our team faced was latency. We learned that every link in the chain matters (Including open ports on cable internet coax splitters outside of your house! As crazy as that sounds.) Remote post-production workflow development accelerated to meet the challenge. The basics of addressing latency, permissions, and cloud-based proxy workflows have been addressed. So the next question is, “How do you scale it?”

What is remote post-production and cloud-based production?

Traditionally, an entire post-production team would be together in a “post-house.” Editors, colorists, and sound could work together on a centralized server known as a SAN. Cloud-based workflows move the storage to a cloud service provider instead of a local centralized server. This allows for post-production members to be distributed throughout the nation or the globe. 

Why is scaling workflows important for post-production?

Post-production teams need to be able to scale to deliver multiple projects for multiple clients. If a team relies on shipping hard drives back and forth in the mail, there is only so fast you can deliver your work to clients. 

On-set technology has also improved. New Camera to Cloud technologies have been released like the Atomos + MediaSilo integration where footage is delivered right into MediaSilo from an on-board monitor/recorder. 

Understanding workflows in production workflow

Now that you don’t have to wait for footage to be brought back to base to start editing, why not have a distributed post-production team? Editors can get right to work with low-resolution proxies as soon as they are uploaded to the cloud. Another advantage of cloud-based post-production is that editing teams worldwide can work in shifts. 

There are a couple of kinds of remote workflows. On one end of the spectrum is ingesting everything to the cloud. This requires a significant amount of bandwidth if you are putting raw camera files onto a cloud storage provider. You need to make sure that your upload speed isn’t a bottleneck that negates the efficiencies of remote post-production. 

Another approach is hybrid. In this remote video workflow, you can keep your raw files local and upload proxy files to a cloud storage provider. Project files can also be synced to the cloud so that editors can check in and out projects without stepping on each other toes.

Key factors for scalability

Cloud-based services for remote video editing workflows allocate a specific amount of storage to an account. This could range from 3TB – 10TB for starters. Users can add additional storage as they need it. It is worth thinking through how much “active” storage your team needs at any one time. If you have 3 editors who work with projects from 2-3TB each, 10TB would be a good amount to have in your “active” cloud storage. 

If your team is just using the cloud for proxies, you could probably accomplish the same amount of editing with 4TB of cloud storage. However, when you are ready to finish the final files, you’ll want to conform back to your raw camera files. If that is happening where you keep your raw files, then you are all set. If the person doing the color grade is remote, you might need to ship them an SSD. This is the limitation of a hybrid/proxy remote workflow. There is enough available storage and bandwidth for working with proxy files, but not RAW. 

Another challenge to scalable video production is having the right space for building a stock video library. Many clients want to accumulate footage that can be reused in multiple videos. 

Using cloud-based tools & software to scale workflows

One solution to the challenge of needing space for active projects and space for “stock” footage is to use a review and approval application, like MediaSilo, as a cloud-based asset manager for finished assets. These could be stock video clips, or they could be graphic assets, or project files for After Effects, Photoshop or Illustrator project files  (I know of an insurance company that does this). Review and approval tools are good places for frequently accessed files because they are easily searchable, and you don’t have to worry about permitting external users to access the primary “active” video storage. 

Managing post-production assets in the cloud

If you are running a remote post-production workflow, you will learn quickly that the file management tools in Google Drive or Dropbox aren’t designed for media production. That’s why EditShare FLEX. Its a suite of tools to facilitate your entire cloud-based post-production workflow. 

Cloud-based media management tools will help you to view assets while they reside on the cloud service without downloading them to your local machine. You can search your assets, make notes, create proxies, and organize projects.

Getting files to the cloud efficiently takes more than just a fat pipe from your ISP. Technologies from companies like Data Expedition optimize uploads to maximize your bandwidth. 

Another area to consider is data archival. Many teams have used LTO tape as a long-term storage solution. However, using LTO also means barriers to retrieving old footage. A smart cloud-storage strategy (like one using FLEX Cloud Sync) employs cloud-based archival solutions to store older projects on less expensive storage tiers.

Editing from the cloud

Once all your footage is in the cloud (whether raw or proxy), it is time to edit. Most remote editors download the proxies to local storage and start editing with their powerful computers. But there are a couple of other options. 

Technologies like EditShare FLEX Cloud Edit and Cloud Edit+ enable users to log into a remote server and edit with their favorite NLE without having to download footage locally. The NLE runs on a remote server but behaves as responsively as a locally installed copy. This wizardry is accomplished through technology like HP Teradici PCoIP (it just rolls off the tongue, doesn’t it?). Your local machine is essentially just a window into a responsive remote workstation.

Another approach allows editors to access on-prem storage as efficiently as cloud storage. EditShare Swift Link delivers this for EditShare FLOW users. Swift Link ensures latency is addressed for remote editors and that their editing experience is optimized for the network conditions between their workstation and your on-prem storage. 

Automation in the cloud

If you are evaluating a cloud-based remote post-production, don’t forget about transcoding and quality control workflows. If you are accustomed to a local workflow, you probably don’t give a second thought to batch transcoding a bunch of clips from a mezzanine codec like ProRes to a delivery codec like h.264. However, if that transcode takes place on a local client and the ProRes files are on a server, you’d have to download the ProRes files, transcode locally, and then upload the h.264 versions. 

If your cloud service provides the ability to automate transcodes in the cloud you can eliminate the upload and download times. Its even better if you can setting up multiple steps and rules so that the work of transcoding for various deliverables is automated. With the right tools, QC can also be done in the cloud as well. 

Scaling for remote production

Cloud-based workflows scale easily because additional resources can be added instantly. Scaling on-prem hardware solutions does take more planning, but if you make a good plan, it isn’t hard to add a unit to your local storage.

If you need higher performance, consider all NVMe shared storage. NVMe storage eliminates the bottlenecks of spinning disk storage. It is more expensive, but it also consumes less power and 

It is helpful to know that post-production standards are moving to the cloud. Today’s cutting-edge products are the result of years of careful planning and a deliberate industry-wide plan to take advantage of cloud-based post-production workflows.

Choosing to deploy remote video workflows now means your team will be prepared for all the latest technological advancements that are coming along every day. 

Conclusion

The time has finally arrived for scaling remote production workflows. Teams have options between hybrid and cloud-based workflows. Cameras and recorders can send files straight to the cloud. Media asset management apps can be deployed in the cloud. Remote cloud-based workstations can be accessed anywhere in the world. Solutions for archival, transcoding, QC and review/approval now integrate with each other. All the pieces are now in place to create efficient remote post-production teams. 

EditShare, paired with MediaSilo, offers a complete solution that incorporates the latest technologies with the flexibility of your choice of hybrid or fully cloud-based workflows. 

What do you think of remote video production workflows? If you have questions about the right setup for your team, send us a message!