Search

Fast Enough? Data-Driven Broadcast Infrastructure

by Bob Zelin
Creative COW Magazine : Blue Ribbon Awards Issue : Fast Enough? Data-Driven Broadcast Infrastructure
SAN - Storage Area Networks Review at Creative COW


FAST IS NEVER FAST ENOUGH

Two terabyte drives are now commonplace and inexpensive, so 8 bay drive arrays with 16 terabytes of storage, and 16 bay arrays with 32 terabytes of storage, were everywhere, and everyone was talking about arrays currently running 600 - 800 Mb/sec -- fast enough not only for uncompressed HD, but for 2K and 4K media. But as always, fast is never fast enough, so JMR was showing their split bus drive arrays that are like having two drive arrays in one box, with two SAS/SATA host controller cards -- one running each bus -- to achieve speeds of 1200 - 1400 Mb/sec. Real fast!

The big "speed" story was the announcement of 6 Gig drive technology, and 6 Gig support products, like the new ATTO R680 card. I was told at the ATTO booth that they estimate that a typical 6 Gig, 16 bay drive chassis with the new R680 card will probably do about 2200 Mb/sec. Why is this important when 2K DPX files only require about 300Mb/s? Shared storage, that's why!

There are lots of fantastic shared storage solutions on the market, but many are limited by the speed of the data connection per client computer, or the overall speed of the drive array. For example, at the Maxx Digital booth, I demonstrated uncompressed 2K DPX files running Autodesk Smoke on a Mac, over 10 Gig Ethernet cable to a shared disk drive array.

It worked, and it was impressive -- but it is a fantasy, because common drive arrays commonly run between 600 - 700 Mb/sec., enough for two guys to work at 300MB/s, tops. What if you want to attach more people? Your drives are not fast enough, and cannot support that many streams of video. Once drive arrays can do 2200Mb/sec, all of a sudden, an entire small company can be running uncompressed 2K media over shared storage, and not spending a fortune to make this happen.

While 6 Gig SAS/SATA host adaptors and drive arrays will be released in a couple of months, it may take till the end of 2010 for us to see 6 Gig SATA drives. This can be achieved now with SAS drives, but they are expensive, and as we all know too well, no one wants to spend too much money now, with all the new stuff coming out in a few months.

Many of the drive manufacturers like Rorke, JMR, and Sonnet were "ATTO FastStream" crazy. They were all promoting "instant shared storage" based on the fact that they incorporate the ATTO FastStream appliance into their drive arrays, which allows you to have shared storage without a server or fibre switch.

ATTO FibreConnect.
ATTO FibreConnect™


JMR FibreStream RAID Storage System.
JMR FibreStream RAID Storage System


But all of your computers must have fibre cards, fibre transceivers back to the ATTO FastStream in their drive arrays, and of course SAN management software (like Tiger Technology MetaSAN or Commandsoft FibreJet) running on each workstation. CalDigit showed a truly unique shared storage solution that used their new PCIe switch and PCIe hub.


CalDigit SuperShare.
CalDigit SuperShare


Because their drive arrays, such as the HDPro2, do not daisy chain for expansion, all the drives go into the hub, and you keep adding more and more drives to the hub as you expand. The hub ties to the switch, so that you can now connect multiple FCP systems to the switch via PCIe expansion cards. Using the PCIe switch allows you run at full uncompressed speeds, as you are not limited to the bandwidth of Ethernet.

As you look at these shared storage systems, and see the future of uncompressed HD, 2K and 4K workflows becoming a reality for many of us in the near future, you realize that having very fast drive arrays will become not a luxury, but a necessity to stay in business.


  View 9 Comment(s)

  Blue Ribbon Awards
Reply   Like  
Comments

Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Bob Zelin
Ryan -
please post your question on a regular Cow forum, like SAN networks, or Arrays and Storage.

I don't understand your question.

Bob Zelin

Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Ryan Wu
has anyone used this copying to RAIDs.
I'd love to get this and put it through it's paces on a feature right now shooting with ARRI SxS cards.

Cus the Sony usb 2 reader is really inadequate for a multicamera show.

Anybody used this in the real deal yet?
Ready to drop some cash on it if it can handle the work via my 17" MBP.
Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Loch Phillipps
Mr. Z - We miss you in the NY area. Nice to see that you still have that crazy energy that keeps you surfing the tech wave rather than trying to catch up like the many of us.

Loch Phillipp
Off Ramp Films
Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Mike Cohen
That Qio device is interesting - combining P2 and SxS in one device - surprised that would be permitted by the makers of VHS and Betamax! It's like a half moon cookie - chocolate and vanilla living in harmony.

Always interesting reading about those shiny metal boxes we see advertised but never actually see in action.

Mike Cohen
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Alex Udell
Very cool!

I'd like to know more about both Cal Digit Super Share and Cat DV.

Thanks for letting me know these exist.


Alex
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Bob Zelin
I'd like to know more about both Cal Digit Super Share and Cat DV.



Lucky for you, Alex, that Creative Cow has a Cal Digit forum, and a CAT DV forum, that can answer all your questions about Super share, and CAT DV.

Bob Zelin


Re: Fast Enough? Data-Driven Broadcast Infrastructure
by Earle Nichol
Nice Job Mr Zelin! I had the exact same feeling on some DDR slomotion controllers from Tightrope...how did I miss that??
Thanks for the Hard Rock Centre Bar... great meeting!!

Earle

Communication! Communication! Communication!
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Herb Sevush
Bob -

Thanks for the great article. You saved me the cost of flying to Vegas.

Herb Sevush
Zebra Productions
Re: Article: Fast Enough? Data-Driven Broadcast Infrastructure
by Simon Blackledge
Thanks Bob.. appreciated.

s




More From Blue Ribbon Awards Issue:
Why We've Avoided Tradeshow Awards Until Now Letters to the COW Team
Why We've Avoided Tradeshow Awards Until Now
Editorial
Winners of the Creative COW Magazine Blue Ribbon Letters to the COW Team
Winners of the Creative COW Magazine Blue Ribbon
Review, Editorial, Feature
Camera and Lens Round-UpCinematography
Camera and Lens Round-Up
Review, Feature, People / Interview
Stereoscopic Storm - NAB 3D CamerasStereoscopic 3D
Stereoscopic Storm - NAB 3D Cameras
Review, Feature, People / Interview
DSLRs: A Time ExposureCinematography
DSLRs: A Time Exposure
Review, Feature, People / Interview
Blue Ribbon Broadcast SwitchersBroadcast Video
Blue Ribbon Broadcast Switchers
Review
Blue Ribbon for Best of Show: NAB 2010 -- Blackmagic DesignBlackmagic Design
Blue Ribbon for Best of Show: NAB 2010 -- Blackmagic Design
Review, Feature, People / Interview
Best Nonlinear Editing System ReportBroadcast Video
Best Nonlinear Editing System Report
Review, People / Interview
A Great Team to Introduce Our Award Winners Letters to the COW Team
A Great Team to Introduce Our Award Winners
Editorial
MORE




Related Articles:
NAB 2012: ATTO TechnologySAN - Storage Area Networks
NAB 2012: ATTO Technology
Feature
XenData and Harmonic Introduce Integrated Broadcast Archive SystemSAN - Storage Area Networks
XenData and Harmonic Introduce Integrated Broadcast Archive System
Feature, People / Interview
Changing the Game with the Blackmagic Design Broadcast VideohubSAN - Storage Area Networks
Changing the Game with the Blackmagic Design Broadcast Videohub
Tutorial
Shared Media Storage Without Breaking the BankSAN - Storage Area Networks
Shared Media Storage Without Breaking the Bank
Feature
Build your own affordable SAN -- that works!SAN - Storage Area Networks
Build your own affordable SAN -- that works!
Tutorial, Feature
Charles McConathy discusses video system configurationSAN - Storage Area Networks
Charles McConathy discusses video system configuration
Tutorial
MORE


Creative COW Magazine is copyright 2006 - 2012 by Creative COW®. All rights are reserved.
No reprint rights are granted except to educational institutions such as universities, colleges,
art academies and other training academies. All other rights are expressly reserved.
[Top]