SanFran MusicTech Summit

I'll be moderating a panel on new developments in streaming at the SanFran MusicTech Summit this Thursday, May 8th at the Hotel Kabuki. Our panel will start at 1:50pm in the Osaka Room (the downstairs room behind the Spring Room). With me will be:

John Richey - Wireless Music Delivery Expert, Apple
Greg Ogonowski - VP of New Product Development, Orban
Chris Grigg - Head of Standards, Beatnick
Tim Pozar - VP of Engineering, UnitedLayer

We're going to be talking about delivery methods. New codecs. Streaming to mobile devices. Internet radio hardware devices. How to determine if you really need a content delivery network. It should be real fun.

Here's a blurb about the summit:

The SanFran MusicTech Summit will bring together digital thought leaders from the San Francisco Bay Area, as well as from all around the country to the region which currently leads the way in innovating (both socially, and technologically) new ways of interacting with both music, and musicians. We will be working long term to help enable a sustainable, ongoing, Northern California based music and related technology market.

Register for the Summit here

Notes from the Platform Equality hearing

Rep. Howard Berman, Chairman of the House Judiciary Subcommittee on Courts, the Internet and Intellectual Property, held a hearing on "Platform Equality", which would end the decades long royalty exemption for terrestrial broadcasts.

Howard Coble (R-NC), Steve Cohen, (D-TN), Lamar Smith (R-TX) and Darrell Issa (R-CA) were among those voicing support for the proposal to end the terrestrial broadcast sound recording performance royalty exemption.

The three main arguments for this according to Berman:

The exemption was never justified under copyright law

Calbe, Satellite and Internet have to pay these royalties. There should be no discrimination based on platform.

US us the only major country that doesn't have a sound recording performance right.

Terrestrial broadcasters currently only pay royalties to the composers of the music; the "musical work". They do not pay for the use of the sound recording. In 2005, broadcasters paid $450 million in muscical work performance royalties.

Issa stated that congress is preparing to reorganize section 114 of the copyright act. (This is the sections that covers royalties for internet, satellite and cable services and provides exemptions for some other uses, such as use of music in business environments.)

Issa spoke a lot about HD radio, and the threat it makes to sale of CDs. He is under the impression that the 64kb or lower compressed digital audio sounds as good as CD. HD does not stand for High Definition. It stands for "Hybrid Digital". Unlike HDTV, which improved the signal quality delivered to consumers, HD radio is not a marked improvement. Signal to noise ratios are improved, but there are audible compression artifacts in the audio.

Issa also talked about a flood of HD radio recording devices that automatically split tracks coming out soon. (I think he's extremely wrong on this, there is so little uptake on HD hardware, there are only 2 or 3 HD radios on the market right now, and they're selling very poorly. I've heard a statistic several times that say an American is more likely to be run over by a bus than they are to listen to HD radio in the last year.)

Steve Cohen, who represents Memphis, TN,

San Jose, CA representative Zoe Lofgren was the only rep to speak out on the importance of small, independent internet (and non-internet) braodcasters. While she's not necessarily opposing the rate, she wants a rate that won't hurt small and non-commercial broadcasters.

(more later)

San Francisco power outage, SomaFM outage

There was a power outage affecting downtown San Francisco today, which also caused an outage at SomaFM's primary datacenter, 365 Main. Note that we've been there for about 2 years now, and this is the first power outage that's affected us. They had another outage right before we moved in, due to a faulty fire alarm which cut power to most of the building.

Now, a "world class datacenter" is supposed to have all sorts of redundant systems in place. And they did. But a slightly unusual series of events proved that even with all that redundancy, things can go very wrong. Here's what really went down at 365main as far as I can tell:

365 Main, like most facilities built by Above.net back in the day, doesn't have a battery backup UPS. Instead, they have a "CPS", or continuious power system. What they are is very very large flywheels that sit between electric motors and generators. So the power from PG&E never directly touches 365main. PGE power drives the motors which turn the flywheels which then turn the generators (or alternators, I don't remember the exact details) which in turn power the facility. There are 10 of these on their roof (or as they call it, the mezzanine; it's basically a covered roof). These CPS units isolate the facility from power surges, brownouts and blackouts.

The flywheels (the CPS system) can run the generator at full load for up to 60 seconds according to the specs.

There are also 10 large diesel engines up on the roof as well, connected to these CPS units. If the power is out for more than 15 seconds (as I recall, I could be wrong on the exact time), the generators start up, and clutch in and drive the flywheels.

There is a large fuel storage tank in the basement, and the fuel is pumped up to the roof. There are smaller fuel tanks on the roof as well, with enough capacity to run all the generators until the fuel starts getting pumped up to the roof.

Here's what I suspect happened:

It was reported there were several brief outages in a row before the power went out for good, so I bet the CPS (flywheel) systems weren't fully back up to speed when the next sequential outage occurred. Since several of these grid power interruption happened in a row, and were shorter than the time required to trigger generator startup, the generators were not automatically started, BUT the CPS didn't have time to get back up to full capacity. By the 6th power glitch, there wasn't enough energy stored in the flywheels to keep the system going long enough for the diesel generators to start up and come to speed before switching over.

Why they just didn't manually switch on the generators at that point is beyond me. (I bet they will next time!)

So they had a brief power outage. By our logs, it looks like it was at the most 2 minutes, but probably closer to 20 seconds or so.

So it looks like the diesels did cut over, but not before the CPS was exhausted in some cases. The whole facility did not lose power I'm told, just most of it.

Here's the letter their noc sent to customers about this:

This afternoon a power outage in San Francisco affected the 365 Main St. data center. In the process of 6 cascading outages, one of the outages was not protected and reset systems in many of the colo facilities of that building.

This resulted in the following:

- Some of our routers were momentarily down, causing network issues. These were resolved within minutes. Network issues would have been noticed in our San Francisco, San Jose, and Oakland facilities.

- DNS servers lost power and did not properly come back up. This has been resolved after about an hour of downtime and may have caused issues for many GNi customers that would appear as network issues

- Blades in the BC environment were reset as a result of the power loss. While all boxes seem to be back up we are investigating issues as they come in

- One of our SAN systems may have been affected. This is being checked on right now

If you have been experiencing network or DNS issues, please test your connections again. Note that blades in the DVB environment were not affected.

We apologize for this inconvenience. Once the current issues at hand are resolved, we will be investigating why the redundancy in our colocation power did not work as it should have, and we will be producing a postmortem report.

Lots of companies were affected. There was a huge line to get into the data center. It was definitely the most people I've ever seen there!