A Self-Organizing, Ad-hoc, Peer-to-peer, Human Network for Optimal Subterranean Transportation Routing

New Yorkers who want to be somewhere they are not are always in a rush, especially when taking the subway. Observations of a New Yorker giving directions demonstrate that they frequently have more than one route to a given destination, and choosing the optimal one is a non-trivial task.

From the Essex/Delancey station, one can take either the M train or the F train uptown to almost any station in Manhattan along this particular line. However, the trains arrive on different platforms, which are separated by a long stair case. It is impossible to observe both platforms simultaneously, and there is no automated indication of which train will arrive first and therefore reach a given destination fastest.

Commuters have devised a novel solution. Between train arrivals, passengers will cluster around the stairs separating the two platforms. As soon as there is more than one passenger, they will evenly distribute themselves along the stairs, re-calculating in O(1) time whenever a new node is added. When a train arrives on either platform, the nearest passenger, or edge node, signals the next node by glancing slightly in the direction of the rest of the passengers, and the message is similarly propagated throughout the network, allowing everyone to board the first train to arrive.

The result is an optimal, low-latency, low-overhead solution, built on existing hardware, following the primary rule of the subway: never make eye contact or speak to anyone.

And it’s a magical little reminder that New Yorkers, whatever our reputation, are good neighbors. Smart too.

An Open Metadata Solution

This Saturday, I will be speaking on a roundtable on metadata at the Open Video Conference and presenting an informal demonstration of new, metadata-related software I’ve been working on at the “Hack Day” on Sunday.

For the past year or so, I’ve been hearing bits of the film industry slowly wake up to the fact that the state of media metadata is a mess. The complete lack of open, common data formats leaves media producers struggling to conform their data to a variety of proprietary formats, only to result in outdated and inaccurate information left under the control of others. Worse, existing processes discriminate against independent producers by limiting what counts as a “real” movie, album or other work.

I have been working on a project called Open Media Object Format, which is a free (both as in beer and as in speech) protocol and file format for publishing rich metadata on a range of media. The protocol creates a distributed network of information on media and its participants, allowing the information to spread while every creator maintains authority over their own work. And the format is designed to store semantic data in more detail than we’ve seen before. The Open Media Object Format is an effort to address the above problems while bringing metadata away from the mere administrative, opening up possibilities for pretty cool stuff we haven’t seen before.

Details for the roundtable and the demo are below. Read the rest of this entry »