Post P2P

Lexus, Mercedes, Porsche

Wednesday, December 29th, 2004

Tyler Cowen cites a Harper’s Index factoid:

Number of American five-year-olds named Lexus: 353

One of them works at Raisins, featured in the first South Park episode I ever watched and still my sentimental favorite. Every kid should watch this episode. If it is available on DVD I can’t find it, but search for “South Park 714” or “South Park Raisins” on any filesharing network — South Park episodes are among the most shared content.

Also see Christian Hard Rock, which tackles filesharing. Almost every episode is well worth watching for kids and adults. Skip the movie, it sucks ass.

ccPublisher 1.0

Monday, December 27th, 2004

Nathan Yergler just cut ccPublisher 1.0, a Windows/Mac/Linux desktop app that helps you license, tag, and distribute your audio and video works. I’m very biased, but I think it’d be a pretty neat little application even if it weren’t Creative Commons centric.

  • It’s written in Python with a wxPython UI, but is distributed as a native windows installer or Mac disk image with no dependencies. Install and run like any other program on your platform, no implementation leakage. Drag’n’drop works.
  • Also invisible to the end user, it uses the Internet Archive’s XML contribution interface, ftp and CC’s nascent web services.
  • RDF metadata is generated, hidden from the user if published at IA, or available for self-publishing, ties into CC’s search and P2P strategies.

Python and friends did most of the work, but the 90/10-10/90 rule applied (making a cross platform app work well still isn’t trivial, integration is always messy, and anything involving ID3v2 sucks). Props to Nathan.

Version 2 will be much slicker, support more media types, and be extensible for use by other data repositories.

Addendum 2005-01-12: Check out Nathan’s 1.0 post mortem and 2.0 preview.

Center for Decentralization

Wednesday, December 15th, 2004

This evening I had the pleasure of attending an open house for the CommerceNet Labs center for decentralization or Zlab. I’ve been meaning to write about Zlab for awhile, and I’m taking advantage of tonight’s event to write without having anything to say.

If I may boil down Zlab’s aim to one paraphrase: Make software that works the way a fully decentralized society would work.

Check out their The Now Economy for a flurry of deep items concerning decentralized commerce and net infrastructure, lab projects that abet the above aim and publications. Of personal interest, see Nutch: A Flexible and Scalable Open-Source Web Search Engine, which uses the Creative Commons search engine to demonstrate how a Nutch plugin is implemented.

Ordinary Submissions

Thursday, November 25th, 2004

Two bloggers on using Bitzi.

Neil Turner recommends “Wonderful Life” by Ordinary People feat. Tina Cousins. Apparently the track is hard to find. Having lost a copy once due to disk troubles, Neil submitted the file to Bitzi. Now others can use the Bitzi ticket to find the file he recommends (and Neil will have an easier time in the event of another storage failure). I was pleasantly surprised to find that after a few tries I could download the exact file from two Gnutella hosts. Unfortunately dance music and electronica aren’t my thing.

Fareed of Cairo and “survivor of a car crash” writes about checking file integrity:

Have you ever downloaded files and you were not sure of it’s integrity. Now their is a way to be sure, a site called Bitzi allows you to check file integrity. Users can submit using a program called Bit Collider file hashes to the site or verify that the integrity is ok.

So Bitzi can help identify good and bad files. Good luck avoiding future hard disk and car crashes!

Morpheus with Bitzi “anti-spoofing”

Thursday, October 7th, 2004

Morpheus, a popular filesharing client at version 4.5:

Includes free Bitzi anti-spoofing look-ups to download only the files you want.

That’s an accurate description (and has been true since at least Morpheus 4.1.1). If you see something you’re interested in downloading in search results, you’re a right-click away from a Bitzi lookup. If Bitzi users have judged the file to be spam, virus-laden, or corrupted, you’ll get a response similar to this:

bad file

Thirty Bitzi users have judged this file as dangerous or misleading (one bozo recommended the file). A few of the judgement notes tell the story:

Every time I write something,it will come up in my searching files. The size is 105,2 kb every time.

and

stupid isaveclub.com spam, coming from 69.44.152.159:255….discuises itself under many wma files

If Bitzi users have judged the file you’re interested in to be worthy, you’d see something similar to this:

good file

That file happens to be the current release for Windows of Bitzi’s bitcollider file metadata collection tool.

Derek Slater notes that Bitzi metadata is itself subject to spoofing, and

even if Bitzi helps people sort out spoofs, the technological arms race will continue.

Very true. Bitzi is dependent upon community policing, and a concerted effort to create dangerous files and submit fraudulent judgements to Bitzi would work, at least for awhile. There are steps Bitzi can take to militate against such attacks should they become a problem. Unfortunately, as I noted recently, development proceeds at a bear in winter’s pace.

It should also be noted that Morpheus is just one of several applications that enable Bitzi lookups or submissions, though most of these send users to a Bitzi web page rather than integrating raw data from Bitzi lookups into their user interface as Morpheus has (see screenshots above).

Best Bitizen

Monday, October 4th, 2004

After over three and a half years I am finally the best bitizen, as defined by a formula that takes into account the amount of file metadata contributed to Bitzi and the quality of that metadata, as rated by other “bitizens” (Bitzi users):

How did I obtain this dubious (as a Bitzi cofounder) honor?

I’ve more or less consistently reported some of the random junk I may have encountered (though around 30 Bitzi users have reported more, all over a shorter active period) and more importantly, have occasionally taken care to add accurate metadata to reports.

On the negative side, I’ve more or less consistently failed to put much effort into adding new features since Bitzi went into hibernation. If I had, doubtless many more prolific than I (nearly everything I download is from the web — file sharing networks, especially post-Napster (really post-AudioGalaxy), are still practically useless in my estimation, unless you have lots of time to kill, i.e., you’re a bored teenager) would’ve stuck around and I’d be nowhere near numero uno.

Download the bitcollider (file metadata reporting tool) and knock me off my throne!

Markets and Election Outcomes

Sunday, September 26th, 2004

Last week (September 22) the Wall Street Journal printed “Market Gains As Bush Rises and Kerry Falls” (unauthorized copy found here).

I’m extremely skeptical that the market should be read as approving or disapproving of Bush or Kerry, or particularly responding to individual polls. There’s so much noise in the market that I’d only expect an unthinking partisan to read candidate preference from market index behavior, particularly when the two candidates who can win are so similar policy-wise (though a partisan wouldn’t agree).

However, it should be possible to design securities which explicitly tease out the effect of a candidate’s election on the market (or something else). One approach is I believe known as “conditional futures”. Three securities would do it: a) has a value determined by whether Bush wins, b) has the value determined by a market index on a date in the future, and c) has the value determined by a market index on the same date in the future if Bush wins, or zero otherwise. If c/a > b then the futures market thinks a Bush win is good for the market index in question. Alternatively b) could be determined by the value of the market on the same date in the future if Bush loses, in which case if c/a > b/(1-a) then the market thinks a Bush win is good.

You can see some claims along these lines in a play money (unfortunately) market:

(In calculations below I use last trade if available, otherwise average of bid and ask.)

bid ask last
/  /   /
61 62 61 http://www.ideosphere.com/fx-bin/Claim?claim=Bush04

Bush is likely to win.

47 48 NA http://www.ideosphere.com/fx-bin/Claim?claim=Stocks
25 30 25 http://www.ideosphere.com/fx-bin/Claim?claim=GBStok

25/.61 = 41 < 47.5 Bush win means lower stock returns? 51 53 52 http://www.ideosphere.com/fx-bin/Claim?claim=GBNuke
33 39 34 http://www.ideosphere.com/fx-bin/Claim?claim=JKNuke

52/.61 = 85 < 34/.39 = 87 Bush win means slightly lower chance of US getting nuked? CORRECTION: I misread *Nuke, which pay if the US does not get nuked. I should've written: "Kerry win means slightly lower chance of US getting nuked?" 75 77 76 http://www.ideosphere.com/fx-bin/Claim?claim=Terr10
20 74 NA http://www.ideosphere.com/fx-bin/Claim?claim=GBTerr

47/.61 = 77 > 76

Bush win means very slightly higher chance of terrorist attack in US?

Note these claims are mostly new with extremely thin volumes and probably don’t tell us much of anything at this point about the consequences of a (likely) Bush win, but one gets the idea, I hope.

Related notes:

Tradesports and the Iowa Electronic Markets (two real-money markets, though investment in IEM is limited) seem to be garnering lots of attention, at least amongst people I read. Geekmedia has yet another electoral map based on Tradesports markets for individual state outcomes (via Patri Friedman).

I think it isn’t widely known that large scale organized betting on election outcomes in the U.S. is a back-to-the-future phenomenon. I didn’t know until a few weeks ago when I encountered Historical Presidential Betting Markets while flipping through the Journal of Economic Perspectives at the newish San Jose main library (’tis very nice that it is a shared facility with SJSU, which means many more journals available to the general public). I indend[ed] to blog a summary.

Drifting:

Koleman Strumpf, one of the authors of the aforementioned paper, has also written on the effects of P2P — to much to read, too little time — and is an indie music fan. Funny quote from one of his media cites, The down low on downloads:

Strumpf, whose own tastes run toward independents, says it’ll be difficult for a study like his to measure their financial prospects. “The kind of albums that are put out by indie labels are not economically very important,” he says. “I know that must sound like a terrible statement. Believe me, if you look at my music collection, I’ve come to the conclusion that most of the music I listen to is economically irrelevant.”

A pin maybe found in a haystack

Monday, August 16th, 2004

Ed Felter spreads a SHA-1 hash collision rumor.

Eric Rescorla does a good job of explaining that even if true, a collision is not of great practical import.

Why? Most uses of SHA-1, including Bitzi, rely on the practical impossibility of finding content that will generate a specific hash.

A collision merely means that two pieces of content (“messages” in crypto-speak) have been found that generate the same arbitrary hash.

For reasons that aren’t all that intuitive, it is much harder to find a specific match than an arbitrary collision.

I think in day-to-day experience a good analogue would be this: it’s pretty easy to find odd coincidences if you look. If you know how to conjure up specific odd coincidences on demand, tell me.

All that said, Bitzi also uses the Tiger hash, which is not from the same family as SHA-1, as an insurance policy among other things.

Disclaimer: I am not a crypto expert. If true this rumor may be huge news for crypto theorists.

DirectConnect increment[al download verification]

Thursday, March 4th, 2004

Slyck reports on a major DirectConnect upgrade. DirectConnect hasn’t seen much interest from the press or technologists, but it does have a significant userbase, with 215,880 users currently online according to the Slyck home page, slightly smaller than Gnutella’s 234,618. I have no idea how Slyck obtains those numbers.

Anyhow, it is good to see that DirectConnect has adopted file hashing, specifically THEX (Tree Hash EXchange) using the Tiger hash. This allows DirectConnect clients to find exact alternate download sources and to verify downloads as they progress and opens to door to future MAGNET and Bitzi lookup support.

Here’s a MAGNET link that includes the tiger tree root (second component of the bitprint) and a corresponding Bitzi info lookup by urn:tree:tiger.

Jay-Z_Construction_Set.zip (631.9MB)

Creative Commons Moving Image Contest Winners

Saturday, February 28th, 2004

Announced today. Copied from the Creative Commons home page:

We’re very happy to announce the winners of the GET CREATIVE! Moving Images Contest: First Place goes to Justin Cone, for the inspired and powerful short film “Building on the Past,” which uses all sorts of Prelinger Archives footage to great effect. Second Place: Sheryl Seibert, for “Mix Tape,” which perfectly captures the found-art ethos of Creative Commons and uses the Creative Commons-licensed song “Mix Tape” by Jim’s Big Ego. Third Place: Kuba and Alek Tarkowski, for “CCC,” a historical look at free culture. Check them out, download them, mirror them, share them with friends. Thanks to all of you who made submissions!

The first place entry is really good, though my favorite scene is midway through the third placer — “a mutation of the system, if you will.”

MAGNET/Bitzi links for easy sharing and info:

Justin_Cone_-_Building_On_The_Past.mov (7.0MB)
Sheryl_Seibert_-_Mix_Tape.mov (31.8MB)
Kuba_and_Alek_Tarkowski_-_CCC.mpg (14.9MB)