Archive for the ‘P2P’ Category

ccPublisher 1.0

Monday, December 27th, 2004

Nathan Yergler just cut ccPublisher 1.0, a Windows/Mac/Linux desktop app that helps you license, tag, and distribute your audio and video works. I’m very biased, but I think it’d be a pretty neat little application even if it weren’t Creative Commons centric.

  • It’s written in Python with a wxPython UI, but is distributed as a native windows installer or Mac disk image with no dependencies. Install and run like any other program on your platform, no implementation leakage. Drag’n'drop works.
  • Also invisible to the end user, it uses the Internet Archive’s XML contribution interface, ftp and CC’s nascent web services.
  • RDF metadata is generated, hidden from the user if published at IA, or available for self-publishing, ties into CC’s search and P2P strategies.

Python and friends did most of the work, but the 90/10-10/90 rule applied (making a cross platform app work well still isn’t trivial, integration is always messy, and anything involving ID3v2 sucks). Props to Nathan.

Version 2 will be much slicker, support more media types, and be extensible for use by other data repositories.

Addendum 2005-01-12: Check out Nathan’s 1.0 post mortem and 2.0 preview.

Center for Decentralization

Wednesday, December 15th, 2004

This evening I had the pleasure of attending an open house for the CommerceNet Labs center for decentralization or Zlab. I’ve been meaning to write about Zlab for awhile, and I’m taking advantage of tonight’s event to write without having anything to say.

If I may boil down Zlab’s aim to one paraphrase: Make software that works the way a fully decentralized society would work.

Check out their The Now Economy for a flurry of deep items concerning decentralized commerce and net infrastructure, lab projects that abet the above aim and publications. Of personal interest, see Nutch: A Flexible and Scalable Open-Source Web Search Engine, which uses the Creative Commons search engine to demonstrate how a Nutch plugin is implemented.

Ordinary Submissions

Thursday, November 25th, 2004

Two bloggers on using Bitzi.

Neil Turner recommends “Wonderful Life” by Ordinary People feat. Tina Cousins. Apparently the track is hard to find. Having lost a copy once due to disk troubles, Neil submitted the file to Bitzi. Now others can use the Bitzi ticket to find the file he recommends (and Neil will have an easier time in the event of another storage failure). I was pleasantly surprised to find that after a few tries I could download the exact file from two Gnutella hosts. Unfortunately dance music and electronica aren’t my thing.

Fareed of Cairo and “survivor of a car crash” writes about checking file integrity:

Have you ever downloaded files and you were not sure of it’s integrity. Now their is a way to be sure, a site called Bitzi allows you to check file integrity. Users can submit using a program called Bit Collider file hashes to the site or verify that the integrity is ok.

So Bitzi can help identify good and bad files. Good luck avoiding future hard disk and car crashes!

Morpheus with Bitzi “anti-spoofing”

Thursday, October 7th, 2004

Morpheus, a popular filesharing client at version 4.5:

Includes free Bitzi anti-spoofing look-ups to download only the files you want.

That’s an accurate description (and has been true since at least Morpheus 4.1.1). If you see something you’re interested in downloading in search results, you’re a right-click away from a Bitzi lookup. If Bitzi users have judged the file to be spam, virus-laden, or corrupted, you’ll get a response similar to this:

bad file

Thirty Bitzi users have judged this file as dangerous or misleading (one bozo recommended the file). A few of the judgement notes tell the story:

Every time I write something,it will come up in my searching files. The size is 105,2 kb every time.

and

stupid isaveclub.com spam, coming from 69.44.152.159:255….discuises itself under many wma files

If Bitzi users have judged the file you’re interested in to be worthy, you’d see something similar to this:

good file

That file happens to be the current release for Windows of Bitzi’s bitcollider file metadata collection tool.

Derek Slater notes that Bitzi metadata is itself subject to spoofing, and

even if Bitzi helps people sort out spoofs, the technological arms race will continue.

Very true. Bitzi is dependent upon community policing, and a concerted effort to create dangerous files and submit fraudulent judgements to Bitzi would work, at least for awhile. There are steps Bitzi can take to militate against such attacks should they become a problem. Unfortunately, as I noted recently, development proceeds at a bear in winter’s pace.

It should also be noted that Morpheus is just one of several applications that enable Bitzi lookups or submissions, though most of these send users to a Bitzi web page rather than integrating raw data from Bitzi lookups into their user interface as Morpheus has (see screenshots above).

Best Bitizen

Monday, October 4th, 2004

After over three and a half years I am finally the best bitizen, as defined by a formula that takes into account the amount of file metadata contributed to Bitzi and the quality of that metadata, as rated by other “bitizens” (Bitzi users):

How did I obtain this dubious (as a Bitzi cofounder) honor?

I’ve more or less consistently reported some of the random junk I may have encountered (though around 30 Bitzi users have reported more, all over a shorter active period) and more importantly, have occasionally taken care to add accurate metadata to reports.

On the negative side, I’ve more or less consistently failed to put much effort into adding new features since Bitzi went into hibernation. If I had, doubtless many more prolific than I (nearly everything I download is from the web — file sharing networks, especially post-Napster (really post-AudioGalaxy), are still practically useless in my estimation, unless you have lots of time to kill, i.e., you’re a bored teenager) would’ve stuck around and I’d be nowhere near numero uno.

Download the bitcollider (file metadata reporting tool) and knock me off my throne!

Markets and Election Outcomes

Sunday, September 26th, 2004

Last week (September 22) the Wall Street Journal printed “Market Gains As Bush Rises and Kerry Falls” (unauthorized copy found here).

I’m extremely skeptical that the market should be read as approving or disapproving of Bush or Kerry, or particularly responding to individual polls. There’s so much noise in the market that I’d only expect an unthinking partisan to read candidate preference from market index behavior, particularly when the two candidates who can win are so similar policy-wise (though a partisan wouldn’t agree).

However, it should be possible to design securities which explicitly tease out the effect of a candidate’s election on the market (or something else). One approach is I believe known as “conditional futures”. Three securities would do it: a) has a value determined by whether Bush wins, b) has the value determined by a market index on a date in the future, and c) has the value determined by a market index on the same date in the future if Bush wins, or zero otherwise. If c/a > b then the futures market thinks a Bush win is good for the market index in question. Alternatively b) could be determined by the value of the market on the same date in the future if Bush loses, in which case if c/a > b/(1-a) then the market thinks a Bush win is good.

You can see some claims along these lines in a play money (unfortunately) market:

(In calculations below I use last trade if available, otherwise average of bid and ask.)

bid ask last
/  /   /
61 62 61 http://www.ideosphere.com/fx-bin/Claim?claim=Bush04

Bush is likely to win.

47 48 NA http://www.ideosphere.com/fx-bin/Claim?claim=Stocks
25 30 25 http://www.ideosphere.com/fx-bin/Claim?claim=GBStok

25/.61 = 41 < 47.5

Bush win means lower stock returns?

51 53 52 http://www.ideosphere.com/fx-bin/Claim?claim=GBNuke
33 39 34 http://www.ideosphere.com/fx-bin/Claim?claim=JKNuke

52/.61 = 85 < 34/.39 = 87

Bush win means slightly lower chance of US getting nuked?

CORRECTION: I misread *Nuke, which pay if the US does not get nuked. I should've written: "Kerry win means slightly lower chance of US getting nuked?"

75 77 76 http://www.ideosphere.com/fx-bin/Claim?claim=Terr10
20 74 NA http://www.ideosphere.com/fx-bin/Claim?claim=GBTerr

47/.61 = 77 > 76

Bush win means very slightly higher chance of terrorist attack in US?

Note these claims are mostly new with extremely thin volumes and probably don’t tell us much of anything at this point about the consequences of a (likely) Bush win, but one gets the idea, I hope.

Related notes:

Tradesports and the Iowa Electronic Markets (two real-money markets, though investment in IEM is limited) seem to be garnering lots of attention, at least amongst people I read. Geekmedia has yet another electoral map based on Tradesports markets for individual state outcomes (via Patri Friedman).

I think it isn’t widely known that large scale organized betting on election outcomes in the U.S. is a back-to-the-future phenomenon. I didn’t know until a few weeks ago when I encountered Historical Presidential Betting Markets while flipping through the Journal of Economic Perspectives at the newish San Jose main library (’tis very nice that it is a shared facility with SJSU, which means many more journals available to the general public). I indend[ed] to blog a summary.

Drifting:

Koleman Strumpf, one of the authors of the aforementioned paper, has also written on the effects of P2P — to much to read, too little time — and is an indie music fan. Funny quote from one of his media cites, The down low on downloads:

Strumpf, whose own tastes run toward independents, says it’ll be difficult for a study like his to measure their financial prospects. “The kind of albums that are put out by indie labels are not economically very important,” he says. “I know that must sound like a terrible statement. Believe me, if you look at my music collection, I’ve come to the conclusion that most of the music I listen to is economically irrelevant.”

A pin maybe found in a haystack

Monday, August 16th, 2004

Ed Felter spreads a SHA-1 hash collision rumor.

Eric Rescorla does a good job of explaining that even if true, a collision is not of great practical import.

Why? Most uses of SHA-1, including Bitzi, rely on the practical impossibility of finding content that will generate a specific hash.

A collision merely means that two pieces of content (”messages” in crypto-speak) have been found that generate the same arbitrary hash.

For reasons that aren’t all that intuitive, it is much harder to find a specific match than an arbitrary collision.

I think in day-to-day experience a good analogue would be this: it’s pretty easy to find odd coincidences if you look. If you know how to conjure up specific odd coincidences on demand, tell me.

All that said, Bitzi also uses the Tiger hash, which is not from the same family as SHA-1, as an insurance policy among other things.

Disclaimer: I am not a crypto expert. If true this rumor may be huge news for crypto theorists.

DirectConnect increment[al download verification]

Thursday, March 4th, 2004

Slyck reports on a major DirectConnect upgrade. DirectConnect hasn’t seen much interest from the press or technologists, but it does have a significant userbase, with 215,880 users currently online according to the Slyck home page, slightly smaller than Gnutella’s 234,618. I have no idea how Slyck obtains those numbers.

Anyhow, it is good to see that DirectConnect has adopted file hashing, specifically THEX (Tree Hash EXchange) using the Tiger hash. This allows DirectConnect clients to find exact alternate download sources and to verify downloads as they progress and opens to door to future MAGNET and Bitzi lookup support.

Here’s a MAGNET link that includes the tiger tree root (second component of the bitprint) and a corresponding Bitzi info lookup by urn:tree:tiger.

Jay-Z_Construction_Set.zip (631.9MB)

Creative Commons Moving Image Contest Winners

Saturday, February 28th, 2004

Announced today. Copied from the Creative Commons home page:

We’re very happy to announce the winners of the GET CREATIVE! Moving Images Contest: First Place goes to Justin Cone, for the inspired and powerful short film “Building on the Past,” which uses all sorts of Prelinger Archives footage to great effect. Second Place: Sheryl Seibert, for “Mix Tape,” which perfectly captures the found-art ethos of Creative Commons and uses the Creative Commons-licensed song “Mix Tape” by Jim’s Big Ego. Third Place: Kuba and Alek Tarkowski, for “CCC,” a historical look at free culture. Check them out, download them, mirror them, share them with friends. Thanks to all of you who made submissions!

The first place entry is really good, though my favorite scene is midway through the third placer — “a mutation of the system, if you will.”

MAGNET/Bitzi links for easy sharing and info:

Justin_Cone_-_Building_On_The_Past.mov (7.0MB)
Sheryl_Seibert_-_Mix_Tape.mov (31.8MB)
Kuba_and_Alek_Tarkowski_-_CCC.mpg (14.9MB)

Get creative, remix culture

Thursday, February 26th, 2004

As posted on the Creative Commons weblog:

The source materials for both “Get Creative” and “Remix Culture” are now available. Download the .fla file for either and you can get creative and remix “Get Creative” or “Remix Culture” with ease.

Quicktime versions of both movies are also now available. Now it’s easier than ever to download, display and share “Get Creative” and “Remix Culture” (right-click on links to download and save).

Thanks to Ibiblio for hosting all of these files. The Quicktime movies are also available at the Internet Archive here and here. The Internet Archive will also host your Creative Commons-licensed movies and music free of charge. Get started.

MAGNET and Bitzi links:

Creative_Commons_-_Get_Creative.fla (46.1MB)
Creative_Commons_-_Get_Creative.mov (6.9MB)
Creative_Commons_-_Get_Creative.swf (5.5MB)
Creative_Commons_-_Remix_Culture.fla (94.9MB)
Creative_Commons_-_Remix_Culture.mov (6.8MB)
Creative_Commons_-_Remix_Culture.swf (6.8MB)

Voluntary Collective Licensing

Wednesday, February 25th, 2004

The EFF has released a white paper outlining a proposed solution to the file sharing wars. It may strike one as compulsory licensing lite, but that perhaps is unfair, as everything is voluntary in the proposal. Still, the system would have to deal with versions of the problems with compulsory licensing (not an exhaustive list).

The one thing that really irritates me about this proposal (and it irritates me every time I hear it, which is often: example) is the mantra that “artists and copyright holders deserve to be fairly compensated.” Yeah, whatever. For some highly variable and contentious definition of “fair”.

Derek Slater provides links here.

Discussion at InfoAnarchy.

Not Hosting The Grey Album

Wednesday, February 25th, 2004

Have LimeWire, BearShare, Shareaza, Kazaa or other MAGNET-enabled software? You might click on a MAGNET icon below. Or click on the filename for more information via Bitzi.

Why would you want to use a MAGNET-enabled program rather than using your browser to download from a web site?

  • The site might use stupid filenames, e.g., 01PublicServiceAnnouncement.mp3. A MAGNET link can specify a better name.
  • The site may have been compromised. A MAGNET link can specify a secure identifier for a file which can be used by an application to verify that the file you have is the one you expected.
  • The site may be down. Some MAGNET-enabled programs can look for the exact file elsewhere.
  • The site may be slow. By virtue of the previous feature, some MAGNET-enabled programs may be able to download from multiple sources.
  • You might already have the exact file. Many MAGNET-enabled programs can tell you this. Why bother to download again?
  • You might want to share the file with others. Some MAGNET-enabled programs will help you do this.
  • You might want to annotate or otherwise organize the file into your collection. Many MAGNET-enabled programs have such features built-in, and do a reasonable job of automatically categorizing new files.
Jay Z + DJ Danger Mouse - The Grey Album - 01 - Public Service Announcement.mp3 (4.0MB)
Jay Z + DJ Danger Mouse - The Grey Album - 02 - What More Can I Say.mp3 (6.3MB)
Jay Z + DJ Danger Mouse - The Grey Album - 03 - Encore.mp3 (3.9MB)
Jay Z + DJ Danger Mouse - The Grey Album - 04 - December 4th.mp3 (5.2MB)
Jay Z + DJ Danger Mouse - The Grey Album - 05 - 99 Problems.mp3 (5.9MB)
Jay Z + DJ Danger Mouse - The Grey Album - 06 - Dirt Off Your Shoulder.mp3 (5.7MB)
Jay Z + DJ Danger Mouse - The Grey Album - 07 - Moment of Clarity.mp3 (5.7MB)
Jay Z + DJ Danger Mouse - The Grey Album - 08 - Change Clothes.mp3 (5.8MB)
Jay Z + DJ Danger Mouse - The Grey Album - 09 - Allure.mp3 (5.9MB)
Jay Z + DJ Danger Mouse - The Grey Album - 10 - Justify My Thug.mp3 (6.0MB)
Jay Z + DJ Danger Mouse - The Grey Album - 11 - Interlude.mp3 (3.0MB)
Jay Z + DJ Danger Mouse - The Grey Album - 12 - My 1st Song.mp3 (7.8MB)

Bitzi Bitcollider 0.6.0 with kzhash, video metadata, tiger tree fix, minimal OS X support

Monday, February 9th, 2004

As reported by Gordon Mohr at Bitzi and InfoAnarchy. I’ll add another thanks to Delirium for the video metadata extraction code, provided a year and a half ago. We need to work on that release often bit. Thanks also to Robert Kaye for cleaning up and packaging the release. If you want to be thanked in less than two years, check out the bitcollider bug and feature request tracker at sourceforge.

Anyone else, if you have files you’d like to alert (of the “it’s greeeat!” or “beware, malware” varieties) the world to, download bitcollider and use it to add said files to the Bitzi catalog.

See Yous at Etech

Wednesday, February 4th, 2004

Posted on the Creative Commons weblog:

Creative Commons will be an exhibitor at the O’Reilly Emerging Technology Conference in San Diego next week.

Etech is regarded by many as the best tech conference of the year, always in step with the latest creations and aspirations of the alpha geeks, having evolved from the Peer-to-Peer Conference in early 2001 and P2P & Web Services in late 2001 to the current multi-tracked annual conference starting two years ago. (Incidentally, the Creative Commons concept was introduced at ETCon 2002. How time flies.)

Matt Haughey and Mike Linksvayer will be attending. Stop by the Creative Commons booth, or better yet our participant session (time and location yet to be announced). We’ll be introducing a new CC metadata-enhanced application. Hint: it’s described in one of our tech challenges, heretofore unmet.

If you’re in the area but not an attendee, you can still register for a free exhibits pass, or an exhibits plus keynotes and birds-of-a-feather (participant sessions) pass for only $50. Hope to see you there!