Tomorrow Elephant

Today, I noticed that somebody is offering all of arXiv as a BitTorrent download. Coupled with this recent article by Steven Berlin Jonson this set off some alarm bells.

ArXiv is a massive online repository of papers on mathematics, physics, computer science and related fields. It’s where people working in these areas send their papers before they get published in deadtree journals. There’s no peer review involved, so cranks can send their stuff in as well, but it’s pretty easy to spot them if you actually work in one of the above areas. Actually, I think that arXiv is partially responsible for the so-called second string theory revolution in the 90s: it made it possible to respond to peoples’ work without the long wait associated with paper journals, and these days the turnover is so rapid that when a new field in string theory emerges, it’s usually mined to death within months. (I’m holding my breath and hoping that this doesn’t happen to my thesis subject.)

Now, the article by Jonson talks about a lovely OS X application called DevonThink - a personal database manager with wiki-like syntax and a powerful search engine that can handle several different file types. I’ve been looking at it for a long time, thinking: “Gee, if I only had a massive database of string theory papers in PDF, this might be pretty useful.”

Well, now I do. One weakness of arXiv is that its web technology is from somewhere circa 1995. No RSS, it looks butt-ugly, and it often takes ages to generate PDF from LaTeX source, which is pretty damn annoying given the low cost of storage space these days - there’s no reason why they couldn’t just keep copies of the PDF files around. And the search function of the site is also pretty unusable. So I plan to throw around a gig of string theory PDFs at DevonThink and see if it can handle it - if it works, finding relevant references for my thesis just became a whole lot easier.

Or what about feeding DevonThink a local copy of Wikipedia? Hmm…