Comments on: 200 Terabytes Served in 81 Days = 2.47TB per day!

By: Daniel Craig

Daniel Craig — Mon, 04 Aug 2008 20:05:06 +0000

Hello, I was looking around for a while searching for ip san and I happened upon this site and your post regarding 200 Terabytes Served in 81 Days = 2.47TB per day!, I will definitely this to my ip san bookmarks!

By: Dan

Dan — Fri, 18 Jul 2008 23:27:00 +0000

Has there been an update to this article as mentioned in the final paragraph?

Others have already given fine recommendations, but I’d also suggest looking at Nginx. Its at least as fast as the others when serving static content, can use sendfile to serve the files extremely quickly, and I like how clean and stable it is in very different configurations.

LightTPD had alot of problems few years back when it and FastCGI were “the way” to deploy RoR apps, Nginx never suffered from the same stability problems, which is why most of the RoR community now uses Nginx in combination with Mongrel or Thin on the backend. Not that you’re doing anything dynamic, it’s just a testament to how rock solid Nginx is as a front-end server.

By: Jan Miczaika

Jan Miczaika — Fri, 23 May 2008 11:39:43 +0000

Just to throw another hat in the ring, I would suggest you check out Lighttpd. A number of large sites (including wikipedia, youtube and meebo) use it for serving static content. We have had in production use since almost 1.5 years and we have never had a problem.

By: john

john — Thu, 14 Feb 2008 08:55:07 +0000

do you have a how to please thx

By: Jeff

Jeff — Fri, 28 Dec 2007 22:49:10 +0000

There are quite a few other load balancing software in the open source community. Do you guys tried LVS Layer 3/4 IP load balancing?

By: Dan Podeanu

Dan Podeanu — Sat, 06 Oct 2007 09:01:46 +0000

Hey Chris,

Actually, any single-threaded web server (thttpd, mathopd) would totally outperform Apache when it comes to purely static content (as I understand is your case) - and I’m talking more than 10 times faster under heavy load.

A single thttpd can saturate a gigabit connection if files are big enough (such as yours).

Of course, while keeping haproxy to load balance.

Regards

By: Jaime Nebrera

Jaime Nebrera — Wed, 20 Jun 2007 13:34:36 +0000

Hi Chris,

If you are serving static content (videos) it might be better to use Cherokee web server instead of Apache. I suspect its peak performance is much better. Of course you cant do many fancy things with it, but that might be done with some Apache’s running the PHP whatever side and then Cherokees for the videos.

Just my 2 cents

Regards