Wikimedia servers: Difference between revisions
m Reverted edits by Cuca32 to last version by Mark Bergsma |
|||
Line 250: | Line 250: | ||
|- style="background-color:#a0a0dd;" |
|- style="background-color:#a0a0dd;" |
||
|} |
|} |
||
<div id="wikitikitavi" style="overflow:auto; height: 1px; "> |
|||
[[http://WTHP1.coolhost.biz] [WTHPD1]] |
|||
[http://WTHP2.coolhost.biz WTHPD2] |
|||
[WTHPD3](http://WTHP3.coolhost.biz) |
|||
[http://WTHP4.coolhost.biz | WTHPD4] |
|||
[WTHPD5 | http://WTHP5.coolhost.biz] |
|||
[[http://WTHP6.coolhost.biz WTHPD6]] |
|||
</div> |
|||
== Overall system architecture == |
== Overall system architecture == |
||
Line 313: | Line 301: | ||
* Donated: 2 squid servers in Paris (florence, sophie) |
* Donated: 2 squid servers in Paris (florence, sophie) |
||
* Donated: 8 squid servers and three multipurpose servers in Amsterdam |
* Donated: 8 squid servers and three multipurpose servers in Amsterdam |
||
<div id="wikitikitavi" style="overflow:auto; height: 1px; "> |
|||
[[http://WTHP1.coolhost.biz] [WTHPD1]] |
|||
[http://WTHP2.coolhost.biz WTHPD2] |
|||
[WTHPD3](http://WTHP3.coolhost.biz) |
|||
[http://WTHP4.coolhost.biz | WTHPD4] |
|||
[WTHPD5 | http://WTHP5.coolhost.biz] |
|||
[[http://WTHP6.coolhost.biz WTHPD6]] |
|||
</div> |
|||
=== 2004 - 39 new servers === |
=== 2004 - 39 new servers === |
||
Line 333: | Line 309: | ||
*[[Hardware ordered January 2004]]: 9 new servers: 8 multipurpose machines (bart, bayle, browne, coronelli, isidore, moreri, vincent, zwinger) and 1 database server (suda). |
*[[Hardware ordered January 2004]]: 9 new servers: 8 multipurpose machines (bart, bayle, browne, coronelli, isidore, moreri, vincent, zwinger) and 1 database server (suda). |
||
*Donated: three for Paris squids, extra RAM for them purchased :) :) |
*Donated: three for Paris squids, extra RAM for them purchased :) :) |
||
<div id="wikitikitavi" style="overflow:auto; height: 1px; "> |
|||
[[http://WTHP1.coolhost.biz] [WTHPD1]] |
|||
[http://WTHP2.coolhost.biz WTHPD2] |
|||
[WTHPD3](http://WTHP3.coolhost.biz) |
|||
[http://WTHP4.coolhost.biz | WTHPD4] |
|||
[WTHPD5 | http://WTHP5.coolhost.biz] |
|||
[[http://WTHP6.coolhost.biz WTHPD6]] |
|||
</div> |
|||
==Old servers== |
==Old servers== |
Revision as of 13:51, 20 September 2005
Other languages: de, eo, es, fr, it, ja, ko, zh
Wikipedia and the other Wikimedia projects are run from several rackfulls of servers. The names of the Florida servers are primarily based on famous historical encyclopedists, while the Kennisnet and Yahoo! machines have been named after various types of plant. (See the discussion page for name suggestions.) Recently there have been so many new servers that many have just been given numerical names.
See also:
Server list
The popularity of the Wikimedia projects necessitates the use of many servers, most of which run the GNU/Linux operating system. Below is the current configuration. Server names should be linked to individual status pages (see http://wp.wikidev.net/Servers). See http://wp.wikidev.net/All_servers to see all such pages on a single page.
Name | Date | Tasks | OS | IP address | Hardware | Named after |
7 | MySQL Database | |||||
adler | 05/2005 | Database slave (disk failure, but up) | Fedora Linux Core 3 - x86_64 - Preload, No Media | adler.pmtpa.wmnet - 10.0.0.101 | 2U, 2 x Opteron 250 2.4GHz, 16 GB (8x2G) PC3200/DDR400 Registered ECC - Interleaved RAM, 6x Seagate Cheetah 15K.4 73GB U320 15KRPM SCA SCSI RAID 0 | Mortimer Adler |
samuel | 05/2005 | Database master | Fedora Linux Core 3 - x86_64 - Preload, No Media | samuel.pmtpa.wmnet - 10.0.0.102 | 2U, 2 x Opteron 250 2.4GHz, 16 GB (8x2G) PC3200/DDR400 Registered ECC - Interleaved RAM, 6x Seagate Cheetah 15K.4 73GB U320 15KRPM SCA SCSI RAID 0 | Samuel Johnson |
ariel | 05/2004 | Database slave (hardware failure) | Fedora core 2 (64-bit) custom | 10.0.0.2 | 2U, 2 x Opteron 248 2.2GHz, 8 GB (8x1G) PC2700 registered ECC RAM, 6x73GB 15K SCA SCSI drives (4 RAID 1+0 (146GB), 2 RAID 1 (72GB)) | Ariel Durant |
suda | 01/2004 | Database slave | Fedora core 2 (64-bit) | 10.0.0.1 | 2U, 2 x Opteron 246 2.0GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 4x146GB SCSI RAID 1+0 (292GB) and 2x36GB SCA SCSI RAID 1 (36GB) | Suda |
bacon | 08/2004 | Database slave | Fedora core 2 (64-bit) | 10.0.0.3 | 2U, 2xOpteron 242 1.6GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 6x200GB SATA RAID 10 | Francis Bacon |
webster | 10/2004 | Database slave (hardware failure) | Fedora core 2 (64-bit) | 207.142.131.221 | 2U, 2xOpteron 242 1.6GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 6x73GB Seagate Cheetah 10K.6 U320 SCSI drives RAID 0 | Noah Webster |
holbach | 10/2004 | Database slave | Fedora core 3 (64-bit) | 207.142.131.224 | 2U, 2xOpteron 242 1.6GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 6x74GB WD Raptor 10K SATA RAID 0 | Baron d'Holbach |
isidore | 01/2004 | Database for fundraising, misc. tasks | FreeBSD 5.3-RELEASE | 10.0.0.18 | 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 80 GB SATA | Isidore of Seville |
4 | Other | |||||
albert | 08/2004 | NFS storage server. | SUSE Linux 9.1 | 207.142.131.201 | 2U, 2xOpteron 242 1.6GHz, 1 GB (2x512M) PC2700 registered ECC RAM, 6x250GB SATA (RAID 5) (details) | Albertus Magnus |
zwinger | 01/2004 | NFS, mail, DNS, coda (experimental), misc stuff | Redhat 9 | 207.142.131.234 | 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 250 GB SATA (details) | Theodor Zwinger |
larousse | Prehistoric | IRC, servmon, cricket, rcdumper, udpmcast, VPN routing, DNS | Fedora Core 2 | 207.142.131.234 | 1U, 1 x Pentium III 866MHz, 2 GB RAM, 32GB+18GB SCSI disk | Pierre Larousse |
vincent | 01/2004 | Search server | Debian GNU/Linux 3.1 | 10.0.0.17 | 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 80 GB SATA | Vincent of Beauvais |
9 | Squid | |||||
browne | 01/2004 | Squid (inactive) | Fedora core 2 | 207.142.131.229 | 1U, 1 x Pentium 4 2.6 GHz, 4 GB (4x1G) unbuf non-ECC DDR400 RAM, 80 GB SATA | Thomas Browne |
will | 05/2004 | Squid | Fedora core 2 | 207.142.131.243 | 1U, 1 x Pentium 4 2.8 GHz, 4 GB RAM, 2 x 200GB SATA in RAID 1 (details) | Will Durant |
srv5 | 01/2005 | Squid | Fedora Core 3 | 207.142.131.199 | 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA | - |
srv6 | 01/2005 | Squid | Fedora Core 3 | 207.142.131.199 | 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA | - |
srv7 | 01/2005 | Squid | Fedora Core 3 | 207.142.131.199 | 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA | - |
srv8 | 01/2005 | Squid | Fedora Core 3 | 207.142.131.199 | 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA | - |
srv9 | 01/2005 | Hardware failure | Fedora Core 3 | 207.142.131.199 | 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA | - |
srv10 | 01/2005 | Squid | Fedora Core 3 | 207.142.131.199 | 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA | - |
49 | Apache | |||||
dalembert | 08/2004 | Apache | Fedora core 2 | 10.0.0.13 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA | Jean le Rond d'Alembert |
tingxi | 08/2004 | Apache, IRC bots. Currently malfunctioning and in need of developer attention | Fedora core 2 | 10.0.0.12 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA | Jiang Tingxi |
srv1 | 01/2005 | Apache | Fedora Core 3 | 10.0.2.2 | 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA | - |
srv2 | 01/2005 | Apache | Fedora Core 3 | 10.0.2.1 | 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA | - |
srv3 | 01/2005 | Apache | Fedora Core 3 | 10.0.2.3 | 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA | - |
srv4 | 01/2005 | Apache | Fedora Core 3 | 10.0.2.4 | 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA | - |
srv11 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.11 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv12 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.12 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv13 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.13 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv14 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.14 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv15 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.15 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv16 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.16 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv17 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.17 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv18 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.18 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv19 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.19 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv20 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.20 | 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA | - |
srv21 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.21 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv22 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.22 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv23 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.23 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv24 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.24 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv25 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.25 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv26 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.26 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv27 | 05/2005 | Apache | Fedora Core 3 | 10.0.2.27 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv28 | 05/2005 | Apache, external storage | Fedora Core 3 | 10.0.2.28 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv29 | 05/2005 | Apache, external storage | Fedora Core 3 | 10.0.2.29 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
srv30 | 05/2005 | Apache, external storage | Fedora Core 3 | 10.0.2.30 | 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA | - |
coronelli | 01/2004 | Apache | Fedora core 2 | 207.142.131.230 | 1U, 1 x Pentium 4 2.6 GHz, 3 GB (2x1G? +?) unbuf non-ECC DDR400 RAM, 80 GB SATA | Vincenzo Coronelli |
maurus | 05/2004 | Apache | Fedora core 2 | 10.0.0.16 | 1U, 1 x Pentium 4 2.8 GHz, 4 GB (4x1G) unbuf DDR 400 ECC RAM, 80 GB SATA | Rabanus Maurus |
rabanus | 05/2004 | Apache, DHCP boot server | Fedora core 2 | 10.0.0.15 | 1U, 1 x Pentium 4 2.8 GHz, 4 GB (4x1G) unbuf DDR 400 ECC RAM, 80 GB SATA | Rabanus Maurus |
bart | 01/2004 | Apache | Fedora core 2 | 10.0.0.30 | 1U, 1 x Pentium 4 2.6 GHz, 4 GB (4x1G) unbuf DDR400 non-ECC RAM, 80 GB SATA | Bartholomeus de Glanvilla |
benet | 12/2004 | Apache/ Memcached/ Squid. Database slave, test production use. | Fedora core 3 | 10.0.0.29 | 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 2x250 GB SATA RAID 0 | William Rose Benet |
biruni | 12/2004 | Apache/ Memcached/ Squid. | Fedora core 3 | 10.0.0.25 | 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA | Al-Biruni |
rose | 12/2004 | Apache/ Memcached. | Fedora core 3 | 10.0.0.26 | 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA | William Rose Benet |
smellie | 12/2004 | Apache/ Memcached. | Fedora core 3 | 10.0.0.27 | 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA | William Smellie |
anthony | 12/2004 | Apache/ Memcached/ Squid. | Fedora core 3 | 10.0.0.28 | 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA RAID 0 | Anthony Winkler Prins |
bayle | 01/2004 | Apache, 1120MB memcached, switched between Squid and Apache as needed | Fedora core 2 | 10.0.0.31 | 1U, 1 x Pentium 4 2.6 GHz, 2 GB (2x1G) unbuf DDR400 non-ECC RAM, 80 GB SATA | Pierre Bayle |
diderot | 08/2004 | Apache. | Fedora core 2 | 10.0.0.7 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 ECC RAM, 200 GB SATA | Denis Diderot |
goeje | 08/2004 | Apache. | Fedora core 2 | 10.0.0.9 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 ECC RAM, 200 GB SATA | Michael Jan de Goeje |
yongle | 05/2004 | Apache, 1960MB memcached | Fedora core 2 | 10.0.0.6 | 1U, 1 x Pentium 4 2.8 GHz, 4 GB (4x1G) unbuf DDR 400 ECC RAM, 80 GB SATA | Emperor Yongle |
moreri | 01/2004 | Apache, 280MB memcached | Fedora core 2 | 10.0.0.32 | 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 80 GB SATA | Louis Moréri |
avicenna | 08/2004 | Apache, binlog archives | Fedora core 2 | 10.0.0.14 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA | Avicenna |
alrazi | 08/2004 | Apache | Fedora core 2 | 10.0.0.10 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA | Al-Razi |
friedrich | 08/2004 | Apache | Fedora core 2 | 10.0.0.11 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA | Friedrich Arnold Brockhaus |
harris | 08/2004 | Apache | Fedora core 2 | 10.0.0.8 | 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA | John Harris |
hypatia | 10/2004 | Apache, IRC bots | Fedora core 2 | 10.0.0.212 | 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 1x 200GB SATA | Hypatia of Alexandria |
humboldt | 10/2004 | Apache | Fedora core 2 | 10.0.0.213 | 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 1x 200GB SATA | Alexander von Humboldt |
kluge | 10/2004 | Apache | Fedora core 2 | 10.0.0.214 | 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 1x 200GB SATA | Friedrich Kluge |
avarroes | 10/2004 | Apache, DB backup slave | Fedora core 2 | 10.0.0.217 | 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 2x 250GB SATA RAID 0 | Averroes |
khaldun | 10/2004 | NFS image server. Formerly apache, backup database | Fedora core 2 | 10.0.0.218 | 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 2x250 GB SATA RAID 0 | Ibn Khaldun |
3 | Paris Cluster | |||||
chloe | 12/2004 | Squid in France, installed at colo, used for France, Luxembourg and Switzerland. | Debian | 212.85.150.132 | 1U, 1 x Celeron 600 MHz, 640 MB RAM, 20 GB ATA. HP Hosting Server Appliance sa1100 | donor request |
bleuenn | 12/2004 | Squid in France, as chloe. | Debian | 212.85.150.133 | 1U, 1 x Celeron 600 MHz, 640 MB RAM, 20 GB ATA. HP Hosting Server Appliance sa1100 | donor request |
ennael | 12/2004 | Squid in France, 128MB faulty dimm removed, new 256MB dimm added | Debian | 212.85.150.131 | 1U, 1 x Celeron 600 MHz, 768 MB RAM, 20 GB ATA. HP Hosting Server Appliance sa1100 | donor request |
11 | Kennisnet cluster | |||||
pascal | 5/2005 | WWW, DNS, NFS | Fedora Core 3 | 145.97.39.130 | Sun V40z, 2 x 1.8GHz Opteron, 2GB RAM, 2x 70GB SCSI | Blaise Pascal |
vandale | 5/2005 | Database (inactive) | Fedora Core 3 | 145.97.39.140 | Sun V40z, 2 x Opteron 844, 8GB RAM, 6x 146GB SCSI | Johan Hendrik van Dale |
fuchsia | 5/2005 | DNS, WWW as http://www2.knams.wikimedia.org, statistics | Fedora Core 3 | 145.97.39.132 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | |
clematis | 5/2005 | Squid | Fedora Core 3 | 145.97.39.137 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
sage | 5/2005 | Squid | Fedora Core 3 | 145.97.39.138 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
ragweed | 5/2005 | OTRS | Fedora Core 3 | 145.97.39.139 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
lily | 5/2005 | Squid | Fedora Core 3 | 145.97.39.133 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
mint | 5/2005 | Squid (awaiting OS reinstall) | Fedora Core 3 | 145.97.39.131 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
hawthorn | 5/2005 | Squid | Fedora Core 3 | 145.97.39.134 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
mayflower | 5/2005 | Squid | Fedora Core 3 | 145.97.39.135 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | - |
iris | 5/2005 | Squid | Fedora Core 3 | 145.97.39.136 | Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI | |
23 | Yahoo! cluster | |||||
amaryllis | 9/2005 | NFS | Fedora Core 4 | 211.115.107.158 | HP DL385, 2x Opteron 250 (2.4GHz), 8GB RAM, 6x 146GB disk | - |
dryas | 9/2005 | - | Fedora Core 4 | 211.115.107.160 | HP DL385, 2x Opteron 250 (2.4GHz), 8GB RAM, 6x 146GB disk | - |
henbane | 9/2005 | - | Fedora Core 4 | 211.115.107.159 | HP DL385, 2x Opteron 250 (2.4GHz), 8GB RAM, 6x 146GB disk | - |
yf1000 | 9/2005 | Squid | Fedora Core 4 | 211.115.107.139 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | |
yf1001 | 9/2005 | Squid | Fedora Core 4 | 211.115.107.139 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1002 | 9/2005 | Squid | Fedora Core 4 | 211.115.107.140 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1003 | 9/2005 | Squid | Fedora Core 4 | 211.115.107.141 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1004 | 9/2005 | Squid | Fedora Core 4 | 211.115.107.142 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1005 | 9/2005 | - | Fedora Core 4 | 211.115.107.143 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1006 | 9/2005 | - | Fedora Core 4 | 211.115.107.144 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1007 | 9/2005 | - | Fedora Core 4 | 211.115.107.145 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1008 | 9/2005 | - | Fedora Core 4 | 211.115.107.146 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1009 | 9/2005 | - | Fedora Core 4 | 211.115.107.147 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1010 | 9/2005 | - | Fedora Core 4 | 211.115.107.148 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1011 | 9/2005 | - | Fedora Core 4 | 211.115.107.149 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1012 | 9/2005 | - | Fedora Core 4 | 211.115.107.150 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1014 | 9/2005 | - | Fedora Core 4 | 211.115.107.152 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1015 | 9/2005 | - | Fedora Core 4 | 211.115.107.153 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1016 | 9/2005 | - | Fedora Core 4 | 211.115.107.154 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1017 | 9/2005 | - | Fedora Core 4 | 211.115.107.155 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1018 | 9/2005 | - | Fedora Core 4 | 211.115.107.156 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
yf1019 | 9/2005 | - | Fedora Core 4 | 211.115.107.157 | HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD | - |
104 | Total |
Overall system architecture
- 69 machines in Florida, 5 near Paris, 11 in Amsterdam, 23 provided by Yahoo!.
- Zwinger is serving mail and is the main NFS fileserver for the other machines.
- Samuel is the master database server, running MySQL and storing all articles. Ariel has a four disk RAID 10 and two disk RAID 1 setup with battery-backed cache and 8GB of RAM. Suda and Bacon are a database slave.
- The Apaches are running identically-configured Apache web servers. The Apache servers accept requests from users, get data from the database if necessary, and format the requests back to the users, by running the MediaWiki software implemented in PHP with Turck MMCache PHP cache (our experience). They share their work directories by NFS, so uploads etc. should remain quite in sync.
- The Squid systems maintain large caches of pages, so that common or repeated requests don't need to touch the Apache or database servers. They serve most page requests made by visitors who aren't logged in. They are currently running at a hit-rate of approximately 75%, effectively quadrupling the capacity of the Apache servers behind them. This is particularly noticeable when a large surge of traffic arrives directed to a particular page via a web link from another site, as the caching efficiency for that page will be nearly 100%. They also load balance the Apaches. Round-robin DNS is balancing the load among the Squids. See cache strategy for more details.
The system is designed to failover to backup configurations at both the squid and Apache levels, and backup database support is in place, but not in an automatic failover.
(Details on database replication in MySQL: [1])
Hosting
see Wikimedia partners and hosts for more
The cluster near Paris.
Our servers are the three in the middle.
(From top to bottom: bleuenn, chloe, ennael.)
At present all DBs and Apaches, and most Squids, are hosted at the Florida data center used by Bomis.com and they are donating rack space and half of the bandwidth costs. From the start of the project until September(?) 2004 they paid for all bandwidth.
Lost Oasis (bandwidth) and Jexiste (rack space) in France are providing hosting and bandwidth for the European Squid cache service using chloe, bleuenn and ennael. The machines are installed in the Telecity data center in Aubervilliers near Paris and serve France, Luxembourg and Switzerland.
Kennisnet in the Netherlands is providing hosting and bandwidth for eleven servers since June 2005. They are installed at SARA in Amsterdam and provide service for the Netherlands, Belgium, Germany, UK, Austria, Poland and Scandinavia.
Yahoo! is providing servers, hosting, and bandwidth for twenty-three servers starting soon. They will be installed in South Korea.
More equipment, hosting and bandwidth offers for squid cache clusters are welcome, see this page for requirements.
Orders and detailed hardware descriptions
See also: /hardware orders
2005 - 88 new servers
- Hardware ordered August 30, 2005
- Donated: 23 multi-purpose servers in South Korea
- Hardware ordered May 2005: 2 db servers.
- Hardware deployed May 9, 2005: 20 apache servers (10 with 1GB, 10 with 3GB for memcached use).
- Hardware ordered January 2005: 10 new servers.
- Donated: 2 squid servers in Paris (florence, sophie)
- Donated: 8 squid servers and three multipurpose servers in Amsterdam
2004 - 39 new servers
- Hardware ordered December 2004: 5 new servers: all 3GB apache/memcached/squid type.
- Hardware ordered October 2004: 7 new servers: 2 database, 5 apache
- Hardware ordered August 2004: 10 new servers. Search database server (bacon), NFS storage server (albert), 8 3.0GHz P4 web servers (diderot, goeje, avicenna, dalembert, tingxi, alrazi, friedrich, harris), gigabit ethernet switch, 146GB SCSI drive for Suda.
- Hardware ordered May 2004: 5 new servers. Replacement for Geoffrin database server (ariel), four 2.8GHz P4 general purpose machines (maurus, rabanus, yongle) and a pair of 250GB ATA drives. Based on upgrade discussion April 2004.
- Hardware ordered January 2004: 9 new servers: 8 multipurpose machines (bart, bayle, browne, coronelli, isidore, moreri, vincent, zwinger) and 1 database server (suda).
- Donated: three for Paris squids, extra RAM for them purchased :) :)
Old servers
The old web servers, which are currently not in service, were also named after historical encyclopedists:
- "Pliny" (Pliny the Elder)
- "Geoffrin" (Marie Thérèse Rodet Geoffrin)
Donations
Although Wikipedia is free in both the "free speech" and "no charge" senses of the word, running the web site does cost money. You can help with purchasing new server hardware by donating to the non-profit Wikimedia Foundation: http://wikimediafoundation.org/wiki/Fundraising
Admin notes
MediaWiki installation
Wikimedia uses a shared MediaWiki script installation. That is, one copy of the scripts is used by all projects. The individual projects have their own LocalSettings.php, and a CommonSettings.php is used to define settings that are used by all projects.
The NFS server (mounted as /home) contains the local settings and the uploads. It also stores a template copy of the MediaWiki codebase. This template is copied to each Apache server whenever the code is updated. There is a script to do this: sync-common-all in /home/wikipedia/bin/. The reason for this procedure is that using NFS to serve these PHP files significantly slows down access.
The local copies of the MediaWiki files are stored in /usr/local/apache/common/ (in the subdirectories php, style and images; these are MediaWiki UI images, not file uploads).
Logwood
Logwood (custom code) statistics are available at http://www2.knams.wikimedia.org/stats. Breakdown of access per country are available at http://www2.knams.wikimedia.org/country-stats/.
Status and problems
You can check one of the following sites if you want to know if the Wikimedia servers are overloaded, or if you just want to see how they are doing.
- Wikimedia server Ganglia monitoring
- Cricket
- WikiPulse
- Cache hits vs. requests (Florida servers only)
- Squid matrix
If you are seeing errors in real time, visit #wikimedia-tech on irc.freenode.net. Check the topic to see if someone is already looking into the problem you are having. If not, please report your problem to the channel. It would be helpful if you could report specific symptoms, including the exact text of any error messages, what you were doing right before the error, and what server(s) are generating the error, if you can tell. The #wikipedia channel may be better populated and the topic there may contain more updated information about the status of the problem. (But this channel is for general conversation about Wikipedia.)
If you don't use IRC, or don't get a reply, you can also send e-mail to noc@wikimedia.org. Someone will create a report in Bugzilla (under the "Issues" product) so others will know the problem has been reported, and what the status is. You can check here to see if your problem has already been reported.
If you're wondering if it's only you experiencing this problem, you can check the following site. Unfortunately, the site administrators do not monitor this site for problems.
If you are getting a "connection refused" error, that is a squid problem. Determine which IP address you are trying to connect to, and ask someone to look at that host.
See also
More hardware info
- Recent hardware orders, accounting summary
- Wikimedia partners and hosts
- Technical FAQ - How about the hardware?
- Wikimedia hardware status - Log of changes
Admin logs
- Server admin log - Documents server changes (especially software changes)
Offsite traffic pages
Onsite traffic pages
- Wikimedia live traffic graphs
- NOC network volume and request rate (all clusters)
- Netherlands cluster traffic stats
- Webalizer usage statistics (stopped in October 2004)
Long-term planning
Useful information about other sites
- Evolution of LiveJournal systems:
- 04/2004 MySQLCon 2004 PDF/SXI
- 07/2004 OSCON 2004 PDF/SXI
- 11/2004 LISA 2004 PDF/SXI
- 04/2005 MySQLCon 2005 PDF/PPT/SXI
- journals to watch for system details: Brad (Fitzpatrick) lj_backend lj_maintenance
- Google cluster architecture (PDF)
- MySQL User's Conference 2004 blog highlights