Wikimedia servers

From Meta, a Wikimedia project coordination wiki
This is an archived version of this page, as edited by Datrio (talk | contribs) at 13:51, 20 September 2005 (Reverted edits by Cuca32 to last version by Mark Bergsma). It may differ significantly from the current version.
Installed servers as of September 2004

Other languages: de, eo, es, fr, it, ja, ko, zh

Wikipedia and the other Wikimedia projects are run from several rackfulls of servers. The names of the Florida servers are primarily based on famous historical encyclopedists, while the Kennisnet and Yahoo! machines have been named after various types of plant. (See the discussion page for name suggestions.) Recently there have been so many new servers that many have just been given numerical names.

See also:


Server list

The popularity of the Wikimedia projects necessitates the use of many servers, most of which run the GNU/Linux operating system. Below is the current configuration. Server names should be linked to individual status pages (see http://wp.wikidev.net/Servers). See http://wp.wikidev.net/All_servers to see all such pages on a single page.

Name Date Tasks OS IP address Hardware Named after
7 MySQL Database
adler 05/2005 Database slave (disk failure, but up) Fedora Linux Core 3 - x86_64 - Preload, No Media adler.pmtpa.wmnet - 10.0.0.101 2U, 2 x Opteron 250 2.4GHz, 16 GB (8x2G) PC3200/DDR400 Registered ECC - Interleaved RAM, 6x Seagate Cheetah 15K.4 73GB U320 15KRPM SCA SCSI RAID 0 Mortimer Adler
samuel 05/2005 Database master Fedora Linux Core 3 - x86_64 - Preload, No Media samuel.pmtpa.wmnet - 10.0.0.102 2U, 2 x Opteron 250 2.4GHz, 16 GB (8x2G) PC3200/DDR400 Registered ECC - Interleaved RAM, 6x Seagate Cheetah 15K.4 73GB U320 15KRPM SCA SCSI RAID 0 Samuel Johnson
ariel 05/2004 Database slave (hardware failure) Fedora core 2 (64-bit) custom 10.0.0.2 2U, 2 x Opteron 248 2.2GHz, 8 GB (8x1G) PC2700 registered ECC RAM, 6x73GB 15K SCA SCSI drives (4 RAID 1+0 (146GB), 2 RAID 1 (72GB)) Ariel Durant
suda 01/2004 Database slave Fedora core 2 (64-bit) 10.0.0.1 2U, 2 x Opteron 246 2.0GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 4x146GB SCSI RAID 1+0 (292GB) and 2x36GB SCA SCSI RAID 1 (36GB) Suda
bacon 08/2004 Database slave Fedora core 2 (64-bit) 10.0.0.3 2U, 2xOpteron 242 1.6GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 6x200GB SATA RAID 10 Francis Bacon
webster 10/2004 Database slave (hardware failure) Fedora core 2 (64-bit) 207.142.131.221 2U, 2xOpteron 242 1.6GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 6x73GB Seagate Cheetah 10K.6 U320 SCSI drives RAID 0 Noah Webster
holbach 10/2004 Database slave Fedora core 3 (64-bit) 207.142.131.224 2U, 2xOpteron 242 1.6GHz, 4 GB (4x1G) PC2700 registered ECC RAM, 6x74GB WD Raptor 10K SATA RAID 0 Baron d'Holbach
isidore 01/2004 Database for fundraising, misc. tasks FreeBSD 5.3-RELEASE 10.0.0.18 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 80 GB SATA Isidore of Seville
4 Other
albert 08/2004 NFS storage server. SUSE Linux 9.1 207.142.131.201 2U, 2xOpteron 242 1.6GHz, 1 GB (2x512M) PC2700 registered ECC RAM, 6x250GB SATA (RAID 5) (details) Albertus Magnus
zwinger 01/2004 NFS, mail, DNS, coda (experimental), misc stuff Redhat 9 207.142.131.234 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 250 GB SATA (details) Theodor Zwinger
larousse Prehistoric IRC, servmon, cricket, rcdumper, udpmcast, VPN routing, DNS Fedora Core 2 207.142.131.234 1U, 1 x Pentium III 866MHz, 2 GB RAM, 32GB+18GB SCSI disk Pierre Larousse
vincent 01/2004 Search server Debian GNU/Linux 3.1 10.0.0.17 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 80 GB SATA Vincent of Beauvais
9 Squid
browne 01/2004 Squid (inactive) Fedora core 2 207.142.131.229 1U, 1 x Pentium 4 2.6 GHz, 4 GB (4x1G) unbuf non-ECC DDR400 RAM, 80 GB SATA Thomas Browne
will 05/2004 Squid Fedora core 2 207.142.131.243 1U, 1 x Pentium 4 2.8 GHz, 4 GB RAM, 2 x 200GB SATA in RAID 1 (details) Will Durant
srv5 01/2005 Squid Fedora Core 3 207.142.131.199 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA -
srv6 01/2005 Squid Fedora Core 3 207.142.131.199 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA -
srv7 01/2005 Squid Fedora Core 3 207.142.131.199 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA -
srv8 01/2005 Squid Fedora Core 3 207.142.131.199 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA -
srv9 01/2005 Hardware failure Fedora Core 3 207.142.131.199 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA -
srv10 01/2005 Squid Fedora Core 3 207.142.131.199 1U, 1x Pentium 4 3.2GHz, 3GB RAM, 2x 36GB SATA -
49 Apache
dalembert 08/2004 Apache Fedora core 2 10.0.0.13 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA Jean le Rond d'Alembert
tingxi 08/2004 Apache, IRC bots. Currently malfunctioning and in need of developer attention Fedora core 2 10.0.0.12 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA Jiang Tingxi
srv1 01/2005 Apache Fedora Core 3 10.0.2.2 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA -
srv2 01/2005 Apache Fedora Core 3 10.0.2.1 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA -
srv3 01/2005 Apache Fedora Core 3 10.0.2.3 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA -
srv4 01/2005 Apache Fedora Core 3 10.0.2.4 1U, 1x Pentium 4 3.2GHz, 1GB RAM, 1x 200GB SATA -
srv11 05/2005 Apache Fedora Core 3 10.0.2.11 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv12 05/2005 Apache Fedora Core 3 10.0.2.12 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv13 05/2005 Apache Fedora Core 3 10.0.2.13 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv14 05/2005 Apache Fedora Core 3 10.0.2.14 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv15 05/2005 Apache Fedora Core 3 10.0.2.15 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv16 05/2005 Apache Fedora Core 3 10.0.2.16 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv17 05/2005 Apache Fedora Core 3 10.0.2.17 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv18 05/2005 Apache Fedora Core 3 10.0.2.18 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv19 05/2005 Apache Fedora Core 3 10.0.2.19 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv20 05/2005 Apache Fedora Core 3 10.0.2.20 1U, 1x Pentium 4 3.4GHz, 1GB RAM, 1x 80GB SATA -
srv21 05/2005 Apache Fedora Core 3 10.0.2.21 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv22 05/2005 Apache Fedora Core 3 10.0.2.22 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv23 05/2005 Apache Fedora Core 3 10.0.2.23 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv24 05/2005 Apache Fedora Core 3 10.0.2.24 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv25 05/2005 Apache Fedora Core 3 10.0.2.25 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv26 05/2005 Apache Fedora Core 3 10.0.2.26 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv27 05/2005 Apache Fedora Core 3 10.0.2.27 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv28 05/2005 Apache, external storage Fedora Core 3 10.0.2.28 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv29 05/2005 Apache, external storage Fedora Core 3 10.0.2.29 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
srv30 05/2005 Apache, external storage Fedora Core 3 10.0.2.30 1U, 1x Pentium 4 3.4GHz, 3GB RAM, 1x 80GB SATA -
coronelli 01/2004 Apache Fedora core 2 207.142.131.230 1U, 1 x Pentium 4 2.6 GHz, 3 GB (2x1G? +?) unbuf non-ECC DDR400 RAM, 80 GB SATA Vincenzo Coronelli
maurus 05/2004 Apache Fedora core 2 10.0.0.16 1U, 1 x Pentium 4 2.8 GHz, 4 GB (4x1G) unbuf DDR 400 ECC RAM, 80 GB SATA Rabanus Maurus
rabanus 05/2004 Apache, DHCP boot server Fedora core 2 10.0.0.15 1U, 1 x Pentium 4 2.8 GHz, 4 GB (4x1G) unbuf DDR 400 ECC RAM, 80 GB SATA Rabanus Maurus
bart 01/2004 Apache Fedora core 2 10.0.0.30 1U, 1 x Pentium 4 2.6 GHz, 4 GB (4x1G) unbuf DDR400 non-ECC RAM, 80 GB SATA Bartholomeus de Glanvilla
benet 12/2004 Apache/ Memcached/ Squid. Database slave, test production use. Fedora core 3 10.0.0.29 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 2x250 GB SATA RAID 0 William Rose Benet
biruni 12/2004 Apache/ Memcached/ Squid. Fedora core 3 10.0.0.25 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA Al-Biruni
rose 12/2004 Apache/ Memcached. Fedora core 3 10.0.0.26 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA William Rose Benet
smellie 12/2004 Apache/ Memcached. Fedora core 3 10.0.0.27 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA William Smellie
anthony 12/2004 Apache/ Memcached/ Squid. Fedora core 3 10.0.0.28 1U, 1x Pentium 4 3.0 GHz, 2x1 GB + 2x512 MB DDRII-533 RAM, 1x200 GB SATA RAID 0 Anthony Winkler Prins
bayle 01/2004 Apache, 1120MB memcached, switched between Squid and Apache as needed Fedora core 2 10.0.0.31 1U, 1 x Pentium 4 2.6 GHz, 2 GB (2x1G) unbuf DDR400 non-ECC RAM, 80 GB SATA Pierre Bayle
diderot 08/2004 Apache. Fedora core 2 10.0.0.7 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 ECC RAM, 200 GB SATA Denis Diderot
goeje 08/2004 Apache. Fedora core 2 10.0.0.9 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 ECC RAM, 200 GB SATA Michael Jan de Goeje
yongle 05/2004 Apache, 1960MB memcached Fedora core 2 10.0.0.6 1U, 1 x Pentium 4 2.8 GHz, 4 GB (4x1G) unbuf DDR 400 ECC RAM, 80 GB SATA Emperor Yongle
moreri 01/2004 Apache, 280MB memcached Fedora core 2 10.0.0.32 1U, 1 x Pentium 4 2.6 GHz, 1 GB (cap?) unbuf DDR400 non-ECC RAM, 80 GB SATA Louis Moréri
avicenna 08/2004 Apache, binlog archives Fedora core 2 10.0.0.14 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA Avicenna
alrazi 08/2004 Apache Fedora core 2 10.0.0.10 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA Al-Razi
friedrich 08/2004 Apache Fedora core 2 10.0.0.11 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA Friedrich Arnold Brockhaus
harris 08/2004 Apache Fedora core 2 10.0.0.8 1U, 1 x Pentium 4 3 GHz, 0.5 GB (2x256M) unbuf DDR400 RAM, 200 GB SATA John Harris
hypatia 10/2004 Apache, IRC bots Fedora core 2 10.0.0.212 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 1x 200GB SATA Hypatia of Alexandria
humboldt 10/2004 Apache Fedora core 2 10.0.0.213 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 1x 200GB SATA Alexander von Humboldt
kluge 10/2004 Apache Fedora core 2 10.0.0.214 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 1x 200GB SATA Friedrich Kluge
avarroes 10/2004 Apache, DB backup slave Fedora core 2 10.0.0.217 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 2x 250GB SATA RAID 0 Averroes
khaldun 10/2004 NFS image server. Formerly apache, backup database Fedora core 2 10.0.0.218 1U, 1x Pentium 4 3.0 GHz, 1 GB RAM, 2x250 GB SATA RAID 0 Ibn Khaldun
3 Paris Cluster
chloe 12/2004 Squid in France, installed at colo, used for France, Luxembourg and Switzerland. Debian 212.85.150.132 1U, 1 x Celeron 600 MHz, 640 MB RAM, 20 GB ATA. HP Hosting Server Appliance sa1100 donor request
bleuenn 12/2004 Squid in France, as chloe. Debian 212.85.150.133 1U, 1 x Celeron 600 MHz, 640 MB RAM, 20 GB ATA. HP Hosting Server Appliance sa1100 donor request
ennael 12/2004 Squid in France, 128MB faulty dimm removed, new 256MB dimm added Debian 212.85.150.131 1U, 1 x Celeron 600 MHz, 768 MB RAM, 20 GB ATA. HP Hosting Server Appliance sa1100 donor request
11 Kennisnet cluster
pascal 5/2005 WWW, DNS, NFS Fedora Core 3 145.97.39.130 Sun V40z, 2 x 1.8GHz Opteron, 2GB RAM, 2x 70GB SCSI Blaise Pascal
vandale 5/2005 Database (inactive) Fedora Core 3 145.97.39.140 Sun V40z, 2 x Opteron 844, 8GB RAM, 6x 146GB SCSI Johan Hendrik van Dale
fuchsia 5/2005 DNS, WWW as http://www2.knams.wikimedia.org, statistics Fedora Core 3 145.97.39.132 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI
clematis 5/2005 Squid Fedora Core 3 145.97.39.137 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
sage 5/2005 Squid Fedora Core 3 145.97.39.138 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
ragweed 5/2005 OTRS Fedora Core 3 145.97.39.139 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
lily 5/2005 Squid Fedora Core 3 145.97.39.133 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
mint 5/2005 Squid (awaiting OS reinstall) Fedora Core 3 145.97.39.131 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
hawthorn 5/2005 Squid Fedora Core 3 145.97.39.134 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
mayflower 5/2005 Squid Fedora Core 3 145.97.39.135 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI -
iris 5/2005 Squid Fedora Core 3 145.97.39.136 Sun V20z, 2 x 2.2GHz Opteron, 3GB RAM, 2x 70GB SCSI
23 Yahoo! cluster
amaryllis 9/2005 NFS Fedora Core 4 211.115.107.158 HP DL385, 2x Opteron 250 (2.4GHz), 8GB RAM, 6x 146GB disk -
dryas 9/2005 - Fedora Core 4 211.115.107.160 HP DL385, 2x Opteron 250 (2.4GHz), 8GB RAM, 6x 146GB disk -
henbane 9/2005 - Fedora Core 4 211.115.107.159 HP DL385, 2x Opteron 250 (2.4GHz), 8GB RAM, 6x 146GB disk -
yf1000 9/2005 Squid Fedora Core 4 211.115.107.139 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD
yf1001 9/2005 Squid Fedora Core 4 211.115.107.139 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1002 9/2005 Squid Fedora Core 4 211.115.107.140 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1003 9/2005 Squid Fedora Core 4 211.115.107.141 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1004 9/2005 Squid Fedora Core 4 211.115.107.142 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1005 9/2005 - Fedora Core 4 211.115.107.143 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1006 9/2005 - Fedora Core 4 211.115.107.144 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1007 9/2005 - Fedora Core 4 211.115.107.145 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1008 9/2005 - Fedora Core 4 211.115.107.146 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1009 9/2005 - Fedora Core 4 211.115.107.147 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1010 9/2005 - Fedora Core 4 211.115.107.148 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1011 9/2005 - Fedora Core 4 211.115.107.149 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1012 9/2005 - Fedora Core 4 211.115.107.150 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1014 9/2005 - Fedora Core 4 211.115.107.152 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1015 9/2005 - Fedora Core 4 211.115.107.153 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1016 9/2005 - Fedora Core 4 211.115.107.154 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1017 9/2005 - Fedora Core 4 211.115.107.155 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1018 9/2005 - Fedora Core 4 211.115.107.156 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
yf1019 9/2005 - Fedora Core 4 211.115.107.157 HP DL140, 2x Opteron 246 (2.0GHz), 4GB RAM, 1x 80GB HDD -
104 Total

Overall system architecture

Wikimedia server arrangement as of 2005-04-12 (see also: server layout diagrams)
  • 69 machines in Florida, 5 near Paris, 11 in Amsterdam, 23 provided by Yahoo!.
  • Zwinger is serving mail and is the main NFS fileserver for the other machines.
  • Samuel is the master database server, running MySQL and storing all articles. Ariel has a four disk RAID 10 and two disk RAID 1 setup with battery-backed cache and 8GB of RAM. Suda and Bacon are a database slave.
  • The Apaches are running identically-configured Apache web servers. The Apache servers accept requests from users, get data from the database if necessary, and format the requests back to the users, by running the MediaWiki software implemented in PHP with Turck MMCache PHP cache (our experience). They share their work directories by NFS, so uploads etc. should remain quite in sync.
  • The Squid systems maintain large caches of pages, so that common or repeated requests don't need to touch the Apache or database servers. They serve most page requests made by visitors who aren't logged in. They are currently running at a hit-rate of approximately 75%, effectively quadrupling the capacity of the Apache servers behind them. This is particularly noticeable when a large surge of traffic arrives directed to a particular page via a web link from another site, as the caching efficiency for that page will be nearly 100%. They also load balance the Apaches. Round-robin DNS is balancing the load among the Squids. See cache strategy for more details.

The system is designed to failover to backup configurations at both the squid and Apache levels, and backup database support is in place, but not in an automatic failover.

(Details on database replication in MySQL: [1])

Hosting

see Wikimedia partners and hosts for more

The cluster near Paris.
Our servers are the three in the middle.
(From top to bottom: bleuenn, chloe, ennael.)

At present all DBs and Apaches, and most Squids, are hosted at the Florida data center used by Bomis.com and they are donating rack space and half of the bandwidth costs. From the start of the project until September(?) 2004 they paid for all bandwidth.

Lost Oasis (bandwidth) and Jexiste (rack space) in France are providing hosting and bandwidth for the European Squid cache service using chloe, bleuenn and ennael. The machines are installed in the Telecity data center in Aubervilliers near Paris and serve France, Luxembourg and Switzerland.

Kennisnet in the Netherlands is providing hosting and bandwidth for eleven servers since June 2005. They are installed at SARA in Amsterdam and provide service for the Netherlands, Belgium, Germany, UK, Austria, Poland and Scandinavia.

Yahoo! is providing servers, hosting, and bandwidth for twenty-three servers starting soon. They will be installed in South Korea.

More equipment, hosting and bandwidth offers for squid cache clusters are welcome, see this page for requirements.

Kennisnet Amsterdam servercluster in its own rack

Orders and detailed hardware descriptions

See also: /hardware orders

2005 - 88 new servers

2004 - 39 new servers

  • Hardware ordered December 2004: 5 new servers: all 3GB apache/memcached/squid type.
  • Hardware ordered October 2004: 7 new servers: 2 database, 5 apache
  • Hardware ordered August 2004: 10 new servers. Search database server (bacon), NFS storage server (albert), 8 3.0GHz P4 web servers (diderot, goeje, avicenna, dalembert, tingxi, alrazi, friedrich, harris), gigabit ethernet switch, 146GB SCSI drive for Suda.
  • Hardware ordered May 2004: 5 new servers. Replacement for Geoffrin database server (ariel), four 2.8GHz P4 general purpose machines (maurus, rabanus, yongle) and a pair of 250GB ATA drives. Based on upgrade discussion April 2004.
  • Hardware ordered January 2004: 9 new servers: 8 multipurpose machines (bart, bayle, browne, coronelli, isidore, moreri, vincent, zwinger) and 1 database server (suda).
  • Donated: three for Paris squids, extra RAM for them purchased :) :)

Old servers

The old web servers, which are currently not in service, were also named after historical encyclopedists:

Donations

Although Wikipedia is free in both the "free speech" and "no charge" senses of the word, running the web site does cost money. You can help with purchasing new server hardware by donating to the non-profit Wikimedia Foundation: http://wikimediafoundation.org/wiki/Fundraising

Admin notes

MediaWiki installation

Wikimedia uses a shared MediaWiki script installation. That is, one copy of the scripts is used by all projects. The individual projects have their own LocalSettings.php, and a CommonSettings.php is used to define settings that are used by all projects.

The NFS server (mounted as /home) contains the local settings and the uploads. It also stores a template copy of the MediaWiki codebase. This template is copied to each Apache server whenever the code is updated. There is a script to do this: sync-common-all in /home/wikipedia/bin/. The reason for this procedure is that using NFS to serve these PHP files significantly slows down access.

The local copies of the MediaWiki files are stored in /usr/local/apache/common/ (in the subdirectories php, style and images; these are MediaWiki UI images, not file uploads).

Logwood

Logwood (custom code) statistics are available at http://www2.knams.wikimedia.org/stats. Breakdown of access per country are available at http://www2.knams.wikimedia.org/country-stats/.

Status and problems

You can check one of the following sites if you want to know if the Wikimedia servers are overloaded, or if you just want to see how they are doing.

If you are seeing errors in real time, visit #wikimedia-tech on irc.freenode.net. Check the topic to see if someone is already looking into the problem you are having. If not, please report your problem to the channel. It would be helpful if you could report specific symptoms, including the exact text of any error messages, what you were doing right before the error, and what server(s) are generating the error, if you can tell. The #wikipedia channel may be better populated and the topic there may contain more updated information about the status of the problem. (But this channel is for general conversation about Wikipedia.)

If you don't use IRC, or don't get a reply, you can also send e-mail to noc@wikimedia.org. Someone will create a report in Bugzilla (under the "Issues" product) so others will know the problem has been reported, and what the status is. You can check here to see if your problem has already been reported.

If you're wondering if it's only you experiencing this problem, you can check the following site. Unfortunately, the site administrators do not monitor this site for problems.

If you are getting a "connection refused" error, that is a squid problem. Determine which IP address you are trying to connect to, and ask someone to look at that host.

See also

More hardware info

Admin logs

Offsite traffic pages

Onsite traffic pages

Long-term planning

Useful information about other sites