In the last four weeks the data has been moved to a new, even bigger RAID. The amount of RAM has also been increased. The system is now running with 40GB of RAM and over 10TB of diskspace.

Added new mirror: ELDK.

Started to mirror fedora-secondary.

Short unannounced downtime to boot a new kernel.

Fedora. Nobody expected anything else (of course). The first one and a half days since the release of Fedora 9 we are maxing out our bandwidth again. Today we already pushed more than 5.5TB and it looks like we will get close to transmitting 7TB on one day. This is much more than during the […]

We always thought our mirror server is connected with 2 GBit/s (two times an e1000 card using bonding mode=6), but the current Ubuntu release proved that somewhere along the way to the Internet there must still be something that limits us to 1 GBit/s. The following diagram shows this pretty clearly: Now we only need […]

Downtime for a few hours to install a fast (15K) 300GB SAS drive. This disk is used to act as a disk cache for apache. The goal is to reduce the number of simultaneous accesses on our main RAID. We also changed the bonding mode to: mode=6 (balance-alb)

Stopped the fedora and fedora.extras mirror scripts. These scripts were pointing to rsync modules which were removed on the master server because they were only necessary up to Fedora 6 which is already EOL since a few months.

Today was for a few hours one of the RAIDs offline to do the following: tune2fs /dev/sdb1 -O dir_index e2fsck -C 0 -f -D /dev/sdb1 This should, if correctly informed, speed up lookups in large directories.

Rebooted for a new kernel to fix the current available local root exploit.

New mirror of http://www.debian-multimedia.org/ at http://ftp-stud.hs-esslingen.de/pub/Mirrors/debian-multimedia/.

All volumes are mounted again. Back at normal operation.

We unmounted /ftp/pub/.2 again because of problems with the backend. This means that following mirrors are currently not available: ccux-linux.de, ftp.kde.org, ftp.rootlinux.org, ftp.xfree86.org, ftp.ximian.com, Mandrivalinux and wikipedia. Estimates are that it will be fixed sometime tomorrow.

Thanks to Patrick‘s mail I finally fixed a SQL injection security bug in our mirror status page. I was actually able to create and drop tables, but it seems nobody looks much at that page because it is at least online for two years and it has never been compromised (as far as we know). […]

Disabled debian-non-US mirroring, because it is obsolete since Debian 3.1, which was in 2005.

After trying out different new Fedora 7 kernels (which led to a few crashes and downtime) we switched to a CentOS kernel: 2.6.18-8.1.8.el5

On of our volumes (/ftp/pub/.2) was since 6 in the morning not available due to changes in the server room. Before going back online it needed unfortunately a fsck which took quite some time. But now we are fully operational again.

As I wanted to make a new kover release I thought I could try to move my code to git. The first step was to copy the code from cvs to a local git repository: git-cvsimport -i -v -d :pserver:adrian@cvs:/cvs/kover -C kover.git kover I was a bit surprised that the newly created directory kover.git was […]

Unscheduled downtime due to building wide power outage.

After a backup of all our FTP data the RAID will be deleted and a new filesystem will be created. We are going through all this effort because the fragmentation on our RAID has become so bad that the performance suffers immensely. As soon as the new filesystem is ready we will start the restore […]