[OFFICIAL] Debian Image


#1

Continuing the discussion from [OFFICIAL] New linux distributions (Debian, CoreOS, CentOS, Fedora, Arch Linux, …):

New distribution: Debian Wheezy 7.6 - 2014.10.17 BETA


Built with:


Done:

  • Latest Debian Wheezy (7.6)
  • Packages upgraded with security ports
  • Script to sync your ssh keys
  • Script to create /etc/ndbtab and attach nbd devices automatically
  • Script to handle reboots (maintain rootfs NBD device attached until last moment)
  • Script to update the hostname and /etc/hosts

Beta:

We need feedback for this first version of the official Debian image.
You can give your recommendations right here or create pull requests on the Github project


Known bugs:

The service nbd-add-extra-volumes won’t run automatically, you need to run the following command to fix this

update-rc.d nbd-add-extra-volumes defaults

Fixed with the following commit for the next release of the image:


Shutdown/reboot issue: need further investigation


[OFFICIAL] New linux distributions (Debian, CoreOS, CentOS, Fedora, Arch Linux, ...)
[Debian] Problem when rebooting
#2

We seem to have some issue on the shutdown sequence.
I’m going to benchmark it to see if we have any performance difference with Ubuntu!


#4

Here is the output of UnixBench.

       #    #  #    #  #  #    #          #####   ######  #    #   ####   #    #
   #    #  ##   #  #   #  #           #    #  #       ##   #  #    #  #    #
   #    #  # #  #  #    ##            #####   #####   # #  #  #       ######
   #    #  #  # #  #    ##            #    #  #       #  # #  #       #    #
   #    #  #   ##  #   #  #           #    #  #       #   ##  #    #  #    #
    ####   #    #  #  #    #          #####   ######  #    #   ####   #    #

   Version 5.1.3                      Based on the Byte Magazine Unix Benchmark

   Multi-CPU version                  Version 5 revisions by Ian Smith,
                                      Sunnyvale, CA, USA
   January 13, 2011                   johantheghost at yahoo period com

Use of uninitialized value in printf at ./Run line 1378.
Use of uninitialized value in printf at ./Run line 1380.
Use of uninitialized value in printf at ./Run line 1378.
Use of uninitialized value in printf at ./Run line 1380.
Use of uninitialized value in printf at ./Run line 1378.
Use of uninitialized value in printf at ./Run line 1380.
Use of uninitialized value in printf at ./Run line 1378.
Use of uninitialized value in printf at ./Run line 1380.
Use of uninitialized value in printf at ./Run line 1588.
Use of uninitialized value in printf at ./Run line 1590.
Use of uninitialized value in printf at ./Run line 1588.
Use of uninitialized value in printf at ./Run line 1590.
Use of uninitialized value in printf at ./Run line 1588.
Use of uninitialized value in printf at ./Run line 1590.
Use of uninitialized value in printf at ./Run line 1588.
Use of uninitialized value in printf at ./Run line 1590.

1 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

1 x Double-Precision Whetstone  1 2 3 4 5 6 7 8 9 10

1 x Execl Throughput  1 2 3

1 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

1 x File Copy 256 bufsize 500 maxblocks  1 2 3

1 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

1 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

1 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

1 x Process Creation  1 2 3

1 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

1 x Shell Scripts (1 concurrent)  1 2 3

1 x Shell Scripts (8 concurrent)  1 2 3

4 x Dhrystone 2 using register variables  1 2 3 4 5 6 7 8 9 10

4 x Double-Precision Whetstone  1
 2 3 4 5 6 7 8 9 10

4 x Execl Throughput  1 2 3

4 x File Copy 1024 bufsize 2000 maxblocks  1 2 3

4 x File Copy 256 bufsize 500 maxblocks  1 2 3

4 x File Copy 4096 bufsize 8000 maxblocks  1 2 3

4 x Pipe Throughput  1 2 3 4 5 6 7 8 9 10

4 x Pipe-based Context Switching  1 2 3 4 5 6 7 8 9 10

4 x Process Creation  1 2 3

4 x System Call Overhead  1 2 3 4 5 6 7 8 9 10

4 x Shell Scripts (1 concurrent)  1 2 3

4 x Shell Scripts (8 concurrent)  1 2 3

========================================================================
   BYTE UNIX Benchmarks (Version 5.1.3)

   System: c1-10-1-19-18: GNU/Linux
   OS: GNU/Linux -- 3.17.0-85 -- #2 SMP Wed Oct 15 15:31:27 CEST 2014
   Machine: armv7l (unknown)
   Language: en_US.utf8 (charmap="UTF-8", collate="UTF-8")
   CPU 0: ARMv7 Processor rev 2 (v7l) (0.0 bogomips)

   CPU 1: ARMv7 Processor rev 2 (v7l) (0.0 bogomips)

   CPU 2: ARMv7 Processor rev 2 (v7l) (0.0 bogomips)

   CPU 3: ARMv7 Processor rev 2 (v7l) (0.0 bogomips)

   01:13:54 up 35 min,  1 user,  load average: 1.35, 1.48, 1.26; runlevel 2

------------------------------------------------------------------------
Benchmark Run: Sat Oct 18 2014 01:13:54 - 01:42:13
4 CPUs in system; running 1 parallel copy of tests

Dhrystone 2 using register variables        3862326.9 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                      643.3 MWIPS (9.9 s, 7 samples)
Execl Throughput                                507.4 lps   (29.9 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks         93765.4 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks           26946.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks        231032.6 KBps  (30.0 s, 2 samples)
Pipe Throughput                              303437.4 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                  46652.0 lps   (10.0 s, 7 samples)
Process Creation                                676.2 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   1106.2 lpm   (60.0 s, 2 samples)
Shell Scripts (8 concurrent)                    257.0 lpm   (60.2 s, 2 samples)
System Call Overhead                         809526.4 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0    3862326.9    331.0
Double-Precision Whetstone                       55.0        643.3    117.0
Execl Throughput                                 43.0        507.4    118.0
File Copy 1024 bufsize 2000 maxblocks          3960.0      93765.4    236.8
File Copy 256 bufsize 500 maxblocks            1655.0      26946.5    162.8
File Copy 4096 bufsize 8000 maxblocks          5800.0     231032.6    398.3
Pipe Throughput                               12440.0     303437.4    243.9
Pipe-based Context Switching                   4000.0      46652.0    116.6
Process Creation                                126.0        676.2     53.7
Shell Scripts (1 concurrent)                     42.4       1106.2    260.9
Shell Scripts (8 concurrent)                      6.0        257.0    428.4
System Call Overhead                          15000.0     809526.4    539.7
                                                                   ========
System Benchmarks Index Score                                         207.7

------------------------------------------------------------------------
Benchmark Run: Sat Oct 18 2014 01:42:13 - 02:10:40
4 CPUs in system; running 4 parallel copies of tests

Dhrystone 2 using register variables       15416714.4 lps   (10.0 s, 7 samples)
Double-Precision Whetstone                     2566.3 MWIPS (9.9 s, 7 samples)
Execl Throughput                               1010.0 lps   (29.9 s, 2 samples)
File Copy 1024 bufsize 2000 maxblocks        126000.1 KBps  (30.0 s, 2 samples)
File Copy 256 bufsize 500 maxblocks           36330.5 KBps  (30.0 s, 2 samples)
File Copy 4096 bufsize 8000 maxblocks        328104.2 KBps  (30.0 s, 2 samples)
Pipe Throughput                              866584.1 lps   (10.0 s, 7 samples)
Pipe-based Context Switching                 177976.0 lps   (10.0 s, 7 samples)
Process Creation                               2103.9 lps   (30.0 s, 2 samples)
Shell Scripts (1 concurrent)                   2024.1 lpm   (60.1 s, 2 samples)
Shell Scripts (8 concurrent)                    263.3 lpm   (60.4 s, 2 samples)
System Call Overhead                        2173810.0 lps   (10.0 s, 7 samples)

System Benchmarks Index Values               BASELINE       RESULT    INDEX
Dhrystone 2 using register variables         116700.0   15416714.4   1321.1
Double-Precision Whetstone                       55.0       2566.3    466.6
Execl Throughput                                 43.0       1010.0    234.9
File Copy 1024 bufsize 2000 maxblocks          3960.0     126000.1    318.2
File Copy 256 bufsize 500 maxblocks            1655.0      36330.5    219.5
File Copy 4096 bufsize 8000 maxblocks          5800.0     328104.2    565.7
Pipe Throughput                               12440.0     866584.1    696.6
Pipe-based Context Switching                   4000.0     177976.0    444.9
Process Creation                                126.0       2103.9    167.0
Shell Scripts (1 concurrent)                     42.4       2024.1    477.4
Shell Scripts (8 concurrent)                      6.0        263.3    438.9
System Call Overhead                          15000.0    2173810.0   1449.2
                                                                   ========
System Benchmarks Index Score                                         460.1

#5

Hi,

The first impression, i think there is a bug with default debian image :

  • The hostname not match with IP (ip 10.X.Y.Z, hostname c1-10-1-12-112)
  • mkfs on nbdX device don’t work:

root# mkfs -t ext4 /dev/nbd1
mke2fs 1.42.5 (29-Jul-2012)
mkfs.ext4: Device size reported to be zero. Invalid partition specified, or
partition table wasn’t reread after running fdisk, due to
a modified partition being busy and in use. You may need to reboot
to re-read your partition table.

Best regard


#6

Yes, we are working to fix it right now:

The hostname is generated in a dhcp hook, but apparently, there are no ethclient daemon running (ubuntu has by default).
You can bypass this bug by typing ethclient eth0.


The script responsible for attaching secondary nbd devices is not registered to run at boot.
It’s fixed and will be available with the next Debian release, today or tomorrow.
Fixing commit:

You can bypass this bug by running /etc/init.d/nbd-add-extra-volumes start.
You can also do update-rc.d nbd-root-disconnect defaults and reboot, so it will be automatically done on startup.


#7

Bonjour,

Apparement la commande ethclient eth0 n’existe pas ou du moins je ne l’ai pas trouvé, en revanche dhclient eth0 puis reboot résoud le problème avec le hostname.
En revanche le /etc/init.d/nbd-add-extra-volumes ne fait rien :

host# /etc/init.d/nbd-add-extra-volumes start
Starting NBD client process: Connecting…Negotiation: …size = 95367MB
bs=1024, sz=99999997952 bytes
connected /dev/nbd1
Activating…
/dev/nbd1: raw selected. doing nothing.
nbd-client.
2660

host# df -h
Filesystem Size Used Avail Use% Mounted on
rootfs 19G 367M 17G 3% /
none 1009M 0 1009M 0% /dev
/dev/nbd0 19G 367M 17G 3% /
tmpfs 203M 28K 203M 1% /run
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 405M 0 405M 0% /run/shm
J’ai aussi le problème de montage de disque sur ubuntu sauf que le service n’existe pas, je vais peut être passer par un post dans la section ubuntu.

Au passage, la commande reboot ou shutdown -r now ne permettent pas de redémarrer le serveur, il faut en plus faire un hard reboot dans la console (de mémoire le problème existe aussi sur ubuntu).

J’ai aussi une question sur le fait qu’il n’y a pas de syslog/rsyslog de démarré par défaut, c’est volontaire ? peut être pour protéger les SSD du système.


#8

New release: Debian Wheezy 7.7 - 2014.10.24


Predecessor: Debian Wheezy 7.6 - 2014.10.17


Built with:


Done:

  • Latest Debian Wheezy (7.7)
  • Packages upgraded with security ports
  • Latest version of Online Labs’ scripts (sync ssh keys, hostname, additional nbd volume, clean shutdown)
    • Fixed reboot/shutdown
    • Fixed dhclient and hostname
    • Fixed web console daemon config
    • Removed SSH as root with password
    • Automatically attach all secondary NBD devices
  • Added more base packages: vim htop, socat, lsof, tmux, screen, tcpdump, netcat, ioping, fio, locate
  • Added locate/update-db

[OFFICIAL] New linux distributions (Debian, CoreOS, CentOS, Fedora, Arch Linux, ...)
#9

Bonjour,

je viens de faire une ré-installation, pour moi le hostname est corrigé, c’est bien pour packages ajoutés, le reboot a fonctionné 2 fois sur 3 et c’est cool d’avoir intégré le service rsyslog dans l’image de base.

En revanche chez moi les NBD devices ne sont pas monté en automatique.
Cordialement


#10

Ils ne sont pas montés, mais seulement attachés, du coup tu peux les monter sans avoir besoin de les connecter avec une ip et un port


#11

Bonjour,

quand tu dis les monter c’est avec le commandes suivantes ? :

  • mkfs -t ext4 /dev/nbd1
  • mkdir -p /mnt/data
  • mount /dev/nbd1 /mnt/data

y-a-t’il une road map sur le fait de les monter en automatique à l’install/boot ?
ou il faut passer par “Connect to a block device manually” ?

Merci d’avance.
Cordialement


#13

Oui

Ce n’est pas prévu pour l’instant pour une raison simple : nous ne pouvons pas savoir quel FS vous souhaitez mettre sur votre device.


#15

Is there an ETA on the availability of a debian 8 image?


#16

You can follow the work done on debian (and even create issues and requests!) on github


#17

Shutdown/reboot? This may help: