You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

Ms3

From Wikitech-static
Jump to navigation Jump to search

Linux setup with 14 RAID-1 volumes of 3 disks each (spread over controllers), striped together in an LVM volume group.

Disk setup

# The first disks of the first and second controller,
# /dev/sda and /dev/sdi respectively, are used as host OS drives.
# The first disks of the remaining controllers will be used as spares.
#
# (md7)   |  h |  p |  x || af | an | av |  (md15)
# (md6)   |  g |  o |  w || ae | am | au |  (md14)
# (md5)   |  f |  n |  v || ad | al | at |  (md13)
# (md4)   |  e |  m |  u || ac | ak | as |  (md12)
# (md3)   |  d |  l |  t || ab | aj | ar |  (md11)
# (md2)   |  c |  k |  s || aa | ai | aq |  (md10)
# (md1)   |  b |  j |  r ||  z | ah | ap |  (md9) 
# (md0)   |  a |  i || q  |  y | ag | ao |  (spares, md8 missing)
#
#           c0   c1   c2    c3   c4   c5

Output of /home/mark/thumper-es-raid-lvs-setup.py:

mdadm --create --level 1 --raid-devices 3 /dev/md1 /dev/sdb /dev/sdj /dev/sdr
mdadm --create --level 1 --raid-devices 3 /dev/md9 /dev/sdz /dev/sdah /dev/sdap
mdadm --create --level 1 --raid-devices 3 /dev/md2 /dev/sdc /dev/sdk /dev/sds
mdadm --create --level 1 --raid-devices 3 /dev/md10 /dev/sdaa /dev/sdai /dev/sdaq
mdadm --create --level 1 --raid-devices 3 /dev/md3 /dev/sdd /dev/sdl /dev/sdt
mdadm --create --level 1 --raid-devices 3 /dev/md11 /dev/sdab /dev/sdaj /dev/sdar
mdadm --create --level 1 --raid-devices 3 /dev/md4 /dev/sde /dev/sdm /dev/sdu
mdadm --create --level 1 --raid-devices 3 /dev/md12 /dev/sdac /dev/sdak /dev/sdas
mdadm --create --level 1 --raid-devices 3 /dev/md5 /dev/sdf /dev/sdn /dev/sdv
mdadm --create --level 1 --raid-devices 3 /dev/md13 /dev/sdad /dev/sdal /dev/sdat
mdadm --create --level 1 --raid-devices 3 /dev/md6 /dev/sdg /dev/sdo /dev/sdw
mdadm --create --level 1 --raid-devices 3 /dev/md14 /dev/sdae /dev/sdam /dev/sdau
mdadm --create --level 1 --raid-devices 3 /dev/md7 /dev/sdh /dev/sdp /dev/sdx
mdadm --create --level 1 --raid-devices 3 /dev/md15 /dev/sdaf /dev/sdan /dev/sdav
spares:
mdadm --add /dev/md1 /dev/sdq /dev/sdy /dev/sdag /dev/sdao
pvcreate:
pvcreate /dev/md1
pvcreate /dev/md2
pvcreate /dev/md3
pvcreate /dev/md4
pvcreate /dev/md5
pvcreate /dev/md6
pvcreate /dev/md7
pvcreate /dev/md9
pvcreate /dev/md10
pvcreate /dev/md11
pvcreate /dev/md12
pvcreate /dev/md13
pvcreate /dev/md14
pvcreate /dev/md15
vgcreate:
vgcreate data /dev/md1 /dev/md2 /dev/md3 /dev/md4 /dev/md5 /dev/md6 /dev/md7 /dev/md9 /dev/md10 /dev/md11 /dev/md12 /dev/md13 /dev/md14 /dev/md15
lvcreate:
lvcreate -i 14 -I 64 -n ES data

bonnie++

Version 1.03b       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
ms3          64608M           414517  45 147501  24           364129  33 539.1   1
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  2085   2 +++++ +++  9414  18  7345  33 +++++ +++  5624  19
ms3,64608M,,,414517,45,147501,24,,,364129,33,539.1,1,16,2085,2,+++++,+++,9414,18,7345,33,+++++,+++,5624,19