QEMU/KVM の仮想環境(ゲスト)を止めずに別のホストに移す。
構成は以下ような感じ。
- ホスト環境 sayori(192.168.1.12) で動作しているゲスト環境 guest(192.168.1.50)を別のホスト環境 wasabi(192.168.1.10) に live migration する。
- ホストOS は debian lenny
- ゲストOS も debian lenny
- ゲストOS は PXE boot して、ルートファイルシステムはkujira(192.168.1.11)のiSCSIターゲットをマウントする。
- qemu-kvm のバージョンは 0.12.3
- sayori は Intel Core2 Duo で wasabi は AMD Opteron。ホストのCPUアーキテクチャは異なる。
この際、別ホストから guest へのTCPコネクションがどうなるか。と
guest 内で開きっぱなしのファイルがどうなるかを検証する。
rootfsの作成
iscsiターゲットのrootfsを作る。
debootstrapでお手軽サクサク。
パーティション切るとloopbackマウントがめんどいので切らない。
kujira:~# dd if=/dev/zero of=disk1.img seek=10G bs=1 count=0
kujira:~# mkfs.ext3 disk1.img
kujira:~# mkdir mnt
kujira:~# mount -t ext3 -o loop disk1.img mnt/
kujira:~# debootstrap lenny mnt/
kujira:~# echo guest > mnt/etc/hostname
kujira:~# umount mnt/
/etc/ietd.conf にこんな風に書く。
Target iqn.1999-05.net.hamano:dick1
Lun 0 Path=/path/to/disk1.img,Type=fileio
initramfsの作成
iSCSIイニシエータとして機能する initramfsを作る。
% mkidr initrd
% cd initrd
% zcat /boot/initrd.img-2.6.26-2-686 | cpio -iv
init スクリプトの root file system をマウントする直前に以下の5行を追加。
ipconfig -t 60 ${DEVICE}
modprobe iscsi_tcp
iscsid -f &
iscsiadm -m discovery -t sendtargets -p 192.168.1.11
iscsiadm -m node -T iqn.1999-05.net.hamano:dick1 -l
iSCSIターゲットをマウントするのに必要なファイルを配置、あと kernel module の libcrc32c.ko と crc32c.ko が必要。
% cp /usr/sbin/iscsid ./sbin/
% cp /usr/bin/iscsiadm ./bin/
% mkdir etc/iscsi/
% echo "InitiatorName=iqn.1999-05.net.hamano:hoge" > etc/iscsi/initiatorname.iscsi
% cp /lib/modules/2.6.26-2-686/kernel/lib/libcrc32c.ko lib/modules/2.6.26-2-686/kernel/lib
% mkdir lib/modules/2.6.26-2-686/kernel/crypto/
% cp /lib/modules/2.6.26-2-686/kernel/crypto/crc32c.ko lib/modules/2.6.26-2-686/kernel/crypto/
あと iscsid の中で getpwuid(3)呼んでいてユーザー名が root じゃなかったら蹴られてしまうので nss関連も適当に入れておく。
% cp /lib/libnsl.so.1 ./lib/
% cp /lib/libnss_files.so.2 ./lib/
% echo "root:x:0:0:root:/:/bin/sh" > etc/passwd
% echo "passwd: files" > etc/nsswitch.conf
この initrd に chroot して
# id
uid=0(root) gid=0
って帰ってくればひとまずOK
initramfsを固めて、tftpd サーバーに配置する。
% find ./ | cpio -o -H newc | gzip -9 > ../initrd.img-2.6.26-2-686
PXE boot の設定
pxelinux.cfg/default にこんな風に書く。パラメータに noresume を付けないと起動途中で止まってしまったので付けた。
default guest
label guest
kernel vmlinuz-2.6.26-2-686
append load initrd=initrd.img-2.6.26-2-686 root=/dev/sda noresume
qemu-kvmのネットワーク設定
wasabi, sayoriの両方のホストでtap50をブリッジする。
この辺りいつもは qemu-ifup scriptで自動化しているけど今回は手動で。
wasabi:~# tunctl -u hamano -t tap50
wasabi:~# brctl addif br0 tap50
wasabi:~# ip link set tap50 up
wasabi:~# brctl show br0
bridge name bridge id STP enabled interfaces
br0 8000.001e0bbc9da5 no eth0
tap50
qemu-kvmの実行
wasabi 側で待機する。
wasabi:~# qemu -enable-kvm -m 512 \
-net nic,macaddr=00:16:3E:00:FF:32,model=virtio \
-net tap,vlan=0,ifname=tap50,script=no,downscript=no -incoming tcp:0:4444
sayori 側でゲストを起動する。
sayori:~# qemu -enable-kvm -m 512 \
-net nic,macaddr=00:16:3E:00:FF:32,model=virtio \
-net tap,vlan=0,ifname=tap50,script=no,downscript=no -boot n
guest側でファイルをオープンしっぱなしにして、
別のサーバーから guest にTCPコネクションを張っておく。
準備が整ったのでいざ Live Migration!
sayori のモニターコンソールから
(qemu) migrate -d tcp:wasabi:4444
live migration の進捗はこれで確認できる。
(qemu) info migrate
Migration status: active
transferred ram: 8000 kbytes
remaining ram: 533648 kbytes
total ram: 541056 kbytes
(qemu) info migrate
Migration status: completed
migrationはだいたい5秒くらいで完了する。
結果
TCPコネクションは切れていない、オープン中のファイルも問題なく読み書き出来た。
理論上出来ると解っていても実際に動かしてみるとなかなか感動。
補足事項
- qemu-kvm 0.11.1 では nic の virtio を有効にして PXE boot 出来ない。
- 最初、sayoriの kernel を 2.6.32.9、wasabi の kernel を 2.6.26.8 で試すと以下のエラーメッセージが出て失敗した。
Unknown savevm section or instance 'kvmclock' 0
load of migration failed
kernel 2.6.31.5 < -> kernel 2.6.26.8 で試すと成功した。kvmのバージョンは出来るだけ揃えた方が無難。
…
…
…
…
…
…
…
…
…
…
…
…
…
…
buy@viagra.online” rel=”nofollow”>……
Need cheap generic VIAGRA?…
Trackback by Alexander — 2011/07/07 Thursday @ 12:54:16
buy@aloe.vera.gel” rel=”nofollow”>……
Need cheap generic VIAGRA?…
Trackback by Alexander1 — 2011/07/08 Friday @ 21:59:39
buy@generic.VIAGRA” rel=”nofollow”>……
Need cheap generic VIAGRA?…
Trackback by Alexander6 — 2011/07/16 Saturday @ 08:58:50
buy@generic.LEVITRA” rel=”nofollow”>……
Need cheap generic LEVITRA?…
Trackback by Alexander7 — 2011/07/20 Wednesday @ 14:39:46
Buy@Cheap.Coral.Calcium” rel=”nofollow”>……
Buywithout prescription…
Trackback by FREDDIE — 2011/07/29 Friday @ 13:14:50
Purchase@Coral.Calcium.Online” rel=”nofollow”>……
Buywithout prescription…
Trackback by PERRY — 2011/07/29 Friday @ 17:15:14
Get@Coral.Calcium.Online” rel=”nofollow”>..…
Buygeneric drugs…
Trackback by DUSTIN — 2011/07/29 Friday @ 18:53:46
Purchase@Abana.Online” rel=”nofollow”>..…
Buydrugs without prescription…
Trackback by OTIS — 2011/07/29 Friday @ 22:14:29
Purchase@Cheap.Abana” rel=”nofollow”>……
Buygeneric pills…
Trackback by LEO — 2011/07/29 Friday @ 23:30:20
Cheap@Generic.Abilify.5mg.10mg.15mg.20mg.30mg” rel=”nofollow”>..…
Buygeneric pills…
Trackback by EDUARDO — 2011/07/30 Saturday @ 12:15:17
Buy@Discount.Acai” rel=”nofollow”>..…
Buynow it…
Trackback by CHARLIE — 2011/07/30 Saturday @ 20:02:42
Get@Acai.Online” rel=”nofollow”>……
Buygeneric drugs…
Trackback by WALLACE — 2011/07/31 Sunday @ 09:52:47
Cheap@Coral.Calcium.Online” rel=”nofollow”>..…
Buyno prescription…
Trackback by BRANDON — 2011/08/01 Monday @ 07:40:58
Buy@Discount.Abana” rel=”nofollow”>..…
Buygeneric meds…
Trackback by SALVADOR — 2011/08/01 Monday @ 09:10:40
Order@Discount.Abilify” rel=”nofollow”>..…
Buyit now…
Trackback by TERRENCE — 2011/08/02 Tuesday @ 02:27:08
Purchase@Generic.Abilify” rel=”nofollow”>.…
Buynow it…
Trackback by ENRIQUE — 2011/08/02 Tuesday @ 06:29:51
Cheap@Abilify.5mg.10mg.15mg.20mg.30mg” rel=”nofollow”>..…
Buynow it…
Trackback by LEWIS — 2011/08/02 Tuesday @ 07:57:03
Buy@Abilify.5mg.10mg.15mg.20mg.30mg” rel=”nofollow”>……
Buywithout prescription…
Trackback by ROY — 2011/08/04 Thursday @ 00:05:51
Buy@Acai.Online” rel=”nofollow”>.…
Buywithout prescription…
Trackback by KURT — 2011/08/04 Thursday @ 03:42:45
Buy@Cheap.Acai” rel=”nofollow”>..…
Buydrugs without prescription…
Trackback by RICARDO — 2011/08/04 Thursday @ 05:45:07
Buy@Discount.Acai” rel=”nofollow”>……
Buyit now…
Trackback by FELIX — 2011/08/04 Thursday @ 06:44:21
Order@Cheap.Acai” rel=”nofollow”>……
Buywithout prescription…
Trackback by TRACY — 2011/08/04 Thursday @ 10:42:38
Order@Cheap.Acai” rel=”nofollow”>……
Buygeneric drugs…
Trackback by WILLIE — 2011/08/04 Thursday @ 11:05:08
Order@Discount.Acai” rel=”nofollow”>……
Buyit now…
Trackback by DONALD — 2011/08/04 Thursday @ 11:41:35
Order@Discount.Acai” rel=”nofollow”>……
Buynow…
Trackback by SALVADOR — 2011/08/04 Thursday @ 12:12:53
Purchase@Acai.Online” rel=”nofollow”>……
Buynow it…
Trackback by JEFFREY — 2011/08/04 Thursday @ 13:19:20
Cheap@Acai.Online” rel=”nofollow”>..…
Buynow it…
Trackback by ALVIN — 2011/08/04 Thursday @ 18:28:17
Buy@Generic.Acai” rel=”nofollow”>..…
Buywithout prescription…
Trackback by RUSSELL — 2011/08/04 Thursday @ 22:56:04
Buy@Generic.Acai” rel=”nofollow”>..…
Buydrugs without prescription…
Trackback by JUAN — 2011/08/05 Friday @ 00:53:07
Buy@Accupril.Online” rel=”nofollow”>.…
Buygeneric meds…
Trackback by CARL — 2011/08/06 Saturday @ 02:24:22
push@ywrns6.wheat” rel=”nofollow”>.…
сэнкс за инфу
…
Trackback by rafael — 2011/10/07 Friday @ 23:17:17
…
tnx for info
…
Trackback by dwayne — 2011/10/08 Saturday @ 15:19:49
“http://en.hangdrums.ru/?p=5646&lol= shine@ltfyf1.clean“>.…
thanks
…
Trackback by raymond — 2011/10/09 Sunday @ 17:09:04
< a href =
…
good
…
Trackback by joey — 2011/10/09 Sunday @ 21:53:37
run@pashw7.bring” rel=”nofollow”>.…
сэнкс за инфу
…
Trackback by maurice — 2011/10/10 Monday @ 00:22:15
hiv research being conducted in usa…
Buy_generic pills…
Trackback by BRANDON — 2011/10/17 Monday @ 13:04:24
advair and contraindications…
Buy_generic meds…
Trackback by FREDDIE — 2011/10/19 Wednesday @ 11:37:01
canine heat cycles…
Buy_without prescription…
Trackback by MICHAEL — 2011/10/19 Wednesday @ 13:17:05
viagra order uk…
Buy_generic pills…
Trackback by MIKE — 2011/10/19 Wednesday @ 14:57:12
weight loss disclaimer law…
Buy_drugs without prescription…
Trackback by DUSTIN — 2011/10/19 Wednesday @ 21:37:33
apo amitriptyline…
Buy_generic pills…
Trackback by ALBERTO — 2011/10/20 Thursday @ 15:38:18
what are the trimesters of pregnancy…
Buy_generic drugs…
Trackback by NORMAN — 2011/10/21 Friday @ 08:18:13
conquer online hacking tools…
Buy_generic drugs…
Trackback by ALFREDO — 2011/10/21 Friday @ 23:49:19
symptoms of prescription drug abuse…
Buy_drugs without prescription…
Trackback by KYLE — 2011/10/22 Saturday @ 04:48:53
percent of obese children in usa…
Buy_now it…
Trackback by BRADLEY — 2011/10/22 Saturday @ 08:08:59
weight loss doctors in memphis tennessee…
Buy_generic drugs…
Trackback by ROBERTO — 2011/10/26 Wednesday @ 00:30:46
is flomax good for prostatitis…
Buy_generic meds…
Trackback by TOM — 2011/10/26 Wednesday @ 12:09:51
working and twin pregnancy…
Buy_now it…
Trackback by MANUEL — 2011/10/27 Thursday @ 06:29:48
cancer of spine…
Buy_without prescription…
Trackback by CHRIS — 2011/10/27 Thursday @ 19:50:22
how to embed pictures ms office…
Buy_drugs without prescription…
Trackback by FRANCIS — 2011/10/27 Thursday @ 21:30:34
herbal essence coupon discount…
Buy_now it…
Trackback by GORDON — 2011/10/28 Friday @ 04:10:00
adult survivors of childhood cancer…
Buy_generic pills…
Trackback by RAMON — 2011/10/28 Friday @ 22:29:42
stress from clinical duty…
Buy_without prescription…
Trackback by TERRENCE — 2011/10/29 Saturday @ 11:49:51
singapore secure psychiatric forensic unit…
Buy_no prescription…
Trackback by DOUGLAS — 2011/10/29 Saturday @ 16:06:34
saline for nebulizer…
Buy_generic pills…
Trackback by MARC — 2011/10/30 Sunday @ 00:23:08
mini insulin fridge…
Buy_generic drugs…
Trackback by ALFREDO — 2011/10/30 Sunday @ 02:02:52
avelox treats for bacteria…
Buy_drugs without prescription…
Trackback by ANDREW — 2011/10/30 Sunday @ 21:09:38
drug treatment for bipolar disorder…
Buy_generic pills…
Trackback by SERGIO — 2011/10/31 Monday @ 03:46:43
how to get teens off drugs…
Buy_drugs without prescription…
Trackback by JOEL — 2011/11/01 Tuesday @ 16:27:25
office of generic drug…
Buy_generic drugs…
Trackback by GEORGE — 2011/11/03 Thursday @ 21:47:22
chronic bronchitis from marijuana…
Buy_now…
Trackback by JUAN — 2011/11/03 Thursday @ 23:27:47
decreased appetite during pregnancy…
Buy_generic drugs…
Trackback by JEREMIAH — 2011/11/04 Friday @ 10:15:28
maximum daily dose for venlafaxine…
Buy_it now…
Trackback by BILL — 2011/11/04 Friday @ 13:35:35
can a woman have colorectal cancer…
Buy_drugs without prescription…
Trackback by KURT — 2011/11/05 Saturday @ 02:55:50
food low in cholesterol…
Buy_now it…
Trackback by ZACHARY — 2011/11/05 Saturday @ 09:35:34
build muscle mass diet…
Buy_drugs without prescription…
Trackback by ROSS — 2011/11/06 Sunday @ 04:52:37
ayurvedic ashwagandha zyban…
Buy_generic pills…
Trackback by ALFREDO — 2011/11/06 Sunday @ 23:12:51
relief of skin itching…
Buy_now it…
Trackback by WALLACE — 2011/11/09 Wednesday @ 07:06:38
free diabetes logbooks to print…
Buy_generic drugs…
Trackback by LUTHER — 2011/11/09 Wednesday @ 15:26:23
eye drops canine paralysis…
Buy_now…
Trackback by DALE — 2011/11/10 Thursday @ 09:46:18
hiv quality of life survey tools…
Buy_drugs without prescription…
Trackback by DAVE — 2011/11/10 Thursday @ 23:06:39
obesity in moorhead minnesota…
Buy_now…
Trackback by PATRICK — 2011/11/11 Friday @ 04:06:40
kim kardashian weight gain…
Buy_now…
Trackback by IVAN — 2011/11/12 Saturday @ 21:46:39
breast cancer site is having trouble…
Buy_drugs without prescription…
Trackback by JORGE — 2011/11/13 Sunday @ 02:46:16
boost metabolism foods…
Buy_now…
Trackback by JIM — 2011/11/16 Wednesday @ 02:44:13
cause for morning erections…
Buy_generic meds…
Trackback by LESLIE — 2011/11/16 Wednesday @ 09:24:11
inpatient drug rehab sanford fl…
Buy_it now…
Trackback by CHRISTIAN — 2011/11/16 Wednesday @ 22:44:26
substitute for diovan hct…
Buy_now…
Trackback by GARY — 2011/11/17 Thursday @ 07:04:23
acyclovir stada cream…
Buy_generic drugs…
Trackback by REGINALD — 2011/11/17 Thursday @ 22:04:57
thank you
…
Trackback by andre — 2011/12/09 Friday @ 04:12:12
спасибо за инфу
…
Trackback by nicholas — 2011/12/10 Saturday @ 01:50:36
спс за инфу
…
Trackback by jeffery — 2011/12/10 Saturday @ 06:31:32
thanks
…
Trackback by curtis — 2011/12/10 Saturday @ 14:35:32
good info
…
Trackback by maurice — 2011/12/10 Saturday @ 20:51:12
спс
…
Trackback by terrance — 2011/12/10 Saturday @ 22:05:42
…
sps
…
Trackback by adam — 2011/12/11 Sunday @ 00:47:57
Download@alternative.Rock” rel=”nofollow”>.…
Search rock UK Charts…
Trackback by nathaniel — 2011/12/11 Sunday @ 07:54:41
tnx
…
Trackback by dale — 2011/12/11 Sunday @ 16:58:17
…
спасибо за инфу
…
Trackback by billy — 2011/12/11 Sunday @ 18:24:34
tnx
…
Trackback by evan — 2011/12/12 Monday @ 05:15:25