Keepalived + Haproxy 实现高可用负载均衡架构

实验环境：

Host	IP
Web1	192.168.116.103
Web2	192.168.116.104
Haproxy-Master	192.168.116.105
Haproxy-Backup	192.168.116.106
VIP	192.168.116.110

实验步骤：

1. 部署 Web 服务器

• 安装 Nginx、Apache 都可以

• 这里我们安装Nginx，参考https://blog.csdn.net/RunzIyy/article/details/104822655

• Web1 编写验证文件、启动服务、验证

echo 'This is a Web1-Master ' > /usr/local/nginx/html/index.htmlnginxcurl 192.168.116.103
This is a Web1-Master 

• Web2 编写验证文件、启动服务、验证

echo 'This is a Web2-Backup ' > /usr/local/nginx/html/index.htmlnginxcurl 192.168.116.103
This is a Web2-Backup

2. 部署 Haproxy

1） 安装Haproxy

• 解决依赖关系

[root@localhost ~]# yum -y install pcre-devel bzip2-devel

• 源码安装
  • 安装时需要制定内核版本号

[root@localhost ~]# tar -zxf haproxy-1.4.24.tar.gz -C /usr/src/
[root@localhost ~]# cd /usr/src/haproxy-1.4.24/
[root@localhost haproxy-1.4.24]# uname -r
3.10.0-862.el7.x86_64
[root@localhost haproxy-1.4.24]# make TARGET=linux3.10 PREFIX=/usr/local/haproxy && make install PREFIX=/usr/local/haproxy

2） 优化路径

• 优化sbin下的脚本

[root@localhost ~]# ln -s /usr/local/haproxy/sbin/* /usr/sbin	

• 创建 Haproxy 配置文件目录

[root@localhost ~]# mkdir /etc/haproxy	

• copy haproxy 配置文件模板

[root@localhost ~]# cp /usr/src/haproxy-1.4.24/examples/haproxy.cfg /etc/haproxy/

• copy haproxy 启动脚本

[root@localhost ~]# cp /usr/src/haproxy-1.4.24/examples/haproxy.init /etc/init.d/haproxy  # 赋予执行权限且将haproxy加入 系统管理工具中
[root@localhost ~]# chmod +x /etc/init.d/haproxy 
[root@localhost ~]# chkconfig --add haproxy

3） 修改 Haproxy 配置文件

• Haproxy-Master

[root@localhost ~]# vim /etc/haproxy/haproxy.cfg # this config needs haproxy-1.1.28 or haproxy-1.2.1globallog 127.0.0.1   local0log 127.0.0.1   local1 notice#log loghost    local0 infomaxconn 4096chroot /usr/local/haproxy			# 指定Haproxy 家目录uid 99								# 运行用户 UIDgid 99daemon#debug#quietdefaultslog     globalmode    httpoption  httplogoption  dontlognullretries 3redispatchmaxconn 2000contimeout      5000clitimeout      50000srvtimeout      50000
# 26之后全部删除，手动编写
listen webserver 192.168.116.110:80				# haproxy监听的地址与端口balance roundrobin						# 指定轮询方式option httpchk GET /index.html			# 后端服务器，健康检查server web_one 192.168.116.103:80 check inter 2000 rise 3 fall 3server web_two 192.168.116.104:80 check inntr 2000 rise 3 fall 3#  监听的节点信息# web_one 节点name，IP：port  #check 开启节点健康检查  #inter 2000        每隔  2000毫秒进行一个jiance# rise 3 fall      后端建立成功的次数，和失败的次数，   如果三次健康检查都失败的话则将该 web 服务区踢出负载群集# 还可以添加 weight（权重）  maxconn（最大连接）   backup（使当前节点为备份节点）

• haproxy-Backup

[root@localhost ~]# vim /etc/haproxy/haproxy.cfg # this config needs haproxy-1.1.28 or haproxy-1.2.1globallog 127.0.0.1   local0log 127.0.0.1   local1 notice#log loghost    local0 infomaxconn 4096chroot /usr/local/haproxy			# 指定Haproxy 家目录uid 99								# 运行用户 UIDgid 99daemon#debug#quietdefaultslog     globalmode    httpoption  httplogoption  dontlognullretries 3redispatchmaxconn 2000contimeout      5000clitimeout      50000srvtimeout      50000
# 26之后全部删除，手动编写
listen webserver 192.168.116.110:80				# haproxy监听的地址与端口balance roundrobin						# 指定轮询方式option httpchk GET /index.html			# 后端服务器，健康检查server web_one 192.168.116.103:80 check inter 2000 rise 3 fall 3server web_two 192.168.116.104:80 check inter 2000 rise 3 fall 3#  监听的节点信息

3. 部署 Keepalived

1） 安装 Keepalived

• 解决依赖关系

[root@localhost ~]# yum -y install popt-devel kernel-devel openssl-devel

• 源码安装

[root@localhost ~]# tar -zxf keepalived-1.2.13.tar.gz -C /usr/src/
[root@localhost ~]# cd /usr/src/keepalived-1.2.13/
[root@localhost keepalived-1.2.13]# ./configure --prefix=/ --with-kernel-dir=/usr/src/kernel && make && make install

2） 修改配置文件

• Haproxy 本身会检查各节点的信息，所以不需要配置节点信息
• Haproxy-Master

! Configuration File for keepalivedglobal_defs {notification_email {acassen@firewall.locfailover@firewall.locsysadmin@firewall.loc}notification_email_from Alexandre.Cassen@firewall.locsmtp_server 192.168.200.1smtp_connect_timeout 30router_id LVS_DEVEL-R1
}vrrp_instance VI_1 {state MASTERinterface ens33virtual_router_id 51priority 100advert_int 1authentication {auth_type PASSauth_pass 1111}virtual_ipaddress {192.168.116.110}
}

• Haproxy-Backup

global_defs {notification_email {acassen@firewall.locfailover@firewall.locsysadmin@firewall.loc}notification_email_from Alexandre.Cassen@firewall.locsmtp_server 192.168.200.1smtp_connect_timeout 30router_id LVS_DEVEL-R2		# 修改
}vrrp_instance VI_1 {state BACKUP				# 修改interface ens33virtual_router_id 51priority 100advert_int 1authentication {auth_type PASSauth_pass 1111}virtual_ipaddress {192.168.116.110}
}

4. 启动服务

• 由于Haproxy 监听的是虚拟地址， 不存在的，只有当 Keepalived 先启动，生成虚拟IP地址，Haproxy 才可以正常启动

• Haproxy-Master

[root@localhost ~]# service keepalived start
Starting keepalived (via systemctl):                       [  确定  ][root@localhost ~]# systemctl start haproxy

• Haproxy-Backup Keepalived 不生成虚拟IP地址，haproxy 则无法启动，那该怎么办呢

• 这里呢我们需要手写一个脚本文件

• 编写监控192.168.116.110 VIP 是否生成

  • haproxy 两台都需要添加哦

[root@localhost ~]# vim haproxy_run.sh#! /bin/baship add | grep 192.168.116.110 > /dev/nullif [ `echo $?` -eq 0 ];thensystemctl start haproxy
elsesystemctl stop haproxy
fi

• 赋予执行权限

[root@localhost ~]# chmod +x /root/haproxy_run.sh 

• Keepalived 添加脚本并进行监控

vrrp_script chk_haproxy_run {script "/root/haproxy_run.sh"interval 2weight
}       vrrp_instance VI_1 {state MASTERinterface ens33virtual_router_id 51priority 100advert_int 1authentication {auth_type PASSauth_pass 1111}   track_script {chk_haproxy_run}   virtual_ipaddress {192.168.116.110}   
}  

• Haproxy-Backup

[root@localhost ~]# vim haproxy_run.sh#! /bin/baship add | grep 192.168.116.110 > /dev/nullif [ `echo $?` -eq 0 ];thensystemctl start haproxy
elsesystemctl stop haproxy
fi[root@localhost ~]# chmod +x /root/haproxy_run.sh 

• 添加 Keepalived

vrrp_script chk_haproxy_run {script "/root/haproxy_run.sh"interval 2      weight 2 
}       
vrrp_instance VI_1 {state BACKUPinterface ens33virtual_router_id 51priority 100advert_int 1authentication {auth_type PASSauth_pass 1111}   track_script {chk_haproxy_run}   virtual_ipaddress {192.168.116.110}   
}   

• 重启 Keepalived 服务

[root@localhost ~]# service keepalived restart
Restarting keepalived (via systemctl):                     [  OK  ]

• 可以关闭 主 Keepalived 测试

[root@localhost ~]# curl 192.168.116.110
This is a Web1-Master 
[root@localhost ~]# curl 192.168.116.110
This is a Web2-Backup