Openstack|Openstack Kolla-Ansible安装部署

Openstack Kolla-Ansible安装部署 部署节点制作 环境准备

  1. CentOS环境安装
    • 配置国内pypi源:
    mkdir -p ~/.config/pip/ vim ~/.config/pip/pip.conf[global] index-url = https://mirrors.ustc.edu.cn/pypi/web/simple format = columns

    • CentOS 部分常用软件安装
    yum install -y vim net-toolsbash-completion-extras git

  2. 安装依赖
    • pip
    yum install -y python-pip pip install --upgrade pip

    • 软件依赖
    yum install -y python-devel libffi-devel gcc openssl-devel libselinux-python

    • ansible 安装
    yum install -y ansible pip install -U ansible

    • 修改ansible配置文件 /etc/ansible/ansible.cfg
    [defaults] host_key_checking=False pipelining=True forks=100

安装docker-ce
cd /etc/yum.repos.d/ wget https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo yum install docker-ce -y

开启 Docker 的共享挂载功能:所谓共享挂载即同一个目录或设备可以挂载到多个不同的路径并且能够保持互相之间的共享可见性,类似于 mount --shared。在 OpenStack for Kolla 中,主要解决 Neutron 的 namespace 在不同 container 中得以保持实效性的问题。
mkdir /etc/systemd/system/docker.service.d tee /etc/systemd/system/docker.service.d/kolla.conf << 'EOF' > [Service] > MountFlags=shared > EOF

使用阿里的加速器(登陆阿里云–>控制台–>产品与服务–>容器镜像服务–>镜像加速器 即可获取加速器地址)
mkdir -p /etc/docker tee /etc/docker/daemon.json <<-'EOF' { "registry-mirrors": ["https://mb8n4btz.mirror.aliyuncs.com"] } EOF

启动docker服务
systemctl enable docker.service systemctl start docker.service

Kolla-Ansible 安装
Kolla-Ansible 可以从pip安装,也可以从git安装,这里从git安装
  1. clone 代码
git clone https://github.com/openstack/kolla git clone https://github.com/openstack/kolla-ansible

  1. 安装
pip install -r kolla/requirements.txt pip install -r kolla-ansible/requirements.txt python kolla-ansible/setup.py install

注意:
如果出现requests 2.20.0 has requirement idna<2.8,>=2.5, but you'll have idna 2.4 which is incompatible.错误,则强制更新requets
pip install --ignore-installed requests

同样,出现Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.错误,强制更新
sudo pip install --ignore-installed PyYAML

  1. copy globals.yml passwords.yml to /etc/kolla
mkdir -p /etc/kolla cp -r kolla-ansible/etc/kolla/* /etc/kolla

  1. 配置安装目录
mkdir dep-158 cp kolla-ansible/ansible/inventory/* ./dep-158

制作本地镜像源
  1. 修改kolla镜像有关配置
vim /etc/kolla/globals.yml openstack_release: "rocky" network_interface: "ens192"

  1. 拉取镜像
kolla-ansible pull -vvv

  1. 启动容器
mkdir -p /var/www/html/registry # docker run -d -p 5000:5000 -v /var/www/html/registry:/var/lib/registry --restart=always --name registry registry:2.6.2

  1. 修改docker配置,10.10.129.151ens192的ip
vim /etc/docker/daemon.json { "registry-mirrors": ["https://mb8n4btz.mirror.aliyuncs.com"], "insecure-registries":["10.10.129.151:5000"] }

  1. 修改镜像tag
for i in `docker images|grep -v registry|grep -v R|awk '{print $1}'`; do docker image tag $i:rocky 10.10.129.151:5000/$i:rocky; done

  1. 上传镜像到私有镜像仓库
for i in `docker images|grep 10.10.129.151|awk '{print $1}'`; do docker push $i:rocky; done

  1. 查看镜像是否上传成功
curl -XGET http://10.10.129.151:5000/v2/_catalog

  1. 备份镜像文件
tar -zcvf kolla-openstack-queens-registry.tar.gz /var/www/html/registry

Openstack 部署 环境说明
部署配置
kolla自带了all-in-one和多节点的两种部署方式,需要配置ansible 部署文件
  1. multinode部署文件修改
[control] 10.0.0.[10:12] ansible_user=ubuntu ansible_password=foobar ansible_become=true # Ansible supports syntax like [10:12] - that means 10, 11 and 12. # Become clause means "use sudo".[network:children] control # when you specify group_name:children, it will use contents of group specified.[compute] 10.0.0.[13:14] ansible_user=ubuntu ansible_password=foobar ansible_become=true[monitoring] 10.0.0.10 # This group is for monitoring node. # Fill it with one of the controllers' IP address or some others.[storage:children] compute[deployment] localhostansible_connection=local become=true # use localhost and sudo

说明:
  • Ansible官方文档
  1. 部署中使用的密码存储在/etc/kolla/passwords.yml文件中。通过运行下面命令生成随机密码,初始化之后,可手动更改keystone_admin_password密码(OpenStack登录密码)
kolla-genpwd vim /etc/kolla/passwords.yml keystone_admin_password: password

部署
  1. 确认inventory配置文件是否正确
ansible -m ping all -i ./multinode结果: localhost | SUCCESS => { "changed": false, "ping": "pong" } 10.10.129.158 | SUCCESS => { "changed": false, "ping": "pong" } 10.10.129.159 | SUCCESS => { "changed": false, "ping": "pong" }

  1. 向各个节点安装基本依赖,如docker等;
修改docker yum源。https 有时会报ssl的错误,这里替换为http,也可以修改成本地源
vim /usr/share/kolla-ansible/ansible/roles/baremetal/defaults/main.yml docker_yum_url: "http://yum.dockerproject.org"

【Openstack|Openstack Kolla-Ansible安装部署】如果打开了octavia,需要在/var/lib/kolla/config_files路径下制作证书文件
mkdir -p /etc/kolla/config/octavia git clone https://github.com/openstack/octavia.git source create_certificates.sh /etc/kolla/config/octavia/ /home/octavia/etc/certificates/openssl.cnf # 注意 /home/octavia/etc/certificates/openssl.cnf 为octavia的代码路径下的文件 cp /etc/kolla/config/octavia/private/* /etc/kolla/config/octavia/

# -vvv 可以打印出最详细的信息 kolla-ansible -i ./multinode bootstrap-servers -vvv

  1. 对主机执行预部署检查
kolla-ansible -i ./multinode prechecks -vv

  1. 执行OpenStack部署
kolla-ansible -i ./multinode deploy -vv

  1. 使用OpenStack
kolla-ansible post-deploy . /etc/kolla/admin-openrc.sh

一些注意事项
  • 部署过程中所有的ansible task都在 /usr/share/kolla-ansible/ansible/roles/glance/tasks/ 下面,可以查看;
参考文档
  • kolla-ansible部署OpenStack多节点
  • kolla构建openstack镜像的本地yum源配置
  • kolla-openstack-queens-本地镜像
  • Openstack kolla-ansible

    推荐阅读