Dex Chen

Dex Chen

Dex's Blog

© 2020

Dark Mode

Use Contiv-VPP CNI on K3s
Oct 24, 2020
  • Kubernetes

Contiv-VPP is an alternative to have use-space data plane for K3s. And I tried to install Contiv-VPP on K3s with default configuration. When I finished installation, realized Pods on K3s failed to create Pod networking interface with Contiv-VPP CNI. After some investigation on Contiv-VPP along with source code. I realized containerd as default container runtime of K3s was not supported by Contiv-VPP due to naming of network namespace is different between containerd and docker (here and here). So docker is required as container runtime if you would like to enable Contiv-VPP as CNI. By default, fannel is used as CNI plugin on K3s. K3s provides a confiugration during installation: --flannel-backend=none. So the command to install K3s should be:

$ curl -sfL https://get.k3s.io | INSTALL_K3S_EXEC="server --flannel-backend=none" sh -s - --docker

Since Contiv-VPP uses DPDK as its underlying library for process packets from NICs. Needs to make sure hugepages is enabled on host. The following command could be used to enable it (need to restart K3s):

$ sudo sysctl -w vm.nr_hugepages=512

Now, we are ready to install Contiv-VPP. Since the node selector in contiv-vpp.yaml from Contiv-VPP didn’t match what K3s provides. We need to change it before applying YAML file:

$ curl -sfL https://raw.githubusercontent.com/contiv/vpp/master/k8s/contiv-vpp.yaml \
    | sed 's#node-role.kubernetes.io/master: ""#node-role.kubernetes.io/master: "true"#' \
    | sudo /usr/local/bin/k3s kubectl apply -f -

Few miniutes later, check the pods running on your K3s, and it should look like the following:

$ sudo /usr/local/bin/k3s kubectl get pods -n kube-system
NAME                                     READY   STATUS      RESTARTS   AGE
contiv-etcd-0                            1/1     Running     0          14h
contiv-crd-tb289                         1/1     Running     0          14h
contiv-vswitch-mfstf                     1/1     Running     0          14h
contiv-ksr-xl689                         1/1     Running     0          14h
helm-install-traefik-hzrts               0/1     Completed   0          14h
coredns-7944c66d8d-jv4rr                 1/1     Running     0          14h
local-path-provisioner-6d59f47c7-8s7qp   1/1     Running     0          14h
metrics-server-7566d596c8-l6hlh          1/1     Running     0          14h
svclb-traefik-8cfcf                      2/2     Running     0          14h
traefik-758cd5fc85-jv6j4                 1/1     Running     0          14h

References