passt: Add the README
Signed-off-by: Stefano Brivio <sbrivio@redhat.com>
This commit is contained in:
parent
ef25cb39a9
commit
00f3bcea05
1 changed files with 177 additions and 0 deletions
177
README.md
Normal file
177
README.md
Normal file
|
@ -0,0 +1,177 @@
|
||||||
|
# passt: Plug A Simple Socket Transport
|
||||||
|
|
||||||
|
_passt_ implements a translation layer between a Layer-2 network interface (tap)
|
||||||
|
and native Layer-4 sockets (TCP, UDP, ICMP/ICMPv6 echo) on a host. It doesn't
|
||||||
|
require any capabilities or privileges, and it can be used as a simple
|
||||||
|
replacement for Slirp.
|
||||||
|
|
||||||
|
- [General idea](#general-idea)
|
||||||
|
- [Non-functional Targets](#non-functional-targets)
|
||||||
|
- [Interfaces and Environment](#interfaces-and-environment)
|
||||||
|
- [Services](#services)
|
||||||
|
- [Addresses](#addresses)
|
||||||
|
- [Protocols](#protocols)
|
||||||
|
- [Ports](#ports)
|
||||||
|
- [Try it](#try-it)
|
||||||
|
- [Contribute](#contribute)
|
||||||
|
|
||||||
|
## General idea
|
||||||
|
|
||||||
|
When container workloads are moved to virtual machines, the network traffic is
|
||||||
|
typically forwarded by interfaces operating at data link level. Some components
|
||||||
|
in the containers ecosystem (such as _service meshes_), however, expect
|
||||||
|
applications to run locally, with visible sockets and processes, for the
|
||||||
|
purposes of socket redirection, monitoring, port mapping.
|
||||||
|
|
||||||
|
To solve this issue, user mode networking as provided e.g. by _Slirp_,
|
||||||
|
_libslirp_, _slirp4netns_ can be used. However, these existing solutions
|
||||||
|
implement a full TCP/IP stack, replaying traffic on sockets that are local to
|
||||||
|
the pod of the service mesh. This creates the illusion of application processes
|
||||||
|
running on the same host, eventually separated by user namespaces.
|
||||||
|
|
||||||
|
While being almost transparent to the service mesh infrastructure, that kind of
|
||||||
|
solution comes with a number of downsides:
|
||||||
|
|
||||||
|
* three different TCP/IP stacks (guest, adaptation and host) need to be
|
||||||
|
traversed for every service request. There are no chances to implement
|
||||||
|
zero-copy mechanisms, and the amount of context switches increases
|
||||||
|
dramatically
|
||||||
|
* addressing needs to be coordinated to create the pretense of consistent
|
||||||
|
addresses and routes between guest and host environments. This typically needs
|
||||||
|
a NAT with masquerading, or some form of packet bridging
|
||||||
|
* the traffic seen by the service mesh and observable externally is a distant
|
||||||
|
replica of the packets forwarded to and from the guest environment:
|
||||||
|
* TCP congestion windows and network buffering mechanisms in general operate
|
||||||
|
differently from what would be naturally expected by the application
|
||||||
|
* protocols carrying addressing information might pose additional challenges,
|
||||||
|
as the applications don't see the same set of addresses and routes as they
|
||||||
|
would if deployed with regular containers
|
||||||
|
|
||||||
|
_passt_ implements a thinner layer between guest and host, that only implements
|
||||||
|
what's strictly needed to pretend processes are running locally. A further, full
|
||||||
|
TCP/IP stack is not necessarily needed. Some sort of TCP adaptation is needed,
|
||||||
|
however, as this layer runs without the `CAP\_NET\_RAW` capability: we can't
|
||||||
|
create raw IP sockets on the pod, and therefore need to map packets at Layer-2
|
||||||
|
to Layer-4 sockets offered by the host kernel.
|
||||||
|
|
||||||
|
The problem and this approach are illustrated in more detail, with diagrams,
|
||||||
|
[here](https://gitlab.com/abologna/kubevirt-and-kvm/-/blob/master/Networking.md).
|
||||||
|
|
||||||
|
## Non-functional Targets
|
||||||
|
|
||||||
|
Security and maintainability goals:
|
||||||
|
|
||||||
|
* no dynamic memory allocation
|
||||||
|
* ~2 000 LoC target
|
||||||
|
* no external dependencies
|
||||||
|
|
||||||
|
## Interfaces and Environment
|
||||||
|
|
||||||
|
_passt_ exchanges packets with _qemu_ via UNIX domain socket, using the `socket`
|
||||||
|
back-end in qemu. Currently, qemu can only connect to a listening process via
|
||||||
|
TCP. Two temporary solutions are available:
|
||||||
|
|
||||||
|
* a [patch](https://passt.top/passt/tree/qemu) for qemu
|
||||||
|
* a wrapper, [qrap](https://passt.top/passt/tree/qrap.c), that connects to a
|
||||||
|
UNIX domain socket and starts qemu, which can now use the file descriptor
|
||||||
|
that's already opened
|
||||||
|
|
||||||
|
This approach, compared to using a _tap_ device, doesn't require any security
|
||||||
|
capabilities, as we don't need to create any interface.
|
||||||
|
|
||||||
|
## Services
|
||||||
|
|
||||||
|
_passt_ provides some minimalistic implementations of networking services that
|
||||||
|
can't practically run on the host:
|
||||||
|
|
||||||
|
* [ARP proxy](https://passt.top/passt/tree/arp.c), that resolve the address of
|
||||||
|
the host (which is used as gateway) to the original MAC address of the host
|
||||||
|
* [DHCP server](https://passt.top/passt/tree/dhcp.c), a simple implementation
|
||||||
|
handing out one single IPv4 address to the guest, namely, the same address as
|
||||||
|
the first one configured for the upstream host interface, and passing the
|
||||||
|
nameservers configured on the host
|
||||||
|
* [NDP proxy](https://passt.top/passt/tree/ndp.c), which can also assign prefix
|
||||||
|
and nameserver using SLAAC
|
||||||
|
* _to be done_: DHCPv6 server: right now, the guest gets the same _prefix_ as
|
||||||
|
the host, but not the same address, because the suffix is generated from the
|
||||||
|
MAC address of the virtual machine, so we currently have to translate packet
|
||||||
|
addresses back and forth. With a DHCPv6 server, we could simply assign the
|
||||||
|
host address to the guest
|
||||||
|
|
||||||
|
## Addresses
|
||||||
|
|
||||||
|
For IPv4, the guest is assigned, via DHCP, the same address as the upstream
|
||||||
|
interface of the host, and the same default gateway as the default gateway of
|
||||||
|
the host. Addresses are never translated.
|
||||||
|
|
||||||
|
For IPv6, the guest is assigned, via SLAAC, the same prefix as the upstream
|
||||||
|
interface of the host, and the same default route as the default route of the
|
||||||
|
host. This means that the guest will typically have a different address, and
|
||||||
|
the destination address is translated for packets going to the guest. This will
|
||||||
|
be avoided in the future once a minimalistic DHCPv6 server is implemented in
|
||||||
|
_passt_.
|
||||||
|
|
||||||
|
## Protocols
|
||||||
|
|
||||||
|
_passt_ supports TCP, UDP and ICMP/ICMPv6 echo (requests and replies). More
|
||||||
|
details about the TCP implementation are available
|
||||||
|
[here](https://passt.top/passt/tree/tcp.c), and for the UDP
|
||||||
|
implementation [here](https://passt.top/passt/tree/udp.c).
|
||||||
|
|
||||||
|
An IGMP proxy is currently work in progress.
|
||||||
|
|
||||||
|
## Ports
|
||||||
|
|
||||||
|
To avoid the need for explicit port mapping configuration, _passt_ binds to all
|
||||||
|
unbound non-ephemeral (0-49152) TCP ports and all unbound (0-65536) UDP ports.
|
||||||
|
Binding to low ports (0-1023) will fail without additional capabilities, and
|
||||||
|
ports already bound (service proxies, etc.) will also not be used.
|
||||||
|
|
||||||
|
Service proxies and other services running in the container need to be started
|
||||||
|
before _passt_ starts.
|
||||||
|
|
||||||
|
## Try it
|
||||||
|
|
||||||
|
* build from source:
|
||||||
|
|
||||||
|
git clone https://passt.top/passt
|
||||||
|
cd passt
|
||||||
|
make
|
||||||
|
|
||||||
|
* a static build for x86_64 as of the latest commit is also available for
|
||||||
|
convenience [here](https://passt.top/builds/static/). These binaries are
|
||||||
|
simply built with:
|
||||||
|
|
||||||
|
CFLAGS="-static" make
|
||||||
|
|
||||||
|
* run the demo script, that creates a network namespace called `passt`, sets up
|
||||||
|
sets up a _veth_ pair and and addresses, together with NAT for IPv4 and NDP
|
||||||
|
proxying for IPv6, then starts _passt_ in the network namespace:
|
||||||
|
|
||||||
|
doc/demo.sh
|
||||||
|
|
||||||
|
* from the same network namespace, start qemu. At the moment, qemu doesn't
|
||||||
|
support UNIX domain sockets for the `socket` back-end. Two alternatives:
|
||||||
|
|
||||||
|
* use the _qrap_ wrapper, which maps a tap socket descriptor to _passt_'s
|
||||||
|
UNIX domain socket, for example:
|
||||||
|
|
||||||
|
ip netns exec passt ./qrap 5 qemu-system-x86_64 ... -net socket,fd=5 -net nic,model=virtio ...
|
||||||
|
|
||||||
|
* or patch qemu with [this patch](https://passt.top/passt/tree/qemu/0001-net-Allow-also-UNIX-domain-sockets-to-be-used-as-net.patch)
|
||||||
|
and start it like this:
|
||||||
|
|
||||||
|
qemu-system-x86_64 ... -net socket,connect=/tmp/passt.socket -net nic,model=virtio
|
||||||
|
|
||||||
|
* and that's it, you should now have TCP connections, UDP, and ICMP/ICMPv6
|
||||||
|
echo working from/to the guest for IPv4 and IPv6
|
||||||
|
|
||||||
|
* to connect to a service on the VM, just connect to the same port directly
|
||||||
|
with the address of the network namespace. For example, to ssh to the guest,
|
||||||
|
from the main namespace on the host:
|
||||||
|
|
||||||
|
ssh 192.0.2.2
|
||||||
|
|
||||||
|
## Contribute
|
||||||
|
|
||||||
|
Send patches and issue reports to [sbrivio@redhat.com](mailto:sbrivio@redhat.com).
|
Loading…
Reference in a new issue