A scalable overlay networking tool with a focus on performance, simplicity and security
Find a file
Wade Simmons ee7c27093c
add HostMap.RemoteIndexes (#329)
This change adds an index based on HostInfo.remoteIndexId. This allows
us to use HostMap.QueryReverseIndex without having to loop over all
entries in the map (this can be a bottleneck under high traffic
lighthouses).

Without this patch, a high traffic lighthouse server receiving recv_error
packets and lots of handshakes, cpu pprof trace can look like this:

      flat  flat%   sum%        cum   cum%
    2000ms 32.26% 32.26%     3040ms 49.03%  github.com/slackhq/nebula.(*HostMap).QueryReverseIndex
     870ms 14.03% 46.29%     1060ms 17.10%  runtime.mapiternext

Which shows 50% of total cpu time is being spent in QueryReverseIndex.
2020-11-23 14:51:16 -05:00
.github/workflows Use Go 1.15 (#277) 2020-08-12 16:16:21 -04:00
cert fix panic in UnmarshalNebulaCertificate (#339) 2020-11-19 08:44:54 -05:00
cmd More like a library (#279) 2020-09-18 09:20:09 -05:00
dist Start nebula after the network is up (#270) 2020-08-07 11:33:48 -05:00
examples Added line to systemd config template to start Nebula before sshd (#317) 2020-10-29 21:43:02 -04:00
sshd enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
util More like a library (#279) 2020-09-18 09:20:09 -05:00
.gitignore Support for 1.0.0 release 2019-11-19 10:31:59 -08:00
allow_list.go Add lighthouse.{remoteAllowList,localAllowList} (#217) 2020-04-08 15:36:43 -04:00
allow_list_test.go Add lighthouse.{remoteAllowList,localAllowList} (#217) 2020-04-08 15:36:43 -04:00
AUTHORS Public Release 2019-11-19 17:00:20 +00:00
bits.go Public Release 2019-11-19 17:00:20 +00:00
bits_test.go Be more like a library to support mobile (#247) 2020-06-30 13:48:58 -05:00
cert.go Use inclusive terminology for cert blocking (#272) 2020-08-06 11:17:47 +10:00
CHANGELOG.md Bring in the new version of kardianos/service and output logfiles on osx (#303) 2020-09-24 15:34:08 -07:00
cidr_radix.go Add a way to find the most specific network 2019-12-09 16:28:58 -08:00
cidr_radix_test.go Add a way to find the most specific network 2019-12-09 16:28:58 -08:00
config.go Add disable_timestamp option (#288) 2020-09-09 07:42:11 -04:00
config_test.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
connection_manager.go add HostMap.RemoteIndexes (#329) 2020-11-23 14:51:16 -05:00
connection_manager_test.go Move slice allocations in connection manager monitor loop (#340) 2020-11-19 15:44:05 -08:00
connection_state.go Public Release 2019-11-19 17:00:20 +00:00
control.go More like a library (#279) 2020-09-18 09:20:09 -05:00
control_test.go More like a library (#279) 2020-09-18 09:20:09 -05:00
dns_server.go Allow configuration of dns listener host/port (#74) 2019-12-11 17:42:55 -08:00
dns_server_test.go Public Release 2019-11-19 17:00:20 +00:00
firewall.go More like a library (#279) 2020-09-18 09:20:09 -05:00
firewall_test.go Preserve conntrack table during firewall rules reload (SIGHUP) (#233) 2020-07-31 18:53:36 -04:00
go.mod Bring in the new version of kardianos/service and output logfiles on osx (#303) 2020-09-24 15:34:08 -07:00
go.sum Bring in the new version of kardianos/service and output logfiles on osx (#303) 2020-09-24 15:34:08 -07:00
handshake.go add HostMap.RemoteIndexes (#329) 2020-11-23 14:51:16 -05:00
handshake_ix.go add HostMap.RemoteIndexes (#329) 2020-11-23 14:51:16 -05:00
handshake_manager.go add HostMap.RemoteIndexes (#329) 2020-11-23 14:51:16 -05:00
handshake_manager_test.go trigger handshakes when lighthouse reply arrives (#246) 2020-07-22 10:35:10 -04:00
header.go Public Release 2019-11-19 17:00:20 +00:00
header_test.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
hostmap.go add HostMap.RemoteIndexes (#329) 2020-11-23 14:51:16 -05:00
hostmap_test.go allow go test -bench=. to run (#234) 2020-05-27 16:52:34 -04:00
inside.go Fix a data race on message counter (#284) 2020-09-21 21:41:46 -04:00
interface.go More like a library (#279) 2020-09-18 09:20:09 -05:00
LICENSE Public Release 2019-11-19 17:00:20 +00:00
lighthouse.go Lighthouse handler optimizations (#320) 2020-11-23 14:50:01 -05:00
lighthouse_test.go Lighthouse handler optimizations (#320) 2020-11-23 14:50:01 -05:00
logger.go More like a library (#279) 2020-09-18 09:20:09 -05:00
logger_test.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
main.go More like a library (#279) 2020-09-18 09:20:09 -05:00
main_test.go Public Release 2019-11-19 17:00:20 +00:00
Makefile mips-softfloat (#231) 2020-06-26 13:46:23 -04:00
message_metrics.go add meta packet statistics (#230) 2020-06-26 13:45:48 -04:00
metadata.go Public Release 2019-11-19 17:00:20 +00:00
nebula.pb.go Public Release 2019-11-19 17:00:20 +00:00
nebula.proto Public Release 2019-11-19 17:00:20 +00:00
noise.go Correct typos in noise.go (#205) 2020-03-30 11:23:55 -07:00
outside.go add HostMap.RemoteIndexes (#329) 2020-11-23 14:51:16 -05:00
outside_test.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
punchy.go add configurable punching delay because of race-condition-y conntracks (#210) 2020-03-27 11:26:39 -07:00
punchy_test.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
README.md Update README for supported platforms (#312) 2020-10-12 13:11:32 -05:00
ssh.go Handle panic when invalid IP entered in sshd (#296) 2020-09-18 10:10:25 -04:00
stats.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
timeout.go Public Release 2019-11-19 17:00:20 +00:00
timeout_system.go Public Release 2019-11-19 17:00:20 +00:00
timeout_system_test.go Public Release 2019-11-19 17:00:20 +00:00
timeout_test.go enforce the use of goimports (#248) 2020-06-30 18:53:30 -04:00
tun_android.go Make Interface.Inside an interface type (#252) 2020-07-28 08:53:16 -04:00
tun_common.go unsafe_routes mtu (#209) 2020-04-06 11:33:30 -07:00
tun_darwin.go Make Interface.Inside an interface type (#252) 2020-07-28 08:53:16 -04:00
tun_disabled.go Support startup without a tun device (#269) 2020-08-10 09:15:55 -04:00
tun_freebsd.go Make Interface.Inside an interface type (#252) 2020-07-28 08:53:16 -04:00
tun_ios.go Make Interface.Inside an interface type (#252) 2020-07-28 08:53:16 -04:00
tun_linux.go Make Interface.Inside an interface type (#252) 2020-07-28 08:53:16 -04:00
tun_linux_test.go linux: set advmss correctly when route MTU is used (#245) 2020-06-26 13:47:21 -04:00
tun_test.go unsafe_routes mtu (#209) 2020-04-06 11:33:30 -07:00
tun_windows.go Make Interface.Inside an interface type (#252) 2020-07-28 08:53:16 -04:00
udp_android.go More like a library (#279) 2020-09-18 09:20:09 -05:00
udp_darwin.go Be more like a library to support mobile (#247) 2020-06-30 13:48:58 -05:00
udp_freebsd.go More like a library (#279) 2020-09-18 09:20:09 -05:00
udp_generic.go Lighthouse handler optimizations (#320) 2020-11-23 14:50:01 -05:00
udp_linux.go Lighthouse handler optimizations (#320) 2020-11-23 14:50:01 -05:00
udp_linux_32.go Be more like a library to support mobile (#247) 2020-06-30 13:48:58 -05:00
udp_linux_64.go Be more like a library to support mobile (#247) 2020-06-30 13:48:58 -05:00
udp_windows.go More like a library (#279) 2020-09-18 09:20:09 -05:00

What is Nebula?

Nebula is a scalable overlay networking tool with a focus on performance, simplicity and security. It lets you seamlessly connect computers anywhere in the world. Nebula is portable, and runs on Linux, OSX, Windows, iOS, and Android. It can be used to connect a small number of computers, but is also able to connect tens of thousands of computers.

Nebula incorporates a number of existing concepts like encryption, security groups, certificates, and tunneling, and each of those individual pieces existed before Nebula in various forms. What makes Nebula different to existing offerings is that it brings all of these ideas together, resulting in a sum that is greater than its individual parts.

You can read more about Nebula here.

You can also join the NebulaOSS Slack group here

Supported Platforms

Desktop and Server

Check the releases page for downloads

  • Linux - 64 and 32 bit, arm, and others
  • Windows
  • MacOS
  • Freebsd

Mobile

Technical Overview

Nebula is a mutually authenticated peer-to-peer software defined network based on the Noise Protocol Framework. Nebula uses certificates to assert a node's IP address, name, and membership within user-defined groups. Nebula's user-defined groups allow for provider agnostic traffic filtering between nodes. Discovery nodes allow individual peers to find each other and optionally use UDP hole punching to establish connections from behind most firewalls or NATs. Users can move data between nodes in any number of cloud service providers, datacenters, and endpoints, without needing to maintain a particular addressing scheme.

Nebula uses elliptic curve Diffie-Hellman key exchange, and AES-256-GCM in its default configuration.

Nebula was created to provide a mechanism for groups hosts to communicate securely, even across the internet, while enabling expressive firewall definitions similar in style to cloud security groups.

Getting started (quickly)

To set up a Nebula network, you'll need:

1. The Nebula binaries for your specific platform. Specifically you'll need nebula-cert and the specific nebula binary for each platform you use.

2. (Optional, but you really should..) At least one discovery node with a routable IP address, which we call a lighthouse.

Nebula lighthouses allow nodes to find each other, anywhere in the world. A lighthouse is the only node in a Nebula network whose IP should not change. Running a lighthouse requires very few compute resources, and you can easily use the least expensive option from a cloud hosting provider. If you're not sure which provider to use, a number of us have used $5/mo DigitalOcean droplets as lighthouses.

Once you have launched an instance, ensure that Nebula udp traffic (default port udp/4242) can reach it over the internet.

3. A Nebula certificate authority, which will be the root of trust for a particular Nebula network.

./nebula-cert ca -name "Myorganization, Inc"

This will create files named ca.key and ca.cert in the current directory. The ca.key file is the most sensitive file you'll create, because it is the key used to sign the certificates for individual nebula nodes/hosts. Please store this file somewhere safe, preferably with strong encryption.

4. Nebula host keys and certificates generated from that certificate authority

This assumes you have four nodes, named lighthouse1, laptop, server1, host3. You can name the nodes any way you'd like, including FQDN. You'll also need to choose IP addresses and the associated subnet. In this example, we are creating a nebula network that will use 192.168.100.x/24 as its network range. This example also demonstrates nebula groups, which can later be used to define traffic rules in a nebula network.

./nebula-cert sign -name "lighthouse1" -ip "192.168.100.1/24"
./nebula-cert sign -name "laptop" -ip "192.168.100.2/24" -groups "laptop,home,ssh"
./nebula-cert sign -name "server1" -ip "192.168.100.9/24" -groups "servers"
./nebula-cert sign -name "host3" -ip "192.168.100.10/24"

5. Configuration files for each host

Download a copy of the nebula example configuration.

  • On the lighthouse node, you'll need to ensure am_lighthouse: true is set.

  • On the individual hosts, ensure the lighthouse is defined properly in the static_host_map section, and is added to the lighthouse hosts section.

6. Copy nebula credentials, configuration, and binaries to each host

For each host, copy the nebula binary to the host, along with config.yaml from step 5, and the files ca.crt, {host}.crt, and {host}.key from step 4.

DO NOT COPY ca.key TO INDIVIDUAL NODES.

7. Run nebula on each host

./nebula -config /path/to/config.yaml

Building Nebula from source

Download go and clone this repo. Change to the nebula directory.

To build nebula for all platforms: make all

To build nebula for a specific platform (ex, Windows): make bin-windows

See the Makefile for more details on build targets

Credits

Nebula was created at Slack Technologies, Inc by Nate Brown and Ryan Huber, with contributions from Oliver Fross, Alan Lam, Wade Simmons, and Lining Wang.