id | title | custom_edit_url |
---|---|---|
network |
Network |
For more detailed info, see the AptosNet Specification.
AptosNet is the primary protocol for communication between any two nodes in the Aptos ecosystem. It is specifically designed to facilitate the consensus, shared mempool, and state sync protocols. AptosNet tries to maintain at-most one connection with each remote peer; the application protocols to that remote peer are then multiplexed over the single peer connection.
Currently, it provides application protocols with two primary interfaces:
- DirectSend: for fire-and-forget style message delivery.
- RPC: for unary Remote Procedure Calls.
The network component uses:
- TCP for reliable transport.
- [NoiseIK] for authentication and full end-to-end encryption.
- On-chain
NetworkAddress
set for discovery, with optional seed peers in theNetworkConfig
as a fallback.
Validators will only allow connections from other validators. Their identity and
public key information is provided by the validator-set-discovery
protocol,
which updates the eligible member information on each consensus reconfiguration.
Each member of the validator network maintains a full membership view and connects
directly to all other validators in order to maintain a full-mesh network.
In contrast, Validator Full Node (VFNs) servers will only prioritize connections from more trusted peers in the on-chain discovery set; they will still service any public clients. Public Full Nodes (PFNs) connecting to VFNs will always authenticate the VFN server using the available discovery information.
Validator health information, determined using periodic liveness probes, is not
shared between validators; instead, each validator directly monitors its peers
for liveness using the HealthChecker
protocol.
This approach should scale up to a few hundred validators before requiring partial membership views, sophisticated failure detectors, or network overlays.
+-----------+---------+------------+--------+
Application Modules | Consensus | Mempool | State Sync | Health |
+-----------+---------+------------+--------+
^ ^ ^ ^
Network Interface | | | |
v v v v
+----------------+--------------------------+ +---------------------+
Network Module | PeerManager |<->| ConnectivityManager |
+----------------------+--------------------+ +---------------------+
| Peer(s) | |
+----------------------+ |
| AptosTransport |
+-------------------------------------------+
The network component is implemented in the Actor model — it uses message-passing to communicate between different subcomponents running as independent "tasks." The tokio framework is used as the task runtime. The primary subcomponents in the network module are:
-
Network Interface
— The interface provided to application modules using AptosNet. -
PeerManager
— Listens for incoming connections, and dials outbound connections to other peers. Demultiplexes and forwards inbound messages fromPeer
s to appropriate application handlers. Additionally, notifies upstream components of new or closed connections. Optionally can be connected toConnectivityManager
for a network with Discovery. -
Peer
— Manages a single connection to another peer. It reads and writesNetworkMessage
es from/to the wire. Currently, it implements the two protocols: DirectSend and Rpc.
AptosTransport
— A secure, reliable transport. It uses [NoiseIK] over TCP to negotiate an encrypted and authenticated connection between peers. The AptosNet version and any Aptos-specific application protocols are negotiated afterward using the [AptosNet Handshake Protocol].
-
ConnectivityManager
— Establishes connections to known peers found via Discovery. NotifiesPeerManager
to make outbound dials, or disconnects based on updates to known peers via Discovery updates. -
validator-set-discovery
— Discovers the set of peers to connect to via on-chain configuration. These are thevalidator_network_addresses
andfullnode_network_addresses
of eachValidatorConfig
in theValidatorSet
set. Notifies theConnectivityManager
of updates to the known peer set. -
HealthChecker
— Performs periodic liveness probes to ensure the health of a peer/connection. It resets the connection with the peer if a configurable number of probes fail in succession. Probes currently fail on a configurable static timeout.
../types/src
├── network-address # Network addresses and encryption
network
├── builder # Builds a network from a NetworkConfig
├── memsocket # In-memory socket interface for tests
├── netcore
│ └── src
│ ├── transport # Composable transport API
│ └── framing # Read/write length prefixes to sockets
├── discovery # Protocols for peer discovery
└── src
├── application
├── peer_manager # Manage peer connections and messages to/from peers
├── peer # Handles a single peer connection's state
├── connectivity_manager # Monitor connections and ensure connectivity
├── protocols
│ ├── network # Application layer interface to network module
│ ├── direct_send # Protocol for fire-and-forget style message delivery
│ ├── health_checker # Protocol for health probing
│ ├── rpc # Protocol for remote procedure calls
│ └── wire # Protocol for AptosNet handshakes and messaging
├── transport # The base transport layer for dialing/listening
└── noise # Noise handshaking and wire integration