Protocol and Reference Implementation
Mercure is a protocol allowing to push data updates to web browsers and other HTTP clients in a convenient, fast, reliable and battery-efficient way. It is especially useful to publish real-time updates of resources served through web APIs, to reactive web and mobile apps.
The protocol has been published as an Internet Draft that is maintained in this repository.
A reference, production-grade, implementation of a Mercure hub (the server) is also available here. It's a free software (AGPL) written in Go. It is provided along with a library that can be used in any Go application to implement the Mercure protocol directly (without a hub) and an official Docker image.
In addition, a managed and high-scalability version of Mercure is available in private beta.
- native browser support, no lib nor SDK required (built on top of server-sent events)
- compatible with all existing servers, even those who don't support persistent connections (serverless architecture, PHP, FastCGI...)
- built-in connection re-establishment and state reconciliation
- JWT-based authorization mechanism (securely dispatch an update to some selected subscribers)
- performant, leverages HTTP/2 multiplexing
- designed with hypermedia in mind, also supports GraphQL
- auto-discoverable through web linking
- message encryption support
- can work with old browsers (IE7+) using an
EventSourcepolyfill - connection-less push in controlled environments (e.g. browsers on mobile handsets tied to specific carriers)
The reference hub implementation:
- Fast, written in Go
- Works everywhere: static binaries and Docker images available
- Automatic HTTP/2 and HTTPS (using Let's Encrypt) support
- Cloud Native, follows the Twelve-Factor App methodoloy
- Open source (AGPL)
Example implementation of a client (the subscriber), in JavaScript:
// The subscriber subscribes to updates for the https://example.com/foo topic
// and to any topic matching https://example.com/books/{name}
const url = new URL('https://hub.example.com/subscribe');
url.searchParams.append('topic', 'https://example.com/books/{id}');
url.searchParams.append('topic', 'https://example.com/users/dunglas');
const eventSource = new EventSource(url);
// The callback will be called every time an update is published
eventSource.onmessage = e => console.log(e); // do something with the payloadOptionaly, the hub URL can be automatically discovered:
fetch('https://example.com/books/1') // Has this header `Link: <https://hub.example.com/subscribe>; rel="mercure"`
.then(response => {
// Extract the hub URL from the Link header
const hubUrl = response.headers.get('Link').match(/<(.*)>.*rel="mercure".*/)[1];
// Subscribe to updates using the first snippet, do something with response's body...
});To dispatch an update, the application server (the publisher) just need to send a POST HTTP request to the hub.
Example using Node.js / Serverless:
// Handle a POST, PUT, PATCH or DELETE request or finish an async job...
// and notify the hub
const https = require('https');
const querystring = require('querystring');
const postData = querystring.stringify({
'topic': 'https://example.com/books/1',
'data': JSON.stringify({ foo: 'updated value' }),
});
const req = https.request({
hostname: 'hub.example.com',
port: '443',
path: '/publish',
method: 'POST',
headers: {
Authorization: 'Bearer <valid-jwt-token>', // the JWT key must be shared between the hub and the server
'Content-Type': 'application/x-www-form-urlencoded',
'Content-Length': Buffer.byteLength(postData),
}
}, /* optional response handler */);
req.write(postData);
req.end();
// You'll probably prefer use the request library or the node-fetch polyfill in real projects,
// but any HTTP client, written in any language, will be just fine.Examples in other languages are available in the example/ directory.
- a Progressive Web App retrieves the availability status of a product from a REST API and displays it: only one is still available
- 3 minutes later, the last product is bought by another customer
- the PWA's view instantly show that this product isn't available anymore
- a Progressive Web App tells the server to compute a report, this task is costly and will some time to finish
- the server delegates the computation of the report on an asynchronous worker (using message queue), and close the connection with the PWA
- the worker sends the report to the PWA when it is computed
- a webapp allows several users to edit the same document concurently
- changes made are immediately broadcasted to all connected users
Mercure gets you covered!
The full protocol specification can be found in spec/mercure.md.
It is also available as an IETF's Internet Draft,
and is designed to be published as a RFC.
A managed, high-scalability version of Mercure is available in private beta. Drop us a mail for details and pricing.
Grab a binary from the release page and run:
PUBLISHER_JWT_KEY=myPublisherKey SUBSCRIBER_JWT_KEY=mySubcriberKey ADDR=:3000 DEMO=1 ALLOW_ANONYMOUS=1 ./mercure
The server is now available on http://localhost:3000, with the demo mode enabled. Because ALLOW_ANONYMOUS is set to 1, anonymous subscribers are allowed.
To run it in production mode, and generate automatically a Let's Encrypt TLS certificate, just run the following command as root:
PUBLISHER_JWT_KEY=myPublisherKey SUBSCRIBER_JWT_KEY=mySubcriberKey ACME_HOSTS=example.com ./mercure
The value of the ACME_HOSTS environment variable must be updated to match your domain name(s).
A Let's Enctypt TLS certificate will be automatically generated.
If you omit this variable, the server will be exposed on an (unsecure) HTTP connection.
When the server is up and running, the following endpoints are available:
POST https://example.com/publish: to publish updatesGET https://example.com/subscribe: to subscribe to updates
See the protocol for further informations.
To compile the development version and register the demo page, see CONTRIBUTING.md.
A Docker image is available on Docker Hub. The following command is enough to get a working server in demo mode:
docker run \
-e PUBLISHER_JWT_KEY=myPublisherKey -e SUBSCRIBER_JWT_KEY=mySubcriberKey -e DEMO=1 -e ALLOW_ANONYMOUS=1 \
-p 80:80 \
dunglas/mercure
The server, in demo mode, is available on http://localhost:80. Anonymous subscribers are allowed.
In production, run:
docker run \
-e PUBLISHER_JWT_KEY=myPublisherKey -e SUBSCRIBER_JWT_KEY=mySubcriberKey -e ACME_HOSTS=example.com \
-p 80:80 -p 443:443 \
dunglas/mercure
Be sure to update the value of ACME_HOSTS to match your domain name(s), a Let's Encrypt TLS certificate will be automatically generated.
ACME_CERT_DIR: the directory where to store Let's Encrypt certificatesACME_HOSTS: a comma separated list of hosts for which Let's Encrypt certificates must be issuesADDR: the address to listen on (example:127.0.0.1:3000, default to:80or:httpor:httpsdepending if HTTPS is enabled or not)ALLOW_ANONYMOUS: set to1to allow subscribers with no valid JWT to connectDB_PATH: the path of the bbolt database (default toupdates.dbin the current directory)CERT_FILE: a cert file (to use a custom certificate)CERT_KEY: a cert key (to use a custom certificate)CORS_ALLOWED_ORIGINS: a comma separated list of hosts allowed CORS originsDEBUG: set to1to enable the debug mode (prints recovery stack traces)DEMO: set to1to enable the demo mode (automatically enabled whenDEBUG=1)LOG_FORMAT: the log format, can beJSON,FLUENTDorTEXT(default)PUBLISHER_JWT_KEY: must contain the secret key to valid publishers' JWTSUBSCRIBER_JWT_KEY: must contain the secret key to valid subscribers' JWT
If ACME_HOSTS or both CERT_FILE and CERT_KEY are provided, an HTTPS server supporting HTTP/2 connection will be started.
If not, an HTTP server will be started (not secure).
Because they are delivery agnostic, Mercure plays particulary well with GraphQL's subscriptions.
In response to the subscription query, the GraphQL server may return a corresponding topic URL.
The client can then subscribe to the Mercure's event stream corresponding to this subscription by creating a new EventSource with an URL like https://hub.example.com?topic=https://example.com/subscriptions/<subscription-id> as parameter.
Updates for the given subscription can then be sent from the GraphQL server to the clients through the Mercure hub (in the data property of the server-sent event).
To unsubscribe, the client just calls EventSource.close().
Mercure can easily be integrated with Apollo GraphQL by creating a dedicated transport.
WebSocket is a low level and bidirectional protocol. Mercure is a high level and unidirectional protocol (servers-to-clients, but we will come back to that later). Unlike Mercure (which is built on top of Server-Sent Events), WebSocket is not designed to leverage HTTP/2.
Also, Mercure provides convenient built-in features (authorization, re-connection, state reconciliation...) while with WebSocket, you need to implement them yourself.
HTTP/2 connections are multiplexed and bidirectional by default (it was not the case of HTTP/1).
Even if Mercure is unidirectional, when using it over a h2 connection (recommended), your app can receive data through Server-Sent Events, and send data to the server with regular POST (or PUT/PATCH/DELETE) requests, with no overhead.
Basically, in most cases Mercure can be used as a modern, easier to use replacement for WebSocket, but it is a higher level protocol.
WebSub is a server-to-server protocol while Mercure is mainly a server-to-client protocol (that can also be used for server-to-server communication, but it's not is main interest).
Mercure has been heavily inspired by WebSub, and we tried to make the protocol as close as possible from the WebSub one.
Mercure uses Server-Sent Events to dispatch the updates, while WebSub use POST requests. Also, Mercure has an advanced authorization mechanism, and allows to subscribe to several topics with only one connection using templated URIs.
The Push API is mainly designed to send notifications to devices currently not connected to the application. In most implementations, the size of the payload to dispatch is very limited, and the messages are sent through the proprietary APIs and servers of the browsers' and operating systems' vendors.
On the other hand, Mercure is designed to send live updates to devices currently connected to the web or mobile app. The payload is not limited, and the message goes directly from your servers to the clients.
In summary, use the Push API to send notifications to offline users (that will be available in Chrome, Android and iOS's notification centers), and use Mercure to receive live updates when the user is using the app.
- JavaScript library to parse
Linkheaders - JavaScript library to decrypt JWE using the WebCrypto API
EventSourcepolyfill for old browsersEventSourceimplementation for Node- Server-Sent Events client for Go
See CONTRIBUTING.md.
Created by Kévin Dunglas. Sponsored by Les-Tilleuls.coop.