fedmsg Deployment

fedmsg has proper packages in the Debian archive. Let's actually get it deployed on Debian Infrastructure.

Packages

Working around firewall issues

By default, fedmsg binds one (or several) PUB/SUB 0mq sockets on the senders. This adds a listening service to the message sender, which is often undesirable.

fedmsg also provides a relay component, which sits on the bus (binds a PUB/SUB socket), and listens to incoming messages on a 0mq socket. Ephemeral commands can then send their messages on that socket instead of having to listen to a port. However, the relay protocol isn't standard and isn't really firewall friendly (not on a common port).

The proposition is to write a web app that would allow services to push messages through a HTTP POST.

Letting new services push messages

The web app would also serve as a service registration system. Any DD could register a service, and either have it send messages through HTTP POST, or have a central fedmsg gateway go listen to the messages at the source.

fedmsg.d.n deployment

                                              +----------------------+-----------------------------------+
                                              |fedmsg.debian.net     |                                   |
                                              +----------------------+                                   |
     +---------------+------+                 |                                                          |
     |mentors.d.n    |      |                 |                                                          |
     +---------------+      |                 |                                                          |
     |                      |                 |                                                          |
     |       Cron runner    +-port 3000-------+----------------------------------+                       |
     |       WSGI 1-4       +-port 3001-------+---------------------------------+|                       |
     |                      +-port 3002-------+--------------------------------+||                       |
     |                      +-port 3003-------+-------------------------------+|||                       |
     |                      +-port 3004-------+------------------------------+||||                       |
     +----------------------+                 |                              |||||                       |
                                              |                              |||||     +-----------------+                   -----------
                                              |                              ||||+---->|                 |                --/           \--
                                              |                              |||+----->|                 |              -/                 \-
                                              |                              ||+------>|  fedmsg-gateway |             /    rest of the      \
                                              |                              |+------->|                 +-port 9940-> |       world         |
                                              |                              +-------->|                 |             \                     /
                                              |                                        |                 |              -\                 /-
                                              |                                      +>|                 |                --\           /--
                                              |                                      | +-----------------+                   -----------
                                              +---------------+--------------+       |                   |
       +------------------------+             |               |              |       |                   |
       |                        |             | d-d-changes   |              |       |                   |
       | mailing lists subscr.  +------------>| d-bpo-changes | debmessenger +-3000--+                   |
       |                        |             | d-bugs-dist   |              |                           |
       +------------------------+             | ...           |              |                           |
                                              |               |              |                           |
                                              +---------------+--------------+                           |
                                              |                                                          |
                                              |                                                          |
                                              |                                                          |
                                              +----------------------------------------------------------+