Continuous Deployment GitOps with Kubernetes
- Spoke with Marcus (Ognots) from NetOps team
- Will be an alpha user of their Gitops process in 1 - 2 months
- They are currently writing run books to make things easy for us
- GitOps using Weave
- Our medusa deployment will be authorized based on Github team permissions
- Need to create templates / helm chart for deploying Medusa
- Writing a Kubernetes Operator will be helpful for partners to easily deploy Medusa with Kubernetes
- We can run Medusa in a namespace under a shared PL Kubernetes cluster
- We can also run Medusa in our own cluster if we need to
Jonathan participating in Launchpad
- Likely 1 - 3 hours per day for 6 weeks
- Learn in-depth technical details about IPFS, IPLD, libp2p, Filecoin from team leads
- Meet others in PLN
Decision
Not worth it considering:
- Uncertainty after 6 month contract
- Amount of work to be done for Medusa
Actually we did a U-turn after a long discussion, with the key caveats:
(1) accept that you may not finish everything in a day or for the whole launchpad, that you may not have time to read everything you wanted, that a code snipped is still not working but that you need to stop and go back to Medusa. i.e seeing this as a
very low engagement / low expectation commitment
(2) be honest with yourself and Nicolas about saying when things get out of hand, and you’ve spend more than alloted time per day.
Reencryption Refactor PR
- Genericity of Suite has to be tied to concrete triple (CURVE, ENCRYPTION, HASH)
- Enums to match packet types to state machine (Concrete message —> State machine)
- Downcast / dynamic dispatch to go from generic to concrete (State Machine —> Concrete message)
- Oracle Smart Contract designated by id —> State machine (i.e. id = "BN254_KEYG1_HGAMAL”)
Hanging Tests
Decision
- Continue debugging rendezvous test until Monday and then update Github Issue with findings
- Factory / Oracle tests do not use a rendezvous server to connect to peers
- Update ethers-rs, libp2p, tokio dependencies
Rendezvous / setup_network / libp2p
One or more nodes wait to establish connection with all other nodes
ideas:
- Registration TTL expires for a node before all other nodes connect to it
Orthogonal fixes:
- Do not attempt to connect to self
- Do not register rendezvous server address as a valid address for other nodes
Logs for critical section of peer discovery
- See node with 1 peer at top of logs
- See rdv server send 4 peers to all 4 nodes
- See node still with 1 peer at bottom of logs
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 1 peers)
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z DEBUG medusa::net::rendezvous] Served peer 12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam with 4 registrations
[2022-09-23T12:40:08Z DEBUG medusa::net::rendezvous] Served peer 12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh with 4 registrations
[2022-09-23T12:40:08Z DEBUG medusa::net::rendezvous] Served peer 12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc with 4 registrations
[2022-09-23T12:40:08Z DEBUG medusa::net::rendezvous] Served peer 12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj with 4 registrations
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc at /ip4/127.0.0.1/tcp/16799
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/16799/p2p/12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc at /ip4/127.0.0.1/tcp/16799
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/16799/p2p/12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/16799/p2p/12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh at /ip4/127.0.0.1/tcp/17258
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh at /ip4/127.0.0.1/tcp/17258
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/16799/p2p/12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/17258/p2p/12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/17258/p2p/12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam at /ip4/127.0.0.1/tcp/17691
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/17258/p2p/12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/17258/p2p/12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/17691/p2p/12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj at /ip4/127.0.0.1/tcp/22799
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam at /ip4/127.0.0.1/tcp/17691
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/17691/p2p/12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/22799/p2p/12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc at /ip4/127.0.0.1/tcp/16799
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/17691/p2p/12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj at /ip4/127.0.0.1/tcp/22799
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/22799/p2p/12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/16799/p2p/12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/17691/p2p/12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/22799/p2p/12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/16799/p2p/12D3KooWHhsw6iQ3VVTQxs8ER7EmRq223u6XQ9zkHCBojBPmXTtc
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj at /ip4/127.0.0.1/tcp/22799
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/22799/p2p/12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh at /ip4/127.0.0.1/tcp/17258
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/22799/p2p/12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/17258/p2p/12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/22799/p2p/12D3KooWJodMpuixPH1maj2mT5sUVtxUJpWiJVyVzPUXkNToXcaj
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/17258/p2p/12D3KooWLW8XtQuDdzE81GLX7M4rZ3e6TRtHXKZMdJARukYz6nkh
[2022-09-23T12:40:08Z DEBUG medusa::net::node] Discovered peer 12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam at /ip4/127.0.0.1/tcp/17691
[2022-09-23T12:40:08Z INFO medusa::net::node] DIALING PEER at address: /ip4/127.0.0.1/tcp/17691/p2p/12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam
[2022-09-23T12:40:08Z INFO medusa::net::node] skipping discovering peer already known /ip4/127.0.0.1/tcp/17691/p2p/12D3KooWSazyrJ1k2yqacpFGQPY9ip67eaJab2mkkH38XY9uiNam
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z INFO medusa::net::node] Unhandled swarm event ConnectionClosed { peer_id: PeerId("12D3KooWJwTCLmrZqjWx8t55AdsB5jq8rr1uUhA4kTT1196FCN5p"), endpoint: Dialer { address: "/ip4/127.0.0.1/tcp/15866", role_override: Dialer }, num_established: 0, cause: Some(KeepAliveTimeout) }
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 4 peers)
[2022-09-23T12:40:08Z INFO medusa::net::node] Unhandled swarm event ConnectionClosed { peer_id: PeerId("12D3KooWJwTCLmrZqjWx8t55AdsB5jq8rr1uUhA4kTT1196FCN5p"), endpoint: Dialer { address: "/ip4/127.0.0.1/tcp/15866", role_override: Dialer }, num_established: 0, cause: Some(KeepAliveTimeout) }
[2022-09-23T12:40:08Z INFO medusa::net::node] Unhandled swarm event ConnectionClosed { peer_id: PeerId("12D3KooWJwTCLmrZqjWx8t55AdsB5jq8rr1uUhA4kTT1196FCN5p"), endpoint: Dialer { address: "/ip4/127.0.0.1/tcp/15866", role_override: Dialer }, num_established: 0, cause: Some(KeepAliveTimeout) }
[2022-09-23T12:40:08Z DEBUG medusa::net::node] tick -> asking for more peers (currently 1 peers)