In order for us to fully prepare to run the SnapDeals trusted setup in January with external participants we need to:
List of items:
1. Determine ways how we can easily get large files to participants:
Notice here: We need to avoid
worker-gpu-4 because those machines would run out of disk space if it stored every participant’s files
Goal: create a great UX for people running the trusted setup with us
- They would have a single place that they need to land, get the files —> Download them
——>process them on their machines ——> upload the results back in an easy way.
- Notes for this - don’t have the ability
- We have a note
- Rsync machine for our internal run is ok.
- S3 bucket can be used for external people, once we start the run for the external team. The challenge here is not to make any information that is public.
@jake we should be fine since we will have the GPG key.
We are hoping to test commands and run things with 1 participant since we want to test the process in a real-life scenario.
We need to ability to add SSH keys to the current machine + setup the Rsync box for an external run in January.
@Marcus Stong we can look for the things we used before and make them available for usage again.
2. Publicity communicate trusted setup towards the community and get participants to join in
- We plan to have 10-12 teams running the params between @January 11, 2022 until @January 28, 2022
Goal: We have an open and easy communication process that will enable all participants to know when is their turn, what they need to do, and how
3. Determine and organize a way for large files to get into China, since we need to have at least 4,5 participants running the params there
——> Process them on their machines ——> Upload the results back in an easy way.
- @jake Proposed solution:
We take the following steps:
- We created an S3 bucket in the Hong Kong aws region ap-east-1, then uploaded files into that bucket
- The first participant in mainland China setup an Alicloud server (located in Singapore) where they were able to download files from the S3 bucket
- The first Chinese participant transferred their downloaded files from their Alicloud server to their own servers in Shenzhen
- The first Chinese participant uploaded their files to a JDCloud
188.8.131.52rsync machine in region cn-south-1 owned by us
rsync’ed the Chinese participants files from the JDCloud rsync machine to one of our trusted-setup verification machines
- I verified the Chinese participant’s files
- The next Chinese participant downloaded the previous participant’s files from our JDCloud rsync machine
Notes from the call:
@Marcus Stong - we should get a hold of the scripts we used before.
@jake - we can edit read and write permissions between participants
We can use it to spin it up and test if it still works.
- Large files need to get into China before - 4 circuits will need 20GB file that each participant to use. 80GB in total, since we are kinda doing 4 trusted setups at the same time.
- @Marcus Stong - that will take time, since the "great wall" is hard to cross.
We can start that on January 1st. - @Marcus Stong can volunteer for this line of work.
- We should also have the copy on JDcloud
@Marcus Stong :