ceremonyclient/docker/README.md

166 lines
5.0 KiB
Markdown
Raw Normal View History

Squashed commit of the following: commit 8e57cb3c50417665495617721687da33f7ae2a33 Author: Cassandra Heart <cassandra@quilibrium.com> Date: Mon May 27 00:06:39 2024 -0500 remove binaries, release ready commit a032474e5f420707ae1b61f2cb1bcf87a7de113c Author: Cassandra Heart <cassandra@quilibrium.com> Date: Mon May 27 00:04:25 2024 -0500 Signatory #8 added commit 86ab72ea75a366045052daa2a5c71f4f1e2de717 Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 23:55:02 2024 -0500 Signatory #1 added commit 9853bbff1c18bb941b4563acf3afbbc72846e57a Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 23:52:43 2024 -0500 Signatory #16 added commit d1eb0bd2b2e0aab92cbe1c9ca8c43dc19d93eb22 Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 23:24:51 2024 -0500 Signatory #2 added commit 270591416ba2817c879471ea27bc93769bb22819 Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 22:33:53 2024 -0500 Signatory #3 added commit ea767f9eaa5de1e7e00e3e87ff2760a23377205b Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 22:10:50 2024 -0500 Signatory #12 added commit e73a0a005a01b8045859673781f3e2d6360f13f8 Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 22:09:07 2024 -0500 Signatory #17 added commit 07be249c52682c66c91a07df6eeb0eadf41603b5 Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 22:04:40 2024 -0500 Signatory #14 added commit dbc014b8127e6452e31609b130ea68759a3c1f4a Author: 0xOzgur <29779769+0xOzgur@users.noreply.github.com> Date: Mon May 27 05:55:21 2024 +0300 Signatory #4 added (#223) commit 13407f6ff3347bd57fbacabda42d60d0285a927f Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 21:34:26 2024 -0500 Signatory #13 added commit 3731de7b66bd403c92bb7d66db25890567652e9d Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 21:33:50 2024 -0500 add digests commit b0a3493dd2f6162d7e02e9cb10aa482fb3ff6e9b Author: Cassandra Heart <cassandra@quilibrium.com> Date: Sun May 26 21:26:54 2024 -0500 replace binaries with patch build commit 6a20b44441cba01189050ccf45b53c99f9a218ab Author: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Date: Sun May 26 21:15:07 2024 -0500 fix: switch RPC for peer and node info (#222) commit 72d730d23f91ce9a2bdd55617fb70f7a1193645e Author: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Date: Sun May 26 20:53:38 2024 -0500 feat: recalibrate self-test on the fly (#221) commit 99702af0b7afd3b556bb20e9bebc238b3e52b53a Author: Marius Scurtescu <marius.scurtescu@gmail.com> Date: Sun May 26 19:31:39 2024 -0400 Signer related fixes (#220) * add pems 16 and 17 * remove .bin extension from generated binaries * no more json files to copy to docker image commit 88d704ab16dd3a18985a7179f88fb39908110532 Author: Marius Scurtescu <marius.scurtescu@gmail.com> Date: Sun May 26 19:07:52 2024 -0400 Docker split take 2 (#219) * split runtime docker files into a docker subfolder * split DOCKER-README.md * updated docker instructions * add restore command * add image update related tasks * add command to test if P2P port is visible * Remove bootstrap peer (#189) * Change bootstrap servers to DHT-only peers (#187) * support voucher file-based claims (#183) * Change bootstrap servers to DHT-only peers Changing my bootstrap servers to DHT-only peers with somewhat lower specs. One of the new ones is in the US and the other one is in Switzerland. Both use reliable providers and have 10Gbps network interfaces. --------- Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> * Don't run self-test in DHT-only mode (#186) * support voucher file-based claims (#183) * Don't run self-test in DHT-only mode The node tries to create a self-test when ran with the `-dht-only` flag, but it doesn't load the KZG ceremony data in DHT-only mode which leads to a crash. Don't run self-test when the `-dht-only` flag is set. I tested by starting a node locally with and without existing self-test and with the `-dht-only` flag. --------- Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> * Embed json files in binary (#182) * Embed ceremony.json in binary * Embed retroactive_peers.json in binary * Signers build and verification tasks (#181) * add signers specific Taskfile * add verify tasks * move signer task under signer folder * create docker image specific for signers * map current user into docker image and container * ignore node-tmp-* * add verify:build:internal * prevent tasks with docker commands from being run inside a container * rename *:internal to *:container * add README.md * add pem files to git * Updating Q Guide link (#173) * Update README.md Updated link to Quilibrium guide to new website * Update README.md --------- Co-authored-by: littleblackcloud <163544315+littleblackcloud@users.noreply.github.com> Co-authored-by: Agost Biro <5764438+agostbiro@users.noreply.github.com> Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Co-authored-by: Demipoet <161999657+demipoet@users.noreply.github.com> commit 20560176dcb8ace8ff4fe5a3bb0a8a188c11add2 Author: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Date: Sun May 26 17:17:36 2024 -0500 Revert "Change volume mapping so .config folder is created inside node folder…" (#218) This reverts commit 27f50a92c6f5e340fd4106da828c6e8cdc12116b. commit b9ea4c158e4657c09976fa6b2e625b3809119687 Author: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Date: Sun May 26 14:46:40 2024 -0500 fix: keys file remains null (#217) commit 6ed6728bfdb6825470cb772ee44a6a468887e3eb Author: luk <luk@luktech.dev> Date: Sun May 26 22:38:50 2024 +0300 switched get node info response to use masterClock frame for maxFrame field (#212) commit 2bc8ab6a0a243a28300f999af695fe3b42db5e3e Author: Ravish Ahmad <ravishahmad16@gmail.com> Date: Mon May 27 01:07:53 2024 +0530 Update main.go to fix Q logo (#213) Q logo is not appearing correctly on the terminal while running node. Added a new line character after "Signature check passed" to fix it commit 27f50a92c6f5e340fd4106da828c6e8cdc12116b Author: AvAcalho <158583728+AvAcalho@users.noreply.github.com> Date: Sun May 26 20:37:14 2024 +0100 Change volume mapping so .config folder is created inside node folder and not on root (#214) commit 4656dedc2a2de608b9d69d0a6b4559b7169b03be Author: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Date: Sun May 26 14:27:55 2024 -0500 experiment: verify in channel (#215) commit 2bbd1e0690d10e17aa2142e66ab1b7ff40d47ad9 Author: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> Date: Sat May 25 00:22:50 2024 -0500 v1.4.18 (#193) * Remove bootstrap peer (#189) * Change bootstrap servers to DHT-only peers (#187) * support voucher file-based claims (#183) * Change bootstrap servers to DHT-only peers Changing my bootstrap servers to DHT-only peers with somewhat lower specs. One of the new ones is in the US and the other one is in Switzerland. Both use reliable providers and have 10Gbps network interfaces. --------- Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> * Don't run self-test in DHT-only mode (#186) * support voucher file-based claims (#183) * Don't run self-test in DHT-only mode The node tries to create a self-test when ran with the `-dht-only` flag, but it doesn't load the KZG ceremony data in DHT-only mode which leads to a crash. Don't run self-test when the `-dht-only` flag is set. I tested by starting a node locally with and without existing self-test and with the `-dht-only` flag. --------- Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com> * Embed json files in binary (#182) * Embed ceremony.json in binary * Embed retroactive_peers.json in binary * Signers build and verification tasks (#181) * add signers specific Taskfile * add verify tasks * move signer task under signer folder * create docker image specific for signers * map current user into docker image and container * ignore node-tmp-* * add verify:build:internal * prevent tasks with docker commands from being run inside a container * rename *:internal to *:container * add README.md * add pem files to git * Updating Q Guide link (#173) * Update README.md Updated link to Quilibrium guide to new website * Update README.md * feat: network switching and namespaced announce strings/bitmasks (#190) * feat: network switching and namespaced announce strings/bitmasks * bump version name and logo * feat: mini pomw proofs as part of peer manifest (#191) * shift default config directory under current folder (#176) * feat: signature check (#192) * feat: signature check * adjust docker command so it doesn't invoke sigcheck * remove old version * add binaries and digests * fix bug, revert build * shasum has weird byte at end * proper binaries and digests * Signatory #13 added * Signatory #3 added * Signer 4 (#194) * Signatory #5 added * Signatory #9 added (#195) * Signatory #1 added * added sig.6 files (#196) * Signatories #8 and #16 added * Signatory #12 added * Add signature (#197) * reset build for v1.4.18 after testnet bug * updated build, resigned by #13 * Signatory #16 added * added sig.6 files (#198) * Signatory #8 added * Signatory #17 added * Signatory #1 added * Signatory #7 added * Signatory #4 added * Signatory #14 added * remove binaries, ready to ship --------- Co-authored-by: littleblackcloud <163544315+littleblackcloud@users.noreply.github.com> Co-authored-by: Agost Biro <5764438+agostbiro@users.noreply.github.com> Co-authored-by: Marius Scurtescu <marius.scurtescu@gmail.com> Co-authored-by: Demipoet <161999657+demipoet@users.noreply.github.com> Co-authored-by: 0xOzgur <29779769+0xOzgur@users.noreply.github.com> Co-authored-by: Freekers <1370857+Freekers@users.noreply.github.com>
2024-05-27 06:09:13 +00:00
# Quilibrium Docker Instructions
## Install Docker on a Server
> [!IMPORTANT]
> You have to install Docker Engine on your server, you don't want to install Docker Desktop.
The official Linux installation instructions start here:
https://docs.docker.com/engine/install/
For Ubuntu you can start here:
https://docs.docker.com/engine/install/ubuntu/
While there are several installation methods, you really want to use the apt repository, this way you get
automatic updates.
Make sure you also follow the Linux post-installation steps:
https://docs.docker.com/engine/install/linux-postinstall/
## Install Docker on a Desktop
For a Linux desktop follow the server installation steps above, do not install Docker Desktop for Linux unless
you know what you are doing.
For Mac and Windows follow the corresponding Docker Desktop installation links from the top of:
https://docs.docker.com/engine/install/
## Running a Node
Copy [docker-compose.yml](docker-compose.yml) to a new folder on a server. The official
Docker image provided by Quilibrium Network will be pulled.
A `.config/` subfolder will be created in this folder, this will hold both configuration
and the node storage.
Optionally you can also copy [Taskfile.yaml](Taskfile.yaml) and [.env.example](.env.example) to the
server, if you are planning to use them. See below.
### New Instance
If you are starting a brand new node then simply run Quilibrium in a container with:
```shell
docker compose up -d
```
A `.config/` subfolder will be created under the current folder, this is mapped inside the container.
> [!IMPORTANT]
> Once the node is running (the `-node-info` command shows a balance) make sure you backup
> `config.yml` and `keys.yml`.
### Restore Previous Instance
If you have both `config.yml` and `keys.yml` backed up from a previous instance then follow these
steps to restore them:
1. Create an empty `.config/` subfolder.
2. Copy `config.yml` and `keys.yml` to `.config/`.
3. Start the node with:
```shell
docker compose up -d
```
### Task
You can also use the [Task](https://taskfile.dev/) tool, it is a simple build tool that takes care of running
complex commands and intereacting with the container. The tasks are all defined in
[Taskfile.yaml](Taskfile.yaml).
You can optionally create an `.env` file, in the same folder to override specific parameters. Right now
only one optional env var is supported with `Task` and that is `QUILIBRIUM_IMAGE_NAME`, if you want to change the
default image name from `quilibrium` to something else. If you are pushing your images to GitHub, for example, then you
have to follow the GitHub naming convention and use a name like `ghcr.io/mscurtescu/ceremonyclient`. See the
[.env.example](.env.example) sample file, and keep in mind that `.env` is shared with
[docker-compose.yml](docker-compose.yml).
Bellow there are example interactions with `Task`.
Start the container through docker compose:
```shell
task up
```
Show the logs through docker compose:
```shell
task logs
```
Drop into a shell inside the running container:
```shell
task shell
```
Stop the running container(s):
```shell
task down
```
Backup the critical configuration:
```shell
task backup
```
The above command will create a `backup.tar.gz` archive in the current folder, you still have to copy this
file from the server into a safe location. The command adds the `config.yml` and `keys.yml` files from
the `.config/` subfolder to the archive, with the ownership of the current user.
## Customizing docker-compose.yml
If you want to change certain parameters in [docker-compose.yml](docker-compose.yml) it is better not
to edit the file directly as new versions pushed through git would overwrite your changes. A more
flexible solution is to create another file called `docker-compose.override.yml` right next to it
and specifying the necessary overriding changes there.
For example:
```yaml
services:
node:
image: ghcr.io/mscurtescu/ceremonyclient
restart: on-failure:7
```
The above will override the image name and also the restart policy.
You can optionally create an `.env` file, in the same folder to override specific parameters. See the
[.env.example](.env.example) sample file, and keep in mind that `.env` is shared with
[Taskfile.yaml](Taskfile.yaml). You can customize the image name and port mappings.
To check if your overrides are being picked up run the following command:
```shell
docker compose config
```
This will output the merged and canonical compose file that will be used to run the container(s).
## Interact with a running container
Drop into a shell inside a running container:
```shell
docker compose exec -it node sh
```
Watch the logs:
```shell
docker compose logs -f
```
Get the node related info (peer id, version, max frame and balance):
```shell
docker compose exec node node -node-info
```
Run the DB console:
```shell
docker compose exec node node -db-console
```
Run the Quilibrium client:
```shell
docker compose exec node qclient help
docker compose exec node qclient token help
docker compose exec node qclient token balance
```