Go to file
Bo QIU bcbd8b3baa
Some checks are pending
abi-consistent-check / build-and-compare (push) Waiting to run
code-coverage / unittest-cov (push) Waiting to run
rust / check (push) Waiting to run
rust / test (push) Waiting to run
rust / lints (push) Waiting to run
functional-test / test (push) Waiting to run
Ban peer if failed to decode pubsub message (#259)
2024-11-05 15:10:44 +08:00
.gitbook/assets @peter/doc (#22) 2024-03-24 22:37:46 +08:00
.github Remove contract abi submodule (#139) 2024-07-22 17:32:51 +08:00
common Use LRU to cache MPT nodes. (#227) 2024-10-27 12:52:06 +08:00
docs Docs improvements (#82) 2024-07-11 14:10:57 +08:00
node Ban peer if failed to decode pubsub message (#259) 2024-11-05 15:10:44 +08:00
run Implement file sync protocol V2 (#249) 2024-10-28 14:56:08 +08:00
scripts Update with the most recent storage contract (#142) 2024-07-24 13:01:30 +08:00
storage-contracts-abis chore: update abi (#234) 2024-10-14 12:38:13 +08:00
tests Hotfix for python tests caused by unexpected file deletion (#258) 2024-11-05 13:49:58 +08:00
version-meld Refuse network identity incompatible nodes in UDP discovery layer (#253) 2024-10-30 17:26:02 +08:00
.bookignore @peter/doc (#22) 2024-03-24 22:37:46 +08:00
.gitignore Hotfix for python tests caused by unexpected file deletion (#258) 2024-11-05 13:49:58 +08:00
.gitmodules Remove contract abi submodule (#139) 2024-07-22 17:32:51 +08:00
Cargo.lock Hardcode pad data segment root. (#250) 2024-10-27 20:58:03 +08:00
Cargo.toml Use LRU to cache MPT nodes. (#227) 2024-10-27 12:52:06 +08:00
codecov.yml Initial commit 2024-01-04 18:05:32 +08:00
contributing.md @peter/doc (#22) 2024-03-24 22:37:46 +08:00
LICENSE.lighthouse Initial commit 2024-01-04 18:05:32 +08:00
NOTICE @peter/doc (#22) 2024-03-24 22:37:46 +08:00
README.md Docs improvements (#82) 2024-07-11 14:10:57 +08:00
requirements.txt add readme for python tests (#5) 2024-01-19 21:26:33 +08:00
rust-toolchain fix build dependency isuse (#12) 2024-01-26 19:48:40 +08:00
rustlint.sh fix build dependency isuse (#12) 2024-01-26 19:48:40 +08:00
SUMMARY.md @peter/doc (#22) 2024-03-24 22:37:46 +08:00

0G Storage

Overview

0G Storage is the storage layer for the ZeroGravity data availability (DA) system. The 0G Storage layer holds three important features:

  • Buit-in - It is natively built into the ZeroGravity DA system for data storage and retrieval.
  • General purpose - It is designed to support atomic transactions, mutable kv stores as well as archive log systems to enable wide range of applications with various data types.
  • Incentive - Instead of being just a decentralized database, 0G Storage introduces PoRA mining algorithm to incentivize storage network participants.

To dive deep into the technical details, continue reading 0G Storage Spec.

Integration

We provide a SDK for users to easily integrate 0G Storage in their applications with the following features:

  • File Merkle Tree Class
  • Flow Contract Types
  • RPC methods support
  • File upload
  • Support browser environment
  • Tests for different environments (In Progress)
  • File download (In Progress)

Deployment

Please refer to Deployment page for detailed steps to compile and start a 0G Storage node.

Test

Prerequisites

  • Required python version: 3.8, 3.9, 3.10, higher version is not guaranteed (e.g. failed to install pysha3).
  • Install dependencies under root folder: pip3 install -r requirements.txt

Dependencies

Python test framework will launch blockchain fullnodes at local for storage node to interact with. There are 2 kinds of fullnodes supported:

  • Conflux eSpace node (by default).
  • BSC node (geth).

For Conflux eSpace node, the test framework will automatically compile the binary at runtime, and copy the binary to tests/tmp folder. For BSC node, the test framework will automatically download the latest version binary from github to tests/tmp folder.

Alternatively, you could also manually copy specific version binaries (conflux or geth) to the tests/tmp folder. Note, do NOT copy released conflux binary on github, since block height of some CIPs are hardcoded.

For testing, it's also dependent on the following repos:

  • 0G Storage Contract: It essentially provides two abi interfaces for 0G Storage Node to interact with the on-chain contracts.
    • ZgsFlow: It contains apis to submit chunk data.
    • PoraMine: It contains apis to submit PoRA answers.
  • 0G Storage Client: It is used to interact with certain 0G Storage Nodes to upload/download files.

Run Tests

Go to the tests folder and run the following command to run all tests:

python test_all.py

or, run any single test, e.g.

python sync_test.py

Contributing

To make contributions to the project, please follow the guidelines here.