0g-storage-node

mirror of https://github.com/0glabs/0g-storage-node.git synced 2024-11-10 10:05:17 +00:00

Author	SHA1	Message	Date
Bo QIU	6685757a03	notify file announcement to sync layer only if shard config matches (#174 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * notify file announcement to sync layer only if shard config matches * use FromStr trait	2024-08-29 18:35:35 +08:00
Bo QIU	2fd9712d59	Enhance P2P network protocol to support batch messages for performance concern (#173 ) * Add p2p protocol version in network identity * Cache annouce file pubsub messages to publish in batch * fix file location cache * opt sync metrics * opt file location cache default configs * publish files announcements in batch * enhance announce file pubsub msg metrics * opt metrics * fix ci * fix clippy * fix batcher * minor fix * opt batcher: publish all if expired	2024-08-29 09:55:24 +08:00
Bo QIU	f14a1b5975	add timestamp in p2p rpc request id for latency stat (#167 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * add timestamp in p2p rpc request id for latency stat * fix test compilation error	2024-08-22 14:34:10 +08:00
Bo QIU	82fef674ed	Add more metrics for file sync (#164 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * add metrics in log sync package * udpate auto sync metrics * Add metrics for completed file sync * add more metrics for serial file sync * adjust default timeout value for auto sync * fix metrics rpc for Timer type * add metrics for channel * refactor channel metrics * add timeout metrics for segment sync * refactor channel receiver	2024-08-22 10:42:15 +08:00
Bo QIU	c1f465e009	Do not verify announced ip address by default (#163 ) Some checks failed abi-consistent-check / build-and-compare (push) Has been cancelled Details code-coverage / unittest-cov (push) Has been cancelled Details rust / check (push) Has been cancelled Details rust / test (push) Has been cancelled Details rust / lints (push) Has been cancelled Details functional-test / test (push) Has been cancelled Details	2024-08-20 14:39:58 +08:00
Bo QIU	f9120b1e4a	Add metrics for router and auto sync (#161 ) * Add metrics configurations * Add metrics in router package * Add catch up info in sync service state * Add metrics for auto sync * update cargo lock	2024-08-19 09:54:52 +08:00
Bo QIU	22ed8f5f91	opt router debug logs (#160 ) Some checks failed abi-consistent-check / build-and-compare (push) Has been cancelled Details code-coverage / unittest-cov (push) Has been cancelled Details rust / check (push) Has been cancelled Details rust / test (push) Has been cancelled Details rust / lints (push) Has been cancelled Details functional-test / test (push) Has been cancelled Details	2024-08-16 10:34:28 +08:00
peilun-conflux	12d0c6b675	Check network id in status and ban incompatible peers. (#159 ) Some checks failed abi-consistent-check / build-and-compare (push) Has been cancelled Details code-coverage / unittest-cov (push) Has been cancelled Details rust / check (push) Has been cancelled Details rust / test (push) Has been cancelled Details rust / lints (push) Has been cancelled Details functional-test / test (push) Has been cancelled Details * Check network id in status and ban incompatible peers. * Revert debug changes. * Request chain id from the blockchain server.	2024-08-14 11:35:48 +08:00
Bo QIU	a5f95e2e7b	Verify announced IP with seen ip for pubsub msg (#130 ) * Verify announced IP with seen ip for pubsub msg * do not verify announced ip at local mode	2024-07-17 19:01:41 +08:00
peilun-conflux	ba8d065e73	Generate sync proof with the given tx seq. (#123 ) * Generate sync proof with the given tx seq. * Fill HistoryTree with new data. * Fix clippy.	2024-07-12 15:55:57 +08:00
Bo QIU	821e4bd06e	Use public ip address to broadcast file announcement (#115 ) * Use public ip address to broadcast file announcement * auto detect public ip address for ENR address * add more log	2024-07-09 17:39:14 +08:00
Bo QIU	68b5d27728	Filter out file announcement of private ip (#113 ) * Filter out file announcement of private ip * add log for listen address	2024-07-08 18:45:55 +08:00
Bo QIU	e44db25807	opt log level for file announcement relevant logs (#109 )	2024-07-04 16:30:05 +08:00
Bo QIU	5bc5bbd696	Enhance log level (#103 ) * reduce default find peers timeout for auto sync * opt log level to avoid too many noisy info logs	2024-07-02 11:52:52 +08:00
peilun-conflux	4eb2a50b0e	Use inner lock in storage and use async lock. (#92 ) * Use inner lock in storage. * Remove mut. * Remove async lock for storage. * Fix tests and warnings. * Use spawn_blocking for storage task. * Fix clippy. * Finalize the new tx at last. * Revert "Finalize the new tx at last." This reverts commit `b56ad5582d`. * Wait for old same-root txs to finalize. * Use async storage in miner. * Update rust version to 1.79.0. * Use Vec to avoid stack overflow. * Fix unused warning. * Fix clippy. * Fix test warning. * Fix test. * fmt. * Use async storage in pruner. * nit.	2024-06-29 17:08:02 +08:00
peilun-conflux	0f52325f67	Sync and finalize sharded data. (#79 ) * Save test logs. * Prepare to handle shard config in chunk pool. * Allow files to be finalized with only sharded data. * Handle shard config change. * Only sync needed data in shard config. * Fix clippy and tests.	2024-06-08 02:50:36 +08:00
peilun-conflux	c2c6e2d5fb	Store shard config for peers and choose sync peers accordingly. (#77 ) * Implement Pruner. * Put pruner in a crate. * Fix clippy. * Add rpc zgs_getShardConfig. * Fix. * Increase wait time. * Add pruner_test and use max_num_chunks instead of size_limit. * Store shard config for peers and choose sync peers accordingly. * Add test and fix sync. * Fix clippy and test. * Fix some ut. * Add AnnounceShardConfig gossip and fix tests. * Add sharded tx finalize check in LogManager. * Try, * Rename. * Longer timeout for mine_test. * Save test logs.	2024-06-07 16:58:15 +08:00
MiniFrenchBread	8b410f2fc8	Chore: expose RPC modules, update dependency (#35 ) * feat: expose rpc clients * chore: expose rpc types * chore: update dependency	2024-04-02 21:00:26 +08:00
Bo QIU	a4abe2b2a4	fix build dependency isuse (#12 ) * fix build dependency isuse * cargo fmt * fix lint failure in CI * update toolchain	2024-01-26 19:48:40 +08:00
MiniFrenchBread	7479f56474	feat: write cached segments to storage on log synced (#7 )	2024-01-23 18:47:14 +08:00
Bo QIU	9b4b0436c3	Supports to sync partial chunks (#4 ) * refactor p2p signed message * add new pubsub messages in network layer to find chunks * handle find chunks pubsub message in router * Supports to sync partial chunks * add admin rpc to sync chunks * limit number of chunks to sync at a time * refactor code to sync file and chunks * add more switches to trigger file sync * fix ut failure * refactor code	2024-01-19 14:04:59 +08:00
Peilun Li	9058467be1	Initial commit	2024-01-04 18:05:32 +08:00

22 Commits