feat(test-lab): add IPFS devnet

[Alenar]

Content

This PR includes a new pure Bash IPFS devnet tool in mithril-test-lab/ipfs-devnet.

It provides a local private Kubo/IPFS swarm that can be initialized with a configurable number of nodes and managed through a single entry point:

./ipfs-devnet.sh --help
Manage a swarm of IPFS Kubo nodes

Usage: ./ipfs-devnet.sh <COMMAND> [OPTIONS]

Commands:
  init                     Download, configure, and create scripts to manage the Kubo swarm
  log                      Tail the logs from all Kubo nodes
  query                    Run an ipfs command against one configured node
  start                    Start the Kubo swarm using the generated start script
  stop                     Stop the Kubo swarm using the generated stop script
  help                     Print this help

Run './ipfs-devnet.sh <COMMAND> --help' for command-specific options.

Environment variables:
  SWARM_DIR                Directory that contains the swarm nodes

The tool supports:

• downloading a Kubo binary for the current platform;
• initializing a configurable number of Kubo nodes;
• configuring a private IPFS swarm with a shared swarm key;
• disabling external discovery/bootstrap mechanisms to keep the network private;
• starting and stopping all configured nodes;
• tailing node logs;
• querying a selected node with the downloaded ipfs binary;
• configuring options through CLI arguments and environment variables;
• generating self-contained helper scripts in the swarm directory;

The supported platforms are aligned with the end-to-end/devnet tooling compatibility:

• Linux amd64 and arm64;
• macOS amd64 and arm64 (checked on my own arm64 macbook air);
• Windows is not supported.

Pre-submit checklist

• Branch
  • Crates versions are updated (if relevant)
  • Commit sequence broadly makes sense
  • Key commits have useful messages
• PR
  • All check jobs of the CI have succeeded
  • Self-reviewed the diff
  • Useful pull request description
  • Reviewer requested
• Documentation
  • Update README file (if relevant)
  • No new TODOs introduced

Comments

One thing, optional, is missing: a download-webui command (tentative name) that would fetch the webui car file from the ipfs network using the public, and slow, gateway (https://ipfs.io/ipfs/<CID>?format=car&dag-scope=all) store it in a download dir and load it in one of the network node.
Edit: added in the feat(ipfs-devnet): add load-webui command to download and load Kubo Web UI commit.

Issue(s)

Closes #3434

[github-actions]

Test Results

     5 files  ± 0     209 suites  ±0   59m 36s ⏱️ - 1h 17m 9s
 3 333 tests  - 41   3 333 ✅  - 41  0 💤 ±0  0 ❌ ±0 
11 097 runs   - 47  11 097 ✅  - 47  0 💤 ±0  0 ❌ ±0 

Results for commit 4f37c55. ± Comparison against base commit 5470a67.

This pull request removes 41 tests.

mithril-stm ‑ circuits::halo2_ivc::tests::encoding::negative::slow::circuit_rejects_wrong_current_epoch_byte_range
mithril-stm ‑ circuits::halo2_ivc::tests::encoding::negative::slow::circuit_rejects_wrong_next_merkle_tree_commitment_byte_range
mithril-stm ‑ circuits::halo2_ivc::tests::encoding::negative::slow::circuit_rejects_wrong_next_protocol_parameters_byte_range
mithril-stm ‑ circuits::halo2_ivc::tests::golden::golden_verification_key_test::slow::golden_recursive_modification_test
mithril-stm ‑ circuits::halo2_ivc::tests::golden::positive::slow::genesis_base_case_circuit_is_accepted
mithril-stm ‑ circuits::halo2_ivc::tests::golden::positive::slow::replay_integrity_matches_stored_next_step_output
mithril-stm ‑ circuits::halo2_ivc::tests::in_circuit::accumulator::slow::circuit_rejects_with_wrong_next_accumulator_in_same_epoch_step
mithril-stm ‑ circuits::halo2_ivc::tests::in_circuit::genesis_gating::slow::genesis_step_accepts_garbage_certificate_proof_bytes
mithril-stm ‑ circuits::halo2_ivc::tests::in_circuit::genesis_gating::slow::genesis_step_accepts_garbage_ivc_proof_bytes
mithril-stm ‑ circuits::halo2_ivc::tests::in_circuit::public_inputs::slow::circuit_rejects_wrong_certificate_circuit_verification_key_representation_global_field
…

♻️ This comment has been updated with latest results.

[Copilot]

Pull request overview

This PR adds a new Bash-based ipfs-devnet tool under mithril-test-lab/ to create and manage a local private Kubo/IPFS swarm for development and testing (matching the need from issue #3434).

Changes:

• Added an ipfs-devnet.sh entrypoint plus command scripts to initialize, start/stop, log, and query a multi-node private Kubo swarm.
• Added helpers to download a platform-appropriate Kubo binary and generate self-contained management scripts into the swarm directory.
• Updated Cardano devnet mkfiles scripts to use an absolute SCRIPT_DIRECTORY and read VERSION reliably.

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
mithril-test-lab/ipfs-devnet/VERSION	Introduces versioning for the new IPFS devnet tool.
mithril-test-lab/ipfs-devnet/README.md	Documents installation, commands, and usage examples for the IPFS devnet.
mithril-test-lab/ipfs-devnet/ipfs-devnet.sh	Adds the top-level CLI entrypoint and command dispatch.
mithril-test-lab/ipfs-devnet/commands/ipfs-devnet-init.sh	Implements init to download Kubo, configure nodes, and generate helper scripts.
mithril-test-lab/ipfs-devnet/commands/ipfs-devnet-exec.sh	Implements log/query/start/stop execution by delegating to generated scripts in the swarm dir.
mithril-test-lab/ipfs-devnet/commands/lib/common.sh	Adds shared Bash helpers (validation, quoting, directory creation).
mithril-test-lab/ipfs-devnet/commands/mkfiles/kubo-download.sh	Adds Kubo download + checksum verification + extraction.
mithril-test-lab/ipfs-devnet/commands/mkfiles/kubo-configure-swarm.sh	Adds Kubo node initialization and private swarm configuration/peering.
mithril-test-lab/ipfs-devnet/commands/mkfiles/mkscripts-lifecycle.sh	Generates start.sh and stop.sh into the swarm directory.
mithril-test-lab/ipfs-devnet/commands/mkfiles/mkscripts-query.sh	Generates log.sh and query.sh into the swarm directory.
mithril-test-lab/cardano-devnet/mkfiles/mkfiles-init.sh	Fixes devnet version reading to use ${SCRIPT_DIRECTORY}/VERSION.
mithril-test-lab/cardano-devnet/devnet-mkfiles.sh	Switches to an absolute SCRIPT_DIRECTORY and updates sourced paths accordingly.

Suppressed comments (1)

mithril-test-lab/ipfs-devnet/README.md:394

• The troubleshooting command block includes a stray shell prefix; users copying it will likely get a "command not found" error. The command should be killall ipfs without shell.

```shell
shell killall ipfs

</details>

[jpraynaud]

LGTM 👍

Maybe you can add a .gitignore for the example swarm folder.

[turmelclem]

LGTM 👍