Skip to main content
Robot datasets first. Cyberwave currently focuses on robot manipulation and navigation datasets (LeRobot, RLDS, and similar time-series formats). Zip upload supports LeRobot only; HuggingFace Hub import detects any dataset repository, but only robotics datasets are correctly displayed today. Full support for non-robotics formats — playback, conversion, and training — is coming in a future release.

​
Overview

Cyberwave supports importing datasets from two sources:
  • HuggingFace Hub — Import directly by repository ID (lazy, no multi-GB copy)
  • Zip Upload — Upload a pre-packaged dataset archive (max 10 GB)
Format detection happens automatically on the server side and sets the source_format field on the dataset record.

​
Supported formats

The two import sources have different levels of format support today.

​
Zip upload — LeRobot only

Zip upload currently supports LeRobot v2.1 and v3 only. Other dataset formats are not yet supported via zip upload.

​
HuggingFace Hub — broader import, robotics-only display

HuggingFace Hub import works for any dataset repository — Cyberwave queries the repo and detects its format automatically regardless of what kind of dataset it is. However, only robotics datasets are correctly displayed and usable in Cyberwave today.
Playback, conversion, and ML training are fully wired up only for LeRobot today. Other robotics formats imported from HuggingFace are recorded correctly (source_format, sample counts) but full episode playback is still being built out.

​
Import from HuggingFace Hub

  1. Navigate to your workspace and click Import Dataset
  2. Select HuggingFace Hub as the source
  3. Enter the repository ID (e.g. lerobot/pusht)
  4. Click Import
HuggingFace imports are lazy by default: Cyberwave queries the HF API for tags, card data, and the file list, and for LeRobot datasets reads only the small meta/*.json files. The dataset card appears immediately with episode counts, FPS, robot type, and cameras — without copying the multi-GB payload. Frames are fetched on demand when a training run or visualisation needs them. The metadata.import.materialized flag stays false until a follow-up materialisation step runs. Any repository can be imported this way — Cyberwave will detect and catalogue whatever format it finds — but only robotics datasets are correctly displayed and usable today (see Supported formats).
For private HuggingFace repositories, ensure your organisation has configured the HuggingFace token in the deployment settings.

​
Upload a zip file

  1. Navigate to your workspace and click Import Dataset
  2. Select Upload Zip as the source
  3. Select your zip file (max 10 GB)
  4. Click Upload
The system automatically detects the format after the upload completes. Zip upload only supports LeRobot (v2.1/v3) today (see Supported formats); other formats should be imported from HuggingFace Hub instead.

​
Monitor progress

After starting an import you can track it via:
  • The dataset list view (status indicator)
  • The dataset detail page (metadata.upload_progress)

​
API reference

POST /datasets/import/init

Initialise a dataset import. Returns a signed URL for zip uploads, or immediately starts an HF import.

POST /datasets/import/complete

Complete a zip upload import after the file has been uploaded to the signed URL.
See the API Reference for full details.