Pre-training
Pre-training from your own corpus
Build on existing language-model weights or start from random initialization. New run offers Continued pretraining and Pretraining from scratch, with a managed recipe when supported and a custom-code path for your own trainer.
Corpus and training controls
- Use text passages from uploaded, saved, Hugging Face or HTTPS datasets, with configurable text columns and file selection.
- Continued pretraining uses a pinned model revision. Training from scratch selects random initialization, full model weights and no quantization.
- Set precision, sequence length, batch size, gradient accumulation, learning rate, epochs or step count, seed and held-out fraction. Review data and the exact configuration before launch.
- Choose minimum GPU memory, an optional GPU model, vCPUs, disk, allowed regions, saved secret references and a container image. Preset resource estimates adjust with the model and method while keeping your explicit edits.
Bring your own training stack
Submit a container command, a verified GitHub revision, or an uploaded script or project. Public repositories and team-connected private repositories are supported. Prepared code and dataset selections can produce an editable command suggestion. Review it or enter your own command, then save the setup for reuse.
Custom code supports your own framework, streaming data and distributed launcher. Request the exact GPU count offered by the deployment on one machine. Your program must implement distributed execution. The managed recipe remains a single-GPU workflow. Vision, diffusion, audio, multimodal, embedding, classification and forecasting selections also use customer-supplied code.
Observe and resume
Follow execution events, logs and the measurements your trainer reports. For
custom training, write complete recovery files to NODUS_CHECKPOINT_DIR, which
defaults to state, and load them when restarting. Whole-folder saving is an
explicit opt-in. Native managed-recipe recovery includes trainer state.
Download final weights and other declared results separately from recovery files.