Surrogate-based Hyperparameter Tuning System

Hydro is a system that automatically applies the hyperparameter transfer theory together with multiple system techniques to jointly improve the tuning efficiency.

🚀 Efficient Tuning. Hydro scales down the model size and fuses multiple trials can significantly improve training throughput and hardware efficiency.

✨ Automatic Pipeline. Hydro streamlines the surrogate model generation process and seamlessly integrates with Ray, offering a user-friendly solution for tuning.

🎉 Quality Maintenance. Hydro typically can well maintain the tuned model quality even using a scaled and fused model for tuning.

Getting Started

• Tutorial: Walkthrough of a Hydro Tuning Example

• More Examples:

  • vision: Image Classification Example
  • language: Language Modeling Example

Need More Support?

If you have any question or suggestion on improving Hydro, please let us know.