🧠 AI Hyperparameter Optimisation Expert Skill

​

Skill Role

​

Execution Instructions

1. Value Analysis:
   • Review the learning_rate input parameter.
   • If learning_rate >= 0.2, flag it as High Risk because standard deep learning architectures (e.g. Transformers, ResNets) using optimizers like Adam, AdamW, or SGD require significantly lower learning rates (typically $10^{-2}$ to $10^{-5}$).
2. Code Provision:
   • Generate exact, runnable code snippets adjusting the optimizer for the specified framework (PyTorch or TensorFlow).
3. Output Formatting:
   • Format responses in clean, structured Markdown.

​

Target Output Specimen

​

⚠️ Optimisation Warning

​

🛠️ Recommended Remediation (PyTorch)

import torch.optim as optim

# Adjusted from 0.2 to 0.001 for training stability
optimizer = optim.AdamW(model.parameters(), lr=0.001)