Our other_languages example is one way to use SigOpt when your metric evaluation function is in a language other than python. All you need to do is create an executable file that accepts parameters as command line arguments, and then create an experiment with the same parameter names as the executable. The executable file should accept the suggested parameters at the command line, evaluate the metric, and print out a float.
- Log in to your SigOpt account at https://app.sigopt.com
- Find your API Token on the API tokens page.
export CLIENT_TOKEN=<your client_token>- Install the SigOpt python client
pip install sigopt
python other_languages.py --command='<command to run your script>' --experiment_id=EXPERIMENT_ID --client_token=$CLIENT_TOKEN
The above command will run the following sub process to evaluate your metric, automatially requesting the suggsetion beforehand and reporting the observation afterwards:
<comamnd to run your script> --x=SUGGESTION_FOR_X
Feel free to use, or modify for your own needs!
Visit the SigOpt Community page and leave your questions.
To implement SigOpt for your use case, feel free to use or extend the code in this repository. Our API can bolt on top of any complex model or process and guide it to its optimal configuration in as few iterations as possible.
With SigOpt, data scientists and machine learning engineers can build better models with less trial and error.
Machine learning models depend on hyperparameters that trade off bias/variance and other key outcomes. SigOpt provides Bayesian hyperparameter optimization using an ensemble of the latest research.
SigOpt can tune any machine learning model, including popular techniques like gradient boosting, deep neural networks, and support vector machines. SigOpt’s REST API, Python, and R libraries integrate into any existing ML workflow.
SigOpt augments your existing model training pipeline, suggesting parameter configurations to maximize any online or offline objective, such as AUC ROC, model accuracy, or revenue. You only send SigOpt your metadata, not the underlying training data or model.
Visit our website to learn more!