First commit for the tuning playbook

cleeway · Jan 18, 2023 · 50fb92a · 50fb92a
commit 50fb92a
Show file tree

Hide file tree

Showing 15 changed files with 2,535 additions and 0 deletions.
diff --git a/CITATION.bib b/CITATION.bib
@@ -0,0 +1,7 @@
+@misc{tuningplaybookgithub,
+  author = {Varun Godbole and George E. Dahl and Justin Gilmer and Christopher J. Shallue and Zachary Nado},
+  title = {Deep Learning Tuning Playbook},
+  url = {http://github.com/google/tuning_playbook},
+  year = {2023},
+  note = "Version 1"
+}
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
@@ -0,0 +1,45 @@
+# How to Contribute
+
+-   This is not an officially supported Google product.
+
+-   We'd love to hear your feedback!
+
+    -   If you like the playbook, please leave a star! Or email
+        deep-learning-tuning-playbook \[at\] googlegroups.com. Testimonials help
+        us justify creating more resources like this.
+    -   If anything seems incorrect, please file an issue to start a discussion.
+        For questions or other messages where an issue isn't appropriate, please
+        open a new discussion topic on GitHub.
+
+-   As discussed in the preamble, this is a living document. We anticipate
+    making periodic improvements, both small and large. If you’d like to be
+    notified, please watch our repository (see instructions).
+
+-   Please don't file a pull request without first coordinating with the authors
+    via the issue tracking system.
+
+
+## Contributor License Agreement
+
+Contributions to this project must be accompanied by a Contributor License
+Agreement (CLA). You (or your employer) retain the copyright to your
+contribution; this simply gives us permission to use and redistribute your
+contributions as part of the project. Head over to
+<https://cla.developers.google.com/> to see your current agreements on file or
+to sign a new one.
+
+You generally only need to submit a CLA once, so if you've already submitted one
+(even if it was for a different project), you probably don't need to do it
+again.
+
+## Code Reviews
+
+All submissions, including submissions by project members, require review. We
+use GitHub pull requests for this purpose. Consult
+[GitHub Help](https://help.github.com/articles/about-pull-requests/) for more
+information on using pull requests.
+
+## Community Guidelines
+
+This project follows
+[Google's Open Source Community Guidelines](https://opensource.google/conduct/).
diff --git a/LICENSE b/LICENSE
diff --git a/README.md b/README.md
diff --git a/assets/axis_model_with_instability.png b/assets/axis_model_with_instability.png
diff --git a/assets/bad_search_space.png b/assets/bad_search_space.png
diff --git a/assets/beneficial_effect_warmup.png b/assets/beneficial_effect_warmup.png
diff --git a/assets/good_search_space.png b/assets/good_search_space.png
diff --git a/assets/gradient_clipping.png b/assets/gradient_clipping.png
diff --git a/assets/have_we_sampled_enough.png b/assets/have_we_sampled_enough.png
diff --git a/assets/instability_during_warmup.png b/assets/instability_during_warmup.png
diff --git a/assets/isolation_plot.png b/assets/isolation_plot.png
diff --git a/assets/loss_model_with_instability.png b/assets/loss_model_with_instability.png
diff --git a/assets/more_frequent_evals.png b/assets/more_frequent_evals.png
diff --git a/assets/stride_instability.png b/assets/stride_instability.png