Skip to content

Commit

Permalink
Some more FOSSASIA ideas
Browse files Browse the repository at this point in the history
  • Loading branch information
mdda committed Mar 9, 2018
1 parent 71fb00a commit 937a5bc
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion ideas.md
Original file line number Diff line number Diff line change
Expand Up @@ -796,11 +796,15 @@ Early on, maybe keep the shitty random values, but change the connections.
## FOSSASIA Ideas
- Meta-Learning
+ Reptile (OpenAI)
- Has nice webpage/blog-post
- Has nice webpage/blog-post : https://blog.openai.com/reptile/
- Minimal effort required to get going - includes known-good model
- But : This builds a network that is as-retrainable-as-possible,
rather than solving a single problem as well as possible.
ie : less 'delightfull' than a single good result.
+ ENAS is also a tempting idea
- Overall number of back-prop steps would be similar
- But need to have structure updates
- Possible to do in PyTorch or TensorFlow eager...

- Word-Embeddings
+ Translation via alignment of word embeddings in 2+ languages
Expand All @@ -811,3 +815,5 @@ Early on, maybe keep the shitty random values, but change the connections.
- Evolutionary-style improvement (combo-deal for teaching)


- Speech Generation

0 comments on commit 937a5bc

Please sign in to comment.