HN Gopher Feed (2017-08-18) - page 1 of 10
Python code to generate text using a pretrained character-based RNN
27 points by jjwisemanhttps://github.com/minimaxir/textgenrnn
popcorncolonel - 1 hours ago
Very simple interface, but even the cherry-picked examples in the
readme are quite poor in terms of meaning/grammatical correctness.
It is even using pretty state-of-the-art techniques such as LSTMs
and word embeddings, but the results just aren't there.Can someone
point me to some of the best examples of coherent and long (as in
many words/sentences) automatic text generation? Or an explanation
as to why we're so far from being able to tackle this problem?
Because I haven't seen anything noteworthy in text generation to
write home about.
minimaxir - 58 minutes ago
Repo author here:Unfortunately, a lot of the examples people give
for text generation in general are cherrypicked, which leads to a
selection bias toward the robustness of text generation (see my
previous rant: https://news.ycombinator.com/item?id=14949220)In
terms of size vs. performance (including retraining), the
128-cell LSTM was the best balance for a repo like this. (The
3-layer 512-cell networks used in the original Karpathy examples
are hundreds of MB)I recommend looking at the examples in the
/output folder for more robust examples than the ones in the