Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,151 @@ tags:
|
|
7 |
- text-generation
|
8 |
- torch
|
9 |
- lstm
|
10 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
- text-generation
|
8 |
- torch
|
9 |
- lstm
|
10 |
+
---
|
11 |
+
|
12 |
+
This generative text model was trained using [Andrej Karpathy's code](https://github.com/karpathy/char-rnn) on the texts of the Chinese participants of the [Biennale of Poets in Moscow](https://iling-ran.ru/web/ru/conferences/2017_biennale) in 2017.
|
13 |
+
|
14 |
+
Model was trained with size 512 and 3 layers, dropout 0.5.
|
15 |
+
|
16 |
+
## Usage
|
17 |
+
|
18 |
+
The procedure for installing the required software is described [by Karpathy](https://github.com/karpathy/char-rnn), torch is required, the code is written in lua. Be careful, versions of libraries written many years ago are used!
|
19 |
+
|
20 |
+
```bash
|
21 |
+
th sample.lua lm_lstm_epoch41.20_1.6773.t7 -temperature 0.2 -primetext '你见过' -length 300
|
22 |
+
```
|
23 |
+
|
24 |
+
## Train data
|
25 |
+
|
26 |
+
Train data is non free due to copyright restrictions. Texts for training are provided by the authors.
|
27 |
+
|
28 |
+
## What for?
|
29 |
+
|
30 |
+
In an era of winning Transformers, ancient RNN models seem archaic. But I see that they still work better than modern architectures with such important categories from the humanities point of view as individual style.
|
31 |
+
|
32 |
+
## Public demonstration
|
33 |
+
|
34 |
+
The work of the model was publicly demonstrated to the participants of the [Biennale of Poets in Moscow on December 1, 2017](https://goslitmuz.ru/poster/5365/) at the Margarita Rudomino All-Russia State Library for Foreign Literatureм.
|
35 |
+
|
36 |
+
## Samles
|
37 |
+
|
38 |
+
### Text generated on December 1, 2017
|
39 |
+
|
40 |
+
```
|
41 |
+
你见过大地
|
42 |
+
|
43 |
+
我的心在天空下,在天空下
|
44 |
+
我们在大雪中发生的天空
|
45 |
+
在大地地图的天空
|
46 |
+
在我的天空下
|
47 |
+
我们又是一种大地的天空
|
48 |
+
我们的天空又变成了天空
|
49 |
+
我们在南京的天空下
|
50 |
+
我们在天空下
|
51 |
+
我们在大雨中我的天空
|
52 |
+
我们是一个地方
|
53 |
+
在天空
|
54 |
+
```
|
55 |
+
|
56 |
+
### -temperature 0.2 -primetext '旷野'
|
57 |
+
|
58 |
+
```
|
59 |
+
旷野的古怪
|
60 |
+
在我的天空下,我们在我的天空下
|
61 |
+
天空发生的时间
|
62 |
+
我们在我的心中
|
63 |
+
在我的天空下
|
64 |
+
我们在我的天空中
|
65 |
+
我的天空下
|
66 |
+
在我的眼睛上
|
67 |
+
我的大地只是一片空白
|
68 |
+
我们是一种大地
|
69 |
+
在冬天的天空下
|
70 |
+
我们在天空下
|
71 |
+
一只手在大地上
|
72 |
+
```
|
73 |
+
|
74 |
+
### -temperature 0.4 -primetext '旷野'
|
75 |
+
|
76 |
+
```
|
77 |
+
旷野的句子
|
78 |
+
太多的天空只是变化的时候
|
79 |
+
大地又心热的大地
|
80 |
+
在水泥望发天发泉
|
81 |
+
在天空后一只转身
|
82 |
+
天气的天空和天空
|
83 |
+
那只手在地平线上
|
84 |
+
在大地上的夜色
|
85 |
+
在天空发出大雪
|
86 |
+
我只有一只眼睛
|
87 |
+
那么多年过的火焰
|
88 |
+
在电话中的故事
|
89 |
+
在我的天空
|
90 |
+
```
|
91 |
+
|
92 |
+
### -temperature 0.6 -primetext '旷野'
|
93 |
+
|
94 |
+
```
|
95 |
+
旷野的另一个陌生人
|
96 |
+
我不是我们的生活:只是为了持到了他的视死
|
97 |
+
|
98 |
+
一天到底是我的地方,是一种神秘主义的成都人?
|
99 |
+
|
100 |
+
在北方,我已经再发明,我写诗在另一个人。
|
101 |
+
|
102 |
+
宋朝如王,天气停面向天空,声音家
|
103 |
+
|
104 |
+
游泳不会有一个夏天的人在
|
105 |
+
```
|
106 |
+
|
107 |
+
### -temperature 0.8 -primetext '旷野'
|
108 |
+
|
109 |
+
```
|
110 |
+
旷野的另一个陌生人。
|
111 |
+
|
112 |
+
|
113 |
+
2015-10-15
|
114 |
+
|
115 |
+
|
116 |
+
政治多么名
|
117 |
+
|
118 |
+
除了一勒世界的春天在河南
|
119 |
+
那天下的星与女等呢
|
120 |
+
有个生命反好人们羊宗明
|
121 |
+
|
122 |
+
月亮,吹过四声地潃口
|
123 |
+
想象它听我惑得多的走向吗
|
124 |
+
将在有叇进那枝本心地江山苏美
|
125 |
+
风一带风不过我们的欢
|
126 |
+
```
|
127 |
+
|
128 |
+
### -temperature 1.0 -primetext '旷野'
|
129 |
+
|
130 |
+
```
|
131 |
+
旷野的原始呢?
|
132 |
+
初因草凪墙酒写诗,桥杨叫合叼标的南京
|
133 |
+
要读向无数家,在回忆污油呀
|
134 |
+
|
135 |
+
他转眼在教授中锇之内,顿他们
|
136 |
+
世界杯抓弓起免后的,杀息者。
|
137 |
+
|
138 |
+
认识不同已经是什么?大洞倾露去啊,雨树蜜蜂
|
139 |
+
19路,乃左贝上,惊产的歌
|
140 |
+
```
|
141 |
+
|
142 |
+
## BibTeX entry and citation info
|
143 |
+
|
144 |
+
For other insights see:
|
145 |
+
|
146 |
+
```
|
147 |
+
@article{orekhov2020neural,
|
148 |
+
title={Neural reading: Insights from the analysis of poetry generated by artificial neural networks},
|
149 |
+
author={Orekhov, Boris and Fischer, Frank},
|
150 |
+
journal={Orbis Litterarum},
|
151 |
+
volume={75},
|
152 |
+
number={5},
|
153 |
+
pages={230--246},
|
154 |
+
year={2020},
|
155 |
+
publisher={Wiley Online Library}
|
156 |
+
}
|
157 |
+
```
|