RNN vs CNN

The

woods

are

lovely

dark

and

deep

RNN

state

The

woods

are

lovely

dark

and

deep

CNN

The

woods

are

lovely

dark

and

deep

Fig. 3. The RNN passes a hidden state forward one token at a time; the CNN slides one window across the sequence in parallel.