Some GPT2 surprisal based models for FP time on grammatical and ungrammatical sentences. If you have any recent version of pandas, numpy, pytorch, transformers, and R, then: JUST RUN MAIN.PY Enjoy!