Difference between revisions of "GPT-2"

From Interaction Station Wiki
Jump to navigation Jump to search
Line 3: Line 3:
  
 
== Fine-tune GPT-2 with your own text corpus ==
 
== Fine-tune GPT-2 with your own text corpus ==
 
+
*In Google Collabs: https://colab.research.google.com/drive/1UFX8x7qeYKitRHgmJjCUPyG9s5NhVPv5#scrollTo=aeXshJM-Cuaf
In Google Collabs: https://colab.research.google.com/drive/1UFX8x7qeYKitRHgmJjCUPyG9s5NhVPv5#scrollTo=aeXshJM-Cuaf
 
 
*Step by step guide: https://minimaxir.com/2019/09/howto-gpt2/
 
*Step by step guide: https://minimaxir.com/2019/09/howto-gpt2/
  
 
==  GPT-2 next word prediction ==
 
==  GPT-2 next word prediction ==
 
https://demo.allennlp.org/next-token-lm?text=Joel%20is%20new%20person%20and%20he%20is%20not%20a%20member%20of%20any%20group%20of%20players%20who%20are%20not%20part%20of%20the
 
https://demo.allennlp.org/next-token-lm?text=Joel%20is%20new%20person%20and%20he%20is%20not%20a%20member%20of%20any%20group%20of%20players%20who%20are%20not%20part%20of%20the

Revision as of 16:18, 11 January 2020