Generative-AI

Code and Resources that I have used to help you get started out with Generative AI

Papers

• Attention is all you need
• Language Models are Few-Shot Learners (OpenAI chatGPT3)
• Deep Residual Learning for Image Recognition(uses a method here for better results)

Videos

• Andrej Karpathy's GPT from Scratch
• Reinforcement Learning from Human Feedback: From Zero to chatGPT
• Getting Started With Hugging Face in 15 Minutes | Transformers, Pipeline, Tokenizer, Models
• Imitation Learning and Natural Language Generation at NeurIPS 2019 jointly with Hal Daume III

Articles

• Residual Blocks (we use something similar in the GPT model)
• Illustrating Reinforcement Learning from Human Feedback (RLHF)

Repositories

• Nano GPT (medium size GPT like models)