Don't Panic!: Everything Guides
From AI Padawan to Jedi Master: The Mostly Harmless AI Cheat Sheet
Follow me on XFiles (aka Twitter) and Instagram for live-stream updates on AI news and tips.
Updated: April 26, 2024
Table of Contents
No book, course, magazine, or tutorial is ever as good as trial and error. Use the AI tools and fail as quickly as you can. The learning curve is never-ending. We are always students. Even engineers at OpenAI and Google are still figuring it all out. Learn the foundations well and you’ll grow from there.
“After a long time of practicing, our work will become natural, skillfull, swift, and steady.”
Bruce Lee
Hackers Guides to ChatGPT
ChatGPT (Note: OpenAI released an official app for Apple products, not out for Android.)
God Mode - AutoGPT chatbot which effectively runs ‘autonomously’
LangFlow & LangChain: Library for combining language models with other components to build applications. Aka gives LLMs superpowers!
Pinecone - makes it easy to build high-performance vector search applications
Hackers Guides to Image Generation: MidJourney, Stable Diffusion, etc.
MidJourney - the highest quality AI image generator on the market ($)
Stable Diffusion - open-source AI image generator. Less quality but much more control of the image
OpenAI’s Dall-E - personally my least favorite but try it out
Stable Diffusion Beginners Guide (Open Source)
Curious Refuge AI Filmmaking Course ($ course)
ControlNet 📽 - Stable Diffusion model that lets you copy compositions or human poses from a reference image or video (remember a video is a bunch of images stitched together).
AI Animation: Tutorial Animate your AI images with a consistent character
Turn 2D Images into 3D Objects with Monster Mash! (Free Web Tool)
Photoshop Generative Fill (currently 7-day free trial)
Become a Master Level AI Engineer
Coding 101
Start with Python!
Github Copilot (must get, currently powered by GPT-3 and soon 4)
The Hacker Attitude
Mathematics for AI
Math for ML and Data Science: Mathematics for Machine Learning and Data Science by Luis Serrano. Master the essential mathematics for ML.
Probabilistic Machine Learning: a book series by Kevin Murphy
Machine & Deep Learning
📽 Ilya Sutskever's, OpenAI's Founding & Lead Research scientist, explains how and why deep learning works
MIT Deep Learning 101 Course: An efficient and high-intensity boot camp on deep learning methods with applications to computer vision, natural language processing, biology, and more!
Attention Explanation Video Series by Luis Serrano
Google’s DeepMind Deep Learning & Reinforcement Learning Courses
Weights & Biases - makes it easy to track your experiments, manage & version your data, and collaborate with your team so you can focus on building the best models.
Prompt Engineering
Microsoft’s Github Podcast Copilot Demo - great demo with code of how to create your own end-to-end copilot/agent
Vision ML
RoboFlow - Everything you need to build and deploy custom computer vision models without the heavy lifting
MVTEC’s Halcon - Manufacturing & Production level standard for industry
📽Andrew Ng’s Landing AI - computer vision made easy with visual prompting
Meta’s Segment Anything - produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image
Meta’s DINOv2 - foundation models producing universal features suitable for image-level visual tasks (image classification, instance retrieval, video understanding) as well as pixel-level visual tasks (depth estimation, semantic segmentation)
NVIDIA’s Omniverse - highest quality simulator with plenty of AI tools for production scale and quality implementations (free)
AI Reseacher’s Sandbox: The Ludicrous Mode
OpenAI
MuJoCo - a free and open source physics engine that aims to facilitate research and development in robotics, biomechanics, graphics and animation, and other areas where fast and accurate simulation is needed
Microsoft
Meta AI
ImageBind - multimodal AI model: text, image/video, audio, depth (3D), thermal, and inertial measurement units (IMU) in one model. You can add more with engineering.
NVIDIA
Amazon
Foundational Papers
Understanding Large Language Models by Sebastian Raschka
Language Models are Few-Shot Learners by OpenAI
Formals Algorithms of Transformers by DeepMind
Human-Timescale Adaptation in an Open-Ended Task Space (RL) by DeepMind
Learning Agile Soccer Skills for a Bipedal Robot with Deep RL by DeepMind
Misc. AI Tools
Runway AI - Image and Video editing using machine learning. Also, text-to-video and video-to-video AI conversion. (Note: text-to-video has not been released to the public yet.)
Videos
Karpathy technical overview of LLMs (GPT)
Books
Superintelligence by Nick Bostrom
The Master Algorithm by Pedro Domingos
The Mind's I: Fantasies And Reflections On Self & Soul by Douglas Hofstadter & Daniel Dennett
DeepLearning by Ian Goodfellow
Information Theory, Inference and Learning Algorithms by David MacKay
Articles
How ChatGPT Works by Stephen Wolfram
Software 2.0 by Karpathy
A Survival Guide to a PhD by Karpathy
How To Be Successful by Sam Altman