Newsletter July 2022 No.2 - Deep Learning, GAN
This newsletter is all about deep learning, data science, machine learning, natural language processing (NLP) - our core contents. We are taking one newsletter break from blockchain and interviews. Don't worry, they will be out again later this month.
There are some cool new AI kids on the block: DALL-E 2 (openAI) and Imagen (Google). First, read our warning below. If you agree, proceed to the rest of the newsletter.
WARNING: Before using our cross-platform content, please be sure to read our disclaimer, terms of service, and privacy policy. By using and reading our content, you agree to our legal documents.
Generative Adversarial Networks
GAN is a family of amazing neural networks popularized by Ian Goodfellow (an AI lead once at Google and Apple, author of a deep learning textbook). This is the magic behind GPT-3, DALL-E 1 2, and the deep fake videos of Mark Zuckerberg and Tom Cruise. Imagen is Google's version of DALL-E, different nuance, perhaps even more photorealistic. We won't have time to go over Imagen in this newsletter.
What is DALL-E?
Check out this definition of DALL-E below and a beautiful image of an astronaut riding a white horse strolling through outer space in fantastical beauty.
What is DALL·E or DALL-E (definition)? [public]
https://ml.learn-to-code.co/skillView.html?skill=CATLlOhr9OYNrpRVmX21
It's like getting your personal photoshop wizard, except infinitely more flexible, creative and free. And the model gives you many options, not just one image.
Coolest demo of DALLE2 (OpenAI) on Tiktok [public]
https://ml.learn-to-code.co/skillView.html?skill=vQwFUeOaTfAznkTZdMvC
How to try DALLE today? [pro, easter egg] How to create your own DALL-E? [high quality, easter egg]
https://ml.learn-to-code.co/skillView.html?skill=zgNtZ0hmH9zI72fzKZCW
Check out our experiment with DALLE
creating royal raccoon portraits!
Let's learn some GAN Basics
Generative adversarial networks (GANs) [definition, basics, public]
https://ml.learn-to-code.co/skillView.html?skill=sC2ED3p7jDTyTY89g4nS
How Tesla Solves Self Driving Challenges
Here are some gems from Tesla AI Day, which went on for hours. We try to summarize the important parts.
Tesla Cameras, Inputs, How Tesla Data is Collected [public]
https://ml.learn-to-code.co/skillView.html?skill=DV5EkghomJM6k35R7VFr
Tesla Metrics Self Driving Evaluation, Performance Metrics [pro]
https://ml.learn-to-code.co/skillView.html?skill=4laxPyFr3KGSc3uCqfnn
(ignore the purple dot, that's the starting point)
Where would activation function be in the machine learning workflow?
Answer: Usually towards the end of the model sequential layer in the Model Training phase.
Where would metrics and evaluation be in the machine learning workflow?
Answer : in the Model Evaluation phase
MACHINE LEARNING WORKFLOW
Learn more about machine learning workflow here https://ml.learn-to-code.co/topic_machine_learning_workflow.html
Check out Google's Machine Learning workflow here
https://ml.learn-to-code.co/skillView.html?skill=F6zIHZXF7f3ldnghe0zJ
ACTIVATION FUNCTION
Uniqtech Guide Activation Function - Understand activation function in Deep Learning [public]
https://ml.learn-to-code.co/skillView.html?skill=7UtxCw2MqskkTxubD1sg
Sigmoid activation function, Uniqtech Guide, (definition) [public]
https://ml.learn-to-code.co/skillView.html?skill=e1vgz0IvpvxFyHDwlLa2
Uniqtech Guide to Activation Function [pro]
https://ml.learn-to-code.co/skillView.html?skill=MkHtA1eDx02QcVRg6vTR
More on Activation Function
https://ml.learn-to-code.co/skillView.html?skill=aY00RB3o269VlR8zEmgK
Activation Function code example
https://ml.learn-to-code.co/skillView.html?skill=u2uRVTrYBF9Fagqu8eQp
Pytorch Activation Functions [public]
https://ml.learn-to-code.co/skillView.html?skill=TaMLMgYI4pyLmVW1tdGM
METRICS
Evaluation Metric (definition), scoring, loss function [public]
https://ml.learn-to-code.co/skillView.html?skill=biycH5z93LxsGBSifMNB
Using sklearn metrics.accuracy_score (example, code) [public]
https://ml.learn-to-code.co/skillView.html?skill=3Iue6FcwIo9gSP3DfILn
Tesla Metrics Self Driving Evaluation, Performance Metrics [pro]
https://ml.learn-to-code.co/skillView.html?skill=4laxPyFr3KGSc3uCqfnn
ROC AUC, ROC (receiver operating characteristic) Curve, Area Under the Curve (AUC) (definition) [public, metric, pro tip, high quality, important]
https://ml.learn-to-code.co/skillView.html?skill=XpZ0C4Mnpisu1zIEB4MI
#machinelearning #deeplearning #python #sklearn #datascience #AI
NLP measuring error, evaluation metrics, evaluation criteria [pro, pro tip, high quality]
https://ml.learn-to-code.co/skillView.html?skill=OXouSLN4fPjhavmXz70M
GRADIENT DESCENT
gradient update function
Variations of Gradient Descent Explained in Details - Uniqtech Guide Part 1 [pro]
https://ml.learn-to-code.co/skillView.html?skill=alPR0pl45S7ziGPISmLZ
Variations of Gradient Descent Explained in Details - Uniqtech Guide Part 2 calculation, conversions on batch size and iterations [pro]
https://ml.learn-to-code.co/skillView.html?skill=bkpBJDTQJ09QHVfUDc4R
Variations of Gradient Descent Explained in Details - Uniqtech Guide Part 3 + Quizzes [pro]
https://ml.learn-to-code.co/skillView.html?skill=knrrQ2SPNQmbrrERQ2HD
Quiz : When would turn off gradient computing? When would you put your model in evaluation mode (eval), e.g PyTorch? [public]
https://ml.learn-to-code.co/skillView.html?skill=Su5hytqQO5Vk0G7bDipY
Quiz: What’s the difference between stochastic gradient descent versus batch gradient descent in deep learning training?
https://ml.learn-to-code.co/skillView.html?skill=hY9XZfHQ8qs1ATn6XpXp
Custom training loop in Tensorflow
https://ml.learn-to-code.co/skillView.html?skill=mMoge83m7UhGzyuzogcN
What are the optimizers available in Tensorflow?
https://ml.learn-to-code.co/skillView.html?skill=BAv6pD1HJMk1vNcs5azP
What are the optimizers available in tensorflow?
https://ml.learn-to-code.co/skillView.html?skill=BAv6pD1HJMk1vNcs5azP
RECURRENT NEURAL NETWORK
Types of Pytorch Recurrent Layers cells [public]
https://ml.learn-to-code.co/skillView.html?skill=xDJT0NUvO0NoV4h1r6Am
MACHINE LEARNING BASICS
Feature engineering basics (definition) [public]
https://ml.learn-to-code.co/skillView.html?skill=9TTzABBXkHcqz9BLGWYb
Machine Learning Deep Learning Conferences You Want to Pay Attention To. [public]
https://ml.learn-to-code.co/skillView.html?skill=JIQCxZEozCQLbIFoBNgV
How to choose machine learning models cheat sheet [pro]
https://ml.learn-to-code.co/skillView.html?skill=WdpUT0Uc7M2APtpPdz8W
parametric model versus non parametric model [public]
https://ml.learn-to-code.co/skillView.html?skill=MgHFqXYYTm0di69F3pDo
Choosing compute machine types on Google Cloud
https://ml.learn-to-code.co/skillView.html?skill=e05uHuFZd0UONLr2s1kW
Google Cloud tech offerings, services at a glance [public, data science]
https://ml.learn-to-code.co/skillView.html?skill=1muqmACUSTXRLn52OT3H
Machine Learning Deep Learning Conferences You Want to Pay Attention To. [public]
https://ml.learn-to-code.co/skillView.html?skill=JIQCxZEozCQLbIFoBNgV
What is a forward pass? What is a backward pass? [pro, a review] this flash card appeared before
https://ml.learn-to-code.co/skillView.html?skill=Jcq1cuvFz1RKrJoftMN2
What is back propagation (BP)? Definition
https://ml.learn-to-code.co/skillView.html?skill=r09LuM3mHzfCCwgjSGmR
What is back propagation in three sentences?
https://ml.learn-to-code.co/skillView.html?skill=w6gnd1adkAv4gS311XnF
What is back propagation?
https://ml.learn-to-code.co/skillView.html?skill=eGAWuyG2ZOg2lI4YQjXW
Computer Vision Workflow [public]
https://ml.learn-to-code.co/skillView.html?skill=f8ACQ7HPBG0NB8YTmif7
ADVANCED MACHINE LEARNING
Information Retrieval (IR) (definition) [NLP, pro, high quality]
https://ml.learn-to-code.co/skillView.html?skill=QZAej3Jkby5uZfzeSzHf
Best intuition/analogy for understanding PCA [pro]
https://ml.learn-to-code.co/skillView.html?skill=cJbxTK5yTB4cAhE7N6jx
What is ONNX (definition)? [public]
https://ml.learn-to-code.co/skillView.html?skill=BHdHrz5Y2yVOcpmg8ikG
XGboost [definition, pro]
https://ml.learn-to-code.co/skillView.html?skill=PFmSfxhNROEmEIhd73yJ
Google Cloud tech offerings, services at a glance [public]
https://ml.learn-to-code.co/skillView.html?skill=1muqmACUSTXRLn52OT3H
Pick AWS SageMaker compute [pro]
https://ml.learn-to-code.co/skillView.html?skill=XRLFk6XwPK2HWcVZj6qJ
Startup engineering metrics [pro]
https://ml.learn-to-code.co/skillView.html?skill=pCZh8AkCgYQCiYBMlODI
Uniqtech Guide to Pytorch torchvision models [pro, high quality, pro tip, important]
https://ml.learn-to-code.co/skillView.html?skill=jtASXWeJcAtpf9kOg6xb
Pytorch deployment [public]
https://ml.learn-to-code.co/skillView.html?skill=uZkQcxiQanYKuGZY9rnO
Attention, Transformer Basics [definition, architecture, public]
https://ml.learn-to-code.co/skillView.html?skill=2LCSE81wU7wWyn922fE8
NATURAL LANGUAGE PROCESSING (NLP)
Word2vec: Overview in a few words. Summary. [pro, high quality]
https://ml.learn-to-code.co/skillView.html?skill=UVKSXC5o0w6pEvc5DzQK
What’s Gensim
https://ml.learn-to-code.co/skillView.html?skill=Auu5TaqxaXK43gYAC06J
NLP workflow pipeline tokenizer, parser components [pro]
https://ml.learn-to-code.co/skillView.html?skill=4N2TNx2XdlLMWIZugKxC
Google NLP Model, Data, Training, Tasks [pro]
https://ml.learn-to-code.co/skillView.html?skill=9Ft1QWBldeWPqeNT0b4w
NLP measuring error, evaluation metrics, evaluation criteria [pro, pro tip, high quality]
https://ml.learn-to-code.co/skillView.html?skill=OXouSLN4fPjhavmXz70M
GENERAL DATA SCIENCE
Devtools, IDE, pro tips for developers [public] Why use Pycharm? | Why use VSCode?
https://ml.learn-to-code.co/skillView.html?skill=cZ3lBg9aBsgFiSJR1CYs
Handling SQL dates [public, pro tip]
https://ml.learn-to-code.co/skillView.html?skill=AlNVdebb8Vyq5CiW8BXY
NoSQL databases pros and cons benefits of using nosql database [pro]
https://ml.learn-to-code.co/skillView.html?skill=lxNxvpbvOmFHotdkcPhq
Modern Database Technology you should know [pro]
https://ml.learn-to-code.co/skillView.html?skill=bx3cVWPmPCaYQDd2Wwu3
MongoDB Basics [pro]
https://ml.learn-to-code.co/skillView.html?skill=PG0lS9HzbsbiqnedqmfH
Relational database basics [public]
https://ml.learn-to-code.co/skillView.html?skill=usJr7a66CewCyEG36EYZ