Hello 2022 Year of Blockchain and AI, Data Analytics
big UIUX re-design is coming soon to our site, the new course panel format will make the content much easier to navigate and consume. This is another long newsletter. Don’t be overwhelmed by the number of flash cards. They will be organized into easily consumable smart tutorials. We will have opportunities to see how the concepts are useful in various different contexts. They will make appearances in projects (coming soon 2022).
Today's newsletter covers the training loop and training step of machine learning. It's an important topic! We also cover blockchain web3 recruiting and basics. What is avalanche, polygon, alchemy?? And finally we sprinkle the newsletter with a few technical interview tips including Google's guide to python, Steve Jobs explaining OOP in plain English. Have you made learn-to-code, learn machine learning your goal for 2022? There's still time to make that your new year resolution!
[pro] = flashcards for pro, paid members only.
[pub] = flashcards temporarily available for all to view
More payments and tipping options are now available. Become a paid member today! Check out the pricing payment page. https://ml.learn-to-code.co/payments.html
Mini projects, lessons, technical interview lessons and developer NFT launching 2022. Wow how come we only charge $5/month?! Like all startups, we want to be so good that many of you will subscribe, so we end up charging very little per person. And plus, we are investing in software + tech > overhead, so we continue to be a lean startup. These projects will be beginner friendly. We aim to have projects that take only a few lines of code but can demonstrate big concepts. You don't have to worry about another certificate that you can't finish. We have been there, we understand!
Substitute this meme with any other course platforms: Udacity, Coursera, .... even our founder has unfinished business in them all!
VOTE
Vote for any flash cards you like by clicking the vote button at the bottom of each skill card.
Your votes help our algorithms understand what to recommend.
EASTER EGGS
The best value of our newsletters is the high quality freebies (easter eggs) we find on the internet, such as high expensive ebooks and courses available for free for a limited amount of time. [pro]
https://ml.learn-to-code.co/skillView.html?skill=hTiwEpqKvay7XABGP2pv
[Value Proposition]: If there are great courses, by top professors for free, then why do you still need us? We take copious notes of deep learning concepts, transcribe important talks, collect jobs data, make flash cards. We then compile them into meaningful, cohesive courses, and smart tutorials. We also cover current events, hiring trends, tech trends, webinars and talks. We also provide insights on the recruiting, technical interview process, and the tech stacks and layers of your dream companies. We also link to more freebies and events. Don't see something you need? Message us on the message tab, and or email hi@uniqtech.co to request content.
MACHINE LEARNING TRAINING LOOPS
In this newsletter, we want to start tackling two complex topics in deep learning : training, autograd. These two topics open doors to a myriad of related topics: auto differentiation, gradient descent, gradient tape, training loop, back propagation etc. All these concepts are related, yet there are plenty of differentials. No pun intended.
Training dataset is used for training.
Cross validation dataset is used for evaluating the model, fine tuning the model parameters. The third dataset, aka the test dataset is for final model selection. Testing the model's performance on unseen dataset (mimicking real world data), testing its ability to generalize.
Introduction to Machine Learning Training
https://ml.learn-to-code.co/skillView.html?skill=wXEUn4D0lXLnrkFSil3v
Train test split (a review)
Training in Pytorch requires us to write a more custom detailed training loop. In scikit-learn, in tensorflow, training can be calling a simple high level API .fit(). Though each model has different architecture under the hood, the high level API has been abstracted to be .fit(). Here's a fully annotated version of pytorch training loop. We will make a youtube video about it as well. https://ml.learn-to-code.co/skillView.html?skill=KGym1tBatUk11ldPM4nM
Train test split prevents overfitting
https://ml.learn-to-code.co/skillView.html?skill=TcUiRCxmrpN0WHHcLBQQ
Shuffle
https://ml.learn-to-code.co/skillView.html?skill=q6Fspg2rDN2p7cuHhAVO
Train test split basics
https://ml.learn-to-code.co/skillView.html?skill=lsLQbgznFxtv8XyG8QN5
train test split explained 02
https://ml.learn-to-code.co/skillView.html?skill=gzWvNB2BD4tBUl4CZYCc
Annotated training loop, pytorch source code [pro, IMPORTANT, high quality]
https://ml.learn-to-code.co/skillView.html?skill=AOUkVyCzxd3shMR2YbY7
What is model.eval() [pytorch, pro]
https://ml.learn-to-code.co/skillView.html?skill=2L2kvayrTQKiImAENMmP
Summary of Prof. Yann LeCun's insights on deep learning training, optimization from the introductory deep learning class.
https://ml.learn-to-code.co/skillView.html?skill=5Of23iNQfoaSN96Lvvaq
What is back propagation: calculate gradient of the loss function with respect to (w.r.t) parameters (weight parameters) of the neural network.
How is back propagation related to neural networks, weights, loss function, gradient descent, stochastic gradient descent, chain rule. [pub]
https://ml.learn-to-code.co/skillView.html?skill=eGAWuyG2ZOg2lI4YQjXW
Common types of optimizers [pub]
https://ml.learn-to-code.co/skillView.html?skill=oGUC4XtdHs6W3kxZz0sU
A helpful analogy for understanding gradient descent [pro]
Understand the intuition behind gradient descent, and why it is challenging
https://ml.learn-to-code.co/skillView.html?skill=zzZsgttiIZCF61hrmZzp
Training step explained in details, gradient descent update function
https://ml.learn-to-code.co/skillView.html?skill=SbwHGas0sKegYrbB8XiD
Prevent overfitting in Machine Learning Deep Learning Models [pub, high quality]
https://ml.learn-to-code.co/skillView.html?skill=aD5eMJd1cRoChHNTA5SV
MACHINE LEARNING - BASICS
[Joke, humor] Have you seen XKCD's great comic about what machine learning is? check it out [pub, not affiliated]
Basic building block of a neural network, a basic neuron [previous newsletter]
https://ml.learn-to-code.co/skillView.html?skill=r7MwqkKw6ehTk4vUvkSC
What does this model do? [pro, high quality, cheat sheet]
https://ml.learn-to-code.co/skillView.html?skill=vRHs96wuuUqybPD14Dx4
Tensor definition 04 [pro, analogy, linear algebra] In the previous newsletter, we covered 3 definitions. Don't worry you will see these in smart tutorials again.
https://ml.learn-to-code.co/skillView.html?skill=ipaDTPgvrgrIJA16nhBq
Definition of Epoch [pub]
https://ml.learn-to-code.co/skillView.html?skill=QsCq74Zf5YaeSYL0vnMv
Set data type dtype in numpy
https://ml.learn-to-code.co/skillView.html?skill=eRxrn80E2JnA8k9mVhOi
MACHINE LEARNING EXTRACURRICULAR
Machine Learning conferences you should know [pub]
https://ml.learn-to-code.co/skillView.html?skill=VMvpxl21uzXK9X1oKNNP
Recurrent Neural Network (RNN) insights [pro]
https://ml.learn-to-code.co/skillView.html?skill=lFPWfk69PCgWeWhHWcwM
Self driving car hardware, chips
https://ml.learn-to-code.co/skillView.html?skill=NJfTGU69fBRx0uJNJMph
Mini deep learning quiz, computer vision
https://ml.learn-to-code.co/skillView.html?skill=urU8xKjZEUvtdd5I5oY2
Onnx model format defined. What is Onnx and why should you care?
https://ml.learn-to-code.co/skillView.html?skill=6MWshEa2Q9hHYaiQe6L1
Using GPU with CUDA in Pytorch [pub]
https://ml.learn-to-code.co/skillView.html?skill=5mFD35V10gSpqsAITFFN
BLOCKCHAIN, WEB3, CRYPTO, NFT
CRYPTO WEB3 DEVELOPER JOBS, CAREER
Web3 explained using a tweet
For general blockchain, crypto, web3 info, book mark our landing page (glossary vocab page) [log in to view, free, pub]
https://ml.learn-to-code.co/p_smart_tutorial_blockchain_NFT_crypto_glossary.html
Previously we talked about the Work at Startup Expo at Y Combinator. Presenters including OpenSea and Coinbase. Check our previous newsletter for details and notes.
2022 just started and NFT market OpenSea already made many records! Why is OpenSea so hot? What is the tech stacks at OpenSea? Coinbase co-presented at the event. What is coinbase's engineering goals? What are the problems most interesting to coinbase?
OpenSea recent funding (news)
https://ml.learn-to-code.co/skillView.html?skill=1cmeYEo3jy60ttGgk0VE
Some even speculate that OpenSea is aiming for an IPO after hiring Lyft IPO CFO.
Coinbase basics:
How big is coinbase right now? Visit the link below to see its ecosystem size and composition.
https://ml.learn-to-code.co/skillView.html?skill=JyUixCAzYHGuA29DlQjS
https://ml.learn-to-code.co/skillView.html?skill=DLtbt3IEaiRawm7PVSXU
Coinbase career site links:
https://ml.learn-to-code.co/skillView.html?skill=vnqABHwMCYVmR8LNzffs
Coinbase Engineering Lead on why it is not too late to get started with crypto, blockchain, and what kind of engineering problem coinbase wants to solve. [pro]
https://ml.learn-to-code.co/skillView.html?skill=MB8S4oFgKiS5tolAjpBP
Coinbase Engineering lead on exciting technical challenges for coinbase https://ml.learn-to-code.co/skillView.html?skill=jvvORo1aN3JqAOoCwpp9
OpenSea: OpenSea software engineering job and tech stack, what qualifications do you need to have to work at OpenSea, the biggest, hottest NFT market space [pro] Carefully inspect and understand opensea's tech stack at the end of the software engineer qualification section.
https://ml.learn-to-code.co/skillView.html?skill=KS5FFY0en4GuuaaSZSTe
For more info on OpenSea, check out previous newsletter. Paid pro members just message or email us.
BLOCKCHAIN, WEB3, CRYPTO, NFT - General
What is metamask? Metamask is a crypto wallet, the gateway to the blockchain, metaverse, NFT world, and many decentralized apps (dapps). Its logo is a 3rd fox.
[Project, web dev, crypto] How to inspect Tesla payment page to know what kind of payment options and crypto payment options it offers? How to check that Tesla may offer dogecoin payment for its car. [pub, project, mini project, important]
🏅 We aim to have more mini projects like this. Like it? Vote for it. Let us know
https://ml.learn-to-code.co/skillView.html?skill=7U6j9dc52K3RNKipCiDX
Important features of a dapp, decentralized app [pro]
https://ml.learn-to-code.co/skillView.html?skill=jDWJDz6LZGv6nyF3JK79
What is alchemy, alchemy.io
https://ml.learn-to-code.co/skillView.html?skill=CZ3KEykjtOzUm0CVqF8B
What's Avalanche (blockchain)?
https://ml.learn-to-code.co/skillView.html?skill=qtuIuysELZ4dqs0pBhyj
What is polygon (blockchain)? flash card [pro]
https://ml.learn-to-code.co/skillView.html?skill=eknsglpIWRlp0axk8CIk
Polygon + Alchemy.io [pub]
https://ml.learn-to-code.co/skillView.html?skill=lFl4YejoPf4piXCCj0jG
What is IPFS? Define IPFS [pub] It's likely that the NFT you or your friend purchased is hosted on IPFS.
https://ml.learn-to-code.co/skillView.html?skill=BBul0e3L1e6McpAFpA4a
What is ENS .eth?
If you see people using names such as .eth, they are using ENS service. Example Yourname.eth. Read more trivia like this on our blockchain landing page. You bet one of our staff has a .eth name. It's hyped right now. ENS is "Decentralised naming for wallets, websites, & more." If you see people using names such as .eth, they are using ENS service. Example Yourname.eth.
TECHNICAL INTERVIEW BASICS
Did you know Google offers a free online tutorial for python? [pub]
https://ml.learn-to-code.co/skillView.html?skill=zbBfCvD5dEVdRG1Z7YP9
Think about interviewing with Google using Python? You need this tool. [pro]
https://ml.learn-to-code.co/skillView.html?skill=r5oAP7RnPgUkelvEXi9u
Getting started with python [pub]
https://ml.learn-to-code.co/skillView.html?skill=DEIMNbsgKJs74pnNIkIV
Platforms for displaying your data science portfolio [pro]
https://ml.learn-to-code.co/skillView.html?skill=3zmAUhBq51hHQIqjOQeK
Have you heard of Steve Jobs explaining the programming concept OOP? [pub]
https://ml.learn-to-code.co/skillView.html?skill=x2gmQCcp3fjtybpysC54
Heap - FAAANG company's favorite interview questions
https://ml.learn-to-code.co/skillView.html?skill=NNz5sDfD5iJ2f88EL9jN
Tree traversal, recursion with illustration [new and improved, pro, illustrated]
https://ml.learn-to-code.co/skillView.html?skill=0jSSRxVCK2WQMuu9xlZW
In-order Tree traversal, pseudo code and detailed explanation [pro, high quality, pro tip]
https://ml.learn-to-code.co/skillView.html?skill=7N71VLYc8ZwrukoymVBM
FUTURE NEWSLETTER AND PROJECTS
Next Newsletter we will start to cover the next step of machine learning workflow, while still adding info about training (because training is huge)! We will want to get started with two big fields computer vision and Generative Adversarial Networks (GAN). Both have interesting real world projects and applications. On the blockchain web3 side, let's discuss how to use crypto wallets as login, online identity and basic wallet. That is a very useful part of web3 that is easy for web2 developers to start. There will also be useful mini projects in deep learning and data science in the 2022 newsletters. We will learn to build small useful projects. Also in our newsletter pipeline : Tesla AI Day transcript and notes. We will need to spend more time diving into the math behind gradient descent, including a review of chain rule and a recap of Andrew Ng's formula for gradient descent.
We are beefing up our technical interview sections like tree based interview questions. https://ml.learn-to-code.co/topic_tree_interview_questions_uniqtech_guide.html What makes our interview prep a bit different from question bank sites like Leetcode and Hacker Rank is that we give you information to solve types of interview questions in groups instead of solving them one by one. There are too many questions, too many variations, we need to learn the patterns to be effective. Example: previous flashcard on how to solve matrix interview questions. https://ml.learn-to-code.co/skillView.html?skill=sCmmsF1eZGGfXry78HFX
What's amazing is that this framework works well for Uber Engineering and Google Cloud ML. Check out their ML workflow charts here. Machine learning workflow variations at Google and Uber Engineering.
https://ml.learn-to-code.co/skillView.html?skill=q7JpxnKvRKDsxoHCc1TM [uber]
https://ml.learn-to-code.co/skillView.html?skill=F6zIHZXF7f3ldnghe0zJ [google]
You can also find the link on our workflow landing page.
https://ml.learn-to-code.co/topic_machine_learning_workflow.html
Developer NFT designs coming soon
"Hmm something brewing: we may have NFTs available for learners to grab in 2022. The more you learn the cooler NFTs you get. What kind of developer NFTs will you get ;-) Paid members and donors get priorities. "
Everyone learning to code, learning machine learning is like Harry when he first heard about Hogwarts. It will be a magical journey from here. We will take some inspiration from this series to our developer NFT.