Attempting to scale normalized probability counts grows exponentially You can use Multi Layer Perceptrons (MLPs) as a solution to maximize the log-likelihood of the training data. MLPs let you make predictions by embedding words close togehter in a space such that knowledge transfer of interchangability can occur with good confidence. With a vocabulary of 17000 […]
Pytorch Blog Posts
Notes for — The spelled-out intro to language modeling: building makemore
Derived from: https://github.com/karpathy/nn-zero-to-hero/blob/master/lectures/makemore/makemore_part1_bigrams.ipynb Makemore Purpose: to make more of examples you give it. Ie: names training makemore on names will make unique sounding names this dataset will be used to train a character level language model modelling sequence of characters and able to predict next character in a sequence makemore implements a services of language […]
Machine Learning Ideas
Create a neural net that weighs price difference % $TSLA for the past 1, 2, 3, 4, 5, 10, 15, 30, 60, 90 and 180 days. Starting with a binomial, you can create a data set that looks at the % change between yesterday and today. Just like makemore will make name predictions, the predictions […]
