Attempting to scale normalized probability counts grows exponentially You can use Multi Layer Perceptrons (MLPs) as a solution to maximize the log-likelihood of the training data. MLPs let you make predictions by embedding words close togehter in a space such that knowledge transfer of interchangability can occur with good confidence. With a vocabulary of 17000 […]
Code Fun Blog Posts
Notes for — The spelled-out intro to language modeling: building makemore
Derived from: https://github.com/karpathy/nn-zero-to-hero/blob/master/lectures/makemore/makemore_part1_bigrams.ipynb Makemore Purpose: to make more of examples you give it. Ie: names training makemore on names will make unique sounding names this dataset will be used to train a character level language model modelling sequence of characters and able to predict next character in a sequence makemore implements a services of language […]
Notes for – The spelled-out intro to neural networks and backpropagation: building micrograd
Summary of above: Backpropagation is just a recursive application of chain rule backward through the graph storing the computed derivative as a gradient (grad) variable within each node. Gotcha! We must be careful that when adding multiple of the same term we correctly derive wrt all terms instead of just a single term! Ie: b […]
Machine Learning Ideas
Create a neural net that weighs price difference % $TSLA for the past 1, 2, 3, 4, 5, 10, 15, 30, 60, 90 and 180 days. Starting with a binomial, you can create a data set that looks at the % change between yesterday and today. Just like makemore will make name predictions, the predictions […]
NearSuperchargers.com Perfect Page Speed Score
You pretty much have to strip the page completely down to get a score like this. I will try to keep the page speed high, but it won’t be staying at 100. For reference, this is Tesla: Difference being, they load tons of assets and I am a single php document that loads in 26ms. […]
Kudos to Weglot
I love getting errors like this that tell you exactly what is wrong. Great job Weglot!
November 11th, 2020
Delivered by Tesla
I have an idea for a platform which I believe could distrupt Amazon and create a SuperCharger buying frenzy. If this platform has already been thought of, I would love a chance to join the team. How to disrupt Amazon? Deliver more things better than Amazon. What we have today:If you buy from Amazon, you […]
Caching Optimization
I do hold the philosophy that the best cache is no cache. But sometimes, caching is the exact right tool for the job. When it comes to user experience, one metric I hold in the highest regard is page load speed. I want my pages to load in the least amount of time possible and […]