Blog Posts

March 2nd, 2023
  • Midjourney
  • Racarslin

Midjourney Fun

There once was a baby raccoon who loved snuggling his mommy. His name was Racarslin.

February 27th, 2023
  • Machine Learning
  • Pytorch

Notes for – Building makemore Part 3: Activations & Gradients, BatchNorm

Building makemore Part 3 Jupyter Notebook makemore: part 3¶ Recurring Neural Networks RNNs are not as easily optimizable with first order gradient techniques we have available to us and the key to understanding why they are not optimizable easily is to understand the activations and their gradients and how they behave during training. In [2]: import […]

February 21st, 2023
  • Model 3 Improvements
  • Self Driving
  • Speculation
  • Tesla

Tesla Full Self Driving

Currently it costs in the USA ~ $684/mo to drive 1000 miles with FSD subscription, insurance and energy costs. This works out to $0.684(0.69)/mile. How odd. Most cars sit around doing not that much, most of the time. As you decrease the number $684, you broaden the available market. Even starting with a couple buying […]

February 16th, 2023
  • Bad Defaults
  • The Gimp

Gimp’s default screen grab

This is totally useless. It immediately takes a picture of the entire screen. And for me, that is the wrong screen. The “Select a region to grab” option should be the default. Even a 2-second delay would be better.

January 23rd, 2023
  • Machine Learning
  • Pytorch

Notes for – Building makemore Part 2: MLP

Attempting to scale normalized probability counts grows exponentially You can use Multi Layer Perceptrons (MLPs) as a solution to maximize the log-likelihood of the training data. MLPs let you make predictions by embedding words close togehter in a space such that knowledge transfer of interchangability can occur with good confidence. With a vocabulary of 17000 […]

January 12th, 2023
  • Machine Learning
  • Pytorch

Notes for — The spelled-out intro to language modeling: building makemore

Derived from: https://github.com/karpathy/nn-zero-to-hero/blob/master/lectures/makemore/makemore_part1_bigrams.ipynb Makemore Purpose: to make more of examples you give it. Ie: names training makemore on names will make unique sounding names this dataset will be used to train a character level language model modelling sequence of characters and able to predict next character in a sequence makemore implements a services of language […]

January 2nd, 2023
  • Machine Learning

Notes for – The spelled-out intro to neural networks and backpropagation: building micrograd

Summary of above: Backpropagation is just a recursive application of chain rule backward through the graph storing the computed derivative as a gradient (grad) variable within each node. Gotcha! We must be careful that when adding multiple of the same term we correctly derive wrt all terms instead of just a single term! Ie: b […]

December 8th, 2022
  • Tesla

TSLA

December 7th, 2022
  • Uncategorised

How ML (machine learning) Works

If you are here, you are probably wasting your time. Below is a summary of notes I have taken for working through this: I defer you to that resource because Andrej is my mentor wrt ML. If you want to know my specific thoughts and things that I have learned from his “Building makemore” class, […]


1234567891011121314151617181920212223242526272829303132

Partners & Resources


App & Web Design

  • Web & App Design - JIC Design
  • Web Design & SEO - Creative Designs
  • UX Design - Adam.Co
  • Enterprise Web Design - Optimo IT
  • Shopify Solutions - Tangent MTW
Marketing

  • Print Media - Printing Shark
  • Digital Marketing - Digital Growth
Content

  • Professional Writing & Editing - River Street Writing
  • DIY SEO - WL Marketing
© 2017 DevElevation.com
Kingston Ontario
Privacy Policy