comments (9)

  • This is also recommended reading if you want to learn more about building LLMs from scratch: See:

    Train your own LLM - https://github.com/angelos-p/llm-from-scratch

    HN Discussion - https://news.ycombinator.com/item?id=48017948

    iamnotarobotman

  • - half the posts are locked

    - other half have no visualizations whatsoever

    - i have posted far better resources than this in the past collecting everything HN has over a 10 yr period on these subjects https://news.ycombinator.com/item?id=49183198

    vivzkestrel

  • https://www.byhand.ai/p/library

    > AI by Hand is the research publication of By Hand Research, founded by Prof. Tom Yeh. By Hand Research studies model interpretability and explainability at the math and algorithm level. Subscribers receive free new articles and join live seminars. Members get access to our full research library.

    rustyminnow

  • Similarly, I’ve been working through Raschka’s Build a Large Language Model (From Scratch) https://sebastianraschka.com/llms-from-scratch/ and it’s been well worth it (particularly paired with his explainer videos)

    dan-g

  • I'm not sure what this is. Click past the subscribe page to get a bunch of links to descriptions of articles I could read if I was a subscriber?

    zhainya

  • I found Deep Learning by No Starch Press to be an excellent primer the foundation of AI:

    https://nostarch.com/deep-learning-visual-approach

    slowin

  • i created something similar a while back. Inspired by micrograd for showing the connection between math/calculus and code, then building along the way to a full NumPy deep learning library that I pretrained GPT-2 124M model with it. One way to learn is to trace through the PRs merged to the repo in chronological order.

    The philosophy is the same: "What I cannot create, I do not understand." https://github.com/workofart/ml-by-hand

    megadragon9

  • I watched the intro video and all I saw were numbers in an Excel sheet. That doesn't make this fun. I'd rather have AI ELI5 it to me.

    docheinestages

  • My professor used this "by hand" technique when teaching quantum computation algorithms, so I have a soft spot for it.

    copperx