Archive - Intuitive Shorts

#16 | tqdm() behind the scenes

A custom implementation of tqdm from scratch

Mar 30 •

January 2025

#15 | Postel's Law in Software Engineering

Be conservative in what you send, and liberal in what you accept

Jan 25 •

June 2024

#14 | How does Langchain Expression Language (LCEL) work ?

Classic use of Polymorphism and Operator overloading

Jun 15, 2024 •

March 2024

#13 | A fun history about Git

"the information manager from hell" - creator of git

Mar 3, 2024 •

January 2024

#12 | MIPS vs MCSS (Maximum Inner Product / Cosine Similarity Search)

And the one that matters !!

Jan 5, 2024 •

October 2023

#11 | Softmax Temperature

Oct 19, 2023 •

September 2023

#10 | random.seed() and Hitchiker's Guide to Galaxy

And their uncanncy connection

Sep 16, 2023 •

July 2023

#9 | Gradient Checkpointing

To scale new heights in model training

Jul 3, 2023 •

June 2023

#8 | Approximate Nearest Neighbors (1/2)

And where to find them using Product Quantization

Jun 19, 2023 •

#7 | What is Gradient Accumulation ?

It's the answer to "I can't increase batch size because of limited GPU"

Jun 5, 2023 •

May 2023

#6 | How does Linear layer act on multi-dimensional tensor ?

Sounds trivial for 1D, but how about a 3D tensor (or any *D tensor) ?

May 9, 2023 •

April 2023

#5 | Tensor Broadcasting

And this is how Numpy does it

Apr 27, 2023 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts