Ehsan’s Blog

Mojo GPU Puzzles Edition 1

A hands-on guide that teaches GPU programming through 34 progressive challenges - learn by doing, not lectures.

What Ownership is Really About: A Mental Model Approach

A deep dive into understanding ownership in programming through mental models - originally published on Modular’s blog.

Paged Attention & Prefix Caching Now Available in MAX Serve

Announcing state-of-the-art optimizations for LLM inference in MAX Serve - originally published on Modular’s blog.

Agentic Building Blocks: Creating AI Agents with MAX Serve and OpenAI Function Calling

Learn how to build AI agents by integrating MAX Serve with OpenAI’s function calling capabilities - originally published on Modular’s blog.

Hands-on with Mojo 24.6

A practical walkthrough of the new features in Mojo 24.6 - originally published on Modular’s blog.

Build a Continuous Chat Interface with Llama 3 and MAX Serve

A step-by-step guide to building a chat application using Llama 3 and MAX Serve - originally published on Modular’s blog.

Paged Attention & Prefix Caching Now Available in MAX Serve

Announcing state-of-the-art optimizations for LLM inference in MAX Serve - originally published on Modular’s blog.

Hands-on with Mojo 24.5

A practical walkthrough of the new features in Mojo 24.5 - originally published on Modular’s blog.

What’s New in MAX 24.4? MAX on macOS, Fast Local Llama3, Native Quantization and GGUF Support

Exploring the new features in MAX 24.4 including macOS support and Llama3 - originally published on Modular’s blog.

What Ownership is Really About: A Mental Model Approach

A deep dive into understanding ownership in programming through mental models - originally published on Modular’s blog.

Semantic Search with MAX Engine

Building semantic search applications using MAX Engine - originally published on Modular’s blog.

Modal Labs Deep Dive

In this post, we’re going to deep dive into one of my favourite tools that are revolutionizing how Python code is run in cloud and it’s especially aimed at the computing…

The Core of Attention is Communication

Over the past year, perhaps the most cited paper across the software industry is Attention is All You Need that is at the heart of ChatGPT and GPT transformer models. The…

Rust and Node.js: Harmonizing Performance and Safety

In the Rust world, the interaction between Python and Rust is very well-known through the amazing PyO3 ecosystem. There is a similar relation between Python and Javascript…

Notes on the Current State of LLM Frameworks

This post tries to shed some light on the rapidly changing LLM frameworks in particular, LangChain (LC) and Llama-index (LI).

Announcement 📢 Releasing dlpackrs

DLPack is the standard in-memory data format that facilitateszero-costtensor transfer across major Deep Learning frameworks (PyTorch, TensorFlow and TVM) and the supported…

Announcement 📢 Releasing smartalloc

If you happen to write unsafe code in Rust where normal static checks are not available and want better UX for detecting memory issues along side using various sanitizers…

Announcement 📢 Create your own programming language with Rust

After almost a year from my last blog post, in this short post I’m very happy to announce that I’m writing a free online book where early chapters are available now. I’ve…

Rust std study series: Pin

This time we dive into std::pin which has a dense documentation.

Rust std study series: alloc

Let’s get deep into std::alloc!

Rust std study series: Interior mutability

Continuing the standard library study, it’s time for Cell<T>!

The State of Machine Learning in Rust

Every once in a while this topic comes up on a social media or Rust user channel. I’d like to describe briefly the way I see where things are going by a little bit of…

Rust std study series: VecDeque

Continuing from Rust standard library study series, it’s time for VecDeque. Because of its similarity to Vec, there isn’t much to say.

Rust std study series: LinkedList

Continuing from Rust standard library study series, it’s time for LinkedList<T>. Note that implementation are taken fromRust stable v1.33.0.

Variance in Rust: An intuitive explanation

Recently I’ve made a presentation aboutsubtyping and variance in Rustfor our local Vancouver Rust meetup, but I still think intuition was rather lost in the formalism, so…

Rust std study series: Vec

The upcoming series of blog posts will contain my study of Rust standard library. I’ve partially written some parts of the series in scattered places and want to gather them…

NIPS, AI hype and the lost rigor

Warning: This post contains a mixture of excitements, frustrations and rants!

What’s up with word embedding?

Word embedding is one of the interesting areas of research in Natural Language Processing. There are huge amount of materials with a lot of interesting ideas. I have been…

From Machine Learning to Formal Math and Type Theory

The idea of this post was sparkled from the new paperDeveloping Bug-Free Machine Learning Systems with Formal Mathematics.Meanwhile, I have had the idea of writing about…

General Monty Hall Simulation

The idea of this post came up to my mind last night. I’m assuming you have already heard about the famous Monty Hall Problem (if you haven’t, watch the quicker intro in Numbe…

Restaurant Revenue Prediction with BART Machine

In this post, I’d like to show you how to use the newly written package onBayesian Additive Regression Treesi.e.BART Machine for Restaurant Revenue Prediction withR. The…

Vector Bundles, Locally Free Sheaves and Divisors on a Curve

In this post, I’ll be summarizing the basics of the correspondence between vector bundles, locally free sheaves and divisors on a smooth curve (defined over an algebraically…

Classification of Vector Bundles on Elliptic curves

I’m supposed to give a talk on this subject for one of my courses, so I consider this post as a “pre-exposition.” I learned from and heavily used the great exposition “Vector…

Some Homological Algebra Computations

In this post, I’m going to write down the detailed proofs of some of the exercises in Rotman’s Homological Algebra. They were asked in ML and then answered by me. >1. Let \(A…