Build a Continuous Chat Interface with Llama 3 and MAX Serve

AI
LLM
MAX
Tutorial
A step-by-step guide to building a chat application using Llama 3 and MAX Serve - originally published on Modular’s blog.
Author

Ehsan M. Kermani

Published

December 17, 2024

I wrote a tutorial on the Modular blog that builds a chat interface on top of Llama 3 and MAX Serve, end to end. It covers serving the model, keeping a running conversation going, and the part people usually get wrong: managing context and history as the chat grows. It finishes with how to deploy the thing.

Read it here: Build a Continuous Chat Interface with Llama 3 and MAX Serve.