It enables building and running LLMs directly in Zig without external build tools.

The repository includes:

1. A pure Zig build system that handles all C/C++ dependencies 2. Direct bindings to MLX's C API for optimal performance 3. A working transformer-based language model implementation 4. A TikToken tokenizer using PCRE2 (Perl-Compatible Regular Expressions 2) for text processing

Example usage:

``` // Initialize components var tokenizer = try Tokenizer.init(allocator, null); var transformer = try Transformer.init(allocator, null);

// Encode and generate text const input_ids = try tokenizer.encodeChat(allocator, "You are a helpful assistant.", "Hello world"); const output_ids = try transformer.generate(input_ids, 20);

// Decode the result const output_text = try tokenizer.decode(output_ids); ```

Acknowledgement

The build system is based on Erik Kaunismäki's zig-build-mlx approach.