In progress
Local AI inference on Apple Silicon
I'm running local model inference and beginning to benchmark it using Python, PyTorch, Hugging Face Transformers, and Apple MPS acceleration on a MacBook Pro.
The next step is to explore an inference API, then containerisation, observability, and load testing. These are planned extensions of the work.
Code and measurements will follow as the project develops.