https://blog.jaylendouglas.com/ JD Blog 2026-07-13T00:00:00.000Z https://github.com/jpmonette/feed JD Blog https://blog.jaylendouglas.com/img/favicon.svg <![CDATA[Building My AI Cluster]]> https://blog.jaylendouglas.com/building-my-ai-cluster 2026-07-13T00:00:00.000Z I wanted a simple way to experiment with local inference, distributed services, and observability without building a lot of custom infrastructure first.

Goals​

  • Use hardware I had laying around
  • Server the model on my local network
  • Use any AI harness I wanted

Current stack​

  • llama.cpp (build from source)
  • Pi.dev (AI harness)
  • 3 Raspberry Pi 5 + 3 PoE Hats + 4-Port 2Gbps Network Switch
  • 1 2TB SATA Drive

Next steps​

Come back for the full blog post

]]> Jaylen Douglas https://jaylendouglas.com