Skip to main content

3 docs tagged with "Edge-ai"

View all tags

Google Coral Expansion Card

The Google Coral Expansion Card is a community-designed expansion card that integrates a Google Coral Edge TPU accelerator module into the Framework Laptop's expansion card form factor. Created by Evgeni Genchev in May 2022, the project enables on-device machine learning inference (TensorFlow Lite) through a dedicated TPU chip housed in a standard expansion card slot.

Strix Halo Guide

Strix Halo Guide is a comprehensive, practical guide to running large language models locally on AMD Strix Halo / Ryzen AI MAX+ 395 systems with Radeon 8060S (gfx1151) and 96GB/128GB unified memory. Maintained by community member hogeheer499-commits, it covers BIOS configuration, Ubuntu 24.04/kernel setup, Ollama, llama.cpp Vulkan/RADV, ROCm/HIP experiments, vLLM, benchmarks, raw logs, and reproducibility checks.

strix-llm

strix-llm is a known-good local LLM inference configuration tool for the Framework Desktop (Ryzen AI MAX+ 395 / Strix Halo). Maintained by community member Alberto Migliorato (GitHub: AlbeMiglio), it provides a tested, reproducible setup for running large language models locally on Framework Desktop hardware using ROCm and llama.cpp.