Tag

Local Llm

All articles tagged with #local llm

A tiny Mac-native LLM rewrites my typing workflow
ai2 months ago

A tiny Mac-native LLM rewrites my typing workflow

Tom’s Guide tester Lloyd Coombes tries Cotypist, a Mac-native, on-device LLM typing assistant that suggests the next word and can autofill with a Tab press. It runs locally (starting with the Gemma 4 model, 3.2GB, with options up to 15.7GB), works across apps, doesn’t send data off the device, and boosts typing speed; the beta tool is currently free, with pricing on the horizon, and he strongly recommends it for productivity and maintaining his writing style.

AMD Bets on Local AI Agents with New Agent Computer Paths
technology3 months ago

AMD Bets on Local AI Agents with New Agent Computer Paths

AMD outlines an 'Agent Computer' approach to run AI agents locally on consumer hardware via two code paths—RyzenClaw (Ryzen AI Max+ with 128 GB RAM) and RadeonClaw (Radeon AI Pro R9700)—using Windows with WSL2, LM Studio, and llama.cpp, avoiding cloud dependencies. RyzenClaw delivers about 45 tokens/s with a 260K token context window and up to six concurrent agents; RadeonClaw tops ~120 tokens/s, a 190K window, and up to two agents. Configured in under an hour, the setups target developers and early adopters, with prices around $2,700 for RyzenClaw and $1,299 for RadeonClaw GPUs, underscoring that local AI on consumer hardware remains a premium proposition.