Skymizer HTX301: The PCIe Card That Runs 700B LLMs at Just 240W
A Taiwan-based startup just unveiled a PCIe card that runs 700-billion-parameter LLMs locally on 384 GB of memory at only 240 watts — less than half the power of NVIDIA's flagship RTX PRO 6000 Blackwell. Is this the end of GPU clusters for on-prem AI?
- AI
- LLM
- hardware
- inference
- on-prem-ai
- Skymizer
- NVIDIA
