NPU / AI accelerator with emphasis in LLM

Skymizer EdgeThought is compatible with Hugging Face and Nvidia. It supports most cutting-edge LLMs, including the newest Llama3. With expertise in software-hardware co-design, EdgeThought can leverage the high bandwidth of specialty DRAM to run a Llama3 8B at up to 200 tokens per second on just 4GB of memory.

• see the entire NPU / AI accelerator with emphasis in LLM datasheet
• get in contact with NPU / AI accelerator with emphasis in LLM Supplier