Tensix Cores for specialized acceleration

Tensix NEO® is Tenstorrent’s latest high performance AI architecture, optimized for performance-per-mm2 and performance-per-watt. The main unit of compute is the Tensix NEO Cluster, comprised of four Tensix NEO Cores, 4MB of shared L1 SRAM, high-bandwidth on-chip network, and data movement cores handling core-to-core, DRAM, and Ethernet I/O. Micro architectural optimizations maximize FPU utilization and performance in the Tensix NEO Cores while updating the ISA to support more complex data patterns and modern data formats like the MX formats and FP4.

Toolchain and Support

• Open source simulation models available
• Python and C++ entry points for operators, with paths for kernel customization and optimization
• Powered by open source software:
• The TT-Forge™ AI compiler allows for rapid model bring up and automatic optimization
• The TT-Metalium™ SDK provides access directly to the metal, enabling use of Python and C++ for a variety of workloads
• The TT-LLK SDK allows for tensor level programming

• Updated mesh architecture that is both power-efficient and user friendly
• Performant data movement from custom-tailored data movement cores
• Improved performance-per-watt and performance per mm2; each Tensix NEO cluster contains:
  • 4 Tensix NEO Cores
  • Shared 4MB L1 SRAM
  • Shared NoC and Data Movement Block
• Support for FP4 and MX data formats
• Parallel issue of vector and matrix instructions
• ASIL-B certified (NEO Auto only)