Ua hoʻokuʻu aku ka hui ʻāpana i alakaʻi ʻia e Jim Keller ʻo Tenstorrent i kāna kaʻina hana Wormhole hanauna hou no nā ukana hana AI, kahi mea e manaʻo nei e hāʻawi i ka hana maikaʻi ma ke kumu kūʻai kūpono.Ke hāʻawi nei ka ʻoihana i ʻelua mau kāleka PCIe hou e hiki ke hoʻokipa i hoʻokahi a ʻelua paha mau kaʻina hana Wormhole, a me nā kahua hana TT-LoudBox a me TT-QuietBox no nā mea hoʻomohala polokalamu. ʻO nā hoʻolaha a pau o kēia lā e pili ana i nā mea hoʻomohala, ʻaʻole i ka poʻe e hoʻohana ana i nā papa Wormhole no nā ukana hana kalepa.
"He mea ʻoluʻolu mau ka loaʻa ʻana o kā mākou huahana hou aku i nā lima o nā mea hoʻomohala. ʻO ka hoʻokuʻu ʻana i nā ʻōnaehana hoʻomohala me ka hoʻohana ʻana i kā mākou kāleka Wormhole™ hiki ke kōkua i nā mea hoʻomohala e hoʻonui a hoʻomohala i nā polokalamu AI multi-chip," wahi a Jim Keller, Luna Nui o Tenstorrent.Ma waho aʻe o kēia hoʻolaha ʻana, hauʻoli mākou e ʻike i ka holomua a mākou e hana nei me ka lipine i waho a me ka hoʻoikaika ʻana o kā mākou huahana hanauna ʻelua, ʻo Blackhole.
Loaʻa i kēlā me kēia mea hana Wormhole he 72 mau ʻiole Tensix (ʻelima o ia mau mea e kākoʻo ana i nā ʻiole RISC-V ma nā ʻano ʻikepili like ʻole) a me 108 MB o SRAM, e hāʻawi ana i 262 FP8 TFLOPS ma 1 GHz me ka mana hoʻolālā wela o 160W. Ua lako ka kāleka Wormhole n150 chip hoʻokahi me ka hoʻomanaʻo wikiō 12 GB GDDR6 a he bandwidth o 288 GB/s.
Hāʻawi nā mea hana Wormhole i ka scalability maʻalahi e hoʻokō i nā pono like ʻole o nā ukana hana. Ma kahi hoʻonohonoho workstation maʻamau me ʻehā mau kāleka Wormhole n300, hiki ke hoʻohui ʻia nā mea hana i loko o hoʻokahi ʻāpana e kū mai ana i ka polokalamu ma ke ʻano he pūnaewele Tensix core i hoʻohui ʻia a ākea. ʻAe kēia hoʻonohonoho i ka mea hoʻolalelale e lawelawe i ka ukana hana like, hoʻokaʻawale ma waena o ʻehā mau mea hoʻomohala a holo paha i ʻewalu mau hiʻohiʻona AI like ʻole i ka manawa like. ʻO kahi hiʻohiʻona koʻikoʻi o kēia scalability ʻo ia ka hiki ke holo kūloko me ka ʻole o ka pono no ka virtualization. Ma kahi kaiapuni kikowaena ʻikepili, e hoʻohana nā mea hana Wormhole iā PCIe no ka hoʻonui ʻana i loko o ka mīkini, a i ʻole Ethernet no ka hoʻonui ʻana i waho.
Ma ke ʻano o ka hana, ua hoʻokō ka kāleka Wormhole n150 chip hoʻokahi a Tenstorrent (72 Tensix cores, 1 GHz frequency, 108 MB SRAM, 12 GB GDDR6, 288 GB/s bandwidth) i 262 FP8 TFLOPS ma 160W, ʻoiai ʻo ka papa Wormhole n300 chip ʻelua (128 Tensix cores, 1 GHz frequency, 192 MB SRAM, aggregated 24 GB GDDR6, 576 GB/s bandwidth) e hāʻawi a hiki i 466 FP8 TFLOPS ma 300W.
No ke kau ʻana i ka 300W o 466 FP8 TFLOPS i loko o ka pōʻaiapili, e hoʻohālikelike mākou iā ia me ka mea a Nvidia, ke alakaʻi mākeke AI, e hāʻawi nei ma kēia mana hoʻolālā wela. ʻAʻole kākoʻo ʻo Nvidia's A100 i ka FP8, akā kākoʻo ia i ka INT8, me ka hana kiʻekiʻe o 624 TOPS (1,248 TOPS i ka wā sparse). I ka hoʻohālikelike ʻana, kākoʻo ʻo Nvidia's H100 i ka FP8 a hiki i ka hana kiʻekiʻe o 1,670 TFLOPS ma 300W (3,341 TFLOPS i ka sparse), he ʻokoʻa loa ia mai Tenstorrent's Wormhole n300.
Eia nō naʻe, aia kekahi pilikia nui. ʻO ke kumukūʻai o ka Wormhole n150 a Tenstorrent he $999, ʻoiai ke kūʻai ʻia aku nei ka n300 he $1,399. I ka hoʻohālikelike ʻana, ʻo ke kumukūʻai o kahi kāleka kiʻi Nvidia H100 hoʻokahi he $30,000, ma muli o ka nui. ʻOiaʻiʻo, ʻaʻole mākou i ʻike inā hiki i ʻehā a ʻewalu paha mau mea hana Wormhole ke hāʻawi i ka hana o hoʻokahi H300, akā ʻo kā lākou TDP he 600W a me 1200W.
Ma waho aʻe o nā kāleka, hāʻawi ʻo Tenstorrent i nā kahua hana i kūkulu mua ʻia no nā mea hoʻomohala, me 4 mau kāleka n300 ma ka TT-LoudBox ma Xeon me ka hoʻoluʻu hana, a me ka TT-QuietBox holomua me ka hana hoʻoluʻu wai Xiaolong ma EPYC).
Ka manawa hoʻouna: Iulai-29-2024
