|
|
ЯÊÖÒµ½çÖ÷Á÷¿ªÔ´ÉçÇø£¬½âËø•NÌÚ´´ÐÂж¯ÄÜ
2026Äê9ÔÂ19ÈÕ£¬»ªÎªÈ«Áª½Ó´ó»á2026“ЯÊÖÒµ½çÖ÷Á÷¿ªÔ´ÉçÇø£¬½âËø•NÌÚ´´ÐÂж¯ÄܔרÌâÂÛ̳ÔÚÉϺ£Ô²Âú¾ÙÐС£±¾´ÎÂÛ̳»ã¾ÛÁËLinux»ù½ð»á¡¢PyTorch»ù½ð»á¡¢vLLMÉçÇø¡¢Ö£ÖÝÏȽøÊµÑéÊÒ¡¢Ä§´îÉçÇøÒÔ¼°Ascend for PyTorchÉçÇøÓÅÐ㿪·¢Õߵȶ෽ÉçÇø×¨¼Ò£¬¹²Í¬Ì½ÌÖÔÚAI Agentʱ´ú£¬ÈçºÎͨ¹ý¿ªÔ´Ð×÷¡¢ÈíÓ²Ðͬ¼°ÑµÁ··¶Ê½Ñݽø£¬¹¹½¨¿ª·Å¡¢¿É³ÖÐøµÄAI²úÒµÉú̬¡£
ÏÖ³¡ÕÕÆ¬
ÏÖ³¡ÕÕÆ¬ •NÌÚЯÊÖPyTorch¿ªÔ´¹²½¨£¬¿ªÍØAIÉú̬ÐÂʱ´ú »ªÎª•NÌÚAI¿ò¼ÜÉú̬¸ºÔðÈËÍõÉñµÏÔÚÑݽ²Öбíʾ£¬AIÄ£ÐͳÖÐøÍ»ÆÆ¹æÄ£Ó븴ÔӶȱ߽磬AIÉúÌ¬ÃæÁÙÐÂÌôÕ½£¬•NÌÚÉî¸ûAI²úÒµ°ËÄ꣬Òѽ¨³ÉÖйú×î¾ß»îÔ¾¶ÈºÍÓ°ÏìÁ¦µÄ¿ª·ÅAI²úÒµÉú̬¡£×Ô2020Äê•NÌÚÓëPyTorchºÏ×÷Æð²½£¬µ½½ñÄê7ÔÂPyTorch¹ÙÍøÕýʽÉÏÏßAscend NPU£¬³ÉΪ¹Ù·½Ö§³ÖÊ׸öÖйúÓ²¼þÒÔ¼°9ÔÂ9ÈÕPyTorch Conference China 2026·å»áÁªºÏ»ù½ð»áµÄ³¬½ÚµãLive DemoÊ×Ð㣬¶¼±êÖ¾×Å•NÌÚÕýÈ«ÃæÈÚÈëPyTorch¹Ù·½ÔÉúÉú̬¡£Ä¿Ç°£¬•NÌÚÕýͨ¹ýÖØ¹¹°ÙÍò²âÊÔÓÃÀý¡¢½ÓÈë¹Ù·½CI/CDÌåϵµÈ£¬ÓëPyTorch´ÓÊÊÅä¶Ô½ÓÂõÏòÉú̬¹²½¨¡£ÆäÖÐCICDϵͳÒÑʵÏÖÉÏÓÎPR¿É¼û•NÌÚCI½á¹û£¬³ÉΪÊ׸ö´ï³ÉÉçÇøCIϵͳL3±ê×¼µÄÖйúÓ²¼þ¡£Ascend for PyTorchÉçÇø×Ô26Äê5Ô³ÉÁ¢ÒÔÀ´£¬Òѻ㼯ÉçÇøÒ»Ç§¶àλºËÐÄ¿ª·¢Õߣ¬ÍⲿPRÕ¼±È³¬¹ý50%£¬³ÉΪÖйú·¢Õ¹×î¿ìµÄAIÉçÇø£¬Í¬Ê±ÉçÇø»¹ÍƳöÁËһϵÁпγ̡¢¿ªÔ´ÏîÄ¿¼°ÉçÇøÈÎÎñ£¬Ìṩ¶àÖÖ¼¤ÀøÄ£Ê½ºÍÔÚÏßËãÁ¦×ÊÔ´£¬ºôÓõ¹ã´ó¿ª·¢Õß¿ÉÒÔÒ»Æð²ÎÓ뿪Դ¹²½¨¡£
»ªÎª•NÌÚAI¿ò¼ÜÉú̬¸ºÔðÈË ÍõÉñµÏ ¿ª·Åϵͳ¼ÓËÙAIÑݽø£¬¹²½¨Í³Ò»AI¿ò¼ÜÉú̬ Linux»ù½ð»áÖйúÇø×ܼࡢPyTorch »ù½ð»áÑÇÖÞÇø×ܼà Àîê»Ñô½øÐÐÁË¡¶OPEN SYSTEMS LEARN FASTER¡·ÒéÌâ·ÖÏí¡£Ñݽ²Ö¸³ö£¬µ±Ç°AIʱ´ú´ÓÓ²¼þ¡¢»ù´¡ÉèÊ©µ½ÑµÁ·ÍÆÀí¼°Agent²ã£¬¾ùÓÐÖØÒª¿ªÔ´¼¼ÊõÖ§³Å£¬¹úÄÚAIÓ²¼þËä³ÊÏÖ°Ù»¨Æë·ÅµÄ¶àÑù»¯Ì¬ÊÆ£¬µ«ÈôÈí¼þÕ»¸÷×ÔΪս½«µ¼ÖÂÑÏÖØË鯬»¯£¬Òò´ËÐèÒª¿ª·Åϵͳ´Ù½ø¿ª·¢ÕßÐ×÷¹²½¨Í³Ò»¹¤×÷Á÷¡£Í¬Ê±Ç¿µ÷£¬Ä£ÐÍ¡¢¿ò¼ÜÓëÓ²¼þÏ໥ǣ¶¯£¬ÐγɳÖÐøÑݽøµÄÑ»·£¬¿ª·ÅϵͳÄÜÈýðÈÚ¡¢µçÐŵȲ»Í¬ÁìÓò¹²Ïí·´À¡¡¢Ðͬµü´ú¡£PyTorch»ù½ð»á²ÉÓÃEcosystemµ½HostedµÄÁ½¼¶·õ»¯Ìåϵ£¬ÏÖÒÑÍйÜvLLM¡¢DeepSeep¡¢RayµÈÏîÄ¿£¬²¢ÇÒÓÉ•NÌÚÍŶÓÖ÷µ¼µÄAccelerator Integration Working Group£¬ÕýÔÚÍÆ¶¯“PyTorchÅÜÔÚÈκÎÔÆ¡¢ÈκμÓËÙÆ÷ÉÏ”µÄÕ½ÂÔ¡£PyTorch 2.14·¢²¼¡¢•NÌÚCI´ïµ½L3ˮƽµÈ£¬¾ùÊÇ¿ª·ÅÐ×÷µÄ³É¹û¡£
Linux»ù½ð»áÖйúÇø×ܼࡢPyTorch »ù½ð»áÑÇÖÞÇø×ܼà Àîê»Ñô vLLM AscendÍ»ÆÆ³¤ÐòÁÐKV Cache´æ´¢Æ¿¾± vllm-ascend Maintainer À׳¬·ÖÏíÁË¡¶KVPoolÓëDSA KV OffloadÔÚvLLM AscendÖеĽøÕ¹Óë¹æ»®¡·ÒéÌâ¡£ÔÚKVpool·½Ãæ£¬Ãæ¶Ô»ìºÏ×¢ÒâÁ¦¡¢»ìºÏ¼Ü¹¹´øÀ´µÄ»º´æÓïÒåÒì¹¹Óëǰ׺»º´æ¹æÔò²»Í³Ò»µÈÌôÕ½£¬ÊµÏÖÁËMulti KV GroupÖ§³Ö£¬´æ´¢ÉÏÖ§³ÖSSDÐ¶ÔØ£¬´«ÊäÉÏÖ§³Ö³¬Æ½ÃæÄÚ´æÓïÒ壬Á´Â·¸ü¶Ì¡¢´ø¿í¸ü´ó£¬ÓÅ»¯Layerwiseºó£¬ÔÚGLM-5.2 TP16ÉÏʹTTFT½µµÍ21%-30%¡£ÔÚDSA KV Offload·½Ã棬Õë¶Ô³¤ÐòÁÐÏÂÆ¬ÉÏÄÚ´æÈÝÁ¿²»×ãµÄÎÊÌ⣬³¤ÆÚÑ¡ÔñKV Offload·½°¸£¬Ê¹ÓÃÀäKVÐ¶ÔØÖÁCPU DRAM¡¢Òì²½¼ÓÔØ¡¢µþ¼ÓÁ½²ãOverlapµÈ¼¼Êõ£¬ÍÌÍ´ïDCP·½°¸µÄ2.8ÖÁ3.8±¶¡£Î´À´½«³ÖÐøÓÅ»¯Layerwise¡¢¹¹½¨¿ç³¬½ÚµãµÄ´ó¹æÄ£ÄÚ´æ³Ø¡¢¿ª·¢ÈÚºÏËã×Ó£¬²¢ÓëvLLMÉçÇøÌ½Ë÷¶¯Ì¬·½°¸¡£
vllm-ascend Maintainer À׳¬ »ùÓÚAscendNPU IR´òÔìACAGEMMsËã×Ó×Ô¶¯Éú³Éϵͳ Ö£ÖÝÏȽøÊµÑéÊÒ-±àÒëʵÑéÊÒ¼¼Êõ²¿²¿³¤ Îâê» ÔÚ¡¶ACAGEMMs£º»ùÓÚAscendNPU IRµÄËã×Ó×Ô¶¯Éú³É ¡·½éÉÜÁËACAGEMMsËã×Ó×Ô¶¯Éú³Éϵͳ¡£ÒéÌâÖ¸³ö£¬´óÄ£ÐÍÉú³ÉKernelÖ»ÊÇÆðµã£¬ÕæÕý½»¸¶»¹Ðè¾¹ý±àÒë¡¢ÕýÈ·ÐÔÑéÖ¤¡¢ÐÔÄÜÓÅ»¯Óë·º»¯²âÊÔ¡£ ACAGEMMsϵͳÒÔº¸ÇÓïÒå¡¢ÊäÈëÓò¡¢±ß½çÌõ¼þ¡¢ÑéÊÕ±ê×¼ºÍÔËÐл·¾³µÄÈÎÎñÆõÔ¼¹á´©Éú³É¡¢ÑéÖ¤¡¢²âÁ¿Óë½»¸¶È«¹ý³Ì£¬ÒÀÍкòÑ¡Ê÷¡¢Ö¤¾ÝÁ´¡¢¾ÑéÊ÷Èý´ó»úÖÆ¹ÜÀíËÑË÷¡¢ÑéÖ¤Óë¾Ñ鸴Ó㬲¢ÉèÖñàÒë¡¢ÕýÈ·ÐÔ¡¢ÐÔÄÜÈý²ãGate¶ÔºòÑ¡×ö¾²Ì¬Ô¤¼ìÓë¹éÒòɸѡ£¬Ê§°ÜÖ¤¾Ý·´ÏòÔ¼ÊøÏÂÒ»ÂÖËÑË÷£¬±ÜÃâÀË·ÑÕæ»ú×ÊÔ´¡£ÔÚ•NÌÚA2ÉϵIJâÊÔ±íÃ÷£¬¸ÃϵͳÄÜÓÐЧɸѡ¸ßÖÊÁ¿ºòÑ¡£¬¼ÓËٱȴï1.42£¬TokenÏûºÄ½µµÍ55%¡£ÍŶÓ×÷ΪFlagGEMSµÈÏîÄ¿µÄºËÐűÏ×Õߣ¬ÖÂÁ¦ÓÚͨ¹ý¿ªÔ´·ÖÏí½µµÍËã×Ó¿ª·¢Ãż÷£¬Íƶ¯±àÒëÆ÷¼¼Êõ½ø²½¡£
Ö£ÖÝÏȽøÊµÑéÊÒ-±àÒëʵÑéÊÒ¼¼Êõ²¿²¿³¤ Îâê» ´ÓԤѵÁ·µ½ÑµÁ··þÎñ»¯£¬ms-swift¡¢TinkerÖúÁ¦¸ßЧѵÁ· ħ´îÉçÇø¼¼Êõר¼Ò ºú¾°º·¢±í¡¶Ä£ÐÍѵÁ··¶Ê½£º´Ó΢µ÷µ½×Ô½ø»¯ºÍѵÁ··þÎñ»¯¡·Ñݽ²£¬Ê×ÏȻع˴óÄ£ÐÍѵÁ·¼¼Êõ´Ó2018ÄêBERT/GPT¿ªÆôԤѵÁ·Ê±´úÒ»Ö±µ½2026Äê×Ô½ø»¯ÑµÁ·ÐËÆðµÄÑݽøÀú³Ì£¬ËæºóÖ¸³ö¿ª·¢ÕßÈÔÐèѵÁ·Ä£ÐÍ£¬ÔÒò°üÀ¨Ë½ÓÐÁìÓò֪ʶעÈë¡¢ÐÐΪ¿É¿ØÐÔÓ밲ȫ¶ÔÆë¡¢´óÄ£ÐÍÄÜÁ¦ÕôÁóµ½Ð¡Ä£ÐÍ¡¢»ùģ֪ʶ³ÖÐø¸üС£Îª½µµÍѵÁ·Ãż÷£¬Ä§´îÉçÇøÍÆ³öms-swift¿ò¼Ü£¬¸²¸ÇѵÁ·¡¢ÍÆÀí¡¢ÆÀ¹ÀÓëÁ¿»¯²¿Êð£¬Ö§³Ö¶àÖÖÄ£ÐÍÓëËã·¨£»²¢Ìá³ö·þÎñ»¯ÑµÁ·¿ò¼ÜTinker£¬¿ª·¢ÕßÎÞÐè±¾µØÏÔ¿¨¼´¿ÉÔ¶¶ËѵÁ·¡£ÉçÇø»¹ÌṩNPUÖ§³ÖÎĵµÓë¾µÏñ£¬²¢³ÖÐø½øÐпò¼Üµ×²ãÖØ¹¹£¬»¶Ó¿ª·¢Õß¹²½¨¡£
ħ´îÉçÇø¼¼Êõר¼Ò ºú¾°º Ascend for PyTorchµÄ¿ª·¢Ö®Â㬴ӴúÂëʹÓÃÕß±äΪÉÏÓι±Ï×Õß Ascend for PyTorchÉçÇø¿ª·¢Õß Íõ±´çùÔÚ¡¶´Ó“Ö§³Ö”µ½“¹²½¨”£ºÎÒµÄAscend × PyTorch¿ªÔ´Êµ¼ù¡·ÒéÌâÖзÖÏíÁ˲ÎÓë•NÌÚÉçÇø¹±Ï׵ľÀúÓëÐĵá£Í¨¹ýPyTorchÔÉúAPIµÄNPUÑéÖ¤¹¤×÷ºÍÉÏÓÎÉçÇø²âÊÔÓÃÀý½âñîÈÎÎñÌå»áµ½“ÄÜÅÜֻͨÊÇÆðµã”£¬ÕæÕýµÄÄ¿±êÊÇÐÐΪÓëÉú̬ÍêÈ«¶ÔÆë£¬¹²½¨NPUÉú̬²¢·ÇΪNPUÌí¼ÓÌØÊâ·ÖÖ§£¬¶øÊǰïÖúÉÏÓÎʵÏÖÌØÐÔÉ豸Î޹ء£ÒéÌâÖн«“´ÓÖ§³Öµ½¹²½¨”×ܽáΪËIJ½£º´úÂëÅÜͨ¡¢ÔÚNPUÉÏÕýÈ·ÔËÐС¢API²âÊÔÓëÎĵµÉú̬ÍêÈ«¶ÔÆë¡¢½«Í¨ÓÃÄÜÁ¦»ØÀ¡ÉÏÓΡ£¿ª·¢Õß¿ÉÒÔ´ÓС´¦×ÅÊÖ£¬Ò»¸öAPI¡¢Ò»Ìõ²âÊÔ¡¢Ò»¸öIssue»òPR¶¼ÄܳÉΪ¿ªÔ´Ð×÷µÄÆðµã£¬´Ó´úÂëʹÓÃÕß±äΪÉÏÓι±Ï×Õß¡£
Ascend for PyTorchÉçÇø¿ª·¢Õß Íõ±´çù ±¾´ÎÂÛ̳³ä·ÖչʾÁË•NÌÚÓ뿪ԴÉçÇø½ôÃܺÏ×÷µÄ³É¹û£¬ÒÔ¼°¸÷·½ÔÚAI»ù´¡ÉèÊ©¡¢¿ò¼ÜÉú̬¡¢ÍÆÀíÓÅ»¯¼°ÑµÁ··¶Ê½ÉϵÄ×îнøÕ¹¡£ÃæÏòδÀ´£¬•NÌÚÓëÒµ½ç¿ªÔ´ÉçÇø³ÖÐøÉîÈëÐ×÷£¬¹²½¨AI²úÒµ·±ÈÙ¿ª·ÅÐÂÉú̬¡£
|
|||||||||||