°æ±¾
|
AI´óÄ£ÐÍ
|
Ó²¼þÅäÖÃ
|
Ó¦Óû·¾³
|
Æì½¢°æ
|
DeepSeek- 671B ÂúѪ°æ
/Qwen¡¢LlamaµÈ
|
CPU£º4x 32ºËX86/C86´¦ÀíÆ÷
GPU£ºÏÔ´æ64G*16
Äڴ棺64GB*32 DDR4
Ó²ÅÌ£º480G SSD *4+3.84T NVMe*4
ÍøÂ磺ÅäÖÃRDMAÍø¿¨»òIBÍø¿¨
|
•Ö§³ÖÂúѪ°æ671BÄ£Ðͼ°ÕôÁóÄ£ÐÍ
•´ó²¢·¢¡¢ÐÔÄÜÇ¿
•¿ÉÁé»îÀ©Õ¹£¬Ö§³Ö´óÐÍÆóÒµ¹æÄ£»¯Ó¦ÓÃ
|
¸ßÅä°æ
|
DeepSeek- 70B
/Qwen¡¢LlamaµÈ
|
CPU£º2x 32ºËX86/C86´¦ÀíÆ÷
GPU£ºÏÔ´æ32G*8
Äڴ棺64GB*16 DDR4
Ó²ÅÌ£º480G SSD *2+3.84T NVMe*2
ÍøÂ磺ÒÔÌ«Íø/RDMAÍø¿¨
|
•Ö§³Ö¾«¶ÈFP16µÄ70BÄ£Ðͼ°ÕôÁóÄ£ÐÍ
•µÍ³É±¾¡¢Ë½Óл¯²¿Êð
•Âú×ã¿Í»§ÌåÑ顢С¹æÄ£Ê¹ÓÃÐèÇó
|
±ê×¼°æ
|
DeepSeek- 32B
/Qwen¡¢LlamaµÈ
|
CPU£º2x 32ºËX86/C86´¦ÀíÆ÷
GPU£ºÏÔ´æ32G*4
Äڴ棺32GB*16 DDR4
Ó²ÅÌ£º480G SSD*2+3.84T NVMe*2
ÍøÂ磺ÒÔÌ«Íø
|
•Ö§³Ö¾«¶ÈFP16µÄ32BÄ£Ðͼ°ÕôÁóÄ£ÐÍ
•¸ßÐÔ¼Û±È
•Ö§³ÖÖÐСÆóÒµ¸÷ÀàAIÓ¦ÓÃÐèÇó
|
±ßÔµ°æ
|
DeepSeek-14B
/Qwen¡¢LlamaµÈ
|
CPU£ºX86´¦ÀíÆ÷
GPU£ºÏÔ´æ32G*2
Äڴ棺32GB*4 DDR4
Ó²ÅÌ£º°´Ðè
ÍøÂ磺ÒÔÌ«Íø
|
• Ö§³ÖÖÐС²ÎÊýÕôÁóÄ£ÐÍ
• µÍÃż÷Éϳµ£¬ÇáÁ¿»¯Ó¦ÓÃ
• µÍÔëÒô¡¢¿ÉÔÚÕþÎñ¡¢½ÌÓýµÈ°ì¹«»·¾³²¿Êð
|
Èí¼þ»·¾³
|
ÍÆÀí¿ò¼Ü£ºVLLm
²Ù×÷ϵͳ£ºUbuntu¡¢¹ú²úϵͳ
|