Advantech Launches Edge AI Server Solutions for Generative AI
Generative AI tools such as large language models (LLMs) are transforming enterprise knowledge management by automating data organization, retrieval, and analysis, thereby boosting productivity and improving decision-making. Custom LLMs enhance accuracy, while edge training increases data privacy, though it can be more costly. This solution supports LLM fine-tuning with 1-4 GPU cards and SQ ai100 AI SSDs, enabling enterprises to train LLMs cost-effectively while keeping sensitive data secure at the edge.
Four Solution Offerings for Diverse Applications
Quick Installation Optimized for Cost-Efficiency
All AIR-520 solutions include SQ ai100 AI SSDs, which leverage Phison's aiDAPTIV+ technology. These SSDs act as an extension of GPU vRAM, enabling the system to fine-tune LLMs with minimal GPU cards. This approach not only eases the budget barrier, but also makes the Edge AI Server more compact compared to traditional large rack-mount servers. Its size is comparable to a desktop PC, and it can be rack-mounted with the appropriate accessories, eliminating concerns about space and maintenance.
In addition to LLM fine-tuning capabilities,
Early samples of the AIR-520 Edge AI Server Solution are available now. For more information, please contact your local sales team or visit our website. https://shorturl.at/WQze2
View original content to download multimedia:https://www.prnewswire.com/news-releases/advantech-launches-edge-ai-server-solutions-for-generative-ai-302162802.html
SOURCE