Nowadays, large models and generative AI are developing rapidly, and the intelligent computing power market is showing a rapid growth trend. With the continuous progress of AI technology, the application scope of large models and generative AI is becoming more and more extensive, such as natural language processing, image recognition, speech recognition and other fields require a large amount of computing resources and efficient algorithm support, so the market prospect of smart chips is very broad. Not long ago, Intel held a new product launch conference in Beijing with the theme of "AI is ubiquitous, Chuangxin is everywhere", and launched Intel Core Ultra and the fifth generation Intel Xeon Scalable processors, enriching Intel's AI product line, while accelerating AI to benefit thousands of industries and opening the era of AI for all.
Zhicong Wang, vice president of Intel's marketing group and general manager of China, said: "AI has gradually entered people's lives, and the era of intelligent, diversified and open AI has arrived. In the future, AI will be deployed in a hybrid manner and flexibly deployed at the cloud edge. The cloud platform will continue to provide the strongest cornerstone for AI training, and AI PCs with stronger computing power will enable everyone to experience the convenience brought by AI. ”
At this press conference, Intel not only shared with ecological partners the successful practice and application value of Xeon Scalable processors in JD Cloud, Intelligent Cloud, Alibaba Cloud and Volcano Engine, but also the Core Ultra processors bring excellent computing and graphics performance and extraordinary AI PC experience to mobile platforms and edge computing, and announced that it will launch more than 230 models with mainstream OEM partners to open a new era of AI PCs. At the same time, Intel also demonstrated the AI functions and offline AIGC applications with 23 domestic ISV software manufacturers, as well as the cooperation of four art academies on AI art, so as to help all kinds of production masters, creators, design creators, etc. through AI functions, give full play to their artistic talents, and fully demonstrate the strong technical strength of Intel AI PC.
aiReduce costs and increase efficiency to help industrial development
5th Gen Intel Xeon Scalable processors deliver performance per watt for critical workloads such as artificial intelligence, scientific computing, networking, storage, databases, security, and more, as well as lower total cost of ownership (TCO). With up to 64 cores,** nearly 3 times the cache of the previous generation, Xeon Scalable processors are AI-accelerated per core to handle demanding end-to-end AI workloads without the need to add separate accelerators, including up to 42% faster inference performance for large language models with up to 20 billion parameters and less than 100 millisecond latency. It delivers higher computing power and faster memory over the same thermal design power (TDP) range than its predecessor. At the same time, it is also compatible with the software and platform of previous generations, making it easy for users to upgrade their equipment, thereby reducing costs and carbon emissions.
"The 5th Gen Intel Xeon Scalable processors are designed to deliver higher performance for customers deploying AI in cloud, network, and edge environments," said Sandra Rivera, executive vice president and general manager of Intel's Data Center and AI Group. "Thanks to our long-standing relationships with our customers, partners, and developer ecosystem, we have delivered 5th Gen Intel Xeon Scalable processors on a proven basis that will enable customers and partners to rapidly adopt and scale at a lower total cost of ownership." In this regard, Intel invited partners such as JD Cloud, Alibaba Cloud, and Volcano Engine to share the application of the fifth-generation Intel Xeon Scalable processor in AI scenarios.
Dong Kexin, Director of Hardware Architecture of JD Technology JD Cloud Business Division, said: "In last month's promotion, JD's peak user access per second increased by 170% year-on-year, and intelligent customer service provided consulting services for more than 1.4 billion users. JD Cloud's virtual anchors bring goods to more than 4,000 brand live broadcast rooms, and the number of people in JD Procurement and Sales Official Live Broadcast Rooms exceeds 3800 million. Behind these dazzling data is inseparable from the support of underlying hardware technology. JD has developed and launched a new generation of JD Cloud servers based on the fifth-generation Intel Xeon Scalable processors, and has achieved performance improvement through technological innovation in heat dissipation and power supply. At the same time, in the inference performance test of the general AI vision model Resnet50, the overall performance of the platform was improved by 38% compared with the previous generation platformIn the general-purpose large language model LLAMA2-13B model inference performance test, compared with the previous generation, the improvement is as high as 51%. JD.com will deepen cooperation with Intel to further promote technological innovation and improve performance for more business scenarios of JD.com. ”
Wang Wei, an Alibaba Cloud executive, said: "With the launch of Intel's fifth-generation Xeon chips, Alibaba Cloud's eighth-generation computing instances have also undergone comprehensive computing upgrades. Intel CPUs' L3 cache and memory bandwidth improvements bring better performance and experience to customers in data computing scenarios. Combined with Alibaba Cloud's CIPU architecture and TDX technology, the 8th generation of instances not only improves the performance of computing, storage, networking, and security, but also ensures data security throughout the AI inference process. In addition, Alibaba Cloud can help users quickly experience the latest Tongyi Qianwen 72 billion parameter model, and users can easily deploy and enjoy the model's inference services on Alibaba Cloud 8th generation instances. ”
Li Yueyuan, head of IaaS product at Volcano Engine, shared with the audience how to achieve a comprehensive upgrade of computing power through in-depth cooperation with Intel. Li Yueyuan pointed out that the arrival of Intel's fifth-generation Xeon Scalable processor "Emerald Rapids", combined with self-developed technology, will improve the basic computing power, memory bandwidth and latency performance, and obtain significant benefits in mainstream applications such as artificial intelligence, processing, j**a applications and scientific computing. In addition, Volcano Engine hopes to better serve customers from all walks of life and help enterprises create greater value through full-stack self-developed and integrated software and hardware design, homologous architecture, unified models, tidal multiplexing of resource pools, and iteration of software and hardware capabilities based on Intel's fifth-generation Xeon Scalable processors.
It is reported that more than 20 hardware partners and 7 cloud service providers in China have prepared new servers and cloud services based on the fifth-generation Intel Xeon Scalable processors, which can meet the diversified needs of domestic end users for types, scales and applications, thereby helping industrial development and prosperous ecological construction.
aiRedefining the PC
Along the way, Intel has driven the PC industry through innovation and brought users a better experience with high performance. Whether it's work, Xi, or play, Intel processors play an important role and become an integral part of people's lives. Now, under the wave of AI, Intel has also brought Core Ultra processors, combined with artificial intelligence technology, to redefine personal computers.
Intel Core Ultra is the first processor built on Intel 4 process technology and represents the biggest evolution of Intel's architecture in 40 years. It uses advanced FoverOS 3D packaging technology, combining cutting-edge intellectual property achievements with advanced process technology to optimize the performance of related modules. The Core Ultra integrates an Intel Arc GPU, has up to 8 XE cores, supports the AI-based supersampling technology XESS and DX12 Ultimate, and delivers up to 2x the graphics performance of its predecessor. In addition, Intel's latest NPUs are designed for AI workloads that run for long periods of time at low power consumption, complementing the AI capabilities of CPUs and GPUs, capable of bringing 25x more energy efficient.
The arrival of Intel Core Ultra will power more than 230 AI PCs from partners such as Acer, Asus, Dell, Dynabook, Gigabyte, HP, Lenovo, LG, Microsoft, MSI and Samsung. Among them, Dell Inspiron 13Pro is supported by Intel Core Ultra processor, not only the battery life is greatly improved, but also through the Bidl-LLM library can optimize and support a variety of large language models, so that it can run up to 16 billion parameters of large language models on an Intel thin and light laptop equipped with 16GB memory, which greatly reduces the threshold for the use of AI, and also makes it easier for Dell Inspiron 13Pro to achieve high-performance AI office.
For the application of Intel Core Ultra chips, Amu, vice president of Lenovo Group and chief strategy officer of China, took the stage to share further. "As a leader in the PC industry, Lenovo has been a strategic partner of Intel for many years. With the advent of the AI era, Lenovo will also be duty-bound to create a new era of AI PCs with you. The first batch of Lenovo AI Ready laptops equipped with Intel Core UITRA processors and equipped with new AI-specific NPO units have been officially launched, including the Lenovo ThinkPad X1 Carbon AI and Lenovo Xiaoxin Pro 16 AI Core Edition. In addition to the embedded hybrid AI computing power, these two new products have made full use of the hybrid computing power of Intel Core UITRA processors to innovate or enhance a lot of AI experience, which is believed to bring users an extraordinary experience. ”
Today, with the flourishing of AI applications, the intelligent computing power of PCs has been redefined. Intel's AI PC Acceleration Program will provide software partners with engineering software and resources to enable AI features for more than 100 million PCs by 2025. Based on the Core Ultra platform, Microsoft demonstrated Studio Effect's "eye contact", "auto-framing" and other featuresBaichuan Intelligent launched 7 large models in eight months;Xuanmi released the digital human solution. It is not difficult to see that the excellent performance of the Core Ultra processor will accelerate the popularization of AI on PCs and lead a new era of AI PCs.
It is worth mentioning that Intel also invited four art schools to share the role and impact of generative AI in the film and television, art creation, and content creation industries. Wang Lei, Dean of the School of Animation and Digital Arts at Communication University of China, said that AI is becoming an unprecedented powerful extension of the artist's brain, eyes and hands, and that AI technology is good at creating a large number of details, making up for the shortcomings of traditional animation that it is difficult to express grand scenesThe "Identity Mirror" created in collaboration with Wu Qiong's team at the Academy of Arts and Design, Tsinghua University, interacts with large language models and AI face fusion technology, leading people to think about the identity relationship between people and their digital selves in the era of artificial intelligenceIn the work "Fake Mirage, Iteration 1, Consciousness Deception", which cooperated with Feng Mengbo, Dean of the School of Experimental Art and Technology of the **Academy of Fine Arts, the computing power of AI PC promotes the reasoning of large language models to realize the artistic expression of the workIn cooperation with Wu Hongliang, dean of the Art Academy of Beijing Fine Art Academy, the computing power of AI PC will be used to reproduce Qi Baishi's artistic style for the creation of essays and sketches, and feel the artistic charm of AI. In addition, the team of Wu Qiong of the Communication University of China, the Academy of Arts and Design of Tsinghua University, and the School of Experimental Art and Technology of the **Academy of Fine Arts also announced the AIGC Joint Practice Center project to be established and launched by Intel and the three art academies to accelerate the cultivation of AIGC artistic talents.
Michelle Johnston Holthaus, executive vice president and general manager of Intel's Client Computing Group, said, "The release of Intel Core Ultra means that Intel is building AI capabilities on the PC at an incredible scale and speed. AI PCs will gradually become mainstream in the next four years, accounting for 80% of the PC market share. By working with our hardware and software ecosystem partners, Intel is transforming the next generation of computing experiences. "With Intel Core Ultra processors, AI will be the next watershed in the PC industry.
According to reports, the scale of intelligent computing power is growing faster than that of general computing power, and it is expected that the average annual compound growth rate of China's intelligent computing power scale will reach 339%, and the average annual compound growth rate of general computing power in the same period was 166%。With the explosion of AI technology, different types of chips play a key role in AI computing, training, and inference. Each chip type has its own unique advantages to meet different application scenarios and needs. The release of Core Ultra and 5th Gen Intel Xeon Scalable processors will provide ubiquitous AI acceleration and solutions where developers need them, contributing to the development of the entire industry.