On February 6, Kunlun Wanwei officially released the new version of the MOE large language model Tiangong 20 With the new version of the Tiangong AI Smart Assistant app, it isIt is the first AI application of 100 billion parameter large language model equipped with MOE architecture and free for all C-end users in China。From now on, users can experience Kunlun Wanwei Tiangong 2 in the mobile phone application market** Tiangong AI intelligent assistant APPExcellent performance of 0 moe large models.
Tiangong 20 is Kunlun Wanwei since the release of the double 100 billion-level large language model Tiangong in April last yearLargest version upgrade, its adoptionThe industry's top MOE experts have a hybrid model architecture that is more capable of dealing with complex tasks, faster model response, more efficient training and inference, and more scalable.
This update comprehensively upgrades the answer quality and response speed of AI search, dialogue, reading, and creation, and is equipped with powerful multi-modal capabilities, supporting multi-modal applications such as ** dialogue, Wensheng diagram, etc., supporting ultra-long context windows (more than 150,000 Chinese characters) up to 100K, and adding AI painting, data analysis, AI companion, AI fortune telling, hot terrier encyclopedia and many other emerging gameplay, making AI smarter, more practical, and more interesting, and becoming an all-round AI assistant in everyone's daily life.
Kunlun Wanwei is committed to the innovation and development of artificial intelligence model algorithms, and constantly explores the frontier of general artificial intelligence technology. In addition to the double 100 billion-level large language model Tiangong and MOE expert hybrid large model Tiangong 20 In addition, Kunlun Wanwei has also launched a series of tens of billions of open source large language models around the Tiangong series of large models, such as Tiangong SKYWORK-13B, AI agent development platform Tiangong SKYAGENTS, multimodal large language model SKYWORK-MM and other cutting-edge AI products, and has gradually built AI business matrices such as AI large models, AI search, AI **, AI story, AI games, etc., which is the strongest model technology and engineering capability in China. One of the most comprehensive artificial intelligence model enterprises.
MOE: The world's top core technology path for large models
MOE (mixture-of-experts) is currentThe underlying architecture of the large language model track is one of the world's leading core technology paths for large models
Since June 2023, Kunlun Wanwei has continued to conduct R&D and exploration on the forefront of MOE architecture technology, and has successfully released itTiangong AI Intelligent Assistant APP, the first AI application with 100 billion parameters equipped with MOE architecture and free for all C-end users in China.
Tiangong AI intelligent assistant to Kunlun Wanwei Tiangong 2The 0 moe large model is the core technology engine, and its technical principle is to disassemble the complex large model task into multiple smaller and more subdivided subtasks, and each subtask is handled by the expert model in the vertical field, so as to make Kunlun Wanwei Tiangong 20 Not onlyIt greatly improves the performance and efficiency of model training and inference, and realizes the knowledge integration of multiple vertical fields, so that the model can better understand and deal with complex problems in different application scenarios, and provide users with more accurate and comprehensive answers.
At the same time, the Kunlun Wanwei technical team has invested a lot of R&D and training resources through a series of targeted MOE technology researchFinally, the core performance problems such as model non-convergence and poor generalization effect of specific tasks that plague the entire MOE industry are solved, making Tiangong 2Model performance of 0 has been significantly improved.
Models are more performant, faster, and more architecturally flexible
Tiangong 20's technological leadership is reflected in the excellent advantages of its core MOE architecture. When data is fed into the gating model router, the system assigns each token to one or more expert models according to the task type, so that each expert model can focus on processing the part of the data, so as to obtain the overall improvement of model performance.
Compared with the traditional large-scale model architecture, Tiangong 20 has the following advantages:
1.Greater ability to cope with complex tasksTiangong 2The 0 moe model integrates a plurality of expert models, each of which can be built for different data distribution and construction modes, thereby significantly improving the professional ability of the large model in various subdivisions0 Significant performance improvement when dealing with complex and multi-modal tasks.
2.Faster and more efficient: Since only a few specific expert models are activated in the inference calculation process of the MOE model, compared with the dense model of the same parameter scale, Tiangong 2The 0 moe model exhibits extremely high sparsity, making it more efficient in inference and computing, so that users can get faster AI response speed.
3.Flexible, diverse, and scalable: On the one hand, the sparsity of the model makes Tiangong 20 can significantly expand the model size without increasing the amount of computation, and obtain stronger model performance with the same computing resources; On the other hand, by increasing the number of expert models and adjusting the weight ratio of expert models, Tiangong 20 can greatly enrich the scalability of the model and build a more flexible, diverse, and scalable model in the new era.
Tiangong AI intelligent assistant APP has been fully upgraded
Tiangong AI intelligent assistant APP is based on Kunlun Wanwei's self-developed Tiangong series of large models, is a search, chat, write, can draw AI intelligent assistant, it has a strong natural language processing and intelligent interaction capabilities, can achieve personalized AI search, intelligent question answering, AI painting, chat interaction, text generation, writing, language translation and other application scenarios, and has a wealth of knowledge reserves.
Accompanied by Tiangong 20 The blockbuster upgrade of the large model, Tiangong AI intelligent assistant has also ushered in a comprehensive update of the version.
1.Powerful multimodal capabilities: The multi-modal large model adopted by Tiangong AI intelligent assistant is based on the integrated development strategy, and is deeply developed and optimized on the basis of the base model, introducing a multi-resolution visual encoder and a powerful language base model, so that it can support input of any size and complex user instructions.
With the support of powerful multi-modal large model capabilities, the new version of Tiangong AI intelligent assistant has excellent visual understanding, reasoning and instruction following capabilities, which can meet a variety of user needs such as dialogue, creation, and knowledge Q&A. At the same time, thanks to the excellent comprehension ability of the model, the images generated by the new version of Tiangong AI intelligent assistant perform well in terms of content richness, fineness, and image quality.
At the same time, with the blessing of powerful multimodal capabilities, Tiangong AI intelligent assistant can also generate the best answer content, allowing users to ask "How to make snail noodles?" "How do you play "Daoxiang" on the guitar? "2024 Spring Festival holiday arrangement? This kind of question can be presented with the help of images, which makes the results of AI answers more intuitive and richer.
2.Supports 100k ultra-long context windows: Tiangong AI intelligent assistant is trained on 100k native text, which can support up to 100k (more than 150,000 Chinese characters) text dialogue, and can support 200k ultra-long document understanding through extended technology. In the InfiniteBench evaluation, the Tiangong series of large models ranked first in the world in many indicators, with an average score of 47 in 10 indicators5 points, more than Claude2, close to GPT4-128K's 526 points.
In the "needle in a haystack" test for the ultra-long context model, the researchers will insert specific information into the massive document set, and then ask questions to the document set, hoping that the model can find the correct key information from the "vast sea of text" to verify the model's ability to extract long and upper and lower information. In the "needle in a haystack" test, the Tiangong model achieved 100% correct results.
3.Search more accurately, write better, read fasterThe new version of Tiangong AI intelligent assistant has more powerful keyword and semantic analysis capabilities, more accurately identifies user task needs, and can provide more accurate and specific answers and follow-up suggestions for different needs of users in different application scenarios such as AI search, dialogue, reading, and creation. At the same time, the new version of Tiangong AI intelligent assistant AI search quality, security capabilities, and answer richness have been further improved.
For example, in Tiangong AI intelligent assistant, users can use the "AI reading" function to quickly refine and summarize the content of the literature, and ask questions about the details of the content of the literature, so as to get fast, accurate and specific answers.
4.Abundant and interesting AI agents: The new version of Tiangong AI Intelligent Assistant has added a variety of official AI agents such as AI painting, data analysis, AI companion, AI fortune telling, hot stalk encyclopedia, etc., so that Tiangong AI intelligent assistant can search, chat, and write, in addition to adding more interesting and practical emerging gameplay, constantly exploring the application boundaries of AIGC technology, and becoming an indispensable all-round AI assistant in everyone's daily life.
Starting from February 8th, the "Year of the Dragon" AI Painting Contest hosted by Kunlun Wanwei will also be launched in the Tiangong AI Smart Assistant app, where users can use the "AI Painting" function in the app to draw drawings and submit them to the event area, and they will have the opportunity to win a cash prize of up to 100,000 yuan.
This is the first AI painting competition in China that is free and open to all C-end users and has a prize scale of hundreds of thousands. Thanks to the excellent multi-modal technical capabilities of the Tiangong series of large models, the high-level text intent recognition ensures that users can unleash their creativity and draw personalized AIGC images with rich content, exquisite details and advanced aesthetics.
For a long time, Kunlun Wanwei has always adhered to the company mission of "realizing general artificial intelligence, allowing everyone to better shape and express themselves", constantly lowering the application and learning threshold of large model technology in all walks of life, and working together to explore the unknown world and create the future of science and technology.