Three minutes a day to learn about the hot spots in the VR AR industry.
A quick look at today's news
Vision Pro's perspective delay crushes competing products from companies such as Meta and HTC.
OpenAI CEO Ultraman: Vision Pro is the second most impressive technology after the iPhone.
The total investment is 2 billion yuan! The R&D and manufacturing project of Xreal intelligent AR glasses optical display module was settled in Kunshan, Suzhou.
The Quest 3's WDR Mode extends the range of hand tracking by tracking the arm.
The Quest Store and App Lab apps now work with hand tracking and Quest 3 or Quest Pro controllers at the same time.
Two classic games from Google's VR studio, Owlchemy Labs, are coming to Vision Pro
Citr**R is testing the Nintendo 3DS emulator for the Quest in "Super Immersive Mode".
Mozilla Hubs, a metaverse social platform, is shutting down and will be handed over to the community.
The first company in the XR industry, Li Weike Technology, has passed the deep synthesis service algorithm for the record.
Goertek applied for a patent for an image processing method for an all-in-one headset, involving the picture delay of VR products.
Vision Pro's perspective delay crushes competing products from companies such as Meta and HTC.
Recently, a new research report by Finnish testing agency Optofidelity pointed out that mixed reality glasses and headsets are complex devices made up of multiple components that work together to achieve full immersion. Now, one of the biggest challenges for MR devices is transparent latency. With the launch of the Apple Vision Pro, Optofidelity wanted to see how it compares to some of the other MR devices on the market, so it conducted a side-by-side test.
The agency used an Optofidelity Buddy 6 tester with a transparent measurement LED target add-on and tested the HTC Vive XR Elite, Meta Quest 3, Meta Quest Pro, and Vision Pro. The results show that the Apple Vision Pro is the clear winner, with its *** photon-to-photon delay of just 11ms, while both the Meta Quest Pro and Quest 3 are above 35ms.
Optofidelity confirms that Apple claims that they have a breakthrough reduction in perspective latency, which is certain. PatentlyApple argues that Meta CEO Mark Zuckerberg's criticism of Vision Pro shows that Meta is scared, and his comments make the CEO look like a true amateur.
OpenAI CEO Ultraman: Vision Pro is the second most impressive technology after the iPhone.
Recently, OpenAI CEO Sam Altman (Sam Altman) commented on the Vision Pro on social **, calling it "the second most impressive technology since the iPhone".
Altman didn't specify what he thought was the most impressive technology, but it's safe to say that he was referring to artificial intelligence — and perhaps ChatGPT, which OpenAI launched in November 2022. Now, ChatGPT has started to impact the industry and daily life like never before. According to reports, Altman wants to make ChatGPT a "super-intelligent personal assistant" to work.
But even if Ultraman likes ChatGPT, he doesn't necessarily like its name. Under the post praising Vision Pro, one user said that Vision Pro's name was a bit bad, and Ultraman replied, "ChatGPT is much worse. ”
It is reported that Jony Ive, Apple's former head of industrial design, and Tang Tan, a recently hired iPhone executive, are teaming up with the creators of ChatGPT to develop an unnamed product that will have the power of artificial intelligence behind it. Referring to it as an "AI-powered iPhone," Apple Vision Pro could inspire OpenAI's CEO to create something revolutionary in the coming years, according to people familiar with the matter.
The total investment is 2 billion yuan! The R&D and manufacturing project of Xreal intelligent AR glasses optical display module was settled in Kunshan, Suzhou.
On February 19, the R&D and manufacturing project of Xreal smart AR glasses optical display module with a total investment of 2 billion yuan was settled in Kunshan Development Zone, and the press conference of **Air2 Ultra smart AR glasses in China was held simultaneously. Xu Chi, chairman of xreal, and Xiao Bing, co-founder; Zhou Wei, Secretary of the Municipal Party Committee, Chen Liyan, Deputy Secretary of the Municipal Party Committee and Mayor, Xu Minzhong, Qian Xudong, municipal leaders, and representatives of more than 30 important partners of the ecological chain and the first chain attended the event.
It is reported that the Xreal optical display module R&D and manufacturing project is mainly engaged in the R&D and manufacturing of the core optical display module of AR glasses, and will also actively build an industrial innovation ecosystem for coordinated development. After the project is put into production, it is expected to produce 3.5 million sets of AR glasses optical modules annually and achieve annual sales of 10.5 billion yuan.
During the event, xreal officially settled in Kunshan Maigao Industrial Park, started construction immediately after signing the contract, and donated the latest products to Suzhou science education bases such as Kunshan Metaverse Experience Center and Kunshan Jinhui Experimental Primary School. In addition, Xreal has also signed a strategic cooperation agreement with Kunshan Kesen Technology Co., Ltd., which will further help build a completely independent and controllable industrial chain and first-class chain system, attract more high-quality enterprises in the upstream and downstream of the industrial chain to favor Kunshan and take root in Kunshan, and boost the accelerated development and comprehensive momentum of Kunshan's metaverse industry.
The Quest 3's WDR Mode extends the range of hand tracking by tracking the arm.
Recently, it was reported that the new wide dynamic mode of the Quest 3 expands the range of hand tracking. It does this by constantly running internal and external upper body tracking in the background. When one of the user's hands is occluded or out of view of all tracking cameras, WDR mode will estimate the position of the hand based on the rest of the arm.
This feature enables hand tracking to support wide dynamic movements that were previously only possible with controllers, such as throwing, grabbing objects from behind, or Echo VR-style movements. Of course, the movement of the fingers cannot be estimated in this way, so the fingers will remain frozen until the hand re-enters the field of view of the tracking camera, which can be a challenge for game developers to deal with. In addition, WDR mode cannot be used with multi-mode mode.
As with the inside-out body tracking feature that powers it, WDR mode is only available for the Quest 3, although Meta notes that it will also work with all future headsets.
The Quest Store and App Lab apps now work with hand tracking and Quest 3 or Quest Pro controllers at the same time.
According to recent news, the Quest Store and App Lab apps can now use hand tracking and the controller of the Quest 3 or Quest Pro at the same time. Since July, the feature, called Multimodal, has been available as an "experimental" feature in the Meta XR SDK, meaning developers can use it or release it through third-party avenues such as SideQuest, but not on the official Quest Store and App Lab. In the v62 update, it is already fully available to the public.
It is reported that since the launch of hand tracking about four years ago, developers have been able to build quest apps that support both hand tracking and controllers, where users can pick up or drop controllers to switch between the two modes at any time. But there is a delay between switching modes, and, in hand tracking mode, the controller disappears and stops tracking.
However, tracking with a multi-mode controller continues, but more importantly, it enables a mix of hands and controllers. This allows single-controller games like Golf+ and Walkabout Minigolf to track the user's other hand – if the developers of those games implement this feature at all.
Two classic games from Google's VR studio, Owlchemy Labs, are coming to Vision Pro
Recently, Google's VR studio Owlchemy Labs announced that it will bring the chart-topping VR game Job Simulator and its sequel Vacation Simulator to Apple Vision Pro.
Over the years, the studio's groundbreaking "Simulator" series has been quite successful, garnering over 1 million ** on all major VR headsets. Since its launch on HTC Vive in 2016, the studio's successful workplace parody game, Job Simulator, has regularly appeared on the charts of the most popular VR games, and both games offer great VR experiences for beginners as they focus on creating family-friendly experiences that make it easy for anyone to pick up.
Owlchemy Labs says the two games will have free updates to their respective content when they launch on Vision Pro, and those updates will come soon. Both games are reportedly originally designed around VR motion controllers, which are clearly lacking in the $3,500 Vision Pro, so it's safe to assume that the studio has adapted both games to use the headset's hand tracking capabilities.
Citr**R is testing the Nintendo 3DS emulator for the Quest in "Super Immersive Mode".
Citr**R is an open-source 3DS emulator developed by Amanda Watson, creator of Air Link, which allows users to enjoy 3DS games with excellent stereoscopic depth effects on a large, flexible virtual screen by sideloading on Quest devices.
Recently, the Citr**R team is testing an experimental "Super Immersive Mode" that is a continuation of Immersive Mode, which projects the game onto a large 180-degree screen, and Super Immersion Mode, which allows players to learn more about the game and even supports 6DOF.
Now, the Super Immersion mode is experimental and has only been tested in a few games. It should be especially useful for Zelda games, as other games that have been found to work well with the new mode are Super Mario 3D Land and Mario Kart 7.
It is reported that the Super Immersion Mode was developed by Simon Brown aka DrBeif created, and his team has ported shooters like Mjolnir, Half-Life, and Doom to Meta Quest.
Mozilla Hubs, a metaverse social platform, is shutting down and will be handed over to the community.
Recently, after six years of hard work, WebXR social network framework Hubs has lost its largest sponsor, Mozilla, which will close its residency in Hubs on May 31, 2024mozilla.Demo servers in com, subscriptions, and community resources.
It is understood that the WebXR experience with hand tracking is one of the first truly cross-platform worlds that users can access from the Apple Vision Pro and Meta Quest. WebXR as a technology is still in its infancy, but Mozilla Hubs represents a highlight of the concept, with web-based rooms that can meet on different types of devices with little to no setup required. Now, the Mozilla Hubs service, advertised as a "private virtual 3D world in the browser", is being phased out along with the team that maintains it, but the underlying technology lives on as an open-source project on GitHub with community support.
In a blog post explaining Mozilla's shutdown plans, it was noted that the demo server created "115732 custom avatars, 215923 scenes, and hosted a meetup for nearly 10 million attendees." Mozilla said that after the closure ends, Mozilla will not continue to actively develop or maintain hubs and other community resources, but also encourages people with other questions to post on the community Discord, where there is still a lot of support for this work.
The first company in the XR industry, Li Weike Technology, has passed the deep synthesis service algorithm for the record.
A few days ago, the Cyberspace Administration of China (CAC) released the fourth batch of deep synthesis service algorithm filings. A total of 266 algorithms were included in the list this time, involving image generation, ** generation, digital human, intelligent dialogue and other categories, and their application scope covers education, games, e-commerce and other industries. Among them, there are many well-known Internet companies such as Alibaba, NetEase, JD.com, etc.
Among them, Li Weike Technology's self-developed Li Weike large model algorithm has passed the filing, combined with the first three batches of filing and publication information, less than 600 enterprises have passed the filing, and Li Weike Technology is the first enterprise in the XR industry to pass the filing.
According to the filing announcement, it can be seen that at present, the self-developed large model algorithm of Li Weike Technology focuses on the intelligent dialogue scene, combined with the layout of Li Weike Technology to create an AI agent intelligent assistant, and the filing of this self-developed large model means that Li Weike Technology has the qualification to officially open the use of the algorithm to users, which will bring users more convenient and intelligent intelligent assistant services.
Goertek applied for a patent for an image processing method for an all-in-one headset, involving the picture delay of VR products.
Recently, according to the announcement of the State Intellectual Property Office, Goertek*** applied for a patent called "image processing method, device, equipment and medium for all-in-one headset", publication number CN117579802A, and the application date is October 2023.
According to the patent abstract, the present application discloses an image processing method, device, device and medium for an integrated headset, involving the field of headset technology. Wherein, the method comprises: obtaining a notification time, wherein the notification time is located between the start time and the end time of the current frame image data; In the case that the notification time arrives, the notification image processing unit reads a portion of the frame image data in the current frame image data from the cache. When the embodiment of the present application provides an image processing method for an all-in-one headset device is applied to the VR product, the screen display delay of the surrounding environment seen by the user through the VR product will be reduced.
Wen r Xingren.
Give it a thumbs up and go