Here is Microsoft's "MESH"- AR-VR tech in Holoportation- Here's Everything You Need to Know
A few weeks ago, CEO Satya Nadella and Alex Kipman of Microsoft Ignite unveiled Mesh, the mixed reality application that uses the Azure platform in the business to create joint interactions with Holo Lens 2 and other devices for remote participants at the Redmond, Wash.-based Technical Fellow.
Years of Microsoft research into hand and eye-tracking, HoloLens creation, and artificial intelligence have finally paid off in the form of Microsoft Mesh, the much-anticipated mixed reality marvel. This new mixed reality platform, driven by Azure, will enable diverse teams to have group meetings, virtual design sessions, and meet-ups regardless of their geographical location. People will be able to express themselves as avatars and participate in these interactive environments at first, according to the company's claims. In the future, the company hopes to implement holoportation, which will enable users to project their lifelike, photorealistic selves onto a screen. Suddenly, the world of ‘Tommorowland' is no longer so tomorrow.
Here's what Microsoft technical fellow Alex Kipman has to say about the technology:
“This has been the dream for mixed reality, the idea from the very beginning. You can actually feel like you’re in the same place with someone sharing content or you can teleport from different mixed reality devices and be present with people even when you’re not physically together.”
On Tuesday, the company demonstrated the technology's unique capabilities at Microsoft's Ignite Digital Conference. The virtual presence of Guy Laliberte, Co-founder of Cirque du Soleil, who appeared using holoportation, a live demonstration of 3D capture technology that can project a lifelike picture into a virtual scene, added to the conference's intrigue. The audience got a true taste of the future that was being realized in the present thanks to the shared holographic environment produced by the company's very first keynote experience, which was exclusively curated for mixed reality. Along with filmmaker and ocean explorer Alex Kipman, James Cameron and John Hanke, CEO, and founder of Niantic shared the virtual dais, demonstrating the Microsoft mesh experience in the physical and virtual worlds.
As rays of light that simulated his physical body, Kipman was on the virtual stage as a completely realized holoportation of himself, narrating the show's opening experience in real-time.
Users can hold collaborative meetings, virtual design workshops, assist others, learn together, and host virtual social meetups using Mesh. People will be able to express themselves as avatars in these shared virtual environments at first, but will eventually be able to use holoportation to project themselves as their most lifelike, photorealistic self, according to the company.
Characteristics
Microsoft Mesh is based on the Azure cloud computing framework from Microsoft. As a result, it taps into Azure's enterprise-grade security and privacy, as well as its vast array of computing resources, data, AI, and mixed reality services. According to Kipman, the company is putting a premium on Azure, its intelligent cloud. The only requirement is the special glasses, as the quality of the collaborative interactions is stored in the cloud. Collaborations and discussions around the world can be updated with added comfort and ease, opening up a wide variety of possibilities, thanks to Microsoft Mesh's applications. Engineers working on 3D physical models will appear as themselves and collaborate on the model no matter where they are. Medical students studying human anatomy may congregate in a virtual space around a 3D model and perform in-depth research. Training and meetings will be made more manageable.
The platform will be upgraded in the coming months with a complete suite of AI-powered software and holoportation for mixed reality solutions. Because of the platform's open standards, developers will be able to operate on a variety of devices, including laptops, PCs, smartphones, VR headsets, and even the HoloLens 2.
Two applications based on Microsoft Mesh were also announced at the Ignite conference. The Microsoft Mesh software for HoloLens is now available for download and allows team members to collaborate. Mesh-enabled Altspace VR, on the other hand, will allow businesses to hold virtual reality meetings and gatherings with enterprise-grade protection. These apps are said to be the forerunners of a wide variety of apps that the company will make available in the future. According to Kipman, virtual reality will inevitably prove to be the "next big platform for interactive computing."
We learn of virtual reality advancements. However, holoportation—a 3D capture technology that beams a lifelike image of a human into a virtual scene—is the latest wave catching attention. In a recent keynote, Microsoft demonstrated a mixed reality experience to the audience. The show could be experienced as avatars watching events unfold in a shared holographic environment by people attending the conference from their living rooms and home offices all over the world.
According to Microsoft's blog, it was made possible by the company's new mixed-reality platform, Mesh, which is driven by Azure and enables people in various physical locations to enter interactively and shared holographic interactions on a variety of devices.
In a nutshell, Microsoft Mesh has a wide variety of applications. With the platform, solutions that were previously dismissed as impractical or time-consuming will find new life.
Mesh would be a game-changer in the following scenarios
Consider a factory floor that is still being built: engineers will walk through a holographic model of it in 3D to inspect the machinery.
Students studying electric car engines or human anatomy could form avatars and gather around a holographic model, removing sections of the engine or peeling back muscles to see what's underneath.
OceanXplorer is one of the most advanced deep-sea exploration vessels ever constructed, with scientists on board to learn from new data gathered by instruments and cameras on its deep-sea vehicles on a regular basis. It's used to learn more about coral reefs, brine pools, deep hydrothermal vents, and minerals in the vicinity of underwater volcanoes, among other things.
OceanX announced a new partnership with Microsoft at Ignite to build a Mesh-enabled "holographic laboratory" on the ship where scientists could meet in person or remotely from laboratories and offices around the world to see 3D holograms of the areas the vehicles are exploring.
“The idea is to put all of this incredible science data we're gathering into a holographic environment and use it to direct scientific missions in real-time,” said Vincent Pieribone, OceanX's vice chairman.
The aim of this research is to allow a researcher, using a Microsoft Mesh computer, with HoloLens 2 or any other compatible device to appear around a table as an avatar and to point out that they may have a query and discuss what they see with other scientists in real-time.
Can Microsoft Mesh shift the way we collaborate?
Microsoft Mesh, a mixed-reality platform, will allow users to enter and share the same virtual experience no matter where they are in the world.
The framework was unveiled earlier this month at the company's Ignite interactive conference.
As augmented reality places virtual objects in front of you, mixed reality allows you to connect with what you see while keeping the assets rooted in reality.
The system is accessible through a variety of devices, including the Microsoft Hololens 2, virtual reality headsets, computers, and even smartphones.
Play the Holodeck now
Cirque du Soleil co-founder, Guy Laliberté, appeared with holoportation, using 3D capture technologies to transmit a person's image into a virtual scene. To show the strength and possibilities. In the first main experience of the business, which was completely built for mixed reality, participants from living rooms and home offices around the world could experience the show as the avatars watch events take place in a common holographic world.
Kipman was himself a completely realized holoportation of himself on the Ignite virtual level, narrating the opening experience of the show in real-time as light rays simulated his physical body. Founding CEO and founder of the Niantic company Augmented Reality James Cameron and John Hanke have joined Kipman remotely to demonstrate how Mesh could be used when opened to the public for shared experiences.
The new platform is a result of years of research and development in areas such as hand- and eye monitoring and the development of HoloLens in the production of enduring holograms and models of artificial intelligence, which can produce expressive avatars, according to Microsoft. Built on Azure, it will also feature the security and privacy features and computing power, information technology, AI, and mixed reality services of Azure.
Microsoft also offered previews for HoloLens' Microsoft Mesh app provides remote collaboration with team members and is available for download, and users can also ask for access to the new version of AltspaceVR, which enables companies to hold virtual reality conferences and meetings with corporate security features, including safe sign-ins, session management functions.
The problem is that, aside from the evidence at Ignite, Mesh is little understood and it will probably be months before potential users can have any kind of insights. However, the mixed reality space can really shake the virtual meetings and even teams up. It's an important play.
Own Words Mesh of Microsoft
The idea behind Mesh and how it can use the concept at the following Twitter Spaces meeting hosted by NextReality was discussed by Greg Sullivan, Microsoft's director of mixed reality. He said a sense of presence is one of the key capabilities of Mesh. This allows users to feel like they are hundreds or thousands of miles away from the actual venue.
They began with the avatar framework AltspaceVR and took it to Azure. AltspaceVR has been founded in 2013 and is the creation of the first virtual social network. The company was purchased by Microsoft in 2017 and is now part of the Cloud and AI group Mixed Reality division.
Sullivan clarified that they should be able to participate to some extent in Mesh no matter what platform a user is on. Mesh renders every software an interactive, collaborative application for a mixed reality by connecting it to the Mesh SDK and applying this to an app. This app will run on HoloLens, run on Oculus, or be in Mixed Reality with Windows.
The AR, VR, and mixed reality Booming market
AR and VR in the digital workplace are still early but this is an increasingly growing segment.
Research and Markets forecasted two years ago that by 2023 the global mixed-reality market would hit $2.8 billion. A recent study by UK online stock analyst BuyShares showed that growth would be higher than anticipated over the next couple of years.
Combined, it is anticipated that the global AR, VR, and MR market will continue to expand and reach $124.4 billion by 2023, a rise of 305 percent within two years.
AR apps have come a long way from Snapchat and Pokemon go, according to the report: 'AR technologies have been used in various industries, ranging from mobile apps designed for the individual user to the more advanced visualization software used by companies to analyze big data analysis. The increasingly sophisticated computer and 5G networking made the technology much more viable, enabling consumers to reveal a new generation of AR applications."
The market valuation will be around $58.7 billion by the end of next year, as the use of AR, VR, and MR technologies are projected to rise further in subsequent years. By 2025, a market valuation of nearly $300 billion is anticipated.
Other studies from Kettering, Thrive Analytics, and ARtillate Intelligence from Ohio sponsored this study. 29 percent of customers have used mobile increased reality according to their study. More significantly, it is used frequently: 59% of mobile AR users participate at least once a week and at least 78% a month. This is an example of the potential of mobile AR, as successful usage is an important factor in the performance of the mobile app and is linked to income.
Though games are in the top mobile AR app category, social AR apps and features like Pokemon Go and Snapchat AR are the driving force. In the near future, both categories will continue to lead mobile IR, but others will appear as part of an e-commerce shopping experience, such as the visualization of items in one region.
The Thrive Analytics management partner Jason Peaslee said in a statement that
“AR and VR are still in early adoption phases, There are still technical challenges, but we think AR and VR have the ability to transform the way people work, connect and learn. We’re excited about the prospects and committed to measuring them.”
Mesh as a teacher and cooperation facilitator
So, is Mesh the forum for AR, VR, and MR to get to work? Doug Stephen, president of the Enterprise Learning Division of a New York City-based business, learning, and outsourcing company (CGS), says Mesh release confirms the increasing adoption in the workplace of AR and MR in mixed realities.
AR/MR is the solution to "Zoom Fatigue," a lack of commitment due to a high rate of video calls. Learning and growth are one particular field in which the implementation of AR/MR instruments is optimistic.
Stephen said-
“There is a growing understanding that not all employees can be taught solely through virtual team meetings or video calls, business leaders striving to create more meaningful, deeper connections for their employees will implement these AR/MR technologies, such as Microsoft Mesh, to provide an on-the-job training experience while staff continues to work remotely."
Companies would need a well-considered plan for implementing Mesh in everyday workflows whether collaboration, learning, and growth, or analysis. Otherwise, it will be yet another promising bid without an application in real life.
Utilizing new technologies
Bingo is one of the classic games which is primarily useful for the latest technologies. Bingo has adopted new modes of play, thanks to its large number of online games and mobile phone applications. Traditionally, the group aspect has always been one of the largest elements in playing bingo in a hall. It's a social event as well as a game for people as a night out with friends and family.
Today the idea that Microsoft Mesh seeks for online bingo in many ways is already adopted. On a laptop, whether it's a smartphone, tablet, or PC, you can play bingo, which means that your position is no longer limited. You can still play the same game others play, it doesn't matter how you get there.
BNBS-based Sue Dawson says,
"The online bingo industry must be innovated in order to provide players with access to the entire community chat bingo experience on mobile devices. It seemed unlikely a few years ago, but now 80% of players use their phones to play. Mixed reality seems like a really good way to make the community feel much more like a bingo hall."
Take a look at other societies using new technology
Bingo is not the only game that uses modern technologies to help its users. Developers have begun to look at casino games like poker and blackjack to try to regenerate the casino games experience among a crowd.
In the past 20 years, video games and players have really taken up technological advances in order to create new experiences. In recent years, LAN parties helped to build communities by playing their favorite games together. LAN parties were their way. If players began using Xbox Live services, the gaming communities migrated online and the voice chat incentive kept fellow gamers up and down.
Will the next move in this tour for gamers be Microsoft Mesh? Xbox Series X, the new console in Microsoft, does not support VR but it is still rumored.
Are new technology people embracing?
The broader issue we now have is how people use technology like Virtual Reality and whether this is actually an investment worthwhile for designing and developing games. Research shows that this training technique is being used by the general public and has increased significantly over the last few years. What is in the future for Microsoft and customers around the globe is fascinating?
To help their work, Newsmusk allows writers to use primary sources. White papers, government data, initial reporting, and interviews with industry experts are only a few examples. Where relevant, we also cite original research from other respected publishers.
Source- BBC, DQIndia, CSMWire, Techstory, Techspective
