Methods, systems, and computer-readable media for rendering light probes in a virtual environment are disclosed. Noisy lighting data is accessed in a data structure associated with a light probe in a set of light probes in an environment. The noisy lighting data is provided as an input to a neural network. The neural network is trained to output an estimate of non-noisy lighting data based on the input. The noisy lighting data is replaced in the data structure with the estimated non-noisy lighting data.
A method of smoothly transitioning between input devices with respect to a virtual reality environment is disclosed. A probable user input action is determined based on input data from a plurality of input devices. A best device is selected from the plurality of input devices based on a quality of a signal of the best device relative to qualities of signals of other devices of the plurality of input devices. Based on a determination that the selected best device is not the same as a previously selected best device from the plurality of devices, a transition between the previously selected device and the best selected device is determined and the transition is used to drive the probable user input action based on input data from the selected best device and input data from the previously selected best device.
A method of determining an authenticity of a normal map is disclosed. An input candidate normal map is received. A reconstructed candidate normal map is generated based on a performance of a mathematical differentiation on an integration of the input candidate normal map. A reconstruction error is determined based on a comparison of the input candidate normal map to the reconstructed candidate normal map. An authenticity of the input candidate normal map is determined based on the reconstruction error being within a configurable threshold.
A63F 13/69 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
G06T 11/60 - Editing figures and textCombining figures or text
A method of digital content generation is disclosed. A description of a smart volumetric layout is accessed. The smart volumetric layout includes an arrangement of one or more smart volumetric shapes. Smart shape data is associated to a volumetric shape of the one or more volumetric shapes. The smart shape data includes one or more properties and one or more behaviors. A presence of one or more digital objects is detected in the smart volumetric shape. One or more properties and the one or more behaviors associated with the smart volumetric shape are applied to the one or more digital objects.
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
G06F 30/12 - Geometric CAD characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
G06F 111/18 - Details relating to CAD techniques using virtual or augmented reality
5.
METHOD AND SYSTEM FOR LEARNED MORPHOLOGY-AWARE INVERSE KINEMATICS
A method of estimating a pose for a custom character is disclosed. A skeleton corresponding to a user-supplied character is received or access. Features of the skeleton of the user-supplied character are computed. A set of betas and a scale value that correspond to a skinned multi-person linear (SMPL) model of the user-supplied skeleton are computed. The pose of the skeleton of the custom character is estimated using the SMPL model.
G06T 7/70 - Determining position or orientation of objects or cameras
G06V 10/44 - Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersectionsConnectivity analysis, e.g. of connected components
6.
SYSTEM AND METHOD FOR INTERACTIVE ASYNCHRONOUS TILE-BASED TERRAIN GENERATION
An interactive tile-based ML terrain generation method is disclosed. At a first phase of a painting of a digital environment using a brush tool, a modification to a terrain surface of the digital environment is approximated. The approximating includes decomposing a stroke of the brush tool into one or more stamps. Each of the one or more stamps changes a height of a portion of terrain surface as the brush tool passes over the portion of the terrain surface. At a second phase of the painting of the digital environment, details are added to the portion of the terrain surface passed over by each of the one or more stamps. The adding of the details includes dividing work associated with the adding of the details into one or more tiles and processing the one or more tiles.
A method of rendering a scene in a three-dimensional environment using a plurality of metaframes is disclosed. Data from digital objects within a three-dimensional (3D) environment is loaded. Motion for the digital objects is determined. The determining of the motion includes applying simulation or physics logic to the data. A plurality of metaframes is generated based on a plurality of scene graphs captured at a plurality of points in time. Each of the metaframes includes data describing position, scale, or rotation of the digital objects within the 3D environment at a point in time of the plurality of points of time. The plurality of metaframes is organized into a queue of metaframes. The plurality of metaframes is distributed to one or more rendering nodes in response to dequeuing of the metaframes from the queue by the one or more rendering nodes.
A method of smoothly transitioning between input devices with respect to a virtual reality environment is disclosed. A probable user input action is determined based on input data from a plurality of input devices. A best device is selected from the plurality of input devices based on a quality of a signal of the best device relative to qualities of signals of other devices of the plurality of input devices. Based on a determination that the selected best device is not the same as a previously selected best device from the plurality of devices, a transition between the previously selected device and the best selected device is determined and the transition is used to drive the probable user input action based on input data from the selected best device and input data from the previously selected best device.
A method of performing multicast broadcasting of a plurality of streams corresponding to an event is disclosed. The plurality of data streams corresponding to the event are received. Each of the plurality of streams has a different type or format. A multicast timecode is determined based on a synchronization time for each of a plurality of buffers associated with the plurality of streams. A new data stream is generated. The new data stream includes the plurality of data streams and the multicast timecode.
A method of performing multicast broadcasting of a pluralityof streams corresponding to an event is disclosed. Theplurality of data streams corresponding to the event are received. Each of the plurality of streams has a different type or format. A multicast timecode is determined based on a synchronization time for each of a plurality of buffers associated with the plurality of streams. A new data stream is generated. The new data stream includes the plurality of data streams and the multicast timecode.
H04L 65/611 - Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
H04N 21/2368 - Multiplexing of audio and video streams
H04N 21/262 - Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission or generating play-lists
11.
Systems and methods for rendering a virtual environment using light probes
Methods, systems, and computer-readable media for rendering light probes in a virtual environment are disclosed. Noisy lighting data is accessed in a data structure associated with a light probe in a set of light probes in an environment. The noisy lighting data is provided as an input to a neural network. The neural network is trained to output an estimate of non-noisy lighting data based on the input. The noisy lighting data is replaced in the data structure with the estimated non-noisy lighting data.
A system and a method of volumetric data processing include receiving volumetric data corresponding to a digital asset, the digital asset including a plurality of frames; creating a file to represent the volumetric data in a flat file format, the flat file format representing the plurality of frames arranged in a plurality of buffers in the file, each of the plurality of buffers being assigned with a fixed number of frames; and providing the file to a client device for a rendering of the digital asset.
A system and a method of volumetric data processing include receiving volumetric data corresponding to a digital asset, the digital asset including a plurality of frames; creating a file to represent the volumetric data in a flat file format, the flat file format representing the plurality of frames arranged in a plurality of buffers in the file, each of the plurality of buffers being assigned with a fixed number of frames; and providing the file to a client device for a rendering of the digital asset.
G06T 1/20 - Processor architecturesProcessor configuration, e.g. pipelining
H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
A method of determining an authenticity of a normal map is disclosed. An input candidate normal map is received. A reconstructed candidate normal map is generated based on a performance of a mathematical differentiation on an integration of the input candidate normal map. A reconstruction error is determined based on a comparison of the input candidate normal map to the reconstructed candidate normal map. An authenticity of the input candidate normal map is determined based on the reconstruction error being within a configurable threshold.
A63F 13/69 - Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
G06T 11/60 - Editing figures and textCombining figures or text
A method of digital content generation is disclosed. A description of a smart volumetric layout is accessed. The smart volumetric layout includes an arrangement of one or more smart volumetric shapes. Smart shape data is associated to a volumetric shape of the one or more volumetric shapes. The smart shape data includes one or more properties and one or more behaviors. A presence of one or more digital objects is detected in the smart volumetric shape. One or more properties and the one or more behaviors associated with the smart volumetric shape are applied to the one or more digital objects.
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06F 30/12 - Geometric CAD characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
G06F 111/18 - Details relating to CAD techniques using virtual or augmented reality
a streaming manager arranged for receiving the predicted sets of subregions, for deriving from the predicted sets a working set of subregions to be used for rendering and for outputting, based on the working set of subregions, steering instructions concerning the set of subregions to be actually used.
A method of generating a target display within an environment is disclosed. Data is gathered and analyzed data from one or more environmental sensors to determine a target distance from a point within the system to a target display area within the environment. A distance between a projector and a concave mirror is modified to adjust a distance of a focal plane from the point within the system in order to match the determined target distance. The focal plane is associated with the target display.
G02B 30/52 - Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels the 3D volume being constructed from a stack or sequence of 2D planes, e.g. depth sampling systems
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
18.
Automatic translation of user interface elements from wireframe tools to production augmented reality framework
Systems and methods for generating an extended reality (XR) user interface are disclosed. A two-dimensional data set is imported. The two-dimensional data set defines a two-dimensional user interface design layout. The two-dimensional data set includes a transition data set corresponding to a user interface element included in the design layout. The two-dimensional data set is converted into a three-dimensional data set. The three-dimensional data set defines a three-dimensional user interface design layout corresponding to the two-dimensional design layout. The converting includes identifying three-dimensional art for each of a plurality of phases corresponding to the transition data set. An XR representation of the three-dimensional data set is provided for editing using an editing application associated with one or more XR devices. Based on the editing, the three-dimensional data set is exported as one or more files that are compatible with an XR development environment.
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
G06T 19/00 - Manipulating 3D models or images for computer graphics
A63F 13/533 - Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
G06F 9/451 - Execution arrangements for user interfaces
The present invention relates to a prediction system for determining a set of subregions to be used for rendering a virtual world of a computer graphics application, said subregions belonging to streamable objects to be used for rendering said virtual world, said streamable objects each comprising a plurality of subregions. The prediction system comprises
a plurality of predictor units arranged for receiving from a computer graphics application information on the virtual world and each arranged for obtaining a predicted set of subregions for rendering a virtual world using streamable objects, each predicted set being obtained by applying a different prediction scheme,
a streaming manager arranged for receiving the predicted sets of subregions, for deriving from the predicted sets a working set of subregions to be used for rendering and for outputting, based on the working set of subregions, steering instructions concerning the set of subregions to be actually used.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer game software both downloadable and recorded on computer media; Computer hardware; Computer hardware and computer software programs both downloadable and recorded on computer media for the integration of text, audio, graphics, still images and moving pictures into an interactive delivery for multimedia applications; Computer software, namely, software development tools both downloadable and recorded on computer media for the creation of mobile internet applications and client interfaces; Gesture recognition software, both downloadable and recorded on computer media; Graphical user interface software, both downloadable and recorded on computer media; Software development kits (SDK), both downloadable and recorded on computer media; Downloadable web site development software; Computer software for controlling the operation of audio and video devices, both downloadable and recorded on computer media Computer hardware development; Computer programming services for creating augmented reality videos and games; Computer software development; Computer software development in the field of mobile applications; Design and development of computer game software and virtual reality software; Design and development of computer hardware; Design and development of computer software; Design and development of multimedia products; Design and development of on-line computer software systems; Development of computer hardware for computer games; Video game development services; Video game programming development services; Website design and development for others; Advisory services in the field of product development and quality improvement of software; Consultancy in the design and development of computer hardware; Design and development of software solutions for others, as well as artificial intelligence, machine learning, and blockchain technologies; Development of software architectures for others using databases, data warehouses, and data lakes
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer software development tools for the creation of 3-dimensional models for use in virtual reality and augmented reality applications; Computer software for use as online retail platforms using 3-dimensional models; Computer hardware and software sold as a unit for use in generating 3-dimensional models for use in virtual reality and augmented reality applications; Three dimensional (3D) scanners; Three dimensional (3D) camera systems; Computer software for the delivery of 3-dimensional models for use in virtual reality, augmented reality, and online retail applications Design and development of software for the creation of 3-dimensional models for use in virtual reality and augmented reality applications; Design and development of software used to deliver 3-dimensional content for use in virtual reality, augmented reality, and online retail applications; Customized software development in the field of online retail using 3-dimensional models; Software development in the field of online retail using 3-dimensional models; Design, development, and implementation of software for virtual reality and augmented reality applications; Computer graphics design services for the creation of 3-dimensional content for use in virtual reality, augmented reality, and online retail applications
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
(1) Computer software used for inserting and editing audio, video, text, graphics, multimedia files and still images into virtual reality platforms; Computer software for setting up, operating, configuring, and controlling wearable computer hardware and wearable computer peripherals, namely, wearable computers; Computer software for the creation of applications for mobile devices and the creation of client interfaces for mobile devices; Gesture recognition software; Computer software used in creating and designing user interfaces; Computer software for running development programs and application programs in a common development environment; Computer software for controlling the operation of video cameras. (1) Providing services for inserting and editing audio, video, text, graphics, multimedia files and still images into virtual reality platforms; Providing augmented reality services by enabling the creation, editing and use of holograms using online, non-downloadable operating system software for computer hardware and computer peripherals; software as a service (SaaS) featuring computer programs for running development programs and application programs in a common development environment; Design and development of computer software; Design and development of multimedia products, namely, websites, videos, software, virtual reality platforms and augmented reality platforms
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer game software; Computer hardware; Computer hardware and computer software programs for the integration of text, audio, graphics, still images and moving pictures into an interactive delivery for multimedia applications; Computer software, namely, software development tools for the creation of mobile internet applications and client interfaces; Gesture recognition software; Graphical user interface software; Software development kits (SDK); Web site development software; Computer software for controlling the operation of audio and video devices; Computer hardware and computer software for implementing virtual reality, augmented reality, and mixed reality environments; Artificial intelligence software for replying to questions from online retail store customers related to consumer goods Computer hardware development; Computer programming services for creating augmented reality videos and games; Computer software development; Computer software development in the field of mobile applications; Design and development of computer software and hardware for games, virtual reality, augmented reality, and mixed reality; Design and development of computer hardware; Design and development of computer software; Design and development of multimedia products; Design and development of on-line computer software systems; Development of computer hardware for computer games; Website design and development for others; Advisory services in the field of product development and quality improvement of software; Consultancy in the design and development of computer hardware; Consultancy in the design and development of computer hardware; Computer hardware and software development for implementing and managing devices in the internet of things (IoT); Design and development of blockchain software; Design and development of electronic robotics; Advanced product research in the field of artificial intelligence
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer software for virtual reality visualization, manipulation, immersion and integration of audio, video, text, binary, still images, graphics and multimedia files; computer software, namely, software for setting up, operating, configuring, and controlling wearable computer hardware and wearable computer peripherals; Computer software, namely, software development tools for the creation of mobile internet applications and client interfaces; Gesture recognition software; Graphical user interface software; Software development kits (SDK); Computer software for controlling the operation of audio and video devices Providing online, non-downloadable software for virtual reality visualization, manipulation, immersion and integration of audio, video, text, binary, still images, graphics and multimedia files; providing online, non-downloadable operating system software for computer hardware and computer peripherals; software as a service (SaaS) services featuring software programs for running development programs and application programs in a common development environment; Design and development of computer software; Design and development of multimedia products
A prediction system for determining a set of subregions can be used for rendering a virtual world of a computer graphics application. The subregions belong to streamable objects to be used for rendering the virtual world. The streamable objects each comprise a plurality of subregions. The prediction system comprises a plurality of predictor units arranged for receiving from a computer graphics application information on the virtual world and each arranged for obtaining a predicted set of subregions for rendering a virtual world using streamable objects. Each predicted set can be obtained by applying a different prediction scheme. A streaming manager is arranged for receiving the predicted sets of subregions, for deriving from the predicted sets a working set of subregions to be used for rendering and for outputting, based on the working set of subregions, steering instructions concerning the set of subregions to be actually used.
09 - Scientific and electric apparatus and instruments
41 - Education, entertainment, sporting and cultural services
42 - Scientific, technological and industrial services, research and design
Goods & Services
(1) Camera containing a linear image sensor; computer games; computer hardware; computer software for creating computer games; computer software for creating video games; computer software for digital animation and special effects of images; computer video games; computer video games downloaded via the internet; downloadable video games; interactive multimedia computer games; motion sensors; optical sensors; proximity sensors; software for creating virtual reality games; trackball input devices; video games; virtual reality games (1) Providing video studios
(2) Online video gaming services; production of video games
(3) Cloud computing video hosting web sites; computer programming consultancy; computer programming of video games; computer software consultancy; computer website design; consultancy in the design and development of computer hardware; consultancy in the field of software design; consultancy in the field of webpage design; design and development of computer game software and virtual reality software; design and development of computer hardware; design and development of computer hardware and software; design and development of computer software; development of computer games; development of computer hardware for computer games; web site design consultancy; website design; website development for others
