Systems and Methods for Video/Audio Comprehension and Automated Clipping includes providing at least one media clip (MC) within an event for display or listening on a user device including receiving audio or video media data indicative of the event, transcribing the media data into timestamped text, identifying entities within the text, creating text segments having a begin timestamp and end timestamp and having a minimum number of entity mentions in the text segments, clipping from the media data the at least one media clip having a begin timestamp and end timestamp corresponding to the begin timestamp and end timestamp of a corresponding one of the text segments, and providing the at least one media clip to the user device for viewing or listening by a user. Feedback may also be provided to adjust the logic that identifies MCs. MC Alerts may also be sent to users autonomously or based on user-set parameters.
In some embodiments, a system receives usage data for content delivered by multiple content delivery network (CDN) entities during a last time interval. This usage data is based on delivering the content from servicing first requests. The system calculates ideal distribution weights from this usage data to allocate second requests to the CDN entities in a next time interval. It also calculates effective distribution weights from the usage data to allocate the second requests, where these effective weights are further based on a current network condition. A selection parameter is then generated based on correcting the effective distribution weights to be closer to the ideal distribution weights for the next time interval. The system outputs this selection parameter and uses it to select a particular CDN entity for a second request. This selection is performed according to a distribution for the next time interval that is closer to the ideal distribution than it is to the effective distribution.
A themed aerial vehicle entertainment system or platform useful for generating crowd-pleasing shows or displays through the use of dynamically-coordinated show systems. Instead of use of a fixed flight plan, the new entertainment platform is configured to include one or more UAVs that is enclosed within or supports thematic cladding such as the outer shell of a spacecraft or flying character, and the show is dynamically coordinated to present a cohesive performance. Onboard show effects provided by onboard or UAV supported show system components such as high brightness lights are dynamically adjusted in the new system/platform to ensure the best show appearance to the audience while providing safer operations. The dynamic adjustments may involve selecting or generating a second script or “B show” in a contingent manner based on the current location or timing of movement of the UAV along a flight plan.
G08G 5/55 - Navigation or guidance aids for a single aircraft
B64D 47/02 - Arrangements or adaptations of signal or lighting devices
B64U 101/24 - UAVs specially adapted for particular uses or applications for use as communications relays, e.g. high altitude platforms for use as flying displays, e.g. advertising or billboards
G05D 1/00 - Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
G05D 1/692 - Coordinated control of the position or course of two or more vehicles involving a plurality of disparate vehicles
G05D 1/695 - Coordinated control of the position or course of two or more vehicles for maintaining a fixed relative position of the vehicles, e.g. for convoy travelling or formation flight
G08G 5/56 - Navigation or guidance aids for two or more aircraft
G08G 5/57 - Navigation or guidance aids for unmanned aircraft
4.
Image-Space UV Map-Based Tracking of Image Regions in Video
A system includes a hardware processor and a memory storing software code. The hardware processor executes the software code to receive a sequence of images each including a depiction of the same object, and for each image of the sequence of images: extract visual features of the object depicted in the image and process the visual features to predict an image-space UV map of the object. The hardware processor further executes the software code to receive a masking input identifying a portion of the object to be overlaid by a mask, and mask, using the masking input and the image-space UV map predicted for each image, a respective portion of each image of the sequence of images corresponding to the identified portion to produce a masked sequence of images.
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06V 10/26 - Segmentation of patterns in the image fieldCutting or merging of image elements to establish the pattern region, e.g. clustering-based techniquesDetection of occlusion
G06V 10/54 - Extraction of image or video features relating to texture
G06V 10/77 - Processing image or video features in feature spacesArrangements for image or video recognition or understanding using pattern recognition or machine learning using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]Blind source separation
5.
ARTIFACT PROCESSING IN VIDEO USING TEXTURE INFORMATION
Beijing YoJaJa Software Technology Development Co., Ltd. (China)
Inventor
Huangfu, Xuchang
Xue, Yuanyi
Zhang, Wenhao
Zhang, Yang
Liu, Chen
Meng, Xuewei
Abstract
In some embodiments, a method receives an image to analyze for artifacts. Texture information that characterizes texture in the image is determined. The method merges the texture information with the image. The texture information is used to focus an analysis of artifacts more in a first region of the image and focus less in a second region of the image. The method outputs a score based on the processing of the image that assesses the artifacts in the image.
G06V 10/98 - Detection or correction of errors, e.g. by rescanning the pattern or by human interventionEvaluation of the quality of the acquired patterns
G06V 10/22 - Image preprocessing by selection of a specific region containing or referencing a patternLocating or processing of specific regions to guide the detection or recognition
G06V 10/26 - Segmentation of patterns in the image fieldCutting or merging of image elements to establish the pattern region, e.g. clustering-based techniquesDetection of occlusion
G06V 10/36 - Applying a local operator, i.e. means to operate on image points situated in the vicinity of a given pointNon-linear local filtering operations, e.g. median filtering
G06V 10/54 - Extraction of image or video features relating to texture
G06V 10/74 - Image or video pattern matchingProximity measures in feature spaces
G06V 10/764 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
6.
UNIFIED VIDEO QUALITY SCORE ASSESSMENT USING FUZZY LOGIC
Beijing YoJaJa Software Technology Development Co., Ltd. (China)
Inventor
Chen, Si
Zhang, Wenhao
Dai, Tongyu
Howe, Thomas
Brookins, Nicholas
Abstract
In some embodiments, a method receives a plurality of metric values for quality of service based on delivering content in a content delivery system. Respective metric values into a fuzzy value in a plurality of possible fuzzy values where a plurality of fuzzy values is determined. The method determines a plurality of fuzzy rules where a fuzzy rule is associated with a fuzzy value. Respective conditions for fuzzy rules are applied to the plurality of fuzzy values to determine fuzzy rules that have conditions met. A fuzzy rule applies when respective conditions for the fuzzy rule are met by one or more fuzzy values in the plurality of fuzzy values. A fuzzy output is determined from fuzzy values that are associated with the fuzzy rules that have conditions met. A unified quality score is calculated from the fuzzy output. The method outputs the unified quality score.
H04N 21/24 - Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth or upstream requests
G06N 7/02 - Computing arrangements based on specific mathematical models using fuzzy logic
H04N 21/25 - Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication or learning user preferences for recommending movies
7.
METHOD OF PREDICTING WATER ENVIRONMENTAL CONDITIONS
A method of predicting a localized climate condition includes: receiving, by a processing element, regional environmental data; translating, by the processing element by utilizing a water environment machine learning model, the regional environmental data into the localized climate condition; and generating, by the processing element, an alert based to the localized climate condition.
ETH Zürich (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH) (Switzerland)
Inventor
Azevedo, Roberto Gerson De Albuquerque
Schroers, Christopher Richard
Labrozzi, Scott
Saethre, Jens Eirik
Xue, Yuanyi
Abstract
There is provides a neural network-based video decoding method including receiving a latent feature corresponding to a compressed version of a first video frame of a first plurality of a plurality of video frames included in a video content, the latent feature being a combination of a weighted frame-specific embedding of the first video frame with weighted one or more group-of-pictures (GOP) features of the first plurality of the plurality of video frames, wherein the weighted frame-specific embedding is a product of applying a first weight to a frame-specific embedding and the weighted one or more GOP features are products of applying a second weight to the one or more GOP features, wherein the first weight and the second weight are selected as levers for content-specific fine-tuning. The method also including decoding the latent feature to provide an uncompressed video frame corresponding to the first video frame
H04N 19/189 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
H04N 19/136 - Incoming video signal characteristics or properties
H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
H04N 19/177 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
9.
Low Bit Rate Video Compression With Generative Video Models
ETH Zürich (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH) (Switzerland)
Inventor
Emmenegger, Andre
Relic, Lucas
Azevedo, Roberto Gerson De Albuquerque
Zhang, Yang
Schroers, Christopher Richard
Abstract
A system includes a video decoder, and a video encoder including a processor configured to execute video compression software code to partition video frames into video keyframes and video inter-frames, encode the video keyframes to generate encoded video keyframes, process, using an optical flow model, the video inter-frames to produce forward flows from the video inter-frames to a first video keyframe and backward flows from the video inter-frames to a second video keyframe, generate, using the forward and backward flows, bidirectional flow maps corresponding respectively to the video inter-frames, encode the bidirectional flow maps to provide video decoding metadata, and generate a bitstream including the encoded video keyframes and the video decoding metadata. The video decoder receives the bitstream and produces reconstructed video frames corresponding to the video frames including the video keyframes and the video inter-frames using a generative video model.
H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
10.
AUTONOMOUS HUMAN-ROBOT INTERACTION VIA DIFFUSION-BASED OPERATOR IMITATION
A method of training a diffusion model to enable autonomous interaction between a robotic device and a human includes receiving an operator command for the robotic device and pose data including a history of poses. The method includes applying noise to the operator command and encoding the noisy operator command, pose data, and history of operator commands into input tokens. The method includes inputting the tokens into a transformer encoder of the diffusion model and training the model to perform denoising to generate an autonomous command from the noisy operator command based on the pose data and command history. The method includes generating the autonomous command based on the transformer encoder output and executing the command to cause the robotic device to perform an action during autonomous interaction with the human.
There is provides a system including a hardware processor, and a memory storing instructions that, when executed by the hardware processor, cause the hardware processor to receive operational data corresponding to operation of an apparatus, the operational data including a plurality of timestamps each corresponding to an operating state of the apparatus, obtain, based on the operational data, a software design model of the apparatus, the software design model defining a plurality of internal operating states of the apparatus, determine, using the operational data and the software design model, an operational status of the apparatus at a selected one of the plurality of timestamps or a selected apparatus event, identify, from the software design model, a portion of the software design model corresponding to the determined operational status, and generate output data indicating the determined operational status of the apparatus and the identified portion of the software design model.
A method of training a diffusion model to enable autonomous interaction between a robotic device and a human includes receiving an operator command for the robotic device and pose data including a history of poses. The method includes applying noise to the operator command and encoding the noisy operator command, pose data, and history of operator commands into input tokens. The method includes inputting the tokens into a transformer encoder of the diffusion model and training the model to perform denoising to generate an autonomous command from the noisy operator command based on the pose data and command history. The method includes generating the autonomous command based on the transformer encoder output and executing the command to cause the robotic device to perform an action during autonomous interaction with the human.
The present invention sets forth a technique for performing automated generation of descriptive metadata, the computer-implemented method comprising receiving one or more taxonomies associated with a media content ontology domain, a description of the one or more taxonomies, and one or more hierarchical relationships associated with the one or more taxonomies. The method also includes generating an ontology based on the one or more descriptions and the one or more hierarchical relationships and generating a prompt that includes a representation of the ontology, contextual information associated with a media content item, and a textual instruction to a machine learning model. The method further includes generating, via the machine learning model and based at least on the prompt, one or more descriptive metadata tags associated with the media content item.
G06F 16/36 - Creation of semantic tools, e.g. ontology or thesauri
G06F 16/383 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
14.
MEASUREMENT OF PROSODY SIMILARITY USING A PROSODY ENCODER
In some embodiments, a method inputs a first speech sample into a prosody encoder, wherein the prosody encoder is trained as part of a text-to-speech model. A second speech sample is input into the prosody encoder. The prosody encoder generates a first representation of the first speech sample and a second representation of the second speech sample. The method compares the first representation and the second representation to determine a metric value and determines an action to perform based on the metric value.
G10L 13/10 - Prosody rules derived from textStress or intonation
G10L 25/30 - Speech or voice analysis techniques not restricted to a single one of groups characterised by the analysis technique using neural networks
G10L 25/51 - Speech or voice analysis techniques not restricted to a single one of groups specially adapted for particular use for comparison or discrimination
15.
OPPORTUNISTIC PROJECTION ONTO DYNAMIC LIGHT REFLECTIVE MATERIAL
A system (100) may include a camera (112) configured to capture an image of a light reflective material (102) in an area (118), and a controller (116) configured to detect, based on the captured image, a dynamic characteristic of the light reflective material (102), and determine, based on the detected dynamic characteristic, content (110) to be projected onto the light reflective material (102). The system may include a light source (122) configured to emit nonvisible light (124) in the area (118) and a projector (130) configured to project content (110) onto a dynamic light reflective material (102) in the area (118). The system (100) may include a sensor (120) configured to detect a characteristic of the light reflective material (102) based on a reflection of the nonvisible light (124) off the dynamic light reflective material (102). The controller (116) may be configured to modify the content (110) based on a change to the detected characteristic of the light reflective material (102).
G09F 19/18 - Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
A63J 5/02 - Arrangements for making stage effectsAuxiliary stage appliances
41 - Education, entertainment, sporting and cultural services
Goods & Services
Education; providing of training; entertainment; sporting and cultural activities; development, creation, production, and distribution of digital multimedia and audio and visual content, namely, motion picture films, television programs, and multimedia entertainment and educational content; development, creation, production, distribution, and rental of audio and visual recordings; production of entertainment shows and interactive programs for distribution via audio and visual media, and electronic means; production and provision of entertainment news and entertainment information via electronic communication networks; providing online computer games, websites and applications featuring a wide variety of general interest entertainment information relating to motion picture films, television programs, musical videos, film clips, photographs, and other multimedia materials; entertainment services, namely, providing online and subscription games; online games; amusement park and theme park services; educational and entertainment services rendered in or relating to theme parks, namely, live stage shows, live amusement park shows, live performances by costumed characters, and production and presentation of live theatrical performances; production and presentation of live shows; theater productions; entertainer services, namely, live appearances by a professional entertainer.
41 - Education, entertainment, sporting and cultural services
Goods & Services
Entertainment services in the nature of a television series in the field of drama, comedy, and live action; Providing entertainment information via a website; Providing online non-downloadable videos in the field of graphic art, photography, artwork and text; Providing online non-downloadable images of graphic art, photography, artwork and text; Provision of non-downloadable films and television programmes via a video-on-demand service; Providing online non-downloadable visual and audio recordings featuring drama, comedy, and live action
Methods and systems for a high-resolution virtual vehicle presence sensor are discussed herein. For example, the virtual sensor system may include a plurality of sensors analyzing a known path and configured to determine path-based vehicle data corresponding to a path-based vehicle, wherein each sensor of the plurality of sensors is positionally independent of each other sensor in the plurality of sensors. The virtual sensor system may further include a processing element configured to receive the path-based vehicle data from the plurality of sensors, calculate infilling kinematic data of the path-based vehicle at positions between the plurality of sensors based on the path-based vehicle data and known path information corresponding to the known path, and generate a visualization of the infilling kinematic data, the path-based vehicle data, and the known path information. The virtual sensor system may further include a display configured to display the visualization.
A system includes a processor and a memory storing software code and a trained machine learning (ML) model. The software code is executed to receive global sensor data generated by sensors used to monitor a plurality of apparatuses and, for a first apparatus, extract from the global sensor data, data generated by a first subset of sensors associated with the first apparatus. The software code is further executed to identify, using the global sensor data, other data generated within a respective predetermined time interval of the expected timing of at least one of the first subset of sensors, process the data and the other data to provide performance data for the first apparatus, predict, using the trained ML model and the performance data, whether the first apparatus is operating anomalously, and output, when the first apparatus is operating anomalously, a notification including a visual representation of the performance data.
Embodiments provide for improved machine learning. A request for supplemental content to be provided in association with a media content item is received, and a set of candidate supplemental content items for the request is determined. A user embedding corresponding to a user embedding corresponding to a user associated with the media content item, a media embedding corresponding to the media content item, and a set of supplemental content embeddings corresponding to the set of candidate supplemental content items are accessed from one or more storage repositories. A set of interaction scores is generated based on processing the user embedding, the media embedding, and the set of supplemental content embeddings using an interaction machine learning model. A first supplemental content item of the set of candidate supplemental content items is selected for the request based on the set of interaction scores.
A system includes a hardware processor and a memory storing software code and a user preferences database including at least one of an aversion of a first user or a preference of the first user. The hardware processor is configured to execute the software code to receive, from an attraction providing a user experience, data describing a characteristic of the user experience, compare, using the data and the user preferences database, the characteristic of the user experience with the aversion and/or the preference of the first user, and determine, based on comparing, that the characteristic of the user experience corresponds to the aversion and/or the preference of the first user. The hardware processor is further configured to execute the software code to alert the first user in response to determining that the characteristic corresponds to the aversion and/or the preference of the first user.
G08B 7/06 - Signalling systems according to more than one of groups Personal calling systems according to more than one of groups using electric transmission
H04W 4/021 - Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
27.
OPPORTUNISTIC PROJECTION ONTO DYNAMIC LIGHT REFLECTIVE MATERIAL
A system may include a camera configured to capture an image of a light reflective material in an area, and a controller configured to detect, based on the captured image, a dynamic characteristic of the light reflective material, and determine, based on the detected dynamic characteristic, content to be projected onto the light reflective material. The system may include a light source configured to emit nonvisible light in the area and a projector configured to project content onto a dynamic light reflective material in the area. The system may include a sensor configured to detect a characteristic of the light reflective material based on a reflection of the nonvisible light off the dynamic light reflective material. The controller may be configured to modify the content based on a change to the detected characteristic of the light reflective material.
H04N 13/32 - Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sourcesImage reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using moving apertures or moving light sources
G02F 1/167 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulatingNon-linear optics for the control of the intensity, phase, polarisation or colour based on translational movement of particles in a fluid under the influence of an applied field characterised by the electro-optical or magneto-optical effect by electrophoresis
H04N 13/122 - Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
H04N 13/139 - Format conversion, e.g. of frame-rate or size
H04N 13/351 - Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
41 - Education, entertainment, sporting and cultural services
Goods & Services
Education; Providing of training; Entertainment; Sporting and cultural activities; development, creation, production, and distribution of digital multimedia and audio and visual content, namely, motion picture films, television programs and multimedia entertainment and educational content; development, creation, production, distribution, and rental of audio and visual recordings; production of entertainment shows and interactive programs for distribution via audio and visual media, and electronic means; production and provision of entertainment news and entertainment information via electronic communication networks; providing online computer games, websites and applications featuring a wide variety of general interest entertainment information relating to motion picture films, television programs, musical videos, film clips, photographs, and other multimedia materials; entertainment services, namely, providing online and subscription games; online games; amusement park and theme park services; educational and entertainment services rendered in or relating to theme parks, namely, live stage shows, live amusement park shows, live performances by costumed characters, and production and presentation of live theatrical performances; production and presentation of live shows; theater productions; entertainer services, namely, live appearances by a professional entertainer.
41 - Education, entertainment, sporting and cultural services
Goods & Services
Education; Providing of training; Entertainment; Sporting and cultural activities; development, creation, production, and distribution of digital multimedia and audio and visual content, namely, motion picture films, television programs and multimedia entertainment and educational content; development, creation, production, distribution, and rental of audio and visual recordings; production of entertainment shows and interactive programs for distribution via audio and visual media, and electronic means; production and provision of entertainment news and entertainment information via electronic communication networks; providing online computer games, websites and applications featuring a wide variety of general interest entertainment information relating to motion picture films, television programs, musical videos, film clips, photographs, and other multimedia materials; entertainment services, namely, providing online and subscription games; online games; amusement park and theme park services; educational and entertainment services rendered in or relating to theme parks, namely, live stage shows, live amusement park shows, live performances by costumed characters, and production and presentation of live theatrical performances; production and presentation of live shows; theater productions; entertainer services, namely, live appearances by a professional entertainer.
09 - Scientific and electric apparatus and instruments
Goods & Services
Apparatus for recording, transmission, processing and reproduction of sound, images or data; Digital media, namely, pre-recorded video cassettes, digital video discs, digital versatile discs, downloadable audio and video recordings, DVDs, and high definition digital discs featuring live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Digital media, namely, pre-recorded DVDs, downloadable audio and video recordings, and CDs featuring and promoting live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Downloadable fiction books on a variety of topics; Downloadable non-fiction books on a variety of topics; Non-fiction audio books on a variety of topics; Visual and audio recordings featuring live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Downloadable podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Musical recordings; Pre-recorded vinyl records featuring music, stories, children's programming, dramatic performances, and non-dramatic performances; Downloadable electronic publications in the nature of books, comics, and illustrations in the field of fiction and non-fiction; Downloadable series of children's books; Downloadable e-books in the field of fiction and non-fiction; Downloadable computer game software; Downloadable mobile applications for viewing, playing, and purchasing animated entertainment and electronic games; Downloadable video game software; Downloadable computer software for the administration of learning activities for children; Computer hardware and computer peripheral devices; Mouse pads; Cameras; Digital cameras; Blank recordable optical disc; DVD recording apparatus; Compact disc recorders; Audio speakers; Digital photo frames; Headphones; Earphones; Ear buds; Walkie-talkies; Telephones; Headsets for cellular or mobile phones; Cell phone cases; Screen protectors for cellular phones; Protective covers for cell phones; Protective covers and cases for cell phones; Binoculars; Decorative magnets; Microphones; Protective covers and cases for tablet computers; Radio frequency identification tag readers; Radio-frequency identification (RFID) tags; Radio-frequency transmitters; Smart watches; Fitted plastic films known as skins for covering and protecting electronic apparatus, namely, mobile phones, portable music players, mobile computers, and tablet computers; Karaoke machines; Bicycle helmets; Flotation vests; Protective helmets for sports; Snorkels; Swimming goggles; Swim masks; Downloadable game software
41 - Education, entertainment, sporting and cultural services
Goods & Services
Distribution of motion picture films; Distribution of television programs for others; Production and distribution of television shows and movies; Entertainment services in the nature of production of motion pictures, television shows, and multimedia entertainment content; Entertainment services, namely, an ongoing multimedia program featuring action, adventure, animated content, comedy, drama, live-action, music, and news distributed via various platforms across multiple forms of transmission media; Rental of motion picture films; Provision of non-downloadable films and television programmes via a video-on-demand service; Provision of non-downloadable films and movies via a video-on-demand service; Providing films, not downloadable, via video-on-demand transmission services; Providing television programs, not downloadable, via video-on-demand transmission services; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, music, live-action, and news; Providing online computer games; Providing online non-downloadable e-books in the field of fiction and non-fiction; Providing entertainment information via a website; Providing entertainment information in the fields of motion picture films, television programs, musical videos, film clips, history, technology, artwork, and photographs via a website; Providing online non-downloadable videos in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable images of graphic art, photography, artwork and text; Providing online non-downloadable audio recordings in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable comic books and graphic novels; Entertainment services, namely, providing podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Amusement park and theme park services; Entertainment in the nature of theater productions; Entertainment services in the nature of an amusement park show; Entertainment services, namely, live appearances by a celebrity, musician, athlete, actor, or costumed character; Theatrical shows provided at performance venues; Providing education in the field of entertainment and music rendered through live theater performances; Presentation of live show performances; Entertainment, namely, production of plays, musicals, and theater productions; Theatre productions
41 - Education, entertainment, sporting and cultural services
Goods & Services
Distribution of motion picture films; Distribution of television programs for others; Production and distribution of television shows and movies; Entertainment services in the nature of production of motion pictures, television shows, and multimedia entertainment content; Entertainment services, namely, an ongoing multimedia program featuring action, adventure, animated content, comedy, drama, live-action, music, and news distributed via various platforms across multiple forms of transmission media; Rental of motion picture films; Provision of non-downloadable films and television programmes via a video-on-demand service; Provision of non-downloadable films and movies via a video-on-demand service; Providing films, not downloadable, via video-on-demand transmission services; Providing television programs, not downloadable, via video-on-demand transmission services; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, music, live-action, and news; Providing online computer games; Providing online non-downloadable e-books in the field of fiction and non-fiction; Providing entertainment information via a website; Providing entertainment information in the fields of motion picture films, television programs, musical videos, film clips, history, technology, artwork, and photographs via a website; Providing online non-downloadable videos in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable images of graphic art, photography, artwork and text; Providing online non-downloadable audio recordings in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable comic books and graphic novels; Entertainment services, namely, providing podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Amusement park and theme park services; Entertainment in the nature of theater productions; Entertainment services in the nature of an amusement park show; Entertainment services, namely, live appearances by a celebrity, musician, athlete, actor, or costumed character; Theatrical shows provided at performance venues; Providing education in the field of entertainment and music rendered through live theater performances; Presentation of live show performances; Entertainment, namely, production of plays, musicals, and theater productions; Theatre productions
Children's multiple activity toys; Collectable toy figures; Disc toss toys; Electric action toys; Infant toys; Inflatable toys; Musical toys; Plush toys; Squeeze toys; Talking toys; Toy action figures and accessories therefor; Toy boats; Sand toys; Toy building blocks; Toy mobiles; Toy vehicles; Toy scooters; Toy figures; Toy imitation cosmetics; Toy banks; Toy watches; Toy weapons; Toy building structures and toy vehicle tracks; Mechanical toys; Toy trains and parts and accessories therefor; Toy aircraft; Role playing toys in the nature of play sets for children to imitate real life occupations; Role playing games; Fantasy character toys; Basketballs; Baseball bats; Baseballs; Beach balls; Footballs; Golf balls; Golf gloves; Golf ball markers; Jump ropes; Roller skates; Skateboards; Soccer balls; Table tennis balls; Table tennis paddles; Table tennis rackets; Tennis balls; Tennis rackets; Volley balls; Action skill games; Board games; Card games; Jigsaw puzzles; Manipulative games; Parlor games; Party games; Playing cards; Target games; Action figures; Bean bags; Dolls; Doll clothing; Doll accessories; Playsets for dolls; Bobblehead dolls; Bubble making wand and solution sets; Puppets; Kites; Magic tricks; Marbles; Rubber balls; Play balls; Yo-yos; Teddy bears; Balloons; Christmas stockings; Christmas tree ornaments; Christmas tree decorations, except lights, candles, and confectionery; Crib mobiles; Equipment sold as a unit for playing card games; Hand-held units for playing electronic games for use with external display screen or monitor; Hand held units for playing electronic games other than those adapted for use with an external display screen or monitor; Party favors in the nature of small toys; Paper party favors; Paper party hats; Snow globes; Fitted plastic films known as skins for covering and protecting electronic game playing apparatus, namely, video game consoles and hand-held video game units; Video game machines for use with televisions; Toy for pets
41 - Education, entertainment, sporting and cultural services
Goods & Services
Distribution of motion picture films; Distribution of television programs for others; Production and distribution of television shows and movies; Entertainment services in the nature of production of motion pictures, television shows, and multimedia entertainment content; Entertainment services, namely, an ongoing multimedia program featuring action, adventure, animated content, comedy, drama, live-action, music, and news distributed via various platforms across multiple forms of transmission media; Rental of motion picture films; Provision of non-downloadable films and television programmes via a video-on-demand service; Provision of non-downloadable films and movies via a video-on-demand service; Providing films, not downloadable, via video-on-demand transmission services; Providing television programs, not downloadable, via video-on-demand transmission services; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, music, live-action, and news; Providing online computer games; Providing online non-downloadable e-books in the field of fiction and non-fiction; Providing entertainment information via a website; Providing entertainment information in the fields of motion picture films, television programs, musical videos, film clips, history, technology, artwork, and photographs via a website; Providing online non-downloadable videos in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable images of graphic art, photography, artwork and text; Providing online non-downloadable audio recordings in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable comic books and graphic novels; Entertainment services, namely, providing podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Amusement park and theme park services; Entertainment in the nature of theater productions; Entertainment services in the nature of an amusement park show; Entertainment services, namely, live appearances by a celebrity, musician, athlete, actor, or costumed character; Theatrical shows provided at performance venues; Providing education in the field of entertainment and music rendered through live theater performances; Presentation of live show performances; Entertainment, namely, production of plays, musicals, and theater productions; Theatre productions
Children's multiple activity toys; Collectable toy figures; Disc toss toys; Electric action toys; Infant toys; Inflatable toys; Musical toys; Plush toys; Squeeze toys; Talking toys; Toy action figures and accessories therefor; Toy boats; Sand toys; Toy building blocks; Toy mobiles; Toy vehicles; Toy scooters; Toy figures; Toy imitation cosmetics; Toy banks; Toy watches; Toy weapons; Toy building structures and toy vehicle tracks; Mechanical toys; Toy trains and parts and accessories therefor; Toy aircraft; Role playing toys in the nature of play sets for children to imitate real life occupations; Role playing games; Fantasy character toys; Basketballs; Baseball bats; Baseballs; Beach balls; Footballs; Golf balls; Golf gloves; Golf ball markers; Jump ropes; Roller skates; Skateboards; Soccer balls; Table tennis balls; Table tennis paddles; Table tennis rackets; Tennis balls; Tennis rackets; Volley balls; Action skill games; Board games; Card games; Jigsaw puzzles; Manipulative games; Parlor games; Party games; Playing cards; Target games; Action figures; Bean bags; Dolls; Doll clothing; Doll accessories; Playsets for dolls; Bobblehead dolls; Bubble making wand and solution sets; Puppets; Kites; Magic tricks; Marbles; Rubber balls; Play balls; Yo-yos; Teddy bears; Balloons; Christmas stockings; Christmas tree ornaments; Christmas tree decorations, except lights, candles, and confectionery; Crib mobiles; Equipment sold as a unit for playing card games; Hand-held units for playing electronic games for use with external display screen or monitor; Hand held units for playing electronic games other than those adapted for use with an external display screen or monitor; Party favors in the nature of small toys; Paper party favors; Paper party hats; Snow globes; Fitted plastic films known as skins for covering and protecting electronic game playing apparatus, namely, video game consoles and hand-held video game units; Video game machines for use with televisions; Toy for pets
09 - Scientific and electric apparatus and instruments
Goods & Services
Apparatus for recording, transmission, processing and reproduction of sound, images or data; Digital media, namely, pre-recorded video cassettes, digital video discs, digital versatile discs, downloadable audio and video recordings, DVDs, and high definition digital discs featuring live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Digital media, namely, pre-recorded DVDs, downloadable audio and video recordings, and CDs featuring and promoting live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Downloadable fiction books on a variety of topics; Downloadable non-fiction books on a variety of topics; Non-fiction audio books on a variety of topics; Visual and audio recordings featuring live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Downloadable podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Musical recordings; Pre-recorded vinyl records featuring music, stories, children's programming, dramatic performances, and non-dramatic performances; Downloadable electronic publications in the nature of books, comics, and illustrations in the field of fiction and non-fiction; Downloadable series of children's books; Downloadable e-books in the field of fiction and non-fiction; Downloadable computer game software; Downloadable mobile applications for viewing, playing, and purchasing electronic games and animated entertainment; Downloadable video game software; Downloadable computer software for the administration of learning activities for children; Computer hardware and computer peripheral devices; Mouse pads; Cameras; Digital cameras; Blank recordable optical disc; DVD recording apparatus; Compact disc recorders; Audio speakers; Digital photo frames; Headphones; Earphones; Ear buds; Walkie-talkies; Telephones; Headsets for cellular or mobile phones; Cell phone cases; Screen protectors for cellular phones; Protective covers for cell phones; Protective covers and cases for cell phones; Binoculars; Decorative magnets; Microphones; Protective covers and cases for tablet computers; Radio frequency identification tag readers; Radio-frequency identification (RFID) tags; Radio-frequency transmitters; Smart watches; Fitted plastic films known as skins for covering and protecting electronic apparatus, namely, mobile phones, portable music players, mobile computers, and tablet computers; Karaoke machines; Bicycle helmets; Flotation vests; Protective helmets for sports; Snorkels; Swimming goggles; Swim masks; Downloadable game software
An attraction may include a track section extending at a track angle along a guest travel direction, and one or more set elements positioned adjacent the track section, the set elements at a non-perpendicular angle to the guest travel direction to create an illusion of elevation change different than the track angle. The track section may define a first vanishing point from a guest perspective. The set elements may define a second vanishing point from the guest perspective, the second vanishing point different than the first vanishing point. The second vanishing point may be above or below the first vanishing point. The first vanishing point may be on a horizon line, and the second vanishing point may be below the horizon line to create an illusion of gaining elevation along the track section. The attraction may include a ride vehicle configured to carry the guest along the track section.
Systems, methods and apparatuses for a hybrid approach to perform dynamic projection mapping onto robots in real-time are discussed herein. For example, a robotic system includes a projection surface coupled to a robotic structure and configured to be moved by the robotic structure. The robotic system includes a tracking mechanism comprising at least one of a first tracking mechanism positioned internal to the robotic structure and configured to generate intrinsic tracking data or a second tracking mechanism positioned external to the robotic structure and configured to generate extrinsic tracking data. The robotic system includes a controller in communication with the tracking mechanism. The robotic system includes a projector having a field of view aligned with the projection surface and configured to project content onto the projection surface, wherein the controller modifies the projected content based on data generated by the tracking mechanism.
A method of predicting a localized climate condition includes: receiving, by a processing element, regional environmental data; translating, by the processing element by utilizing a water environment machine learning model, the regional environmental data into the localized climate condition; and generating, by the processing element, an alert based to the localized climate condition.
An attraction may include a track section extending at a track angle along a guest travel direction, and one or more set elements positioned adjacent the track section, the set elements at a non-perpendicular angle to the guest travel direction to create an illusion of elevation change different than the track angle. The track section may define a first vanishing point from a guest perspective. The set elements may define a second vanishing point from the guest perspective, the second vanishing point different than the first vanishing point. The second vanishing point may be above or below the first vanishing point. The first vanishing point may be on a horizon line, and the second vanishing point may be below the horizon line to create an illusion of gaining elevation along the track section. The attraction may include a ride vehicle configured to carry the guest along the track section.
Systems and methods to provide personalized audio streaming and rendering include receiving a cinematic audio track for selected content and a maximum accessible audio track for the content, and adjustably combining the cinematic audio track and accessible audio track to provide an improved dialogue audio track which allows a user/listener to hear the dialogue over an environmental noise floor, the combining being provided by a cross-fade renderer adjusted manually by the user/listener or automatically adjusted based on a measured noise floor, and optionally providing a personalized equalizer for hearing impairments. It also allows a content provider to create the maximum accessible audio track for a given content separate from the user/listener, which may also use a X-Fade renderer to verify quality of the accessible audio track.
An animatronic may include a shell, a skin coupled to the shell, and an actuator configured to selectively create a deformation of the skin, wherein the deformation is configured to complement content projected onto the skin. The skin may cover the shell. The actuator may be mechanically coupled to the skin. The actuator may move the skin to change a topography of the skin to mimic a facial expression. The skin may define a continuous projection surface. A projector may project content onto the projection surface.
Systems, methods and apparatuses for a hybrid approach to perform dynamic projection mapping onto robotic figures in real-time are discussed herein. For example, a robotic system may include a continuous projection surface coupled to a structure. The robotic system may further include an actuator coupled to the structure that is configured to change a topography of a portion of the continuous projection surface. The robotic system may further include a projector positioned relative to the continuous projection surface that is configured to project content onto the continuous projection surface. In some cases, the robotic system may align a projection surface with a projector, wherein the projection surface defines a continuous projection screen over the robotic structure, actuate a mechanical movement of the projection surface to change a topographical shape of the projection surface, and project a content specific to the change of the topographical shape.
A system includes a hardware processor and a memory storing software code and a trained machine learning (ML) model. The hardware processor is configured to execute the software code to receive data describing an operation by an apparatus, generate, using the data, a first visual representation of the operation, and predict, using the trained ML model and the first visual representation, whether an operating state of the apparatus during the operation is anomalous. When predicting identifies an anomalous operating state by the apparatus, the hardware processor is further configured to execute the software code to obtain a second visual representation of an expected operation by the apparatus during a normal operating state of the apparatus, perform a comparison of the first visual representation with the second visual representation, and output an alert including a result of the comparison of the first visual representation with the second visual representation.
An animatronic may include a shell, a skin coupled to the shell, and an actuator configured to selectively create a deformation of the skin, wherein the deformation is configured to complement content projected onto the skin. The skin may cover the shell. The actuator may be mechanically coupled to the skin. The actuator may move the skin to change a topography of the skin to mimic a facial expression. The skin may define a continuous projection surface. A projector may project content onto the projection surface.
Systems, methods and apparatuses for a hybrid approach to perform dynamic projection mapping onto robotic figures in real-time are discussed herein. For example, a robotic system may include a continuous projection surface coupled to a structure. The robotic system may further include an actuator coupled to the structure that is configured to change a topography of a portion of the continuous projection surface. The robotic system may further include a projector positioned relative to the continuous projection surface that is configured to project content onto the continuous projection surface. In some cases, the robotic system may align a projection surface with a projector, wherein the projection surface defines a continuous projection screen over the robotic structure, actuate a mechanical movement of the projection surface to change a topographical shape of the projection surface, and project a content specific to the change of the topographical shape.
Systems, methods and apparatuses for a hybrid approach to perform dynamic projection mapping onto robots in real-time are discussed herein. For example, a robotic system includes a projection surface coupled to a robotic structure and configured to be moved by the robotic structure. The robotic system includes a tracking mechanism comprising at least one of a first tracking mechanism positioned internal to the robotic structure and configured to generate intrinsic tracking data or a second tracking mechanism positioned external to the robotic structure and configured to generate extrinsic tracking data. The robotic system includes a controller in communication with the tracking mechanism. The robotic system includes a projector having a field of view aligned with the projection surface and configured to project content onto the projection surface, wherein the controller modifies the projected content based on data generated by the tracking mechanism.
A system includes an animatronic skin having one or more embedded markers configured to provide a light signature, a camera configured to detect the light signature, a projector configured to project content onto the animatronic skin, and a controller configured to determine positions of the markers based on the light signature and modify the projected content based on the positions of the markers. A light source may generate an invisible light, and the light signature may be produced or resulting from the invisible light interacting with the markers. The light signature may be the result of UV or IR pigment of the markers. The markers may be defined by LEDs or fiber optics. To manufacture the skin, the markers may be defined within a mold, and a material may be poured within the mold, wherein the material defines the skin when cured with the markers embedded therein.
The present invention sets forth techniques for aligning a performance plan to an execution of a scripted performance. The techniques include receiving a performance plan, wherein the performance plan includes one or more documents associated with a scripted performance, and identifying, via a first machine learning model and based on the one or more documents, one or more segments included in the scripted performance. The techniques also include predicting, via a second machine learning model, a current segment of the one or more segments based at least on one or more observation signals associated with an execution of the scripted performance, and initiating the execution of one or more automated actions based on the predicted current segment.
ETH Zürich (Eidgenössische Technische Hochschule Zürich) (Swaziland)
Inventor
Guay, Martin
Agrawal, Dhruv
Borer, Dominik Tobias
Buhmann, Jakob Joachim
Sumner, Robert Walker
Abstract
One embodiment of the present invention sets forth a technique for generating a pose for a virtual character. The technique includes determining a set of joint representations corresponding to a set of joints in the virtual character based on (i) a base pose for the virtual character and (ii) a set of constraints associated with one or more joints included in the set of joints. The technique also includes generating, via execution of a first neural network, a set of updated joint states for the set of joints based on the set of joint representations. The technique further includes generating, based on the set of updated joint states, an output pose that includes (i) a first set of joint positions for the set of joints and (ii) a first set of joint orientations for the set of joints.
41 - Education, entertainment, sporting and cultural services
Goods & Services
Distribution of motion picture films; Distribution of television programs for others; Production and distribution of television shows and movies; Entertainment services in the nature of production of motion pictures, television shows, and multimedia entertainment content; Entertainment services, namely, an ongoing multimedia program featuring action, adventure, animated content, comedy, drama, live-action, music, and news distributed via various platforms across multiple forms of transmission media; Rental of motion picture films; Provision of non-downloadable films and television programmes via a video-on-demand service; Provision of non-downloadable films and movies via a video-on-demand service; Providing films, not downloadable, via video-on-demand transmission services; Providing television programs, not downloadable, via video-on-demand transmission services; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, music, live-action, and news; Providing online computer games; Providing online non-downloadable e-books in the field of fiction and non-fiction; Providing entertainment information via a website; Providing entertainment information in the fields of motion picture films, television programs, musical videos, film clips, history, technology, artwork, and photographs via a website; Providing online non-downloadable videos in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable images of graphics, photographs, artwork and text; Providing online non-downloadable audio recordings in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable comic books and graphic novels; Entertainment services, namely, providing podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Amusement park and theme park services; Entertainment in the nature of theater productions; Entertainment services in the nature of an amusement park show; Entertainment services, namely, live appearances by a celebrity, musician, athlete, actor, or costumed character; Theatrical shows provided at performance venues; Providing education in the field of entertainment and music rendered through live theater performances; Presentation of live show performances; Entertainment, namely, production of plays, musicals, and theater productions; Theatre productions
Children's multiple activity toys; Collectable toy figures; Disc toss toys; Electric action toys; Infant toys; Inflatable toys; Musical toys; Plush toys; Squeeze toys; Talking toys; Toy action figures and accessories therefor; Toy boats; Sand toys; Toy building blocks; Toy mobiles; Toy vehicles; Toy scooters; Toy figures; Toy imitation cosmetics; Toy banks; Toy watches; Toy weapons; Toy building structures and toy vehicle tracks; Mechanical toys; Toy trains and parts and accessories therefor; Toy aircraft; Role playing toys in the nature of play sets for children to imitate real life occupations; Role playing games; Fantasy character toys; Basketballs; Baseball bats; Baseballs; Beach balls; Footballs; Golf balls; Golf gloves; Golf ball markers; Jump ropes; Roller skates; Skateboards; Soccer balls; Table tennis balls; Table tennis paddles; Table tennis rackets; Tennis balls; Tennis rackets; Volley balls; Action skill games; Board games; Card games; Jigsaw puzzles; Manipulative games; Parlor games; Party games; Playing cards; Target games; Action figures; Bean bags; Dolls; Doll clothing; Doll accessories; Playsets for dolls; Bobblehead dolls; Bubble making wand and solution sets; Puppets; Kites; Magic tricks; Marbles; Rubber balls; Play balls; Yo-yos; Teddy bears; Balloons; Christmas stockings; Christmas tree ornaments; Christmas tree decorations, except lights, candles, and confectionery; Crib mobiles; Equipment sold as a unit for playing card games; Hand-held units for playing electronic games for use with external display screen or monitor; Hand held units for playing electronic games other than those adapted for use with an external display screen or monitor; Party favors in the nature of small toys; Paper party favors; Paper party hats; Snow globes; Fitted plastic films known as skins for covering and protecting electronic game playing apparatus, namely, video game consoles and hand-held video game units; Video game machines for use with televisions; Toy for pets
09 - Scientific and electric apparatus and instruments
41 - Education, entertainment, sporting and cultural services
Goods & Services
Scientific, research, navigation, surveying, photographic, cinematographic, audiovisual, optical, weighing, measuring, signalling, detecting, testing, inspecting, life-saving and teaching apparatus and instruments; apparatus and instruments for conducting, switching, transforming, accumulating, regulating or controlling the distribution or use of electricity; recorded and downloadable multimedia files, computer software, blank digital or analogue recording and storage media; mechanisms for coin-operated apparatus; cash registers, calculating devices; computers and computer peripheral devices; diving suits, divers' masks, ear plugs for divers, nose clips for divers, gloves for divers, breathing apparatus for underwater swimming; fire-extinguishing apparatus; apparatus for recording, transmission, processing, and reproduction of sound, images, or data; digital media, namely, pre-recorded downloadable audio and video recordings, CDs, DVDs, high definition digital discs, mp3 files and mp4 files; Audio discs; audio books; audio recordings; audio and video recordings; audio speakers; binoculars; calculators; camcorders; cameras; cellular telephone accessories; cellular telephone cases; cellular telephone covers; face plates for cellular telephones; cell phone battery chargers; chips containing musical recordings; compact disc players; compact disc recorders; compact discs; computer game programs; computers; computer hardware; computer keyboards; computer monitors; computer mouse; computer disc drives; computer software; decorative magnets; digital cameras; digital video and audio players; DVDs; DVD players; DVD recorders; digital versatile discs; digital video discs; software applications; mobile apps; downloadable software applications for mobile devices; downloadable electronic publications; electronic personal organizers; flotation vests; graduated rulers for office and stationery; headphones; karaoke machines; microphones; MP3 players; mouse pads; motion picture films; musical recordings; personal digital assistants; printers; protective helmets for sports; protective face masks not for medical purposes; bicycle helmets; radios; snorkels; swimming goggles; swim masks; telephones; television sets; video cameras; downloadable video game software; recorded video game software; software programs for video games; video recordings; walkie-talkies; wrist and arm rests for use with computers; protective covers and cases for tablet computers. Education; providing of training; entertainment; sporting and cultural activities; providing online video games; rental of video games; entertainment services in the nature of video games; development, creation, production, and distribution of digital multimedia and audio and visual content, namely, motion picture films, television programs, and multimedia entertainment and educational content; development, creation, production, distribution, and rental of audio and visual recordings; production of entertainment shows and interactive programs for distribution via audio and visual media, and electronic means; production and provision of entertainment news and entertainment information via electronic communication networks; providing online computer games, websites and applications featuring a wide variety of general interest entertainment information relating to motion picture films, television programs, musical videos, film clips, photographs, and other multimedia materials; entertainment services, namely, providing online and subscription games; online games; amusement park and theme park services; educational and entertainment services rendered in or relating to theme parks, namely, live stage shows, live amusement park shows, live performances by costumed characters, and production and presentation of live theatrical performances; production and presentation of live shows; theater productions; entertainer services, namely, live appearances by a professional entertainer.
09 - Scientific and electric apparatus and instruments
Goods & Services
Apparatus for recording, transmission, processing and reproduction of sound, images or data; Digital media, namely, pre-recorded video cassettes, digital video discs, digital versatile discs, downloadable audio and video recordings, DVDs, and high definition digital discs featuring live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Digital media, namely, pre-recorded DVDs, downloadable audio and video recordings, and CDs featuring and promoting live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Downloadable fiction books on a variety of topics; Downloadable non-fiction books on a variety of topics; Non-fiction audio books on a variety of topics; Visual and audio recordings featuring live-action entertainment, animated entertainment, music, stories, children’s programming, dramatic performances, non-dramatic performances, learning activities for children, and games; Downloadable podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Musical recordings; Pre-recorded vinyl records featuring music, stories, children's programming, dramatic performances, and non-dramatic performances; Downloadable electronic publications in the nature of books, comics, and illustrations in the field of fiction and non-fiction; Downloadable series of children's books; Downloadable e-books in the field of fiction and non-fiction; Downloadable computer game software; Downloadable mobile applications for viewing, playing, and purchasing electronic games and animated entertainment; Downloadable video game software; Downloadable computer software for the administration of learning activities for children; Computer hardware and computer peripheral devices; Mouse pads; Cameras; Digital cameras; Blank recordable optical disc; DVD recording apparatus; Compact disc recorders; Audio speakers; Digital photo frames; Headphones; Earphones; Ear buds; Walkie-talkies; Telephones; Headsets for cellular or mobile phones; Cell phone cases; Screen protectors for cellular phones; Protective covers for cell phones; Protective covers and cases for cell phones; Binoculars; Decorative magnets; Microphones; Protective covers and cases for tablet computers; Radio frequency identification tag readers; Radio-frequency identification (RFID) tags; Radio-frequency transmitters; Smart watches; Fitted plastic films known as skins for covering and protecting electronic apparatus, namely, mobile phones, portable music players, mobile computers, and tablet computers; Karaoke machines; Bicycle helmets; Flotation vests; Protective helmets for sports; Snorkels; Swimming goggles; Swim masks; Downloadable game software
65.
SYSTEM AND METHOD FOR GENERATING AN IMAGE USING A NATURAL PROJECTION MEDIUM
A system includes a light source configured to emit light; a lens assembly including an optical component and at least one lens; a fiber optic cable configured to transmit the light emitted from the light source to the lens assembly; an image forming layer; and a projection medium. The projection medium includes ulexite, selenite, or a combination thereof. The image forming layer is provided between the lens assembly and the projection medium.
Beijing YoJaJa Software Technology Development Co., Ltd. (China)
Inventor
Huang, Lemei
Dai, Tongyu
Zhang, Wenhao
Chen, Si
Howe, Thomas
Abstract
In some embodiments, a method determines an instance of content to be delivered to a client device. The instance of content includes a plurality of segments that is associated with a plurality of profiles. A target metric and a bandwidth distribution are determined. The method determines a performance of the target metric based on the bandwidth distribution and a model for selecting a top profile for the plurality of segments. The model includes a set of conditions. The method solves the model based on the performance of the target metric where solving the model provides a solution that meets the set of conditions and outputs the top profile for each segment. The top profile for each segment for delivery to the client device. The top profile for each segment is used to remove profiles when requesting segments in the plurality of segments during playback of the instance of content.
H04N 21/24 - Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth or upstream requests
H04N 21/258 - Client or end-user data management, e.g. managing client capabilities, user preferences or demographics or processing of multiple end-users preferences to derive collaborative data
H04N 21/2662 - Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
A vending device for associating an entitlement device with a user profile includes a security mechanism configured to secure the entitlement device; a processing element configured to receive a user input including authentication information; determine the user profile based on the authentication information, and associate the entitlement device with the user profile; and a dispensing portion configured to provide the entitlement device.
A computer-implemented technique for projecting light includes generating, based on a pose of an object within the scene, projector calibration data associated with one or more projectors, and scene geometry data associated with the scene, one or more blend maps using a graphics engine, generating, based on the one or more blend maps and media to be projected via the one or more projectors, one or more blended projections, and causing the one or more projectors to project light upon the object based on the one or more blended projections.
09 - Scientific and electric apparatus and instruments
41 - Education, entertainment, sporting and cultural services
Goods & Services
(1) Apparatus for recording, transmission, processing, and reproduction of sound, images, or data; digital media, namely, pre-recorded downloadable audio and video recordings, CDs, DVDs, high definition digital discs, mp3 files and mp4 files in the field of entertainment and education; audio books in the field of entertainment and education featuring fiction and non-fiction; downloadable ringtones featuring music and other sounds, via a global computer network and wireless communication devices; audio and visual recordings in the field of entertainment and education; musical recordings; downloadable electronic publications in the nature of children's stories in illustrated form; downloadable computer game software; downloadable mobile applications for viewing, playing, and purchasing electronic games and animated entertainment; downloadable video game software; downloadable computer software for the administration of learning activities for children; encoded electronic chip cards in the field of entertainment and education; computer hardware and computer peripheral devices; mouse pads; wrist and arm rests for use with computers; calculators; cell phone battery chargers; electronic personal organizers; cameras; digital cameras; optical, digital versatile, and compact disc players and recorders for audio, video, and computer data; radios; audio speakers; digital photo frames; headphones; earphones; ear buds; walkie-talkies; telephones; headsets for cellular telephones; adapters for cellular telephones in the nature of power adapters; batteries for cellular telephones; cell phone cases; face plates for cellular telephones; binoculars; decorative magnets; graduated rulers; microphones; protective covers and cases for tablet computers; radio frequency authentication device in the nature of identification tag readers and radio frequency transmitter; smart watches; fitted plastic films known as skins for covering and protecting electronic apparatus, namely, mobile phones, portable music players, mobile computers, and tablet computers; video projectors; video projector with wireless connection capability for use with wireless communication devices; karaoke machines; bicycle helmets; flotation vests; protective face masks for the prevention of accident or injury; protective helmets for sports; snorkels; swimming goggles; swim masks (1) Entertainment services, namely, the development, creation, production, and distribution of digital multimedia and audio and visual content, namely, motion picture films, television programs, and multimedia entertainment and educational content; development, creation, production, distribution, and rental of audio and visual recordings; production of entertainment shows and interactive programs for distribution via audio and visual media, audio and video streaming, and electronic means; production and provision of motion pictures, entertainment news and entertainment information via electronic communication networks and audio and video streaming; providing online computer games; providing websites featuring a wide variety of general interest entertainment information relating to motion picture films, television programs, musical videos, film clips, photographs, and other multimedia materials; amusement park and theme park services; educational and entertainment services rendered in or relating to theme parks, namely, live stage shows, live amusement park shows, live performances by costumed characters, and production and presentation of live theatrical performances; production and presentation of live shows; theater productions; entertainer services, namely, live appearances by a professional entertainer
41 - Education, entertainment, sporting and cultural services
Goods & Services
Distribution of motion picture films; Distribution of television programs for others; Production and distribution of television shows and movies; Entertainment services in the nature of production of motion pictures, television shows, and multimedia entertainment content; Entertainment services, namely, an ongoing multimedia program featuring action, adventure, animated content, comedy, drama, live-action, music, and news distributed via various platforms across multiple forms of transmission media; Rental of motion picture films; Provision of non-downloadable films and television programmes via a video-on-demand service; Provision of non-downloadable films and movies via a video-on-demand service; Providing films, not downloadable, via video-on-demand transmission services; Providing television programs, not downloadable, via video-on-demand transmission services; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, music, live-action, and news; Providing online computer games; Providing online non-downloadable e-books in the field of fiction and non-fiction; Providing entertainment information via a website; Providing entertainment information in the fields of motion picture films, television programs, musical videos, film clips, history, technology, artwork, and photographs via a website; Providing online non-downloadable videos in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable images of graphic art, photography, artwork and text; Providing online non-downloadable audio recordings in the field of action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable visual and audio recordings featuring action, adventure, animated content, comedy, drama, live-action, music, and news; Providing online non-downloadable comic books and graphic novels; Entertainment services, namely, providing podcasts in the field of comedy, culture and arts, current events, education, entertainment, history, interviews, music, news, and stories; Amusement park and theme park services; Entertainment in the nature of theater productions; Entertainment services in the nature of an amusement park show; Entertainment services, namely, live appearances by a celebrity, musician, athlete, actor, or costumed character; Theatrical shows provided at performance venues; Providing education in the field of entertainment and music rendered through live theater performances; Presentation of live show performances; Entertainment, namely, production of plays, musicals, and theater productions; Theatre productions
Techniques for machine learning-based database querying are provided. A natural language request for information contained in a database is received. Based on the natural language request and a natural language meta-schema for the database, a relevant schema comprising at least one of a subset of tables from a plurality of tables of the database, a subset of columns from a plurality of columns in the plurality of tables, or a subset of values from a plurality of values in the plurality of columns is identified. A database query is generated based on prompting one or more language models (LMs) using the relevant schema and the natural language request. A result from the database is retrieved using the database query, and a natural language response to the natural language request is generated based on the result and using the one or more LMs.
One embodiment of the present invention sets forth a technique for processing user input. The technique includes determining, via execution of a first machine learning model, a first intent associated with a first message that is received from a user during an interaction associated with a first content item. The technique also includes matching the first intent to a first portion of a graph associated with the interaction. The technique further includes determining, based on the first portion of the graph, a first response to the first message, and causing a second content item corresponding to the first response to be outputted to the user.
ETH Zürich (Eidgenössische Technische Hochschule Zürich) (Switzerland)
Inventor
Zhang, Xiang
Jiao, Longxiang
Zhang, Yang
Schroers, Christopher Richard
Mehl, Lukas Francesco
Abstract
Methods and systems for performing novel view synthesis in addition to various image-to-image diffusion processes using machine learning models are disclosed. These include methods for performing inpainting-based novel view synthesis using depth maps and conditional models, video novel view synthesis using texture map inpainting, spatially consistent inpainting-based novel view synthesis using video diffusion models, and high-fidelity image-to-image diffusion using a texture conditional model. Further, methods for generating training data that can be used to train machine learning models to perform novel view synthesis are disclosed. These include symmetry exploiting methods of training data generation and methods using training pair alignment and splatting error simulations.
G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting
G06V 10/80 - Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
75.
VISUALLY CONSISTENT MULTI-VIEW NOVEL VIEW SYNTHESIS WITH VIDEO DIFFUSION
ETH Zürich (Eidgenössische Technische Hochschule Zürich) (Switzerland)
Inventor
Schroers, Christopher Richard
Zhang, Yang
Zhang, Xiang
Mehl, Lukas Francesco
Abstract
Methods and systems for performing novel view synthesis in addition to various image-to-image diffusion processes using machine learning models are disclosed. These include methods for performing inpainting-based novel view synthesis using depth maps and conditional models, video novel view synthesis using texture map inpainting, spatially consistent inpainting-based novel view synthesis using video diffusion models, and high-fidelity image-to-image diffusion using a texture conditional model. Further, methods for generating training data that can be used to train machine learning models to perform novel view synthesis are disclosed. These include symmetry exploiting methods of training data generation and methods using training pair alignment and splatting error simulations.
One embodiment of the present invention sets forth a technique for controlling motion in an articulated object. The technique includes generating, via execution of a machine learning model, one or more actions based on (i) a first state of the articulated object at a first time and (ii) a first plurality of weights associated with a plurality of rewards. The technique also includes generating, via execution of the machine learning model, one or more additional actions based on (i) a second state of the articulated object at a second time and (ii) a second plurality of weights associated with the plurality of rewards. The technique further includes causing a task associated with the articulated object to be performed based on the one or more actions and the one or more additional actions.
One embodiment of the present invention sets forth a technique for controlling motion in an articulated object. The technique includes generating, via execution of a machine learning model based on a first state of the articulated object at a first time step, a first plurality of weights for a plurality of rewards, and determining (i) one or more actions at the first time step based on the first plurality of weights and (ii) a second state of the articulated object at a second time step based on the first state and the action(s). The technique also includes generating, via execution of the machine learning model based on the second state, a second plurality of weights for the plurality of rewards, and determining one or more additional actions based on the second plurality of weights. The technique further includes generating the motion based on the action(s) and additional action(s).
ETH Zürich (EIDGENOSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH) (Switzerland)
Inventor
Djelouah, Abdelaziz
Helminger, Leonhard Markus
Azevedo, Roberto Gerson De Albuquerque
Labrozzi, Scott
Schroers, Christopher Richard
Xue, Yuanyi
Abstract
There is provided a video encoder including a processing hardware, and a system memory storing a software code. The processing hardware is configured to execute the software code to receive an uncompressed video content and a motion compensated video content corresponding to the uncompressed video content, transform the uncompressed video content to a first latent space representation of the uncompressed video content, transform the motion compensated video content to a second latent space representation of the uncompressed video content, determine, using the first latent space representation and the second latent space representation, a latent space residual, and generate, using the latent space residual, a compressed video content corresponding to the uncompressed video content.
H04N 19/89 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
G06N 3/088 - Non-supervised learning, e.g. competitive learning
79.
PATH GUIDING USING NEURAL RADIANCE CACHING WITH DEFENSIVE RESAMPLED IMPORTANCE SAMPLING AND ADAPTIVE CANDIDATE ALLOCATION
The present disclosure relates to computer-implemented path guiding in a rendering system. A sampling engine generates, at a scattering location on a lightpath, a set of candidate directions from source distributions and selects a direction using resampled importance sampling. The resampling may include defensive target construction in which a neural target derived from learned radiance estimates is combined with a defensive target derived from at least one source distribution, and the candidate directions are weighted and selected based on a fused target. In some embodiments, an optimized resampling candidate allocation (ORCA) module determines, for the scattering location, a candidate count specifying how many candidate directions are generated, wherein the candidate count is determined based on one or more rendering efficiency metrics that relate estimated variance reduction to computational cost. One or more learned radiance models may be trained using samples collected during rendering and evaluated during candidate evaluation.
Beijing YoJaJa Software Technology Development Co., Ltd. (China)
Inventor
Yu, Junchao
Tian, Chenyu
Dai, Tongyu
Howe, Thomas
Abstract
In some embodiments, a method receives online quality of service (QoS) metric values for online logs of using a service. Synthetic QoS metric values that describe anomalies are added to the training dataset. A model predicts predicted QoS metric values in the online logs. A distribution of a difference between QoS metric values from the training dataset and the predicted QoS metric values is determined. The method uses the difference to adjust a parameter in the model to train the model to predict the predicted QoS metric values. The distribution is used to determine a dynamic threshold that is used to determine whether an anomaly occurs. The method determines whether an anomaly is detected in new online logs based on applying the dynamic threshold to a difference between online QoS metric values and predicted QoS metric values generated by the trained model. The dynamic threshold changes over the time series.
ETH Zürich (Eidgenössische Technische Hochschule Zürich) (Switzerland)
Inventor
Zhang, Yang
Schroers, Christopher Richard
Zhang, Xiang
Mehl, Lukas Francesco
Jiao, Longxiang
Abstract
Methods and systems for performing novel view synthesis in addition to various image-to-image diffusion processes using machine learning models are disclosed. These include methods for performing inpainting-based novel view synthesis using depth maps and conditional models, video novel view synthesis using texture map inpainting, spatially consistent inpainting-based novel view synthesis using video diffusion models, and high-fidelity image-to-image diffusion using a texture conditional model. Further, methods for generating training data that can be used to train machine learning models to perform novel view synthesis are disclosed. These include symmetry exploiting methods of training data generation and methods using training pair alignment and splatting error simulations.
21 - HouseHold or kitchen utensils, containers and materials; glassware; porcelain; earthenware
Goods & Services
Beverageware; Cups; Mugs; Vacuum bottles; Thermal insulated containers for food or beverages; Thermal insulated bags for food or beverages; Plastic water bottle holders and attached carabiner clip sold as a unit; Water bottles sold empty; Aluminum water bottles sold empty; Plastic water bottles sold empty; Reusable plastic water bottles sold empty; Reusable stainless steel water bottles sold empty
21 - HouseHold or kitchen utensils, containers and materials; glassware; porcelain; earthenware
Goods & Services
Beverageware; Cups; Mugs; Vacuum bottles; Thermal insulated containers for food or beverages; Thermal insulated bags for food or beverages; Plastic water bottle holders and attached carabiner clip sold as a unit; Water bottles sold empty; Aluminum water bottles sold empty; Plastic water bottles sold empty; Reusable plastic water bottles sold empty; Reusable stainless steel water bottles sold empty
21 - HouseHold or kitchen utensils, containers and materials; glassware; porcelain; earthenware
Goods & Services
Beverageware; Cups; Mugs; Vacuum bottles; Thermal insulated containers for food or beverages; Thermal insulated bags for food or beverages; Plastic water bottle holders and attached carabiner clip sold as a unit; Water bottles sold empty; Aluminum water bottles sold empty; Plastic water bottles sold empty; Reusable plastic water bottles sold empty; Reusable stainless steel water bottles sold empty
41 - Education, entertainment, sporting and cultural services
Goods & Services
Telecommunications; telecommunications information; telecommunications services relating to telephone; mobile telephone services, wireless telephone services; communications via computer terminals or optical fiber network; radio or telephone communications; mobile radiotelephone services; telegraphic communications; data communications services; provision of user access to global computer networks; provision of access to databases; provision of access to information on the Internet and other communications networks; Provision of access to data networks, namely the Internet and Internet forums; Provision of information relating to television, cable and satellite broadcasting or radio broadcasting; Services of access to computer networks; Telecommunications access services; Electronic transmission and retrieval of data, images, audio content, video content, messages and documents; electronic messaging services; transmission of sound, images and video data over the Internet; provision of Internet chat rooms; rental of access time to global computer networks; rental of telecommunications apparatus; rental of telephones and fax machines; teleconferencing and videoconferencing services; broadcasting, transmission and distribution (broadcasting, transmission) of programs, films, images, music, games, excerpts and texts via any technological means to television sets, personal computers and recorders, wireless receivers, telephones and mobile phones, public displays and any other device or facility capable of receiving such content; broadcasting and retransmission of radio or audiovisual programs; mobile media services consisting of the electronic transmission of multimedia information and entertainment content (video and audio content, images, graphic illustrations and music via the Internet, cable and wireless networks for downloading to mobile phones); radio and television broadcasting; Broadcasting of television programs by cable and satellite; Television broadcasting services including the operation of on-subscription television services including video-on-demand services; transmission and broadcasting of television programs and films and in particular video-on-demand programs; video-on-demand transmission services; news agency services; electronic display services [telecommunications]; Streaming of audio, visual and audiovisual material via a global computer network; Broadcasting services, namely, television broadcasting, cable television broadcasting, satellite television broadcasting, closed circuit television broadcasting, radio broadcasting, cable radio broadcasting, Internet radio broadcasting, broadcasting via the Internet, broadcasting of electronic, high definition, and digital audio and video programming via computer communications networks, wireless broadcasting. Education, training, entertainment, sports and cultural activities; Online interactive entertainment services; Entertainment and educational information; Production, presentation, performance (namely representation and interpretation), rental of films, motion pictures, television and radio programs, sound and video recordings, via and to all types of media, including, inter alia, television, cable and satellite television, Internet, telephone; Production, presentation, performance (namely representation and interpretation), rental of images, music, games, excerpts, texts and recordings via and to all types of media, including, inter alia, television, cable and satellite television, Internet, telephone; Production of entertainment shows and interactive programs for distribution via television, cable, satellite, audio and video media, cartridges, laser discs, computer discs and electronic media; Production of entertainment, news and information via computer and communication networks; Amusement and theme park services; Education and entertainment services provided in or in connection with theme parks; Live performance organization; Performance of shows; Theatre performances; Performing artists' services; Booking of tickets for shows; Provision of information on lists of television, cable or radio broadcasting programs; Game services offered online from a computer network.
Embodiments provide for improved resource distribution. A first set of pacing results for a content distribution plan is accessed, and a target pacing for the content distribution plan is determined. A first coverage threshold is generated based on the first set of pacing results and the target pacing. A first ranking of a plurality of users is generated using a machine learning model and based on the content distribution plan, and distribution of content associated with the content distribution plan is facilitated based on the first ranking and the first coverage threshold.
In some embodiments, a method determines a number of session types. Training data from sessions is analyzed to cluster the data in the number of session types. The method trains a model using the number of session types. Feature values for the session types are input into the model. The model generates an output based on the feature values. The output is compared to a reference output for the feature values. The method alters the number of session types based on comparing.
H04N 21/466 - Learning process for intelligent management, e.g. learning user preferences for recommending movies
H04N 21/45 - Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies or resolving scheduling conflicts
A system and method for capturing fames (e.g., images) in an environment. In one example, a system includes a main camera configured to capture target images or frames of the environment and a trigger in communication with the main camera and configured to selectively activate the main camera. The trigger includes a trigger camera having a field of view at least partially aligned with a field of view of the main camera and a processing element in communication with the trigger camera and the main camera, the processing element selectively activates the main camera based on scene images captured by the trigger camera.
H04N 23/61 - Control of cameras or camera modules based on recognised objects
G06V 10/77 - Processing image or video features in feature spacesArrangements for image or video recognition or understanding using pattern recognition or machine learning using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]Blind source separation
One embodiment of the present invention sets forth a technique for generating a shape. The technique includes determining (i) a deformed template shape corresponding to a non-neutral expression on a template subject and (ii) a neutral target shape corresponding to a neutral expression on a target subject. The technique also includes generating input representing the deformed template shape and the neutral target shape. The technique further includes generating, via execution of a machine learning model based on the input, a deformed target shape corresponding to the non-neutral expression on the target subject.
ETH Zürich (Eidgenössische Technische Hochschule Zürich) (Switzerland)
Inventor
Bradley, Derek Edward
Weiss, Sebastian Klaus
Chandran, Prashanth
Zoss, Gaspard
Baeza Rojo, Irene
Xia, Yitong
Abstract
The present invention sets forth techniques for predicting motion in a 3D model. The disclosed techniques include receiving one or more Gaussian primitives representing a 3D scene and receiving one or more control inputs describing one or more primary motions associated with one or more objects. The techniques also include generating, via a first trained machine learning model, a dynamic state based on the one or more control inputs, and generating, via a second trained machine learning model, one or more deformed Gaussian primitives based on the dynamic state and the one or more Gaussian primitives. The techniques further include generating a 2D representation of the 3D scene, and generating an output sequence based on the 2D representation, wherein the output sequence depicts both the primary motions associated with the one or more objects and one or more secondary motions associated with the one or more objects.
