Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining parameters for a sample adaptive offset (SAO) filter for a video unit, where the parameters are selected from an explicitly signaled set, or a predefined set, or an adaptive set, and where the adaptive set is derived based on parameters from one or more video units coded before the video unit. A conversion is performed between a visual media data and a bitstream based on the SAO filter.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a video unit of a video and a bitstream of the video, whether an illumination compensation approach is applied to the video unit based on information associated with the video unit, wherein at least one local illumination compensation (LIC) parameter of the illumination compensation approach is derived based on at least one of: a neighboring sample or a template; and performing the conversion based on the determining.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: for a conversion between a current video block of a video and a bitstream of the video, at least one virtual neighboring block of the current video block is determined, the at least one virtual neighboring block inheriting at least one control point motion vector (CPMV) gradient from a history-affine table (HAT) and being based on at least one real motion vector (MV) of at least one neighboring block of the current video block; at least one affine candidate of the current video block is determined based on the at least one virtual neighboring block; and the conversion is performed based on the at least one affine candidate.

IPC Classes  ?

• H04N 19/61 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Abstract

A mechanism for processing video data is disclosed. The mechanism determines to apply an end-to-end lossless compression network to compress an input stereo image pair {xL, xR} into bitstreams {bL, bR}. A conversion can then be performed between a visual media data and a bitstream based on the end-to-end lossless compression network.

IPC Classes  ?

• H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
• H04N 19/503 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
• H04N 19/60 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding

Abstract

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: obtaining, for a conversion between a video unit of a video and a bitstream of the video unit, a prediction of at least one object of the video unit by using an intra block copy (IBC), wherein the video unit is coded with an IBC-geometric partition mode (GPM) where the video unit is geometrically divided into a plurality of sub-partitions or the video unit is predicated by a plurality of hypothesizes; and performing the conversion based on the prediction of the at least one object of the video unit.

IPC Classes  ?

• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/513 - Processing of motion vectors

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining a value of a neural-network post-filter activation (NNPFA) identifier (nnpfa_id) in a NNPFA supplemental enhancement information (SEI) message. The value of the nnpfa_id is constrained to be in a range of 0 to 232-2, inclusive. A conversion is performed between a visual media data and a bitstream based on the nnpfa_id.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a video unit of a video and a bitstream of the video unit, a Local illumination compensation (LIC) type of the video unit based on at least one neighbouring reconstructed sample of the video unit; and performing the conversion based on the determined LIC type.

IPC Classes  ?

• H04N 19/14 - Coding unit complexity, e.g. amount of activity or edge presence estimation
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction

Abstract

A method of visual media processing video includes determining that palette mode is to be used for processing a first portion of a video block and intra block copy (IBC) mode is to be used for processing a second portion of the video block, and performing further processing of the first portion of the video block using the palette mode and the second portion of the video using the IBC mode. Indications of the first portion of the video block processed using the palette mode and indications of the second portion of the video block processed using the IBC mode are included in a palette index identifying the first portion of the video block and the second portion of the video block.

IPC Classes  ?

• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

The present disclosure proposes a method for video processing. The method comprises: applying, for a conversion between a video unit of a video and a bitstream of the video, a filtering approach to a sample associated with the video unit, the sample comprising at least one of: a prediction sample or a template sample; and performing the conversion based on the filtering approach.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing

Abstract

A mechanism for processing video data is disclosed. The mechanism includes performing a conversion between a visual media data and a bitstream based on a rule. The rule specifies that a neural-network post-filter activation (NNPFA) Supplemental Enhancement Information (SEI) message with a first particular value of an NNPFA identifier is only present in a current Picture Unit (PU) when one or both of the following conditions are met. First, a current Coded Layer Video Sequence (CLVS) contains a neural-network post-filter characteristics (NNPFC) SEI message with a NNPFC identifier (nnpfc_id) equal to the first particular value of the NNPFA identifier in a preceding PU that precedes the current PU in decoding order. Second, an NNPFC SEI message with nnpfc_id equal to the first particular value of the NNPFA identifier is contained in the current PU.

IPC Classes  ?

• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining a value of a neural-network post-filter characteristics (NNPFC) output chroma component block flag (nnpfc_out_sub_c_flag) in a NNPFC Supplemental Enhancement Information (SEI) message, wherein when a chroma format identification code (ChromaFormatIdc) is equal to two, which indicates that a colour format is a 4:2:2 format, and a NNPFC output chroma component block flag (nnpfc_out_sub_c_flag) is present, the value of nnpfc_out_sub_c_flag shall be equal to one. A conversion is performed between a visual media data and a bitstream based on the nnpfc_out_sub_c_flag.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• G06T 9/00 - Image coding
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A method, apparatus, and system for processing media data are disclosed. An example method for processing media data includes obtaining a first parameter or a second parameter used to determine a ratio of a neural-network post-filter characteristics (NNPFC) picture relative to a cropped width or a cropped width, where a value of the ratio is constrained to a range with an endpoint, and where the endpoint of the range is based on a value of 16; and performing a conversion between a visual media data and a bitstream based on the ratio.

IPC Classes  ?

• G06T 9/00 - Image coding
• G06T 5/20 - Image enhancement or restoration using local operators
• G06T 5/60 - Image enhancement or restoration using machine learning, e.g. neural networks
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, motion information and location information of at least one subblock of a temporal block in a collocated frame of the current video block; determining an affine candidate of the current video block by applying a regression process to the current video block based on the motion information and the location information of the at least one subblock; and performing the conversion based on the affine candidate.

IPC Classes  ?

• H04N 19/54 - Motion estimation other than block-based using feature points or meshes
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to apply a Hadamard Domain Filter (HDF) process to samples of a picture, wherein the HDF process applies an average sum, a weighted sum, a linear sum, a non-linear sum, a Wiener function, or combinations thereof. A conversion is performed between a visual media data and a bitstream based on the HDF.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a video unit of a video and a bitstream of the video unit, whether the video unit is non-intra coded or intra coded; in accordance with a determination that the video unit is non-intra coded, deriving one or more intra prediction modes (IPMs) for the video unit; in accordance with a determination that the video unit is intra coded, obtaining a prediction of the video unit without applying an IPM; and performing the conversion based on the one or more IPMs or the obtained prediction.

IPC Classes  ?

• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/513 - Processing of motion vectors

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, a usage of an operation for the current video block is determined based on at least one of a usage of the subblock-based prediction or a usage of a subblock-based combined inter and intra prediction (CIIP). The subblock-based prediction is determined based on the usage of the operation. The conversion is performed based on the subblock-based prediction.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/107 - Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh

Abstract

Embodiments of the present disclosure provide a solution for video processing. In a method for video processing, for a conversion between a current video unit of a video and a bitstream of the video, an indicator of a low-pass filter of the current video unit is determined by inheriting from a previous coded block. The low-pass filter is applied to the current video unit based on the indicator. The conversion is performed based on the applying.

IPC Classes  ?

• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current block of a video and a bitstream of the video, a final prediction for the current block by fusing a first prediction and a second prediction, wherein the first prediction is derived based on a filter model; and performing the conversion based on the final prediction.

IPC Classes  ?

• H04N 19/107 - Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to apply an adaptive loop filter (ALF) to a first component of a video unit. The ALF includes one or more extended taps. The one or more extended taps utilize an input source other than spatial neighbor samples of the first component. A conversion is performed between a visual media data and a bitstream based on the ALF.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/167 - Position within a video image, e.g. region of interest [ROI]
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, a first intra prediction sample of the current video block; determining an adjustment value associated with a further video block in the video, the further video block being coded before the current video block; and performing the conversion based on the first intra prediction sample and the adjustment value.

IPC Classes  ?

• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
• H04N 19/124 - Quantisation
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, whether a candidate frame associated with the current video block is a co-located frame based on temporal information of a current frame comprising the current video block, the co-located frame being co-located with the current frame; and performing the conversion based on the determining.

IPC Classes  ?

• H04N 19/513 - Processing of motion vectors
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/577 - Motion compensation with bidirectional frame interpolation, i.e. using B-pictures

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a video unit of a video and a bitstream of the video, a first syntax element (SE) that indicates whether a geometric partitioning mode (GPM) affine is applied, wherein the first SE shares model information with a second SE; and performing the conversion based on the first SE.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/513 - Processing of motion vectors

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: deriving, for a conversion between a video unit of a video and a bitstream of the video, a first target coding mode at decoder side based on coding information associated with the video unit, wherein the first target coding mode is a variant of a matrix weighted intra prediction (MIP) mode; and performing the conversion based on the first target coding mode.

IPC Classes  ?

• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction

Abstract

A mechanism for processing video data is disclosed. A conversion is performed between a visual media data and a bitstream based on a rule that includes a bitstream conformance requirement which requires that a supplemental enhancement information (SEI) processing order SEI message shall contain a SEI payload type syntax element with at least a first entry and a second entry.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A mechanism for processing video data is in a neural network disclosed. The mechanism includes obtaining quantized residual latent samples. The quantized residual latent samples are processed to obtain processed quantized residual latent samples. A reconstructed latent sample can then be acquired based on the processed quantized residual latent sample.

IPC Classes  ?

• H04N 19/192 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
• H04N 19/124 - Quantisation
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream

Abstract

A method of processing video data, comprising obtaining a non-adjacent reconstruction sample of a picture of a video, inputting the non-adjacent reconstruction sample of the picture as input for an adaptive loop filter (ALF), and performing a conversion between the video and a bitstream of the video based on the ALF.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

A method of processing media data. The method includes determining, for a dependent random access point (DRAP) sample, a first sequence of samples; and performing a conversion between media data and a media data file based on the determining. The first sequence of samples consists of the following samples in order: 1) a closest preceding stream access point (SAP) sample of type 1, type 2, or type 3; 2) the DRAP sample; and 3) all samples following the DRAP sample in both decoding order and output order in a first track.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: determining, for a conversion between at least one bitstream of visual data and the visual data, a residual representation of the visual data at least based on a first probability distribution parameter of the visual data and a gain parameter, the residual representation representing a residual value compared to a second probability distribution representation of the visual data, the gain parameter adjusting a value range of the residual representation; and performing the conversion based on the residual representation.

IPC Classes  ?

• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, at least one context model associated with the current video block based on initiation information of the at least one context model, the initiation information of the at least one context model being included in the bitstream; and performing the conversion based on the at least one context model.

IPC Classes  ?

• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

An image decoding method including transforming an input image into latent samples using an analysis transform; quantizing the latent samples using a hyper encoder to generate quantized hyper latent samples; encoding the quantized hyper latent samples into a bitstream using entropy encoding; applying a latent sample prediction process to obtain quantized latent samples and quantized residual latent samples based on the latent samples using the quantized hyper latent samples; obtaining prediction samples following the latent sample prediction process; and entropy encoding the quantized hyper latent samples and the quantized residual latent samples into the bitstream.

IPC Classes  ?

• H04N 19/192 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
• H04N 19/124 - Quantisation
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a video unit of a video and a bitstream of the video, at least one geometric partitioning mode (GPM) affine candidate for the video unit, wherein a maximum number of GPM affine candidates are signaled or predefined; and performing the conversion based on the at least one GPM affine candidate.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/157 - Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction

Abstract

An image decoding method including obtaining reconstructed latents ŷ[:,:,:] using an arithmetic decoder; feeding the reconstructed latents into a synthesis neural network; tile partitioning output feature maps into multiple parts based on decoded parameters at one or multiple locations; separately feeding each of the multiple parts into a next stage of a plurality of convolutional layers to obtain spatially partitioned feature maps at an output; and cropping and stitching the spatially partitioned feature maps back to a whole feature map spatially until an image is reconstructed.

IPC Classes  ?

• H04N 19/189 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: obtaining, for a conversion between visual data and a bitstream of the visual data, region information indicating positions and sizes of a plurality of regions in a quantized latent representation of the visual data; selecting, based on the region information, a set of target neighboring samples from a plurality of candidate neighboring samples of a current sample in the quantized latent representation, the set of target neighboring samples being in the same region as the current sample; determining statistical information of the current sample based on the set of target neighboring samples; and performing the conversion based on the statistical information.

IPC Classes  ?

• H04N 19/625 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
• H04N 19/124 - Quantisation
• H04N 19/63 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a video unit of a video and a bitstream of the video, one or more spatial geometric partitioning mode (SGPM) candidates for the video unit based on at least one of: history information or neighboring information; obtaining a prediction or construction of the video unit based on the one or more SGPM candidates; and performing the conversion based on the prediction or construction of the video unit.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: determining, for a conversion between a video unit of a video and a bitstream of the video, that the video unit is coded by a motion pair from a same direction relative to a current picture, wherein the video unit is applied with an advanced motion vector prediction (AMVP) merge mode and the video unit belongs to a low-delay picture; and performing the conversion based on the motion pair.

IPC Classes  ?

• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a current video block of a video and a bitstream of the video, a motion candidate list for the current video block; determining, based on a similarity metric between a first motion candidate and a second motion candidate in the motion candidate list, whether to update the motion candidate list; and performing the conversion based on the determination.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/513 - Processing of motion vectors

Abstract

Embodiments of the present disclosure provide a solution for point cloud coding. A method for point cloud coding is proposed. The method comprises: determining, for a conversion between a current frame of a point cloud sequence and a bitstream of the point cloud sequence, first attribute information of a first node of the current frame based on second attribute information of a second node of the current frame, a node representing a spatial partition of the current frame, a first partition depth of the first node being different from a second partition depth of the second node; and performing the conversion based on the first attribute information.

IPC Classes  ?

• G06T 9/00 - Image coding

Abstract

Methods, devices and systems for signalling the use of subpictures in coded video pictures are described. One example method of video processing includes performing a conversion between a video and a bitstream of a video, wherein the bitstream conforms to a format rule, and wherein the format rule specifies that a first syntax element, which indicates whether a picture of the video can be partitioned, is conditionally included in a picture parameter set (PPS) of the bitstream based on values of a second syntax element, which indicates whether identifiers of subpictures are signalled in the PPS, and a third syntax element, which indicates, in the PPS, a number of the subpictures.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/169 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/174 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/46 - Embedding additional information in the video signal during the compression process

Abstract

A video processing method includes deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally co-located with the current picture, wherein the current picture is excluded from the one or more pictures, and the second block is temporally collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture; adding the multiple TMVP candidates to a motion candidate list associated with the video block; and performing a conversion between the video block and a bitstream.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
• H04N 19/517 - Processing of motion vectors by encoding

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: for a conversion between a current video block of a video and a bitstream of the video, prediction samples of the current video block are determined; the prediction samples of the current video block are updated based on a filtering process; and the conversion is performed based on the updated prediction samples.

IPC Classes  ?

• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: clipping, for a conversion between a current video block of a video and a bitstream of the video, a value of a first sample associated with the current video block by using a clipping operation, at least one parameter for the clipping operation being indicated in the bitstream and the at least one parameter comprising at least one of an upper limit value or a lower limit value; and performing the conversion based on the clipped value.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A method for processing video data is disclosed. The method includes: performing a conversion between visual media data and a bitstream of the visual media data by an image compression framework, wherein the image compression framework includes a preprocessing function and a compressor, and the visual media data is processed by the preprocessing function and the compressor sequentially, and wherein the preprocessing function receives a first image among the visual media data with a size of W0×H0×C0 as input and outputs a preprocessed first image with a size of W1×H1×C1, wherein W0 is an input width, H0 is an input height, and C0 is an input channel number, and wherein W1 is an output width, H1 is an output height, and C1 is an output channel number.

IPC Classes  ?

• G06T 9/00 - Image coding
• G06N 3/0455 - Auto-encoder networksEncoder-decoder networks

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, a sign prediction of a block vector difference (BVD) of the current video block; determining the BVD at least based on the sign prediction of the BVD; and performing the conversion based on the BVD.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding

Abstract

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: generating, for a conversion between a video unit of a video and a bitstream of the video, an intra mode for the video unit based on coding information associated with the video unit, wherein the video unit is an intra template matching (TM) coded block or the video unit is an intra copy block (IBC) coded block; and performing the conversion based on the generated intra mode.

IPC Classes  ?

• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
• H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current block of a video and a bitstream of the video, motion information of the current block based on motion information of a neighboring block of the current block and an intra block copy merge mode with block vector difference (IBC-MBVD) mode, the neighboring block being coded with a reconstruction-reordered intra block copy (RRIBC) mode; and performing the conversion based on the motion information of the current block.

IPC Classes  ?

• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/593 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a current video block of a video and a bitstream of the video, values for a set of adjusting parameters associated with values for a set of model parameters of a local illumination compensation (LIC) model for coding the current video block; updating the values for the set of model parameters based on the values for the set of adjusting parameters; and performing the conversion based on the updated values for the set of model parameters.

IPC Classes  ?

• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/103 - Selection of coding mode or of prediction mode
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for point cloud coding. A method for point cloud coding is proposed. The method comprises: obtaining, for a conversion between a current point cloud (PC) sample of a point cloud sequence and a bitstream of the point cloud sequence, target information regarding whether an attribute inter prediction is enabled for the current PC sample, the target information being determined based on at least one of rate information or distortion information associated with coding at least one target PC sample with the attribute inter prediction, wherein the at least one target PC sample comprises at least one of: the current PC sample, or at least one PC sample of the point cloud sequence coded before the current PC sample; and performing the conversion based on the target information.

IPC Classes  ?

• H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
• H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/537 - Motion estimation other than block-based

Abstract

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: determining, during a conversion between a target block of a video and a bitstream of the target block, that a combination of an intra block copy (IBC) and an intra prediction (CIBCIP) mode is applied to the target block; obtaining an IBC predicted signal and an intra predicted signal based on the CIBCIP mode; deriving a prediction or a reconstruction of the target block by combining the IBC predicted signal and the intra predicted signal; and performing the conversion based on the prediction or the reconstruction of the target block.

IPC Classes  ?

• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

An example method of video processing includes determining, for a conversion between a current picture of a video and a coded representation of the video, a position of a reference sample in a reference picture that is associated with the current picture based on a top-left position of a window of a picture. The picture includes at least the current picture or the reference picture, and the window is subject to a processing rule during the conversion. The method also includes performing the conversion based on the determining.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video comprising one or more output layer sets according to a rule, wherein the rule specifies that a supplemental enhancement information (SEI) network abstraction layer (NAL) unit that includes a scalable-nested SEI message carrying picture timing information is not included due to use of a same picture timing in all output layer sets in the bitstream.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/136 - Incoming video signal characteristics or properties
• H04N 19/169 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/30 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
• H04N 19/433 - Hardware specially adapted for motion estimation or compensation characterised by techniques for memory access
• H04N 19/46 - Embedding additional information in the video signal during the compression process

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: performing a conversion between visual data and a bitstream of the visual data with a neural network (NN) -based model, the bitstream comprising a first indication indicating a level to which the bitstream conforms.

IPC Classes  ?

• H04N 19/60 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding

Abstract

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: applying, for a conversion between a video unit of a video and a bitstream of the video unit, a wrap around motion compensation (WAMC) during a derivation of motion information for the video unit; and performing the conversion based on the derived motion information.

IPC Classes  ?

• H04N 19/51 - Motion estimation or motion compensation
• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference

Abstract

Embodiments of the disclosure provide a solution for video processing. A method for video processing is proposed. The method includes: generating, for a conversion between a video unit of a video and a bitstream of the video unit, a sample value of a first color component of the video unit that is corresponding to a sample of a second color component by applying a plurality of filters to at least one sample of the first color component; and performing the conversion based on the generated sample value.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, a plurality of co-located frames of the current video block, the current video block being in a current frame co-located with the plurality of co-located frame; and performing the conversion based on the plurality of co-located frames.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• G06V 10/74 - Image or video pattern matchingProximity measures in feature spaces
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding

Abstract

A mechanism for processing video data is disclosed. The mechanism determines to modify a video unit attendant to applying a video compression function. The modification may include applying a geometric conversion to the video unit. A conversion is performed between a visual media data and a bitstream based on the modified video unit.

IPC Classes  ?

• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a current video block of a video and a bitstream of the video, whether a candidate frame associated with the current video block is a co-located frame based on a frame type of the candidate frame, the co-located frame being co-located with a frame comprising the current video block; and performing the conversion based on the determining.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/172 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: partitioning, for a conversion between visual data and a bitstream of the visual data with a neural network (NN) -based model, a first tensor used in an adaptive filter of the NN-based model into a first set of tiles based on a first tile size, the first tile size being a multiple of a first predetermined value; and performing the conversion based on the first set of tiles.

IPC Classes  ?

• G06N 3/02 - Neural networks
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: refining, for a conversion between a video unit of a video and a bitstream of the video, a sample of the video unit by applying a local illumination compensation (LIC), wherein the video unit is coded with a geometric partitioning mode (GPM); and performing the conversion based on the refined sample.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/109 - Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
• H04N 19/157 - Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, for a conversion between a video unit of a video and a bitstream of the video, a first target coding mode to the video unit, wherein the first target coding mode comprises an inter prediction and a coding tool that comprises at least one of: an intra block copy (IBC) or an intra template matching prediction (intraTMP), and the video unit comprises a plurality of sub-partitions or a plurality of sub-blocks; and performing the conversion based on the first target coding mode.

IPC Classes  ?

• H04N 19/103 - Selection of coding mode or of prediction mode
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between a video unit of a video and a bitstream of the video, a block vector (BV) list for the video unit that is coded with a first target coding mode, wherein the first target coding mode comprises an inter prediction and a coding tool that comprises at least one of: an intra block copy (IBC) or an intra template matching prediction (intraTMP), and the video unit comprises a plurality of sub-partitions or a plurality of sub-blocks; and performing the conversion based on the BV list.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a video unit of a video and a bitstream of the video, a sample of the video unit by applying a first target coding mode, wherein the first target coding mode comprises an inter prediction and a coding tool, and the video unit comprises a plurality of sub-partitions or a plurality of sub-blocks; and performing the conversion based on the obtained sample.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, for a conversion between a video unit of a video and a bitstream of the video, a combined filtering approach to a sample associated with the video unit, wherein the combined filtering approach comprises: a filtering approach and a bilateral filtering (BF) approach for a reference sample; and performing the conversion based on the filtered sample.

IPC Classes  ?

• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: deriving, for a conversion between a video unit of a video and a bitstream of the video, a first set of local illumination compensation (LIC) parameters for the video unit based on spatial neighboring video units of the video unit or a template of the video unit; applying the first set of LIC parameters and a second set of LIC parameters during an illumination compensation associated with the video unit; and performing the conversion based on the illumination compensation.

IPC Classes  ?

• H04N 19/52 - Processing of motion vectors by encoding by predictive encoding

Abstract

A mechanism for processing video data is disclosed. The mechanism determines to pad at least one unavailable sample of a video before feeding the video into a process. A conversion is performed between a visual media data and a bitstream based on the padded samples.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• G06N 3/02 - Neural networks
• G06N 20/00 - Machine learning
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/00 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: performing a conversion between visual data and a bitstream of the visual data with a neural network (NN) -based model, a pooling layer in the NN-based model being configured to be applied with a padding operation that is used for padding at least one sample for an input tensor of the pooling layer.

IPC Classes  ?

• G06T 9/00 - Image coding

Abstract

A method for visual data processing comprises: performing a conversion between visual data and a bitstream of the visual data with a neural network (NN) -based model, a synthesis transform in the NN-based model comprising at least one upscaling layer, and each of the at least one upscaling layer being used for increasing a data dimension of respective input of the at least one upscaling layer.

IPC Classes  ?

• G06T 9/00 - Image coding

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between the current video block and a bitstream of the video, a target number for a set of intra block copy merge mode with block vector difference (IBC-MBVD) candidates, the target number being indicated in the bitstream and dependent on a target configuration of a coding process for coding the current video block; selecting, based on the target number, the set of IBC-MBVD candidates from a plurality of IBC-MBVD candidates associated with an intra block copy (IBC) base candidate for the current video block; and performing the conversion based on the set of IBC-MBVD candidates.

IPC Classes  ?

• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/119 - Adaptive subdivision aspects e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to infer that a value of a syntax element is equal to 0 when the syntax element is not present in a bitstream. The value of the syntax element plus one specifies a number of submeshes in each mesh frame. A conversion is performed between a visual media data and a bitstream based on the syntax element.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• G06T 9/00 - Image coding
• H04N 19/124 - Quantisation
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: determining, for a conversion between visual data and a bitstream of the visual data with a neural network (NN)-based model, a first adjusting parameter from a first table based on a probability parameter sample associated with the visual data; adjusting a first sample associated with the visual data based on the first adjusting parameter; and performing the conversion based on the adjusted first sample.

IPC Classes  ?

• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• G06N 3/02 - Neural networks
• G06N 20/00 - Machine learning
• H04N 19/00 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• G06N 3/00 - Computing arrangements based on biological models

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining one or more bytes of data from a supplemental enhancement information (SEI) raw byte sequence payload (RBSP) header, wherein the SEI RBSP header is included in an SEI RBSP before one or more SEI messages carried in the SEI RBSP. A conversion is performed between a visual media data and a bitstream based on the SEI RBSP header.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/169 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
• H04N 19/196 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters

Abstract

A method for point cloud coding, in the method, for a conversion between a current frame of a point cloud sequence and a bitstream of the point cloud sequence, a set of triangle meshes of the current frame are determined. A parameter for at least one projection plane for a triangle mesh of the set of triangle meshes is determined before voxelizing the triangle mesh. The conversion is performed based on the parameter.

IPC Classes  ?

• G06T 9/00 - Image coding

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: performing a conversion between visual data and a bitstream of the visual data with a neural network (NN) -based model, a color transformation between an internal color format and an output color format associated with the conversion being allowed to be disabled.

IPC Classes  ?

• H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
• H04N 19/13 - Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• G06N 3/02 - Neural networks

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: performing a conversion between visual data and a bitstream of the visual data with a neural network (NN) -based model, wherein a first format for coding the visual data and a second format of output visual data from the conversion are indicated with different indications, the first format indicates a first relationship between a size of a first component of the coded visual data and a size of a second component of the coded visual data, and the second format indicates a second relationship between a size of a first component of the output visual data and a size of a second component of the output visual data.

IPC Classes  ?

• H04N 19/132 - Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking

Abstract

Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: performing a first conversion between visual data and a bitstream of the visual data with a neural network (NN)-based model, the first conversion comprising at least one of the following: converting, based on a first predetermined order, a first tensor having more than one dimension to a one-dimensional first array, the first tensor and the first array storing first data associated with the visual data, and the first predetermined order indicating a correspondence between samples of the first tensor and samples of the first array, or converting, based on a second predetermined order, a one-dimensional second array to a second tensor having more than one dimension, the second tensor and the second array storing second data associated with the visual data.

IPC Classes  ?

• H04N 19/103 - Selection of coding mode or of prediction mode
• H04N 19/1 -

Abstract

Embodiments of the present disclosure provide a solution for point cloud coding. A method for point cloud coding is proposed. In the method, for a conversion between a current frame of a point cloud sequence and a bitstream of the point cloud sequence, at least one prediction weight value of at least one neighbor sub-node of a current node of the current frame is determined. A node representing a spatial partition of the current frame. A sub-node represents a partition of a node. A target neighbor for predicting the current node is determined based on the at least one prediction weight value. A prediction of the current node is determined based on the target neighbor. The conversion is performed based on the prediction.

IPC Classes  ?

• H04N 19/597 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to apply an adaptive coefficient precision for an adaptive loop filter (ALF). A conversion can then be performed between a visual media data and a bitstream based on the adaptive coefficient precision applied.

IPC Classes  ?

• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

Computing systems, computing apparatuses, computing methods, and computer program products are disclosed for machine learning ranking. An example computing method includes receiving a search query and determining a plurality of machine learning model execution engines based on the search query and a plurality of search result types. The example computing method further includes generating a plurality of subsets of search results based on the search query and the plurality of machine learning model execution engines. The example computing method further includes generating a set of search results comprising at least one search result from each of the plurality of subsets of search results.

IPC Classes  ?

• G06F 16/2457 - Query processing with adaptation to user needs
• G06N 5/04 - Inference or reasoning models
• G06N 20/00 - Machine learning

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, for a conversion between the current video block and a bitstream of the video, a target number for a set of motion candidates, the target number being smaller than or equal to an upper limit value; determining, based on the target number and a fast rate distortion optimization (RDO) process, the set of motion candidates from a plurality of motion candidates for an intra block copy (IBC) based mode for coding the current video block; and performing the conversion based on the set of motion candidates.

IPC Classes  ?

• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/103 - Selection of coding mode or of prediction mode
• H04N 19/147 - Data rate or code amount at the encoder output according to rate distortion criteria
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream

Abstract

A method for processing a video includes determining, for a first video unit, a set of local illumination compensation (LIC) parameters including a scaling factor and an offset factor; performing or skipping a pre-process on at least one parameter of the set of LIC parameters; and updating at least one history based local illumination compensation parameter table (HLICT) using at least one parameter of the set of LIC parameters, the at least one HLICT being used for a conversion of subsequent video units.

IPC Classes  ?

• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/105 - Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• H04N 19/124 - Quantisation
• H04N 19/159 - Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, for a conversion between a video unit of a video and a bitstream of the video, a filtering approach to a prediction sample associated with the video unit;and performing the conversion based on the filtered prediction sample.

IPC Classes  ?

• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: obtaining, for a conversion between a current block of a video and a bitstream of the video, a chroma fusion candidate for the current block; and performing the conversion based on the chroma fusion candidate.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: deriving, for a conversion between a current block of a video and a bitstream of the video, at least one of: a filter or a model based on decoding information; applying the at least one of: the filter or the model to coding of at least one of: the current block or a future block; and performing the conversion based on the at least one of: the filter or the model.

IPC Classes  ?

• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

A mechanism for processing video data is disclosed. A determination is made to resize an image with a first size to create a resized image with a second size. A conversion is performed between a visual media data and a bitstream based on the resized image. The conversion includes applying a neural network-based coding model to the resized image to achieve variable rate neural network-based compression.

IPC Classes  ?

• H04N 19/149 - Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• H04N 19/122 - Selection of transform size, e.g. 8x8 or 2x4x8 DCTSelection of sub-band transforms of varying structure or type
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component

Abstract

Motion compensation along different directions is disclosed. A method for video processing includes determining, for a conversion between a current video block of a video and a bitstream representation of the current video block, optical flow associated with the current video block in an optical flow-based motion refinement process or prediction process. The optical flow is derived along directions that are different from a horizontal direction and/or a vertical direction. The method also includes performing the conversion based on the optical flow.

IPC Classes  ?

• H04N 19/139 - Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determine, for a conversion between a video unit of a video and a bitstream of the video, that a first syntax element (SE) related to geometric partitioning mode (GPM) is coded with a plurality of contexts; and performing the conversion based on the first SE.

IPC Classes  ?

• H04N 19/50 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/10 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
• H04N 19/00 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining an identifying number or a syntax element named po_id is signalled in the SEI processing order SEI message to identify a group of SEI message types for which the preferred order of processing is indicated in the SEI processing order SEI message. A conversion is performed between a visual media data and a bitstream based on the syntax element.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/184 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
• H04N 19/00 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining that, except for one or more special cascading cases, any processing chain containing multiple supplemental enhancement information (SEI) message types is indicated by an SEI processing order (SPO) SEI message having a particular value of a processin order identifier syntax element. A conversion is performed between a visual media data and a bitstream based on the SPO SEI message.

IPC Classes  ?

• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/40 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/44 - Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• H04N 21/23 - Processing of content or additional dataElementary server operationsServer middleware
• H04N 13/172 - Processing image signals image signals comprising non-image signal components, e.g. headers or format information

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining preprocessing information including properties or parameters of optimizing filters is included in a bitstream. A conversion is performed between a visual media data and a bitstream based on the preprocessing information.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/635 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by filter definition or implementation details
• H04N 19/40 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• G06F 11/30 - Monitoring

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to apply a chosen processing chain to a picture, wherein the chosen processing chain includes applying one or more post-processing filters (PPFs) to the picture. The PPFs may include neural-network post-filters (NNPFs). A conversion is performed between a visual media data and a bitstream based on the PPFs.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/635 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by filter definition or implementation details
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, affine information of the current video block is determined based on first affine information of a first block of the video. The first block is coded with a first coding tool different from an affine coding tool. A prediction of the current video block is determined based on the affine information. The conversion is performed based on the prediction.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for point cloud coding. A method for point cloud coding is proposed. In the method, for a conversion between a current frame of a point cloud sequence and a bitstream of the point cloud sequence, a prediction mode for a region of the current frame is determined. The prediction mode at least comprises a first mode based on an intra prediction and an inter prediction. A prediction of the region is determined based on the prediction mode. The conversion is performed based on the prediction.

IPC Classes  ?

• G06T 9/00 - Image coding

Abstract

A method implemented by a video coding apparatus. The method includes applying a neural network (NN) filter to an unfiltered sample of a video unit to generate a filtered sample. The NN filter includes an NN filter model generated based on partitioning information of the video unit. Usage of the NN filter is indicated by one or more syntax elements in a bitstream. A conversion is performed between a video media file and a bitstream based on the filtered sample.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, for a conversion between a video unit of a video and a bitstream of the video, a connection to a plurality of filters; applying the plurality of filters with the connection in combination to the video unit; and performing the conversion based on the filtered video unit.

IPC Classes  ?

• H04N 19/82 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/86 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to use only a luma channel to convey displacement data when the displacement data is coded in a 4:4:4 video format. A conversion is performed between a visual media data and a bitstream based on the displacement data.

IPC Classes  ?

• H04N 19/186 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
• H04N 19/463 - Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
• H04N 19/11 - Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• H04N 19/137 - Motion inside a coding unit, e.g. average field, frame or block difference
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• H04N 19/51 - Motion estimation or motion compensation

Abstract

A mechanism for processing video data is disclosed. The mechanism determines for a supplemental enhancement information (SEI) processing order SEI message that SEI prefix indications, when present, are signaled in units of bits, where an SEI prefix indication for a particular SEI payloadType is a bit string that follows an SEI payload syntax of that value of payloadType and contains a number of complete syntax elements starting from a first syntax element in an SEI payload. A conversion is performed between a visual media data and a bitstream based on the SEI processing order SEI message.

IPC Classes  ?

• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/40 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• H04N 19/44 - Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• H04N 21/23 - Processing of content or additional dataElementary server operationsServer middleware
• H04N 13/172 - Processing image signals image signals comprising non-image signal components, e.g. headers or format information

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining multiple neural-network post-filters (NNPFs) or neural-network post-processing filter groups (NNPFGs) defined in one or more supplemental enhancement information (SEI) messages share a same NNPF purpose. A conversion is performed between a visual media data and a bitstream based on the NNPF purpose.

IPC Classes  ?

• H04N 19/46 - Embedding additional information in the video signal during the compression process
• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/70 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• H04N 19/85 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
• G06N 3/08 - Learning methods
• G06N 3/09 - Supervised learning
• G06N 3/0895 - Weakly supervised learning, e.g. semi-supervised or self-supervised learning
• G06N 3/091 - Active learning
• G06N 3/092 - Reinforcement learning
• G06N 3/094 - Adversarial learning
• G06N 3/098 - Distributed learning, e.g. federated learning
• G06N 3/0985 - Hyperparameter optimisationMeta-learningLearning-to-learn

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to apply a processing chain of post-processing filters (PPFs) to visual media data by: obtaining a list of cropped decoded pictures in output order, choosing the processing chain, applying each PPF in the processing chain to each cropped decoded picture in the list, and replacing cropped decoded pictures in the list with processed pictures. A conversion is performed between a visual media data and a bitstream based on the processing chain.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/635 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by filter definition or implementation details
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer

Abstract

A mechanism for processing video data is disclosed. The mechanism includes determining to obtain a list of output pictures from a processing chain, wherein the list of output pictures can include more pictures than are output by a last post-processing filter (PPF) in the processing chain. The PPFs may be neural-network post-filter (NNPFs). A conversion is performed between a visual media data and a bitstream based on the processing chain.

IPC Classes  ?

• H04N 19/117 - Filters, e.g. for pre-processing or post-processing
• H04N 19/635 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets characterised by filter definition or implementation details
• H04N 19/80 - Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• H04N 19/187 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer

Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, a first prediction of the current video block is determined based on a first coding tool. The first coding tool comprises a motion vector difference (MVD) -related coding tool. A third prediction of the current video block is determined based on the first prediction and a second prediction of the current video block. The second prediction is determined based on a second coding tool different from the first coding tool. The conversion is performed based on the third prediction.

IPC Classes  ?

• H04N 19/176 - Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Abstract

Embodiments of the present disclosure provide a solution for point cloud processing. A method for point cloud processing is proposed. The method comprises: determining, for a conversion between a current point cloud (PC) sample of a point cloud sequence and a bitstream of the point cloud sequence, a prediction for a current feature of the current PC sample based on a current sparse PC sample of the current PC sample, a set of sparse PC samples and a set of features of at least one reference PC sample of the current PC sample; and performing the conversion based on the prediction for the current feature.

IPC Classes  ?

• G06T 9/00 - Image coding