An example method for facilitating virtual machines running in a container system includes determining, by a distributed storage management system, that a volume includes a disk image for providing virtual machines in a container system; copying, by the distributed storage management system and based on the determining that the volume includes the disk image, the volume to a plurality of nodes in the container system; and producing, by the distributed storage management system and based on the copying, a clone of the volume on a particular node of the plurality of nodes to start a virtual machine on the particular node.
G06F 9/455 - ÉmulationInterprétationSimulation de logiciel, p. ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
2.
OPTIMIZED RESILIENCY GROUP FORMATION IN A MODULAR STORAGE SYSTEM
A storage configuration of a storage system is received by a storage controller and a set of storage devices of a plurality of storage nodes of the storage system that are available within the storage configuration are identified. A minimum resiliency for data stored in the storage system is determined and at least one resiliency group within the storage system based on the available storage devices in the storage configuration of the storage system and the minimum resiliency for data stored in the storage system is generated.
A method for execution by one or more computing devices of a storage network includes receiving an upgrade request for software of a set of dispersed storage units of a storage network. The method further includes selecting one or more dispersed storage units of the set of dispersed storage units for software upgrading based on available dispersed storage units such that at least an active number of dispersed storage units of the set of dispersed storage units remain active during an upgrade sequence associated with the software upgrading. The method further includes upgrading the software of the selected one or more dispersed storage units in accordance with the upgrade request.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/00 - Détection d'erreursCorrection d'erreursContrôle de fonctionnement
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
H03M 13/00 - Codage, décodage ou conversion de code pour détecter ou corriger des erreursHypothèses de base sur la théorie du codageLimites de codageMéthodes d'évaluation de la probabilité d'erreurModèles de canauxSimulation ou test des codes
H03M 13/05 - Détection d'erreurs ou correction d'erreurs transmises par redondance dans la représentation des données, c.-à-d. mots de code contenant plus de chiffres que les mots source utilisant un codage par blocs, c.-à-d. un nombre prédéterminé de bits de contrôle ajouté à un nombre prédéterminé de bits d'information
H03M 13/15 - Codes cycliques, c.-à-d. décalages cycliques de mots de code produisant d'autres mots de code, p. ex. codes définis par un générateur polynomial, codes de Bose-Chaudhuri-Hocquenghen [BCH]
H03M 13/37 - Méthodes ou techniques de décodage non spécifiques à un type particulier de codage prévu dans les groupes
4.
Application migration using data movement capabilities of a storage system
Application migration using data movement capabilities of a storage system, including: executing an application on a first on-premises cloud infrastructure; storing, in a first storage system that is coupled for data communications with the first on-premises cloud infrastructure, data associated with the application; replicating, from the first storage system to a second storage system that is coupled for data communications with a second on-premises cloud infrastructure, the data; and initiating, based on the data, execution of a new instance of the application on the second on-premises cloud infrastructure.
A method for execution by a computing device of a storage network includes detecting a shutdown associated with a local flash memory of the storage network, where a plurality of data segments are dispersed storage error encoded in accordance with distributed data storage parameters to produce pluralities of sets of encoded data slices, and the pluralities of sets of encoded data slices include encoded data slices stored in the local flash memory. The method further includes determining at least one storage location for transferring storage of a group of the encoded data slices. The method further includes transferring the group of the encoded data slices to the at least one storage location.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
H03M 13/09 - Détection d'erreurs uniquement, p. ex. utilisant des codes de contrôle à redondance cyclique [CRC] ou un seul bit de parité
H03M 13/15 - Codes cycliques, c.-à-d. décalages cycliques de mots de code produisant d'autres mots de code, p. ex. codes définis par un générateur polynomial, codes de Bose-Chaudhuri-Hocquenghen [BCH]
H03M 13/23 - Détection d'erreurs ou correction d'erreurs transmises par redondance dans la représentation des données, c.-à-d. mots de code contenant plus de chiffres que les mots source utilisant des codes de convolution, p. ex. codes d'unité de mémoire
H03M 13/27 - Codage, décodage ou conversion de code pour détecter ou corriger des erreursHypothèses de base sur la théorie du codageLimites de codageMéthodes d'évaluation de la probabilité d'erreurModèles de canauxSimulation ou test des codes utilisant des techniques d'entrelaçage
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
6.
Orchestrating Storage Provisioning Policies Using Declared Storage Objectives
Declarative provisioning of storage, including: identifying one or more policies associated with a storage object; determining, in dependence upon at least the one or more policies, a storage configuration for the storage object; and provisioning, in accordance with the storage configuration, storage that implements the storage object.
An illustrative method includes monitoring, by a storage system, one or more operations performed by a host with respect to data stored within a storage system, the host and the storage system operating within an environment bounded by a managed network; detecting, by the storage system based on the monitoring, an anomaly associated with the one or more operations; and sending, by the storage system based on the detecting the anomaly, metadata descriptive of the anomaly to a network monitoring system configured to perform a network monitoring service with respect to outgoing network traffic from the managed network, wherein the metadata is usable by the network monitoring system to perform the network traffic monitoring service.
Self-tuning clusters for resilient microservices, including: receiving, by a services orchestrator within a cloud-computing environment and from a plurality of cloud computing instances, respective latency measurements corresponding to respective control plane operations directed to a shared resource of the plurality of cloud computing instances; determining, based on a current timeout value and on the respective latency measurements from the plurality of cloud computing instances, an updated timeout value for the shared resource; and providing, to each of the plurality of cloud computing instances, the updated timeout value for the shared resource.
One or more performance parameters associated with data stored at a storage device of a plurality of storage devices are received by a storage controller. A first number of blocks of the storage device to a high resiliency portion and a second number of blocks of the storage device to a low resiliency portion of the storage device are allocated based on the one or more performance parameters.
Replicating a dataset in a storage system operating in a reduced power mode, including: detecting that the storage system should enter the reduced power mode; entering the reduced power mode; and performing, while in the reduced power mode, one or more data replication operations associated with the dataset, including selecting, from amongst a plurality of data communication mechanisms, a data communication mechanism to utilize for performing the one or more data replication operations.
A method to estimate remaining lifespan of a storage device is provided. The method includes obtaining first time series data for a set of metrics associated with operation of a set of flash storage devices, obtaining second time series data for one or more health metrics associated the set of storage devices, providing the first time series data for the set of metrics associated with operation of the plurality of flash storage devices and the second time series data for the one or more health metrics associated with the set of storage devices as training data to a machine learning model, and training the machine learning model to estimate a time to failure of a flash storage device based on the first time series data and the second time series data.
A storage system has NVRAM (nonvolatile random-access memory), storage memory that includes SLC (single level cell) flash memory and QLC (quad level cell) flash memory, and a processor. The processor performs a method that includes determining that a size of a buffer of a storage system should be adjusted. The storage system comprises a non-volatile random-access memory (NVRAM), single level cell (SLC) flash memory, and quad level cell (QLC) flash memory. The buffer of the storage system comprises one or more of the NVRAM and a portion of the SLC flash memory. The method also includes adjusting the size of the buffer of the storage system to a first size.
A failure of a particular storage device is detected where at least a portion of data stored in the particular storage device is readable after the failure. In response to detecting the failure of the particular storage device, one or more copies of the portion of the data that is readable are stored in one or more other storage devices. An addition of a replacement storage device to the storage system that replaces the particular storage device is detected. The one or more copies of the portion of the data that is readable are stored in the replacement storage device.
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
14.
Decommissioning Keys In A Decryption Storage System
A method of decommissioning a key in a decryption storage system includes scanning a storage system to identify metadata associated with a current key to be decommissioned. The method further includes encrypting, with the current key, data corresponding to the metadata to generate encrypted data. The method further includes decrypting the encrypted data with a target key to generate decrypted data. The method further includes modifying, by a processing device, the metadata to identify the target key to generate modified metadata. The method further includes storing the decrypted data and the modified metadata to the storage system.
A recovery storage system asynchronously protecting a synchronously replicated dataset, where the asynchronous protection of the synchronously replicated dataset includes: receiving, by a recovery storage system, an identifier of a synchronously replicated dataset, wherein the synchronously replicated dataset is a dataset synchronously replicated across the plurality of storage systems; asynchronously replicating, on the recovery storage system, the synchronously replicated dataset from the plurality of storage systems; detecting that each dataset in the synchronously replicated dataset on the plurality of storage systems has become unavailable; and restoring the dataset on the recovery storage system.
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 9/455 - ÉmulationInterprétationSimulation de logiciel, p. ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
16.
Optimizing Transfer Of Small Files Of A Storage System
A method of data transfer between storage systems includes determining to transfer a dataset stored at a first storage system to a second storage system and invoking an operation to retrieve, for portions of the dataset having a size less than a threshold size, an identifier, metadata, and data stored in the portions of the dataset. The method further includes transmitting the identifiers, the metadata, and the data for the portions of the dataset having a size less than the threshold size to the second storage system.
G06F 12/0862 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache avec pré-lecture
G06F 12/0866 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache pour les systèmes de mémoire périphérique, p. ex. la mémoire cache de disque
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
17.
UTILIZING MULTIPLE FINGERPRINT TABLES FOR DATA DEDUPLICATION IN A FLASH SYSTEM
An entry for data to be stored in one or more storage devices of a storage system is added by a storage system controller to a particular fingerprint table of multiple fingerprint tables having a range of probabilities that a probability of the data being deduplicated falls within. One of the multiple fingerprint tables is modified in response to an occurrence of an event.
A first command including data to be stored in non-volatile random access memory (NVRAM) of a storage device is received from a storage system controller by a storage device controller. In response to receiving the first command, the data is stored in the NVRAM. One or more second commands including a location in flash memory of the storage device for storing the data and an instruction to store the data in the location of the flash memory are received from the storage system controller. In response to receiving the one or more second commands, the data is stored in the location of the flash memory.
Providing persistent storage to transient cloud computing services, including: creating a cloud computing instance, wherein the cloud computing instance is created on on-premises cloud infrastructure; and storing, in non-volatile storage in a storage system that is communicatively coupled to the on-premises cloud infrastructure, data associated with the cloud computing instance.
Data protection in a storage system that includes a plurality of Non-Volatile Memory Express (‘NVMe’) Solid State Drives (‘SSDs’), including: retrieving, from a plurality of NVMe SSDs (‘Non-Volatile Memory Express Solid State Drives’) of a storage system, one or more unencrypted shares of a master secret; reconstructing the master secret using the shares of the master secret; decrypting one or more encrypted device keys using the master secret; and using the decrypted device keys to perform a plurality of accesses to one or more of the NVMe SSDs.
G06F 21/78 - Protection de composants spécifiques internes ou périphériques, où la protection d'un composant mène à la protection de tout le calculateur pour assurer la sécurité du stockage de données
A method for read voltage levels in flash memory is provided. The method includes determining to which set of pages or blocks of a flash memory device a word line connects, according to a flash memory device architecture. The method includes determining one or more optimum read voltage levels, for one or more pages of the flash memory device that are accessed by activating the word line, according to a specified number of bits per cell and the flash memory device architecture, and using the one or more optimum read voltage levels to access further pages in the set of pages or blocks of the flash memory device to which the word line connect.
Deleting objects based on key pattern matching, including: receiving, by an object storage system, a request to delete any objects matching a key pattern from a bucket of the object storage system; and deleting, in response to the request, a plurality of objects matching the key pattern from the bucket of the object storage system.
G06F 12/0862 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache avec pré-lecture
G06F 12/0866 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache pour les systèmes de mémoire périphérique, p. ex. la mémoire cache de disque
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
23.
MANAGING DATA CONFIGURATION INFORMATION ACROSS DATA REPOSITORIES
An example method for managing data configuration information across data repositories includes receiving, by a target data repository, data for replication from a source data repository; generating, by the target data repository and based on the receiving the data, target repository identifier information for the data, the target repository identifier information enabling clients to access the data on the target data repository and different from source repository identifier information; accessing, by the target data repository, the source repository identifier information that enables clients to access the data on the source data repository; providing, by the target data repository at a first time, the target repository identifier information for accessing the data on the target data repository; and providing, by the target data repository at a second time, the source repository identifier information for accessing the data on the target data repository.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
G06F 16/383 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
24.
Protection of Snapshots of Storage System Data Using a Dedicated Data Store
An illustrative method includes generating a snapshot for data stored in a storage system, storing the snapshot in a first data store, and performing a replication process with respect to the snapshot. The replication process includes creating a snapshot replica representative of a replica of the snapshot and storing the snapshot replica in a second data store, the second data store dedicated to storing snapshot replica data representative of snapshot replicas by implementing write requests representative of requests to write the snapshot replicas to the second data store and not implementing all other types of write requests; wherein a retention policy associated with the second data store specifies one or more conditions that each have to be satisfied for the snapshot replica data stored in the second data store to be modified or deleted from the second data store.
Data spillover for storage arrays, including: entering, by a source storage array, in response to determining that an amount of used capacity for the source storage array exceeds a first threshold, a spillover mode; redirecting, in response to the source storage array being in the spillover mode, write operations directed to the source storage array to a target storage array; and exiting the spillover mode by the source storage array, wherein exiting the spillover mode comprises updating data stored on the source storage array to reflect write operations redirected to the target storage array during the spillover mode.
Predicting write lifetimes for data using machine learning, including: receiving a write operation to write data to a storage device of a storage system; determining, using a trained model, an estimated write lifetime for the data; and writing the data to a memory location of the storage device based on the estimated write lifetime for the data.
Continuing to service a dataset after prevailing in mediation, including: requesting, by a first storage system, mediation from a mediation service that is configured to resolve which storage system continues to service a dataset after the triggering event, wherein the dataset is synchronously replicated by a plurality of storage systems that includes the first storage system and a second storage system; and detaching the second storage system from a plurality of storage systems synchronously replicating the dataset.
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/07 - Réaction à l'apparition d'un défaut, p. ex. tolérance de certains défauts
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 12/06 - Adressage d'un bloc physique de transfert, p. ex. par adresse de base, adressage de modules, extension de l'espace d'adresse, spécialisation de mémoire
G06F 12/1072 - Traduction d’adresse décentralisée, p. ex. dans des systèmes de mémoire partagée distribuée
G06F 16/178 - Techniques de synchronisation des fichiers dans les systèmes de fichiers
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
H04L 45/00 - Routage ou recherche de routes de paquets dans les réseaux de commutation de données
H04L 45/12 - Évaluation de la route la plus courte
H04L 47/125 - Prévention de la congestionRécupération de la congestion en équilibrant la charge, p. ex. par ingénierie de trafic
H04L 67/1095 - Réplication ou mise en miroir des données, p. ex. l’ordonnancement ou le transport pour la synchronisation des données entre les nœuds du réseau
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
A processing system is operable to encode data to produce a first set of data slices based on a value of a width parameter. The data is stored based on maintaining storage of the first set of data slices across a set of storage units of a storage pool. Storage of the first set of data slices is maintained in the set of storage units of the storage pool after addition of an additional set of storage units added to the storage pool. The value of the width parameter is increased to an increased value to produce an updated width parameter. The data is re-encoded in accordance with the updated width parameter to produce a second set of data slices. The data is re-stored based on maintaining storage of the second set of data slices across the expanded set of storage units of the storage pool.
Providing for increased flexibility for large scale parity, the including: writing data to a storage system, including utilizing a first data protection scheme; identifying, for storage media in the storage system, characteristics of the storage media; identifying, in dependence up the characteristics for the storage media, a second data protection scheme to use for the data; and writing the data to the to the storage system utilizing the second data protection scheme.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
Data for a first type of workload that is to be stored in a storage system is received. A first request to store the data for the first type of workload in flash memory is transmitted to a storage device of the storage system. The data for the first type of workload is to be mapped using a first indirection unit (IU) size. Data for a second type of workload that is to be stored in the storage system is received. A second request to store the data for the second type of workload in the flash memory is transmitted to the storage device. The data for the second type of workload is to be mapped using a second IU size that is different than the first IU size.
A method for processing blocks of flash memory to decrease raw bit errors from the flash memory is provided. The method includes identifying one or more blocks of the flash memory for a refresh operation and writing information regarding the identified blocks, to a data structure. The method includes issuing background reads to the identified blocks, according to the data structure, as the refresh operation. The method may be embodied on a computer readable medium. In some embodiments the background reads may be based on a time based refresh responsive to an increase in raw bit error count in the flash memory over time.
G11C 16/34 - Détermination de l'état de programmation, p. ex. de la tension de seuil, de la surprogrammation ou de la sousprogrammation, de la rétention
G06F 11/07 - Réaction à l'apparition d'un défaut, p. ex. tolérance de certains défauts
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G11C 11/402 - Mémoires numériques caractérisées par l'utilisation d'éléments d'emmagasinage électriques ou magnétiques particuliersÉléments d'emmagasinage correspondants utilisant des éléments électriques utilisant des dispositifs à semi-conducteurs utilisant des transistors formant des cellules nécessitant un rafraîchissement ou une régénération de la charge, c.-à-d. cellules dynamiques avec régénération de la charge propre à chaque cellule de mémoire, c.-à-d. rafraîchissement interne
G11C 16/04 - Mémoires mortes programmables effaçables programmables électriquement utilisant des transistors à seuil variable, p. ex. FAMOS
H04L 1/20 - Dispositions pour détecter ou empêcher les erreurs dans l'information reçue en utilisant un détecteur de la qualité du signal
32.
Corruption-free Recovery Point Determination for Ransomware Attacks Against Storage Systems
A data protection system may perform a process including accessing a first compressibility metric indicating an amount of storage space saved if write traffic processed by a storage system is compressed and a second compressibility metric indicating an amount of storage space saved if write traffic processed by an additional storage system is compressed, the additional storage system configured to replicate data stored by the storage system; determining, based on the first and second compressibility metrics, that the storage system is possibly being targeted by a security threat that causes a potential data corruption; and determining a corruption-free recovery point for potential use by the storage system to recover from the potential data corruption.
An illustrative method includes an access control list (ACL) management system generating an ACL that describes one or more access permissions in a file system; generating an ACL identifier for the ACL; mapping, using the ACL identifier, the ACL to a plurality of data files in the file system to apply the ACL to the plurality of data files, the mapping the ACL comprising updating one or more metadata records for the plurality of data files; receiving a request associated with one or more of the plurality of data files; accessing, based on the request, the ACL identifier using the one or more metadata records for the plurality of data files; and accessing, using the ACL identifier, the ACL.
Using machine learning and data sampling to optimize data reduction, including: collecting a plurality of data samples from data stored in a storage system; calculating, based on the plurality of data samples, a deduplication ratio; calculating, based on the plurality of data samples, a compression ratio; and performing a data reduction resource allocation in the storage system based on the deduplication ratio and the compression ratio.
Creating a modifiable cloned image of a dataset, including: generating, based on a dataset stored within a source data repository, a tracking copy of replica data on a target data repository; generating, after receiving an indication to begin accepting modifications to the tracking copy of the replica data, a cloned image of the dataset that is modifiable without modifying the tracking copy of the replica data; and responsive to a storage operation directed to the target data repository, modifying the cloned image of the dataset without modifying the tracking copy of the replica data.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
G06F 16/383 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des métadonnées provenant automatiquement du contenu
Projecting capacity utilization for snapshots includes identifying one or more data release patterns of a storage system; identifying a snapshot policy; and generating, based on the one or more data release patterns and the snapshot policy, an estimate of an impact of the snapshot policy on a capacity of the storage system.
A method for execution by a storage network begins by receiving a data object for storage, segmenting the data according to a data segmenting protocol to generate a set of data segments and executing a deterministic function on the set of data segments to generate scoring information for respective data segments of the set of data segments. The method continues by comparing the scoring information for a respective data segment to scoring information for previously stored data segments in the storage network and based on the comparison, facilitating storage of a first portion of the set of data segments and not storing a second portion of the set of data segments.
G06F 21/62 - Protection de l’accès à des données via une plate-forme, p. ex. par clés ou règles de contrôle de l’accès
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 21/55 - Détection d’intrusion locale ou mise en œuvre de contre-mesures
G06F 21/64 - Protection de l’intégrité des données, p. ex. par sommes de contrôle, certificats ou signatures
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
H04W 12/082 - Sécurité d'accès utilisant la révocation d’autorisation
H04W 12/65 - Sécurité dépendant du contexte dépendant de l’environnement, p. ex. utilisant les données environnementales saisies
38.
Identifying a Resource of a Storage Network for Data Retrieval
Methods and apparatus for identifying resources of a storage network for data retrieval. In an example method, a determination is made to retrieve a data from the storage network, the data having an associated asset identifier. The method further includes converting the asset identifier into a range identifier and performing a deterministic function (e.g., a hashing function) on the range identifier to produce a lookup value. The range identifier may include a smaller number of bits than the asset identifier in an example. The method further includes retrieving storage location information for the data based on the lookup value.
H04L 47/70 - Contrôle d'admissionAllocation des ressources
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
A method of scheduling input/output operations for a storage system including determining a deadline for a storage operation, wherein the deadline is dependent on an expected latency of the storage operation; adding the storage operation to a queue of storage operations; and reordering the queue dependent upon the deadline of the storage operation and one or more deadlines of one or more storage operations in the queue of storage operations.
Dynamic user interfaces for storage system management using generative artificial intelligence (AI), including: receiving a natural language request via a natural language interface of a graphical user interface (GUI) for a storage system; generating, by a generative AI model and based on the natural language request, one or more GUI components for presenting information associated with the natural language request; and presenting, via the GUI for the storage system, the one or more GUI components.
Tiering snapshots across different storage tiers, including: creating a snapshot of a dataset, wherein the snapshot includes user data and metadata; offloading the snapshot of the dataset to a first storage level storage system; and migrating, in accordance with a lifecycle policy and via one or more copy offload operations, the snapshot from the first storage level storage system to a second storage level storage system.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
A method for a transactional commit in a storage unit is provided. The method includes receiving a logical record from a storage node into a transaction engine of a storage unit of the storage node and writing the logical record into a data structure of the transaction engine. The method includes writing, to a command queue of the transaction engine, an indication to perform an atomic update using the logical record and transferring each portion of the logical record from the data structure of the transaction engine to non-persistent memory of the storage unit as a committed transaction. A storage unit for a storage system is also provided.
G06F 9/46 - Dispositions pour la multiprogrammation
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 12/0802 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache
G06F 12/0868 - Transfert de données entre une mémoire cache et d'autres sous-systèmes, p. ex. des dispositifs de stockage ou des systèmes hôtes
G06F 13/16 - Gestion de demandes d'interconnexion ou de transfert pour l'accès au bus de mémoire
G06F 16/10 - Systèmes de fichiersServeurs de fichiers
43.
Managing Versioning in a Distributed Storage Network
A method for execution in a storage network begins by determining to adjust a version number associated with a data object stored in the storage network, where the data object was dispersed storage error encoded to produce a set of encoded data slices. The method continues by identifying a number of versions associated with the data object and based on the number of versions identified and the adjusted version number associated with the data object, generating metadata associated with the data object. The method then continues by issuing a write request for each encoded data slice of the set of encoded data slices to the set of storage units, where each write request includes the metadata associated with the data object.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
H03M 13/15 - Codes cycliques, c.-à-d. décalages cycliques de mots de code produisant d'autres mots de code, p. ex. codes définis par un générateur polynomial, codes de Bose-Chaudhuri-Hocquenghen [BCH]
H04L 67/025 - Protocoles basés sur la technologie du Web, p. ex. protocole de transfert hypertexte [HTTP] pour la commande à distance ou la surveillance à distance des applications
H04L 67/1008 - Sélection du serveur pour la répartition de charge basée sur les paramètres des serveurs, p. ex. la mémoire disponible ou la charge de travail
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
One or more operations to be performed by a storage system are identified by a first storage node having a processing device and one or more authorities that determine types of erasure coding applied to data stored in the storage system. One or more instructions are transmitted to a second storage node to perform the one or more storage operations, wherein the one or more instructions cause the one or more operations to be performed by the second storage node.
G06F 16/22 - IndexationStructures de données à cet effetStructures de stockage
G06F 16/13 - Structures d’accès aux fichiers, p. ex. indices distribués
G06F 16/907 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement
Methods and apparatus for storing data and metadata in a storage network. In a method, one or more processing modules of a storage network establishes a vault as a virtual memory block that maps to memory of the storage network. The method further includes receiving data for storage in the vault, selecting a first vault parameter set regarding distributed storage of the data, and encoding at least a portion of the data in accordance with the first vault parameter set to produce a set of encoded data slices. The method further includes obtaining metadata regarding the set of encoded data slices, selecting a second vault parameter set regarding distributed storage of the metadata, and encoding the metadata in accordance with the second vault parameter set to produce metadata encoded slices. The method further includes facilitating storage of the set of encoded slices and the metadata encoded slices in the vault.
H04L 9/32 - Dispositions pour les communications secrètes ou protégéesProtocoles réseaux de sécurité comprenant des moyens pour vérifier l'identité ou l'autorisation d'un utilisateur du système
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
46.
SIMILARITY BASED COMPRESSION IN A DISTRIBUTED STORAGE SYSTEM
A subset of nodes including storage devices having similar data to data to be stored in a storage system are identified by a storage system controller using hashes corresponding to the data to be stored. The data to be stored in the storage system is transmitted to a particular node of the subset of nodes having data similar to the data based on node characteristics received from the particular node.
A first power profile for servicing a first type of workload is provided to a particular storage device. An input/output (I/O) request for a second type of workload is received. A second power profile for servicing the second type of workload that is different than the first power profile is provided to the particular storage device. The I/O request is transmitted to the particular storage device, wherein the particular storage device is to service the I/O request using the second power profile.
Optimizing copy operations in a storage array, includes combining, in dependence upon a metadata optimization policy, a plurality of copy operations into a single copy operation and splitting the single copy operation into an optimized set of executable copy operations that copy data based on memory alignment.
Prioritizing highly performant storage systems for servicing a synchronously replicated dataset: detecting a communication fault between two or more storage systems that are synchronously replicating a dataset; identifying a preferred storage system for winning mediation, including determining that the preferred storage system winning mediation would result in better performance than other storage systems winning mediation; and requesting, by the preferred storage system, mediation from a mediation target.
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/07 - Réaction à l'apparition d'un défaut, p. ex. tolérance de certains défauts
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 12/06 - Adressage d'un bloc physique de transfert, p. ex. par adresse de base, adressage de modules, extension de l'espace d'adresse, spécialisation de mémoire
G06F 12/1072 - Traduction d’adresse décentralisée, p. ex. dans des systèmes de mémoire partagée distribuée
G06F 16/178 - Techniques de synchronisation des fichiers dans les systèmes de fichiers
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
H04L 45/00 - Routage ou recherche de routes de paquets dans les réseaux de commutation de données
H04L 45/12 - Évaluation de la route la plus courte
H04L 47/125 - Prévention de la congestionRécupération de la congestion en équilibrant la charge, p. ex. par ingénierie de trafic
H04L 67/1095 - Réplication ou mise en miroir des données, p. ex. l’ordonnancement ou le transport pour la synchronisation des données entre les nœuds du réseau
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
50.
MODIFYING PROTOCOLS FOR MULTI-PORTED STORAGE DEVICES OF A STORAGE SYSTEM
A method includes, responsive to receiving a modified first reservation command from a storage controller, identifying, by a storage drive, a first range of storage based on a first range identifier of the modified reservation command. The method also includes granting, by the storage drive, a reservation for access to the storage drive on behalf of a first host controller by associating the reservation for the first range with a second range of storage.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 9/48 - Lancement de programmes Commutation de programmes, p. ex. par interruption
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
H04L 67/60 - Ordonnancement ou organisation du service des demandes d'application, p. ex. demandes de transmission de données d'application en utilisant l'analyse et l'optimisation des ressources réseau requises
51.
Rebuilding Encoded Data Slices in Accordance with a Reduced Rebuild Threshold
A method for execution by one or more computing devices of a storage network includes determining an encoded data slice of a set of encoded data slices needs rebuilding during an encoded data slice reduction operation. The method further includes determining whether a current number of encoded data slices of the set of encoded data slices that are not in need of rebuilding is less than a reduced rebuild threshold number associated with the encoded data slice reduction operation. When the current number is less than reduced rebuild threshold number, the method further includes rebuilding the encoded data slice.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
A storage system with storage drives and a processing device establishes resiliency groups of storage system resources. The storage system determines an explicit trade-off between data survivability over resource failures and data capacity efficiency, for the resiliency groups. Responsive to adding at least one storage drive, the storage system establishes re-formed resiliency groups according to the explicit trade-off, without decreasing data survivability. The storage system may bias to have more and narrower resiliency groups to increase mean time to data loss.
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
G06F 11/07 - Réaction à l'apparition d'un défaut, p. ex. tolérance de certains défauts
53.
USING SIMILARITY DATA TO REDUCE DATA STORED FOR DATA SEGMENTS
A content-dependent delta between a first content-dependent feature of a first data segment and a second content-dependent feature of a second data segment is determined by a storage system controller. The content-dependent delta and an indicator of the first data segment is stored in one or more storage devices.
G06F 16/174 - Élimination de redondances par le système de fichiers
G06F 16/22 - IndexationStructures de données à cet effetStructures de stockage
G06F 18/2413 - Techniques de classification relatives au modèle de classification, p. ex. approches paramétriques ou non paramétriques basées sur les distances des motifs d'entraînement ou de référence
54.
Determining Storage Capacity Utilization Based On Deduplicated Data
Determining effective space utilization in a storage system, including: identifying an amount of data stored within the storage system that is associated with a user-visible entity; identifying an amount of data stored within the storage system that is associated with all snapshots of the user-visible entity; and reporting, in dependence upon the an amount of data stored within the storage system that is associated with the user-visible entity and the amount of data stored within the storage system that is associated with all snapshots of the user-visible entity, a total capacity utilization associated with the user-visible entity.
A first set of physical units of a storage device of a storage system is selected for performance of low latency access operations, wherein other access operations are performed by remaining physical units of the storage device. A determination as to whether a triggering event has occurred that causes a selection of a new set of physical units of the storage device for the performance of low latency access operations is made. A second set of physical units of the storage device is selected for the performance of low latency access operations upon determining that the triggering event has occurred.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/07 - Réaction à l'apparition d'un défaut, p. ex. tolérance de certains défauts
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 11/34 - Enregistrement ou évaluation statistique de l'activité du calculateur, p. ex. des interruptions ou des opérations d'entrée–sortie
G06F 12/0804 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache avec mise à jour de la mémoire principale
G06F 12/0866 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache pour les systèmes de mémoire périphérique, p. ex. la mémoire cache de disque
A list of a available zones across respective SSD storage portions of a plurality of zoned storage devices of a storage system is maintained. Data is received from multiple sources, wherein the data is associated with processing a dataset, the dataset including multiple volumes and associated metadata. Shards of the data are determined such that each shard is capable of being written in parallel with the remaining shards. The shards are mapped to a subset of the available zones, respectively. The shards are written to the subset of the available zones in parallel.
Systems and method for implementing deduplication process based on performance analyses. The system may include a processing device to determine a first performance metric associated with retrieving a second stored data block that is within a specified range of a duplicate of the first data block and a second performance metric associated with retrieving a hash value corresponding to the second stored data block. The processing device further to retrieve the second stored data block within a specified range of the duplicate of the first data block in response to the first performance metric not exceeding the second performance metric.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 12/1018 - Traduction d'adresses avec tables de pages, p. ex. structures de table de page impliquant des techniques de hachage, p. ex. tables de page inversée
G06F 16/22 - IndexationStructures de données à cet effetStructures de stockage
Pod-level snapshot replication, including: generating a snapshot of a data set included in a source pod of a storage system; and replicating the snapshot of the data set to a target pod different than the source pod.
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
Monitoring write amplification metrics for a flash-based storage system, including: generating, by a controller of a storage system, data describing write activity for each storage device of a plurality of storage devices of the storage system, wherein the data describing the write activity comprises data describing application write activity for each storage device of the plurality of storage devices; calculating, by the controller of the storage system, for each storage device of the plurality of storage devices, a corresponding write amplification metric; and providing, by the controller of the storage system, to each storage device of the plurality of storage devices, the corresponding write amplification metric.
A method includes error encoding data to produce a plurality of data slices. Metadata is determined for a data slice of the plurality of data slices. The metadata is stored in a metadata storage tree. The data slice is stored in a slice storage location indicated by the metadata. Based on determining to access the data slice, the metadata for the data slice is accessed in the metadata storage tree to determine the slice storage location for the data slice, and the data slice is accessed in the slice storage location based on determining the slice storage location for the data slice via accessing the metadata storage tree.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
A storage cluster with disaggregated compute resources and storage memory is provided. The storage cluster includes a plurality of blades coupled as the storage cluster, each of at least a subset of the plurality of blades having solid-state storage memory therein. The storage cluster includes a switch that direct network-connects a plurality of processors, as compute resources in the plurality of blades, and the solid-state storage memory in each of the at least a subset of the plurality of blades, wherein the compute resources and the solid-state storage memory are disaggregated in the storage cluster.
G06F 15/16 - Associations de plusieurs calculateurs numériques comportant chacun au moins une unité arithmétique, une unité programme et un registre, p. ex. pour le traitement simultané de plusieurs programmes
G06F 1/26 - Alimentation en énergie électrique, p. ex. régulation à cet effet
G06F 1/3234 - Économie d’énergie caractérisée par l'action entreprise
G06F 1/3287 - Économie d’énergie caractérisée par l'action entreprise par la mise hors tension d’une unité fonctionnelle individuelle dans un ordinateur
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 9/50 - Allocation de ressources, p. ex. de l'unité centrale de traitement [UCT]
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
H04L 41/0893 - Affectation de groupes logiques aux éléments de réseau
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
62.
Notification of an Unfavorable Access Pattern in a Storage Network
A processing system operates by: detecting an access anomaly associated with an access request from a requestor for a set of encoded data slices, the access anomaly having an unfavorable access pattern, wherein the set of encoded data slices is dispersed storage error encoded and stored in at least one storage unit of the storage network; denying the access request in response to detecting the access anomaly; generating, based on the unfavorable access pattern, an anomaly detection indicator identifying the requestor; and sending the anomaly detection indicator to other devices of the storage network.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
63.
Rebuilding Encoded Data Slices via a Storage Network Processor
A storage network operates by: encoding, via a dispersed error encoding, at least one data object as a write threshold number of encoded data slices; storing the write threshold number of the encoded data slices in a set of storage units of the storage network; determining when, due to a failure, less than a pillar width number of the encoded data slices are retrievable from the set of storage units: retrieving a decode threshold number of the encoded data slices from others of the set of storage units; decoding the decode threshold number of the encoded data slices to reproduce the at least one data object; restoring availability of the pillar width number of the encoded data slices of the common revision by: rebuilding at least a subset of encoded data slices of the set of encoded data slices, based on an encoding of the at least one data object; and storing the at least a subset of encoded data slices in the storage network.
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 16/178 - Techniques de synchronisation des fichiers dans les systèmes de fichiers
H04L 67/00 - Dispositions ou protocoles de réseau pour la prise en charge de services ou d'applications réseau
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
64.
Preventing Applications From Overconsuming Shared Storage Resources
Preventing applications from overconsuming shared storage resources, including: identifying one or more sub-regions of data stored on a storage device that are associated with an application of a known application type; compiling information describing the application's utilization of a storage system; determining that a storage system objective has not been met; and initiating, based on the information describing the application's utilization of the storage system, remediation actions.
A processing system of a storage network operates by receiving a write request associated with a data object; identifying dispersed storage error encoding parameters; and determining a number of available storage units. When the number of available storage units is determined to exceed a first number, the processing system operates by: determining a first write threshold number in accordance with the dispersed storage error encoding parameters; dispersed error encoding the data object to produce a first write threshold number of encoded data slices; and writing, to available storage units, the first write threshold number of encoded data slices. When the number of available storage units is determined to not exceed the first number, the processing system operates by: determining a second write threshold number in accordance with the dispersed storage error encoding parameters associated, wherein the second write threshold number is less than the first write threshold number; dispersed error encoding the data object to produce a second write threshold number of encoded data slices; and writing, to the available storage units, the second write threshold number of encoded data slices.
Methods and apparatus for replication of data in storage networks. In an embodiment, a processing module(s) of a computing device identifies a first storage set and a second storage set for replicated storage of data. The processing module(s) maintains a synchronization log for the first storage set and the second storage set. After initiating storage of a data object in the first storage set and the second storage set, the processing module(s) detects an unavailability of one or more storage units of the second storage set. In response to detecting a return to availability of the one or more storage units, the processing module(s) determines, based on the synchronization log, that the second storage set requires at least a portion of the data object to maintain synchronization with the first storage set, and facilitates storage of the at least a portion of the data object in the second storage set.
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 11/16 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel
G06F 16/22 - IndexationStructures de données à cet effetStructures de stockage
G06F 16/2457 - Traitement des requêtes avec adaptation aux besoins de l’utilisateur
G06F 16/2458 - Types spéciaux de requêtes, p. ex. requêtes statistiques, requêtes floues ou requêtes distribuées
H03M 13/15 - Codes cycliques, c.-à-d. décalages cycliques de mots de code produisant d'autres mots de code, p. ex. codes définis par un générateur polynomial, codes de Bose-Chaudhuri-Hocquenghen [BCH]
H03M 13/33 - Synchronisation basée sur le codage ou le décodage d'erreurs
H03M 13/37 - Méthodes ou techniques de décodage non spécifiques à un type particulier de codage prévu dans les groupes
H04L 67/06 - Protocoles spécialement adaptés au transfert de fichiers, p. ex. protocole de transfert de fichier [FTP]
H04L 67/1095 - Réplication ou mise en miroir des données, p. ex. l’ordonnancement ou le transport pour la synchronisation des données entre les nœuds du réseau
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
67.
Storage Device Management By An External Storage System Controller
Offloading device management responsibilities from a storage device in an array of storage devices, including: retrieving, from the storage device, control information describing the state of one or more memory blocks in the storage device; and performing, in dependence upon the control information, a storage device management operation.
A storage system switching between mediation models within a storage system, where the switching between mediation models includes: determining, among one or more of the plurality of storage systems, a change in availability of a mediator service, wherein one or more of the plurality of storage systems are configured to request mediation from the mediator service in response to a fault; and communicating, among the plurality of storage systems and responsive to determining the change in availability of the mediator service, a fault response model to be used as an alternate to the mediator service among one or more of the plurality of storage systems.
H04L 49/253 - Routage ou recherche de route dans une matrice de commutation en utilisant l'établissement ou la libération de connexions entre les ports
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
G06F 16/27 - Réplication, distribution ou synchronisation de données entre bases de données ou dans un système de bases de données distribuéesArchitectures de systèmes de bases de données distribuées à cet effet
G06F 16/907 - Recherche caractérisée par l’utilisation de métadonnées, p. ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
69.
Remedial Actions for a Storage System Based on Similar Block Detection Process Anomalies
An illustrative method includes determining a first value for the metric, the first value associated with a first time period having a particular characteristic; determining a second value for the metric, the second value associated with a second time period having the particular characteristic; and determining that a difference between the first value and the second value is greater than the threshold amount.
An amount of power to be used by a storage system including storage devices having multiplane dies is identified. A number of planes of one or more of the multiplane dies used simultaneously for accessing data are adjusted such that a power usage of the storage system is less than or equal to the amount of power. A block size for allocating blocks by combining a set of erase blocks at a same address in separate planes based on the adjusted number of planes is utilized.
A method is provided. The method includes accumulating a set of data blocks for a data segment in a first type of flash memory and determining whether a size of the data segment exceeds a threshold value as the set of blocks is accumulated for the data segment. The method includes identifying a second type of flash memory to store the set of data blocks and storing the set of data blocks in the second type of flash memory.
Content describing an intended usage of a storage system is received. The content is analyzed by a generative artificial intelligence (AI) model to identify the intended usage described by the content. One or more configurations of the storage system are identified that support the intended usage described by the content. A response including the one or more configurations of the storage system is generated.
One or more requests to store data in a flash memory portion of a storage device are received by a storage device controller of a storage device from a storage system controller. An indirection unit size to use in a flash translation layer (FTL) for mapping the data is determined from information associated with the one or more requests. The data is stored in the flash memory portion of the storage device. The data is mapped in the FTL using the indirection unit size.
An illustrative method includes a log data system detecting an event associated with data operations of a data storage system, accessing, based on the detection, a log definition defining a log data structure format, generating, based on the log definition, log data in the log data structure format for the event, identifying, by the log data system based on the log data structure format, a log rule for the log data, and applying the log rule to the log data. Another illustrative method includes the log data system receiving log data associated with operations of a on-premises endpoint system, detecting, based on the log data, a condition associated with the operations of the on-premises endpoint system, and initializing, based on the condition, a transition from additional log data being sent to the log data system to the additional log data being sent to another log data system.
One or more requests to store data in a flash memory portion of a storage device are received by a storage device controller of a storage device from a storage system controller. An indirection unit size to use in a flash translation layer (FTL) for mapping the data is determined from information associated with the one or more requests. The data is stored in the flash memory portion of the storage device. The data is mapped in the FTL using the indirection unit size.
A computing device of a storage network, the computing device including memory, an interface, and at least one processing module operably coupled to the memory and the interface, where the at least one processing module is operable to error encode a data segment in accordance with error encoding parameters to produce a set of encoded data slices. The at least one processing module also sends via the interface, a first subset of encoded data slices of the set of encoded data slices via a first routing path of a plurality of routing paths to a set of storage units, where the first routing path has a performance level greater than a first performance threshold, and sends, via the interface, a second subset of encoded data slices of the set of encoded data slices via a second routing path of the plurality of routing paths to the set of storage units.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
An illustrative method includes a storage system establishing a snapshot difference namespace within a directory of a file system, storing, within the snapshot difference namespace, snapshot difference data descriptive of differences between snapshots associated with the directory of the file system, and exposing the snapshot difference data within the namespace for client access via one or more file system access protocols. In some embodiments, a client global associated with the storage system accesses the snapshot difference data via the one or more file system access protocols, and accesses, based on the snapshot difference data, one or more files within the directory of the file system.
Systems and methods for application-driven storage workload optimization are disclosed. The method includes receiving, by a storage system, a storage management indication provided by an application, wherein the storage system processes one or more workloads for the application and applying, based on the storage management indication, at least one configuration within the storage system.
An illustrative method includes a storage system establishing a snapshot difference namespace within a directory of a file system, storing, within the snapshot difference namespace, snapshot difference data descriptive of differences between snapshots associated with the directory of the file system, and exposing the snapshot difference data within the namespace for client access via one or more file system access protocols. In some embodiments, a client associated with the storage system accesses the snapshot difference data via the one or more file system access protocols, and accesses, based on the snapshot difference data, one or more files within the directory of the file system.
One or more indications that input/output (I/O) operations have been performed by a storage system are received from the storage system. An amount of energy consumed by the storage system to perform the I/O operations id determined. An energy usage effectiveness of the storage system is generated based on a number of the I/O operations performed by the storage system and the amount of power consumed by the storage system to perform the plurality of I/O operations.
A computing device of a storage network includes an interface configured to interface and communicate with a set of storage, memory that stores operational instructions and processing circuitry operably coupled to the interface and to the memory. The processing circuitry is configured to execute the operational instructions to select a set of storage network storage units and divide the set of storage network storage units into pairs of storage units, where each storage unit of the set of storage units is configured to communicate with every other storage unit of the set of storage units. The processing circuitry is further configured to generate an encryption key for each pair of storage units and distribute the encryption key to each pair of storage units.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
An illustrative method is disclosed for efficiently copying a source directory to a target directory. For example, the method may include receiving, by a storage system, a request to copy a source directory to a target directory; generating, by the storage system in response to the request, directory version metadata for the target directory; and mapping, by the storage system in response to the request, the target directory to metadata of the source directory such that the target directory reuses the metadata of the source directory within a target namespace identified by the directory version metadata for the target directory.
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
83.
FLASH SYSTEM INCLUDING MODULAR STORAGE DEVICES HAVING REDUCED FAILURE DOMAINS
A failure of a flash memory device of multiple flash memory devices positioned on corresponding printed circuit boards is detected by a storage device controller detachably coupled to the flash memory devices and positioned on an interposer board. An indication that the flash memory device has failed is generated. A replacement of the flash memory device with a subsequent flash memory device is detected. In response to detecting the replacement, data stored on the flash memory device is rebuilt and stored on the subsequent flash memory device.
Symmetric storage using a cloud-based storage system, including: receiving, at a cloud-based storage system among storage systems synchronously replicating a dataset, an I/O operation directed to the dataset; determining, in dependence upon the I/O operation, a metadata update describing a mapping of segments of content to an address within a storage object, wherein the storage object includes the dataset; and synchronizing metadata on another storage system of the storage systems by sending the metadata update from the cloud-based storage system to the other storage system to update a metadata representation on the second storage system in accordance with the metadata update.
H04L 67/1095 - Réplication ou mise en miroir des données, p. ex. l’ordonnancement ou le transport pour la synchronisation des données entre les nœuds du réseau
H04L 49/356 - Interrupteurs spécialement adaptés à des applications spécifiques pour les réseaux de stockage
H04L 61/45 - Répertoires de réseauCorrespondance nom-adresse
H04L 61/4552 - Mécanismes de recherche entre plusieurs répertoiresSynchronisation des répertoires, p. ex. méta-répertoires
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
85.
DYNAMIC RESILIENCY GROUP FORMATION IN A STORAGE SYSTEM
A data structure including a first set of storage devices is generated. Storage devices included in the data structure are to be used to form resiliency groups in a storage system. One or more resiliency groups are formed using the first set of storage devices. The data structure is modified to include a second set of storage devices. One or more subsequent resiliency groups are formed using the second set of storage devices.
A system, method, and product for flexible RAID layouts in a storage system, including: determining a reliability of an individual storage device of a plurality of storage devices, the individual storage device containing a plurality of portions of a Redundant Array of Independent Disks (RAID) stripe in a storage system, wherein the RAID stripe includes user data and inter-device parity data; detecting a change in the reliability of the individual storage device that contains the portion corresponding to the RAID stripe; and changing an amount of intra-device protection corresponding to the RAID stripe by decreasing, in the RAID stripe, an amount of space used to store the inter-device protection data.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p. ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
87.
Recovering Data Objects Encoded with Locally Decodable Code Segments
A storage network operates by: encoding at least one data object in the storage network as encoded data slices that include one or more locally decodable code segments; detecting at least one storage error associated with storage of at least one of the encoded data slices in the storage network; and recovering the at least one of the encoded data slices utilizing the one or more locally decodable code segments.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/07 - Réaction à l'apparition d'un défaut, p. ex. tolérance de certains défauts
A method for a storage network begins by receiving, from a requestor, an access request for metadata associated with a data object, where the data object is dispersed error encoded in accordance with dispersed storage error encoding parameters to produce a set of encoded data slices and distributedly stored among a plurality of storage units, where a decode threshold number of encoded data slices are needed to recover the data object. The method continues, by generating a metadata lookup for the data object and then receiving metadata from one or more storage units associated with the storage network. The method then continues, by mapping, based on the metadata, a file path and a storage location for accessing each encoded data slice of the set of encoded data slices. Finally, the method continues by providing, to the requestor, the file path and a storage location for accessing each encoded data slice of the set of encoded data slices and facilitating retrieval of the set of encoded data slices by the requestor.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 21/62 - Protection de l’accès à des données via une plate-forme, p. ex. par clés ou règles de contrôle de l’accès
H04L 41/082 - Réglages de configuration caractérisés par les conditions déclenchant un changement de paramètres la condition étant des mises à jour ou des mises à niveau des fonctionnalités réseau
H04L 41/50 - Gestion des services réseau, p. ex. en assurant une bonne réalisation du service conformément aux accords
89.
Storage replication group membership updates based on performance considerations
Volume migration among a set of storage systems synchronously replicating a dataset for a volume, where volume migration includes: initiating a transfer of the volume in dependence upon determining that a performance metric for accessing the volume stored on a first storage system would improve if transferred to a second storage system; and during the transfer of the volume: determining status information for the transfer; intercepting an I/O operation directed to the volume; and directing, in dependence upon the status information, the I/O operation to either the first storage system or the second storage system.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 12/0804 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p. ex. mémoires cache avec mise à jour de la mémoire principale
90.
CONSERVING FLASH SYSTEM CONTROLLER BANDWIDTH BY OFFLOADING STORAGE SYSTEM OPERATIONS
Data is received by one or more offload components that is to be stored in a storage system. The one or more offload components are operatively coupled to storage devices of the storage system via a first set of communication paths. The data is identified by a storage system controller operatively coupled to the storage devices via a second set of communication paths that are different than the first set of communication paths. An indication of a location in one or more of the storage devices for storing the data is transmitted to the one or more offload components. The indication causes the one or more offload components to store the data in the location of the one or more of the storage devices via the first set of communication paths.
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
H04L 49/15 - Interconnexion de modules de commutation
91.
Policy Driven Data Migration in a Distributed Storage System
A method for storage units of a storage network begins by determining whether a first memory compares favorably to a predetermined performance level and determining whether a data access response activity associated with the first memory compares favorably to a data access response activity threshold. The method continues when the first memory compares unfavorably to the predetermined performance level and the data access response activity associated with the first memory compares unfavorably to a data access response activity threshold, by determining to migrate a set of encoded data slices stored in a first format from the first memory to a second memory, where a data object is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of encoded data slices. The method then continues, by selecting a second format for storing the set of encoded data slices and migrating the set of encoded data slices from the first memory to the second memory.
H04L 9/32 - Dispositions pour les communications secrètes ou protégéesProtocoles réseaux de sécurité comprenant des moyens pour vérifier l'identité ou l'autorisation d'un utilisateur du système
H04L 67/1097 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour le stockage distribué de données dans des réseaux, p. ex. dispositions de transport pour le système de fichiers réseau [NFS], réseaux de stockage [SAN] ou stockage en réseau [NAS]
Utilizing data transfer estimates for active management of a storage environment, including: determining an estimated data transfer time from a source storage environment to a destination storage environment; determining whether the estimated data transfer time exceeds a threshold; and performing, in response to the estimated data transfer time exceeding the threshold, a remedial action associated with data transfers between the source storage environment and the destination storage environment.
Illustrative in-line data processing (e.g., data transformations) as part of fulfilling read and/or write requests to a storage system are described. In an example method, a storage system or a component of a storage system receives a request from a client of the storage system to read or write data in the storage system, the request defined in accordance with a storage access protocol and indicating a data transformation function to be applied to the data as part of fulfilling the request; initiates, based on the request, execution of the data transformation function to transform the data into transformed data; and uses the transformed data to fulfill the request.
A method is provided. The method includes monitoring an incoming workload for a storage system and adjusting an amount of differing solid state memory types within a buffer of the storage system based on the monitoring.
A first namespace is generated on a particular storage device of the plurality of storage devices for storing configuration data for a storage system. The first namespace is accessible by one or more storage controllers of the storage system. A second namespace is generated on the particular storage device for storing other data at the particular storage device. The configuration data is stored in the first namespace and the other data is stored in the second namespace.
A first tuning process to be performed on an erase block of the solid-state storage device is provided by a storage system controller that is external to the solid-state storage device. Results of the first tuning process on the erase block are stored as metadata in the solid-state storage device. A second tuning process to be performed on the erase block is selected based on accessing the results of the tuning process in the metadata.
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G06F 11/16 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel
G06F 12/1009 - Traduction d'adresses avec tables de pages, p. ex. structures de table de page
G11C 29/00 - Vérification du fonctionnement correct des mémoiresTest de mémoires lors d'opération en mode de veille ou hors-ligne
G11C 29/36 - Dispositifs de génération de données, p. ex. inverseurs de données
G11C 29/38 - Dispositifs de vérification de réponse
G11C 29/44 - Indication ou identification d'erreurs, p. ex. pour la réparation
G11C 29/50 - Test marginal, p. ex. test de vitesse, de tension ou de courant
97.
COORDINATION SNAPSHOTS IN A DISTRIBUTED STORAGE SYSTEM
Corresponding confirmations that distributed agents are in a snapshot creation mode are received by a coordinating agent of the distributed agents. A new snapshot copy identifier for a snapshot is provided to the distributed agents. The snapshot is committed and the snapshot creation mode is exited.
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p. ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
A method is provided. The method include obtaining, from a first system, a set of user requirements associated with one or more storage systems. The method also includes obtaining, from a second system, a set of storage system configurations based on the set of user requirements. The method further includes obtaining, from a third system, a set of costs for the set of storage system configurations. The method further includes generating multimedia content based on the set of storage system configurations, the multimedia content providing information about the set of storage system configurations. The method further includes providing the multimedia content to one or more client devices.
One or more data segments to be stored in a storage system are formed. A first data segment of the one or more data segments is written to regions of flash memory of a first storage device of the storage system using an erasure code that divides the first data segment into data shards. Writing the first data segment includes calculating at least one intra-device recovery data shard corresponding to the data shards of the first data segment to be stored in the first storage device that protects the data shards. The data shards of the first data segment and the at least one intra-device recovery data shard are organized and stored into the flash memory of the first storage device based on fault boundaries in flash architectures for writing to flash cells of the flash memory.
G06F 11/10 - Détection ou correction d'erreur par introduction de redondance dans la représentation des données, p. ex. en utilisant des codes de contrôle en ajoutant des chiffres binaires ou des symboles particuliers aux données exprimées suivant un code, p. ex. contrôle de parité, exclusion des 9 ou des 11
G11C 29/52 - Protection du contenu des mémoiresDétection d'erreurs dans le contenu des mémoires
100.
Using Hierarchical Control Planes to Manage Distributed Computing Environments
An illustrative method includes a global control plane managing a plurality of local control planes that manage a respective plurality of distributed computing environments, each of the plurality of local control planes configured to manage its respective computing environment in accordance with a mode of operation that is selected from a plurality of modes of operation based on a respective connectivity status with the global control plane, wherein managing the plurality of local control planes comprises selectively deploying an update to one or more local control planes of the plurality of local control planes based on the connectivity statuses of the plurality of local control planes with the global control plane. In some embodiments, the global control plane receives log data associated with the update and deploys, based on the log data, a second update to the one or more local control planes.
