An online system accesses a two-tower model trained to identify candidate items for presentation to users, in which the model includes an item tower trained to compute item embeddings and a user tower trained to compute user embeddings. The user tower includes a long-term sub-tower trained to compute long-term embeddings for users and a short-term sub-tower trained to compute short-term embeddings for users. The model is trained based on item data associated with items, user data associated with users, and session data associated with user sessions. The system uses the item tower to compute an item embedding for each of multiple candidate items. The system also uses the long-term sub-tower to compute a long-term embedding for a user. The system then receives session data associated with a current session of the user and uses the short-term sub-tower to compute a short-term embedding for the user based on this session data.
An online concierge system allows a customer to search items offered by a retailer by providing a set of items to the customer based on a search query. To account for varying availability of items at the retailer, the online concierge system modifies rankings in the set of items having less than a threshold predicted availability at the retailer. This reduces a likelihood selection of an item likely to be unavailable at the retailer. To maintain customer confidence in the items selected based on the search results by maintaining visibility of items relevant to the search query, the online concierge system determines how much an item is modified within the set based on search query attributes, item attributes, or customer characteristics. This allows different items to be adjusted different amounts in a set based on the item, as well as the search query for which the item was selected.
3.
USING GENERATIVE ARTIFICIAL INTELLIGENCE (AI) FOR AUTOMATED DIGITAL FLYER CONTENT GENERATION
An online system generates digital flyers using a generative model. The online system receives, from a client device, a request to generate a digital flyer. The request includes one or more design conditions for the digital flyer. For example, the design conditions may specify one or more cornerstone items, a theme, a template flyer, other target characteristics, etc. The online system further accesses an item catalog storing item data. The online system generates a query for a generative model including a prompt to generate the digital flyer, the one or more design conditions, and item data accessed from the item catalog. The online system provides the query to a model serving system, which executes the generative model with the query to return a batch of one or more digital flyers. The online system provides a first digital flyer in the batch of one or more digital flyers for presentation.
4.
PREDICTING REPLACEMENT ITEMS USING A MACHINE-LEARNING REPLACEMENT MODEL
An online system predicts replacement items for presentation to a user using a machine learning model. The online system receives interaction data describing a user's interaction with the online system. In particular, the interaction data describes an initial item that the user added to their item list. The online system identifies a set of candidate items that could be presented to the user as potential replacements for the initially-added item. The online system applies a replacement prediction model to each of these candidate items to generate a replacement score for the candidate items. The online system selects a proposed replacement item and transmits that item to the user's client device for display to the user. If the user selects the proposed replacement item, the online concierge system replaces the initial item with the proposed replacement item in the user's item list.
Embodiments relate to automatically generating a basket of items to be recommended to a user of an online system. The online system communicates a basket opportunity to a group of retailers, wherein the basket opportunity defines a plurality of item categories each associated with a respective item to be included in a basket. The online system receives, from each retailer in response to the basket opportunity, a respective bid of a plurality of bids for the basket opportunity. The online system applies a computer model to each bid to determine a score for each bid and selects a winning bid for the user based on determined scores for the bids. For each item category, the online system populates the basket with a respective item from a catalog of a retailer that is associated with the winning bid. The online system then presents the basket with items to the user.
An online system receives, from an entity, a content item to be presented to online system users, in which the content item includes a landing page to a third-party website. The system accesses the landing page, identifies a set of items included in it, and determines whether the landing page is configured for performing one or more types of conversions associated with each item. The system matches one or more of the items with one or more target objects based on the determination and associates the matched target object(s) with the content item. The system receives information describing one or more impression events associated with presenting the content item to a user and information describing a conversion associated with a target object associated with the content item performed by the user, applies an attribution model to determine a contribution of the impression event(s) to the conversion, and reports the contribution.
An online system generates session-based recommendations for a user accessing an application of the online system. The online system receives, from one or more client devices, a sequence of actions performed by a user during a session of an application of an online system. The online system generates a sequence of tokens from the sequence of actions by tokenizing an action to a token representing a respective item identifier. The online system applies a transformer-based machine-learned model to the sequence of tokens to generate predictions for a set of items. The online system selects a subset of items based on the generated predictions for the set of items. The online system generates one or more recommendations to the user from the selected subset of items and displays the recommendations to the user.
An online system performs an inference task in conjunction with the model serving system or the interface system to continuously monitor conversations between users and shoppers to determine whether a message sent by a sending party can be automatically responded to rather than prompting the receiving party for a manual response. The online system automatically provides a response to the message without the receiving party's manual involvement. In one or more embodiments, the online system can infer whether a question can be intercepted and/or suggests one or more available answers the sender can consider as feedback without a manual response from the receiver.
An online system generates a knowledge graph database representing relationships between entities in the online system. The online system generates the knowledge graph database by at least obtaining descriptions for an item. The online system generates one or more prompts to a machine-learned language model, where a prompt includes a request to extract a set of attributes for the item from the description of the item. The online system receives a response generated from executing the machine-learned language model on the prompts. The online system parses the response to extract the set of attributes for the item. For each extracted attribute, the online system generates connections between an item node representing the item and a set of attribute nodes for the extracted set of attributes in the database.
An online system employs real-time and pre-generated images for recommendation. The system leverages generative machine-learning models, such as diffusion models, to generate images dynamically. The selection and creation of these images rely upon user data and session data, which are collected during a user's application session. These data are employed to generate a text prompt string, which directs the image generation process. For instances where real-time computation may be a resource constraint, the system utilizes pre-generated images linked to user-context clusters — data set groupings related to user characteristics and session context. This method enables the system to present tailored recommendations to the user, making use of both dynamic generation and pre-existing image resources, thereby optimizing the balance between customization, computational resources, and latency.
An online concierge system receives, from a client device associated with a user of the online concierge system, order data associated with an order placed with the online concierge system, in which the order data describes a delivery location for the order. The online concierge system receives information describing a set of attributes associated with the delivery location and accesses a machine learning model trained to predict a difference between an arrival time and a delivery time for the delivery location. The online concierge system applies the model to the set of attributes associated with the delivery location to predict the difference between the arrival time and the delivery time for the delivery location and determines an estimated delivery time for the order based at least in part on the predicted difference. The online concierge system sends the estimated delivery time for the order for display to the client device.
An online system performs an inference task in conjunction with the model serving system to infer one or more purposes of the order of a user that includes a list of ordered items. The model serving system may host a machine-learned language model, and in one instance, the machine-learned language model is a large language model. The online system generates recommendations to the user based on the inferred purpose of the order. The online system may generate one or more recommendations that are equivalent orders having the same or similar purpose as the existing order.
Responsive to an input query from a user, an online system presents a list of recommended items that are related to the input query. The input query may be formulated as a natural language query. The online system performs an inference task in conjunction with the model serving system to generate one or more additional queries that are related to the input query and/or are otherwise related to the recommended items presented in response to the input query. The additional queries may be presented to the user in conjunction with the list of recommended items.
An automated checkout system accesses an image of an item inside a shopping cart and receives an identifier determined for the item inside the cart. The automated checkout system determines a load measurement for the item inside the cart using load sensors coupled to the cart. The automated checkout system encodes a feature vector of the item based at least on the determined weight, the accessed image, and the determined identifier. The automated checkout system inputs the feature vector to a machine-learning model to determine a confidence score describing a likelihood that the identifier determined for the item matches the item placed inside the cart. If the confidence score is less than a threshold confidence score, the automated checkout system generates a notification alerting an operator of an anomaly in the identifier.
G01G 19/414 - Appareils ou méthodes de pesée adaptés à des fins particulières non prévues dans les groupes avec dispositions pour indiquer, enregistrer ou calculer un prix ou d'autres quantités dépendant du poids utilisant des moyens de calcul électromécaniques ou électroniques utilisant uniquement des moyens de calcul électroniques
G01G 19/40 - Appareils ou méthodes de pesée adaptés à des fins particulières non prévues dans les groupes avec dispositions pour indiquer, enregistrer ou calculer un prix ou d'autres quantités dépendant du poids
An online concierge system facilitates ordering of items by customers, procurement of the items from physical retailers by pickers assigned to the orders, and delivery of the orders to customers. To enable efficient procurement, the online concierge system may facilitate preemptive picking of items for staging at a rapid fulfillment area of the physical retailer, and pickers may selectively pick items from the rapid fulfillment area instead of their standard storage locations. Decisions on which items to preemptively pick may be based on a predictive optimization model that scores and ranks items for predictive picking in accordance with various optimization criteria. In the course of fulfilling orders, pickers may furthermore be assigned to replenish items from the standard storage locations to the rapid fulfillment area to satisfy future predicted or actual orders in a manner that optimizes a cost metric.
G06Q 10/04 - Prévision ou optimisation spécialement adaptées à des fins administratives ou de gestion, p. ex. programmation linéaire ou "problème d’optimisation des stocks"
G06Q 10/06 - Ressources, gestion de tâches, des ressources humaines ou de projets; Planification d’entreprise ou d’organisation; Modélisation d’entreprise ou d’organisation
G06Q 30/02 - Marketing; Estimation ou détermination des prix; Collecte de fonds
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
16.
INFERRING USER BRAND SENSITIVITY USING A MACHINE LEARNING
An online concierge system may receive, from a customer, a selection of an item that is associated with a first brand. The online concierge system may extract features associated with the customer and features associated with the item. The online concierge system may input the extracted features to a machine learning model that, is trained to predict a degree of association between the customer and the first brand associated with the item. The online concierge system may identify candidate alternatives for replacing the item. The candidate alternatives may include a first alternative that is associated with the first brand and a second alternative that is associated with a second brand different from the first brand. The online concierge system may select, based on the degree of association between the customer and the first brand, one or more candidate alternatives to be presented to the customer to replace the item.
A system may generate a prompt based in part on a search query from a customer client device. The prompt instructs a machine learned model to provide item predictions. And the model was trained by: converting structured data describing items of an online catalog to annotated text data (unstructured data), generating training examples based in part on the annotated text data, and training the model using the training examples. The system may receive item predictions generated by the prompt being applied to the machine learned model, the item predictions may have corresponding item identifiers. The item predictions are processed to identify a recommended item from the item predictions. The processing includes determining item information for the recommended item using an item identifier associated with the recommended item. The item information is provided to the customer client device.
A system accesses user data describing characteristics of a user and generates a content item score for each content item of a plurality of content items. The system generates the content item score by applying a machine-learning model to the user data, and then generates a plurality of content bundles. The system also generates a bundle score for each content bundle based on corresponding content item scores for the content item associated with each content bundle, randomly selects a bundle of the plurality of content bundles based on the generated bundle scores, and transmits the randomly selected bundle to a client device associated with the user for display to the user. Finally, the system applies the model to each of the generated training examples and updates the parameters of the model based on the model output.
An online system uses an offline iterative clustering process to evaluate the performance of a set of content selection frameworks. To perform an iteration of the iterative clustering process, an online system clusters the testing example data into a set of clusters. An online system computes a set of framework scores for each of the generated clusters. An online system computes an improvement score for each cluster based on the performance scores of the clusters. To determine whether to perform another iteration, an online system computes an aggregated improvement score based on the improvement scores of the clusters. If an online system determines that the aggregated improvement score does not meet the threshold, an online system performs another iteration of the process above. When an online system finishes the iterative process, an online system outputs the improvement scores of the most-recent iteration.
A63F 9/24 - Jeux utilisant des circuits électroniques, non prévus ailleurs
A63F 13/79 - Aspects de sécurité ou de gestion du jeu incluant des données sur les joueurs, p.ex. leurs identités, leurs comptes, leurs préférences ou leurs historiques de jeu
G06N 5/04 - Modèles d’inférence ou de raisonnement
G06Q 30/02 - Marketing; Estimation ou détermination des prix; Collecte de fonds
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
G06Q 50/00 - Systèmes ou procédés spécialement adaptés à un secteur particulier d’activité économique, p.ex. aux services d’utilité publique ou au tourisme
An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.
G06K 7/10 - Méthodes ou dispositions pour la lecture de supports d'enregistrement par radiation corpusculaire
G06V 10/46 - Descripteurs pour la forme, descripteurs liés au contour ou aux points, p.ex. transformation de caractéristiques visuelles invariante à l’échelle [SIFT] ou sacs de mots [BoW]; Caractéristiques régionales saillantes
21.
GENERATING AN ORDER FROM UNSTRUCTURED DATA RECEIVED VIA A CHAT INTERFACE
An online concierge system generates an order including multiple items based on unstructured data received from a user through a chat interface instead of manually adding items to the order. The user provides unstructured data to the online concierge system through the chat interface, and the online concierge system extracts an intent from the unstructured data using a natural language process. Based on the intent, the online concierge system identifies a group of items associated with the intent and selects a group of items. The online concierge system generates an order for the user that includes the items comprising the selected group of items.
Techniques for predicting a wait time for a shopper based on a location the shopper's client device are presented. A system identifies a shopper's current location and uses a machine learning model to predict a wait time until the shopper will receive one or more orders. The machine learning model is trained to use input features including a number of orders received during a current time period for fulfillment near the current location, a number of other shoppers available for fulfilling orders during the current time period near the current location, historical information about a presentation of a plurality of orders to a plurality of shoppers near the current location, and historical information about the shopper and the other nearby available shoppers. The system then sends the predicted wait time to the client device for presentation to the shopper.
An online system facilitates various functions using machine learning model microservices. A tuning mechanism tunes various configuration parameters for each microservice that control allocation of computing resources and other configurations of physical and/or virtual machines that implement the microservices. Tuning may be performed in part by executing tests under various configurations and evaluating an objective function associated with the different configurations. Furthermore, parameters of the objective function may be set based on a trained learning model that learns baseline parameters and weights of the objective function based on historical data.
G06F 9/50 - Allocation de ressources, p.ex. de l'unité centrale de traitement [UCT]
G06F 30/27 - Optimisation, vérification ou simulation de l’objet conçu utilisant l’apprentissage automatique, p.ex. l’intelligence artificielle, les réseaux neuronaux, les machines à support de vecteur [MSV] ou l’apprentissage d’un modèle
G06F 11/34 - Enregistrement ou évaluation statistique de l'activité du calculateur, p.ex. des interruptions ou des opérations d'entrée–sortie
G06F 9/455 - Dispositions pour exécuter des programmes spécifiques Émulation; Interprétation; Simulation de logiciel, p.ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
24.
IDENTIFYING CANDIDATE REPLACEMENT ITEMS WITH A SOURCE SIMILARITY SCORE
An online concierge system suggests replacement items when an ordered item may be unavailable. To promote similarity of sources between the replacement item with the ordered item, candidate replacement items are scored, in part, based on a source similarity score based on a source of the candidate replacement item and a source of the ordered item. The source similarity score may be determined by a computer model based on user interactions with item sources. The similarity score may be based on source embeddings that may be determined based on respective item embeddings or may be determined by training source embeddings directly from user-source interactions. The similarity score for a candidate replacement item may be combined with a replacement score indicating the user's likelihood of selecting the candidate replacement item as a replacement to yield a total score for selection as suggestion as a replacement for the ordered item.
An online concierge system receives location information associated with pickers and actual orders associated with a geographical zone. A model trained to predict a likelihood an actual order associated with the zone will be available for servicing within a timeframe is accessed and applied to forecasted orders. Each picker is matched to an order for servicing by minimizing a value of a function that is based on a difference between a location associated with each picker matched to an actual order and an associated retailer location, a difference between the location associated with each picker matched to a forecasted order and an associated retailer location, and the predicted likelihood. Recommendations for accepting an actual order, moving to a retailer location associated with a forecasted order, or checking back later with the system are generated based on the matches and sent for display to a client device associated with each picker.
The present disclosure is directed to selecting order checkout options. In particular, the methods and systems of the present disclosure may, responsive to receiving data describing a potential order for an online shopping concierge platform: generate, based at least in part on the data describing the potential order, a plurality of different and distinct checkout options for the potential order; determine, for each checkout option of the plurality of different and distinct checkout options and based at least in part on one or more machine learning (ML) models, a probability that a customer associated with the potential order will proceed with the potential order if presented with the checkout option; and select a subset of checkout options for presentation to the customer based on their respective determined probabilities that the customer will proceed with the potential order if presented with the subset of checkout options.
An automated checkout system accesses an image of an item inside a shopping cart and a location of the shopping cart within a store. The automated checkout system identifies a set of candidate items located within a threshold distance of the location of the shopping cart based on an item map. The item map describes a location of each item within the store and the location of each candidate item corresponds to a location of the candidate item on the item map. The automated checkout system inputs visual features of the item extracted from the image to a machine-learning model to identify the item by determining a similarity score between the item and each candidate item of the set of candidate items. After identifying the item, the automated checkout system displays a list comprising the item and additional items within the shopping cart to a user.
An online concierge system uses a co-engagement graph to assign attribute values to items for which those attribute values are uncertain. A co-engagement graph is a graph with nodes that represent items and edges that represent co-engagement between items. The online concierge system generates a co-engagement graph for a set of items based on item engagement data and item data for the items. The set of items includes items for which the online concierge system has an attribute value for a target attribute and items for which the online concierge system does not have an attribute value for the target attribute. The online concierge system identifies a node that corresponds to an unknown item and identifies a node connected to that first node that corresponds to a known item. The online concierge system assigns the attribute value for the known item to the unknown item.
An online concierge system may receive multi-angle images of a plurality of instances of a grocery item carried at a physical store. Each instance of the grocery item is associated with one or more multi-angle images that are captured through a checkout process of the instance of the grocery item. The online concierge system may apply a machine learning model to the multi-angle images to identify expiration information of the plurality of instances of the grocery7 item. The online concierge system may use the identified expiration information to predict that a batch of the grocery7 item remaining in inventory' of the physical store is close to expiration. The online concierge system may generate one or more item- specific suggestions associated with the expiration information with respect to the grocery item offered in the physical store.
G06Q 10/0875 - Gestion d’inventaires ou de stocks, p.ex. exécution des commandes, approvisionnement ou régularisation par rapport aux commandes Énumération ou classification des pièces, des fournitures ou des services, p.ex. nomenclatures
G06V 10/764 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant la classification, p.ex. des objets vidéo
G06Q 10/04 - Prévision ou optimisation spécialement adaptées à des fins administratives ou de gestion, p. ex. programmation linéaire ou "problème d’optimisation des stocks"
G06Q 10/0631 - Planification, affectation, distribution ou ordonnancement de ressources d’entreprises ou d’organisations
G06Q 10/30 - Administration du recyclage ou de l’élimination des produits
G06Q 30/0202 - Prédictions ou prévisions du marché pour les activités commerciales
G06Q 30/0235 - Remises ou incitations, p.ex. coupons ou rabais limitées dans le temps ou par une date d’expiration
30.
GENERATING ORDER BATCHES FOR AN ONLINE CONCIERGE SYSTEM
An online concierge system generates order batches for pickers and offers those order batches. The online concierge system generates a set of candidate order batches, which are subsets of a received set of orders. The online concierge system generates a set of order batch scores for each of a set of candidate pickers, and offers the candidate order batches to the candidate pickers for the candidate pickers to service based on the set of order batch scores. If a candidate picker accepts the offered order batch, the online concierge system identifies candidate order batches with overlapping orders with the order batch accepted by the candidate picker, and rescinds the offer for each of the candidate pickers to service the order batches.
A computer-implemented method for suggesting keywords as a search term of a content item includes receiving, from a content provider, information about the content item in a database of content items. The method further includes generating a set of seed keywords related to the content item, and expanding the set of seed keywords to a plurality of candidate keywords. The plurality of candidate keywords are then scored based, at least in part, on an engagement metric measuring a user engagement with the content item in response to being presented with results from a search query comprising the candidate keyword. A candidate keyword is then selected from the plurality of candidate keywords based on the scoring, and stored relationally to the content item to define an audience for a recommendation about the content item, providing a suggestion to the content provider.
G06F 16/787 - Recherche de données caractérisée par l’utilisation de métadonnées, p.ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement utilisant des informations géographiques ou spatiales, p.ex. la localisation
32.
MACHINE LEARNING PREDICTION OF USER RESPONSES TO RECOMMENDATIONS SELECTED WITHOUT CONTEXTUAL RELEVANCE
A method implemented at a computer system includes, responsive to identifying an opportunity to present content to a target user, accessing a machine learning model trained on a dataset containing input features of a plurality of users and labels indicating openness metrics of the respective plurality of users. The machine learning model is then applied to a set of features of the target user to output an openness metric that predicts a loss in the target user's response rate when contextual relevance is not considered in selection of recommendation for the target user. A recommendation is then selected from a plurality of candidate recommendations based on the openness metric and sent for display to the target user.
An online system accesses a machine learning model trained to predict behaviors of users of the online system, in which the model is trained based on historical data received by the online system that is associated with the users and demand and supply sides associated with the online system. The online system identifies a treatment for achieving a goal of the online system and simulates application of the treatment on the demand and supply sides based on the historical data and a set of behaviors predicted for the users. Application of the treatment is simulated by replaying the historical data in association with application of the treatment and applying the model to predict the set of behaviors while replaying the data. The online system measures an effect of application of the treatment on the demand and supply sides based on the simulation, in which the effect is associated with the goal.
The online concierge system generates task units based on orders and assigns batches of task units to pickers. The online concierge system generates task units based on received orders. The online concierge system generates permutations of these task units to generate candidate sets of task batches. The online concierge system scores each of these candidate sets, and selects a set of task batches to assign to pickers based on the scores. Additionally, to determine which task UI to display to the picker, the picker client device uses a UI state machine. The UI state machine is a state machine where each state corresponds to a task UI to display on the picker client device. The state transitions between the UI states of the UI state machine indicate which UI state to transition to from a current UI state based on the next task unit in the received task batch.
B65G 1/137 - Dispositifs d'emmagasinage mécaniques avec des aménagements ou des moyens de commande automatique pour choisir les objets qui doivent être enlevés
G06Q 10/087 - Gestion d’inventaires ou de stocks, p.ex. exécution des commandes, approvisionnement ou régularisation par rapport aux commandes
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
35.
ITEM AVAILABILITY MODEL PRODUCING ITEM VERIFICATION NOTIFICATIONS
An item availability model produces item verification notifications, for example, by receiving data indicating a plurality of items associated with an online shopping concierge platform; determining based at least in part on the data indicating the plurality of items and one or more machine learning (ML) models, a subset of the plurality of items for which to have one or more shoppers associated with the online shopping concierge platform check current availability at one or more warehouse locations associated with the online shopping concierge platform; and generating and transmitting communications comprising at least one of dispatching, instructing, incentivizing, or encouraging the one or more shoppers to check the cunent availability of at least a portion of the subset of the plurality of items at the one or more warehouse locations.
G06Q 30/0217 - Remises ou incitations, p.ex. coupons ou rabais impliquant une contribution sur des produits ou des services en échange d’une incitation ou d’une récompense
G06Q 30/0282 - Notation ou évaluation d’opérateurs commerciaux ou de produits
36.
USING A GENETIC ALGORITHM TO IDENTIFY A BALANCED ASSIGNMENT OF ONLINE SYSTEM USERS TO A CONTROL GROUP AND A TEST GROUP FOR PERFORMING A TEST
An online system generates a set of genomic representations, each including multiple genes, in which each gene represents users assigned to a control or test group for performing a test. A metric is identified based on a treatment associated with the test group and a score for each representation is computed based on a difference between two values, in which each value is based on the metric associated with users assigned to the test or control group. A propagation process is executed by identifying representations having at least a threshold score, propagating genes included in the representations to an additional set of representations through recombination and/or mutation, and computing the score for each additional representation. The propagation process is repeated for each additional set of representations until stopping criteria are met and a representation is selected based on scores associated with one or more representations.
G06Q 30/0242 - Détermination de l’efficacité des publicités
G06Q 30/0217 - Remises ou incitations, p.ex. coupons ou rabais impliquant une contribution sur des produits ou des services en échange d’une incitation ou d’une récompense
G06Q 30/0203 - Modélisation du marché; Analyse du marché; Collecte de données du marché Études de marché; Sondages de marché
37.
GENERATING SUGGESTED INSTRUCTIONS THROUGH NATURAL LANGUAGE PROCESSING OF INSTRUCTION EXAMPLES
An online concierge system generates suggested instructions for presentation to a user. The online concierge system access instruction examples corresponding to a target item category and generates candidate instruction representations based on instruction messages within each instruction example. The online concierge system generates preliminary scores for the candidate instruction representations that are directly related to an intra-category frequency of use of the instruction tokens of the candidate instruction representation within the target item category. The online system normalizes these preliminary scores for the candidate instruction representations based on the inter-category frequency of use of the instruction tokens in all item categories to generate final scores for the candidate instruction representations. The online concierge system selects a set of instruction representations based on these final scores and generates suggested instructions based on the set of instruction representations.
An online concierge system provides arrival prediction services for a user placing an order to be retrieved by a shopper. An order may have a predicted arrival time predicted by a model that may err under some conditions. To reduce the likelihood of providing the predicted arrival time (and related services) when the arrival time may be incorrect, the prediction model and related services are throttled (e.g., selectively provided) based on one or more predicted delivery metrics, which may include a time to accept the order by a shopper and a predicted portion of late orders that will be delivered past the respective predicted arrival times. The predicted delivery metrics are compared with thresholds and the result of the comparison used to selectively provide, or not provide, the predicted delivery services.
A server receives a plurality of product data entries from a plurality of retailer computing systems. Each product data entry includes a product identifier uniquely identifying a corresponding physical product and descriptive data of the corresponding physical product. A subset of the plurality of product data entries having a same product identifier is determined. An embedding vector representative of a product data entry in the subset is pairwise compared with each of respective embedding vectors representative of other product data entries in the subset other than the product data entry to compute respective vector similarity metrics. A pooled semantic similarity metric for the product data entry based on the computed respective vector similarity metrics. It is determined whether the product data entry is an outlier in the subset based on the pooled semantic similarity metric. A notification is transmitted to a client device of a user based on the determination.
An online concierge system may use images received from shopping carts within retailers to determine the availability of items within those retailers. A shopping cart includes externally-facing cameras that automatically capture images of the area around the shopping cart as the shopping cart travels through a retailer. The online concierge system receives these images, which depict displays within the retailers from which a picker or a retailer patron can collect items. The online concierge system determines which items should be depicted in the images and which items are actually depicted in the images. The online concierge system identifies which items should be depicted, but are not depicted, and determines that these items are unavailable (e.g., out of stock) at that retailer. The online concierge system updates an availability database to indicate that these items are unavailable and may notify the retailer that the item is unavailable.
The present disclosure is directed to determining shopper-location pairs. In particular, the methods and systems of the present disclosure may identify a set of available shoppers associated with an online shopping concierge platform and located in a geographic area; identify a set of available warehouse locations associated with the online shopping concierge platform and located in the geographic area; and determine, based at least in part on the set of available shoppers, the set of available warehouse locations, and one or more machine learning (ML) models, a set of shopper-location pairs optimized based at least in part on time required by the set of available shoppers to travel from their respective current locations to one or more of the set of available warehouse locations.
An augmented reality application executing on a client device receives video data captured by a camera of the device, in which the video data includes a display area of the device. The application detects a set of items within the display area based on the video data, wherein the set of items is included among an inventory of a warehouse associated with a retailer, and accesses a set of attributes of each item. The application retrieves profile information including a set of preferences associated with a customer of the retailer, matches one or more of the set of preferences with one or more attributes of each item, and generates an augmented reality element based on the matches. The augmented reality element is then displayed, such that it is overlaid onto a portion of the display area based on a location within the display area at which the items are detected.
G06F 3/04815 - Interaction s’effectuant dans un environnement basé sur des métaphores ou des objets avec un affichage tridimensionnel, p.ex. modification du point de vue de l’utilisateur par rapport à l’environnement ou l’objet
G06F 3/0482 - Interaction avec des listes d’éléments sélectionnables, p.ex. des menus
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
G06T 7/70 - Détermination de la position ou de l'orientation des objets ou des caméras
G06T 19/00 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie
43.
DISPLAYING AUGMENTED REALITY ELEMENTS FOR NAVIGATING TO A LOCATION OF AN ITEM WITHIN A WAREHOUSE
A wayfinding application executing on a client device receives a current location of the device within a warehouse and accesses a layout of the warehouse describing locations of items included among an inventory of the warehouse. The application identifies a route from the current location to one or more locations within the warehouse associated with one or more target items, generates augmented reality elements including instructions for navigating the route, and sends the elements to a display area of the device. The application detects a location within the warehouse associated with a target item and determines whether the item is at the location based on an image captured by the device. Upon determining it is not at the location, the application alerts a user of the device to a replacement item by generating an augmented reality element that calls attention to it and sending the element to the display area.
G06Q 10/087 - Gestion d’inventaires ou de stocks, p.ex. exécution des commandes, approvisionnement ou régularisation par rapport aux commandes
G06Q 50/28 - Logistique, p.ex. stockage, chargement, distribution ou expédition
B65G 1/137 - Dispositifs d'emmagasinage mécaniques avec des aménagements ou des moyens de commande automatique pour choisir les objets qui doivent être enlevés
44.
PACING THE DELIVERY OF CONTENT CAMPAIGNS IN AN ONLINE CONCIERGE SYSTEM USING CROSS-RETAILER INVENTORY STOCKS LEVELS
An online concierge system facilitates procurement and delivery of items for customers using a network of shoppers. The online concierge system includes a promotion management engine that paces delivery of promotions for content campaigns based in part on predicted item availability and a paced spending model that operates to pace spending of a content campaign over a budget period. The system paces the delivery by determining whether to enter a bid for the impression opportunity by comparing an observed cumulative spend for the content campaign during a portion of the budget period prior to the impression time and a desired cumulative spend for the content campaign during the portion of the budget period prior to the impression time based on the distribution of impression opportunities and a budget for the content campaign during the budget period.
An automated checkout system uses a shopping cart that is automatically charged when stacked into another shopping cart. Each shopping cart has a front charging connector and a rear charging connector. When a first shopping cart is stacked into a second shopping cart, the front charging connector of the first shopping cart connects with the rear charging connector of the second shopping cart. Electrical power can flow to the first shopping cart via the second shopping cart to charge a battery of the first shopping cart. The second shopping cart may be similarly stacked into a third shopping cart, wherein the second shopping cart receives electrical power from the third shopping cart. The second shopping cart may use this electrical power to charge its own battery or may provide some or all of the electrical power to the first shopping cart to charge the first shopping cart's battery.
H02J 7/00 - Circuits pour la charge ou la dépolarisation des batteries ou pour alimenter des charges par des batteries
B62B 3/14 - Voitures à bras ayant plus d'un essieu portant les roues servant au déplacement; Dispositifs de direction à cet effet; Appareillage à cet effet caractérisées par des moyens pour l'emboîtement ou l'empilage, p.ex. chariots pour achats
46.
ATTRIBUTE SCHEMA AUGMENTATION WITH RELATED CATEGORIES
To improve attribute prediction for items, item categories are associated with a schema that is augmented with additional attributes and/or attribute labels. Items may be organized into categories and similar categories may be related to one another, for example in a taxonomy or other organizational structure. An attribute extraction model may be trained for each category based on an initial attribute schema for the respective category and the items of that category. The extraction model trained for one category may be used to identify additional attributes and/or attribute labels for the same or another, related category.
G06F 16/907 - Recherche caractérisée par l’utilisation de métadonnées, p.ex. de métadonnées ne provenant pas du contenu ou de métadonnées générées manuellement
A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.
G06Q 20/18 - Architectures de paiement impliquant des terminaux en libre-service, des distributeurs automatiques, des bornes ou des terminaux multimédia
A47F 9/04 - Comptoirs de vérification, p.ex. pour magasins à libre-service
G06K 11/00 - Procédés ou dispositions pour la lecture d'un graphique ou pour transformer la configuration de paramètres mécaniques, p.ex. une force ou une présence, en signaux électriques
48.
MACHINE-LEARNED NEURAL NETWORK ARCHITECTURES FOR INCREMENTAL LIFT PREDICTIONS
An online system trains a machine-learned lift prediction model configured as a neural network. The machine-learned lift prediction model can be used during the inference process to determine lift predictions for users and items associated with the online system. By configuring the lift prediction model as a neural network, the lift prediction model can capture and process information from users and items in various formats and more flexibly model users and items compared to existing methods. Moreover, the lift prediction model includes at least a first portion for generating control predictions and a second portion for generating treatment predictions, where the first portion and the second portion share a subset of parameters. The shared subset of parameters can capture information important for generating both control and treatment predictions even when the training data for a control group of users might be significantly smaller than that of the treatment group.
An online concierge system includes a marketplace automation engine for setting various control parameters affecting marketplace operation. The marketplace automation engine applies a hyperparameter learning model to the marketplace state data to predict a set of hyperparameters affecting a set of respective parameterized control decision models. The hyperparameter learning model is trained on historical marketplace state data and a configured outcome objective for the online concierge system. The marketplace automation engine independently applies the set of parameterized control decision models to the marketplace state data using the hyperparameters to generate a respective set of control parameters affecting marketplace operation of the online concierge system. The marketplace automation engine applies the respective set of control parameters to operation of the online concierge system.
An online system trains a machine-learned lift prediction model configured as a neural network. The machine-learned lift prediction model can be used during the inference process to determine lift predictions for users and items associated with the online system. By configuring the lift prediction model as a neural network, the lift prediction model can capture and process information from users and items in various formats and more flexibly model users and items compared to existing methods. Moreover, the lift prediction model includes at least a first portion for generating control predictions and a second portion for generating treatment predictions, where the first portion and the second portion share a subset of parameters. The shared subset of parameters can capture information important for generating both control and treatment predictions even when the training data for a control group of users might be significantly smaller than that of the treatment group.
An online system performs a method. The method comprises obtaining historical pick data for items located in a warehouse, including data for each of the items picked and pick times between each of the items picked, and determining a taxonomy of items offered by the warehouse. The taxonomy identifies a plurality of product categories structured in a hierarchy, wherein each level of the hierarchy corresponds to a particular level of granularity of product data. The method further comprises applying the historical pick data to a machine learning model to generate pairwise relations between product categories at each level of the taxonomy and generating sequences of product categories based on the pairwise relations. An order for items offered by the warehouse is received and compared to the sequences for each level to generate a pick sequence for picking the items efficiently, which is outputted by the system to a mobile application.
G06Q 10/047 - Optimisation des itinéraires ou des chemins, p. ex. problème du voyageur de commerce
G06Q 10/04 - Prévision ou optimisation spécialement adaptées à des fins administratives ou de gestion, p. ex. programmation linéaire ou "problème d’optimisation des stocks"
G06N 3/0985 - Optimisation d’hyperparamètres; Meta-apprentissage; Apprendre à apprendre
A masked language model is used to predict an attribute of an object, such as a physical item or product based on the predicted value of a masked token. The masked language model may be trained on a general corpus of text for the language, such that the masked language model learns context and text token relationships. Information about the object may then be added to a query template that structures the item information in an attribute query that may be interpretable by the masked language model to provide a resulting token related to the provided information or to confirm or reject an attribute specified in the query template.
A shopping cart's tracking system (190) determines a first baseline location of the shopping cart (120, 400) at a first timestamp with a wireless device located on the shopping cart (120, 400) detecting one or more external wireless devices (e.g., RFID tags) in the indoor environment. The shopping cart's tracking system (190) receives wheel motion data from one or more wheel sensors coupled to one or more wheels of the shopping cart (120, 400), wherein the wheel motion data describes rotation of the one or more wheels. The shopping cart's tracking system (190) calculates a translation traveled by the shopping cart (120, 400) from the first baseline location based on the wheel motion data. The shopping cart's tracking system (190) determines an estimated location of the shopping cart (120, 400) at a second timestamp based on the first baseline location and the translation. With the estimated location, the shopping cart (120, 400) can update a map with the estimated location of the shopping cart (120, 400).
An online concierge system receives, from a client device comprising a customer mobile application, an order comprising a list of one or more items for delivery to a destination location from a warehouse. The customer mobile application comprises a user interface. The online concierge system identifies a set of item groupings from a database that match the list of one or more items. The online concierge system applies the order and the set of item groupings to a machine learning model to produce a set of foundational items. The online concierge system sends for display, to the client device, an updated user interface comprising a foundational items graphical element that visually distinguishes the set of foundational items from other items in the list of one or more items.
An online concierge system receives multiple images of an item from a first client device associated with a shopper associated with the online concierge system, in which each of the images of the item is captured from a different angle and/or position and the item is included among an inventory of a warehouse associated with a retailer associated with the online concierge system. Based in part on the images of the item, the online concierge system generates a three-dimensional image of the item, in which the three-dimensional image of the item includes a dimension of the item and/or a color of the item. The online concierge system then sends the three-dimensional image of the item to a second client device associated with a customer of the online concierge system, in which a perspective of the three-dimensional image is modifiable within a display area of the second client device.
The present disclosure is directed to generating datastore checkpoints. In particular, the methods and systems of the present disclosure may generate, within a datastore, data representing multiple checkpoints. Each checkpoint of the checkpoints may correspond to a respective record of the datastore and may represent a common shared value for a field based at least in part on which the datastore is ordered. Based at least in part on the checkpoints, the datastore may be queried to produce one or more responsive records to one or more criteria of the query. Based at least in part on the responsive record(s), training data may be generated. The training data may be utilized for training one or more machine learning (ML) models configured to process input based at least in part on values for the field based at least in part on which the datastore is ordered.
G06F 11/14 - Détection ou correction d'erreur dans les données par redondance dans les opérations, p.ex. en utilisant différentes séquences d'opérations aboutissant au même résultat
57.
SHOPPING CART WITH ONBOARD COMPUTING SYSTEM GATHERING CONTEXTUAL DATA AND DISPLAYING INFORMATION RELATED TO AN ITEM
A shopping cart system detects the initiation of a shopping session within a physical retail store by a customer, in which the shopping cart system includes a shopping cart, a processor, a memory, and a set of sensors. Contextual information associated with the shopping cart received by the sensors during the shopping session is tracked, in which the contextual information describes one or more locations of the shopping cart within the store, a state of the shopping cart, and a set of items within the shopping cart. Responsive to identifying an opportunity to present content to the customer based on the contextual information, the system identifies a set of content items associated with one or more items within the store based on the contextual information. The system generates a user interface including the set of content items and sends the user interface to a display area associated with the customer.
An online concierge system uses a cumulative incrementality score to evaluate the performance of incrementality models used by the online concierge system to identify users for treatment. The online concierge system applies an incrementality model to a set of examples to generate predicted incrementality scores for the examples. The online concierge system ranks the examples based on the predicted incrementality scores for the examples and groups the examples based on their rankings. The online concierge system iteratively computes cumulative incrementality scores for each grouping based on the examples of each grouping, and computes a final cumulative incrementality score for the incrementality model based on each of the cumulative incrementality scores.
An online system may generate numerous search records in response to searches requested by users. The online system may use a specific way to sample the historical search records to reduce biases in sampling. For example, the online system retrieves historical query records associated with an item query engine. The set of historical query records includes a plurality of search phrases. A historical query record is associated with a search phrase and a list of items returned by the item query engine. The online system determines the search frequencies for the search phrases. The online system stratifies the historical query records into a plurality of bins according to the search frequencies of the search phrases. The online system samples the historical query records from the plurality of bins to collect a representative set of historical query records and outputs the representative set of historical query records for rating.
An online system may receive, from a user device, a request to view, at a graphical user interface, available entries of a third-party system. The third-party system may operate multiple physical locations. The operation of each physical location is documented by a time-sensitive dataset which includes multiple dynamic item entries. The online system may retrieve a geographical location associated with the user device and determine a subset of physical locations operated by the third-party system that are eligible for further selection based on distances of the physical locations from the geographical location associated with the user device. The online system may determine a metric measuring a size of the dynamic item entries available in the time -sensitive dataset and select one of the physical locations based on the metric. The online system may cause for display the dynamic item entries in the time-sensitive dataset associated with the selected physical location.
An automated checkout system automatically establishes sessions between users and shopping carts by correlating action events with distances of the user's client device to the shopping cart. The automated checkout system determines the client device's distance from the shopping cart at timestamps when an action event occurs with respect to the shopping cart. If the distances and the action events are correlated, the system establishes a session between the user and the shopping cart. Additionally, the automated checkout system attributes target actions to recipe suggestions. The automated checkout system displays a recipe suggestion to a user on a display of a shopping cart, and identifies an item added to the shopping cart. If the added item matches an item in the set of recipes, the automated checkout system applies an attribution model that determines whether to attribute a target action that relates to the item with the recipe suggestion.
B62B 3/14 - Voitures à bras ayant plus d'un essieu portant les roues servant au déplacement; Dispositifs de direction à cet effet; Appareillage à cet effet caractérisées par des moyens pour l'emboîtement ou l'empilage, p.ex. chariots pour achats
G06Q 10/087 - Gestion d’inventaires ou de stocks, p.ex. exécution des commandes, approvisionnement ou régularisation par rapport aux commandes
H04W 4/021 - Services concernant des domaines particuliers, p.ex. services de points d’intérêt, services sur place ou géorepères
B62B 5/00 - Accessoires ou détails spécialement adaptés aux voitures à bras
62.
TREATMENT LIFT SCORE AGGREGATION FOR NEW TREATMENT TYPES
An online concierge system uses a new treatment engine to score users for applying treatments of a new treatment type. The new treatment engine uses treatment models to generate treatment lift scores for the user. The new treatment engine applies an aggregation function model to the treatment lift scores to generate an aggregated lift score for the user. If the aggregated lift score exceeds a threshold, the new treatment engine applies a treatment of the new treatment type to the user. The new treatment engine trains the aggregation function model based on training examples used to train the treatment models. For a training example associated with a particular treatment type, the new treatment engine uses a target lift score generated by the treatment model for the treatment type to evaluate the performance of the aggregation function model, and to update the aggregation function model accordingly.
An online system receives information describing a physical retail store, in which the information includes attributes of physical elements within the store and their arrangement. A request is received from a user to generate a rendering of the store in a virtual reality environment. A profile of the user describing the user's geographic location and a set of historical actions performed by the user are accessed, in which the set of historical actions is associated with one or more of the physical elements. Based on the information describing the store and the profile, the rendering is generated to include virtual reality elements representing a set of the physical elements arranged based on the arrangement of the physical elements, and the rendering is sent for display to the user. When an update to the information describing the store is received, the rendering is updated and sent for display to the user.
An online concierge system assigns shoppers to fulfill orders from users. To allocate shoppers, the online concierge system predicts future supply and demand for the shoppers' services for different time windows. To forecast a supply of shoppers, the online concierge system trains a machine learning model that estimates future supply based on access to a shopper mobile application through which the shoppers obtain new assignments by shoppers. The online concierge system also forecasts future orders. The online concierge system estimates a supply gap in a future time period by selecting a target time to accept for shoppers to accept orders and determining a corresponding ratio of number of shoppers and number of orders. The online concierge system may adjust a number of shoppers allocated to the future time period to achieve the determined ratio number of shoppers and number of orders.
An online concierge system receives information describing orders from its customers and generates a route for each order based on this information. The routes are partitioned into multiple sets of routes and multiple candidate generation processes are executed in parallel. During execution of a candidate generation process, one or more routes included in each set of routes are paired with shoppers of the system based on a set of constraints, producing multiple route-shopper pairs. A cost associated with each route-shopper pair is determined based on attributes associated with each shopper and/or information associated with each route of the pair. During an optimization process, which is executed asynchronously with the candidate generation process, one or more route-shopper pairs are selected based on pairing-cost data identifying route-shopper pairs and their associated costs. One or more requests to fulfill orders are sent to one or more shoppers based on the selected route-shopper pair(s).
A system receives a request for a set of items at a warehouse from a user device, and determines a set of candidate items responsive to the request. The system applies a trained item availability model to each candidate item to determine a prediction of a likelihood that the candidate item is available for pickup at the warehouse. A subset of candidate items that have a prediction below a threshold is classified as low availability. The computer system also determines a cap of low availability items to present to a user based on a user utility curve. The user utility curve is modeled based on user utility associated with amounts of low availability items presented. The low availability items are filtered to an amount within the determined cap. The filtered low availability items are sent to the user device for presentation in a user interface.
A warehouse from which shoppers fulfill orders for an online concierge system maintains an online concierge system-specific portion for which the online concierge system specifies placement of items in regions. To place items in the online concierge system-specific portion, the online concierge system accounts for co-occurrences of different items in orders and measures of similarity between different items. From the co-occurrences of items, the online concierge system generates an affinity graph. The online concierge system also generates a colocation graph based on distances between different regions in the online concierge system-specific portion. Using an optimization function with the affinity graph and the colocation graph, the online concierge system selects regions within the online concierge system-specific portion for different items to minimize an amount of time for shoppers to obtain items in the online concierge-system specific portion.
An online concierge system generates recipe embeddings for recipes including multiple items and user embeddings for users, with the recipe embeddings and user embeddings in a common latent space. To generate the user embeddings and the recipe embeddings, a model includes separate layers for a user model outputting user embeddings and for a recipe model outputting recipe embeddings. When training the model, a weight matrix generates a predicted dietary preference type for a user embedding and for a recipe embedding and adjusts the user model or the recipe model based on differences between the predicted dietary preference type and a dietary preference type applied to the user embedding and to the recipe embedding. Additionally cross-modal layers generate a predicted user embedding from a recipe embedding and generate a predicted recipe embedding from a user embedding that are used to further refine the user model and the recipe model.
An online concierge system requests an image of a receipt of an order from a picker after the picker fulfills the order at a store. The online concierge system performs image processing on the image of the receipt and uses machine learning and optical character recognition to determine a tax amount paid for the order and a confidence score associated with the tax amount. The online concierge system may use the machine learning model for segmenting extracted text in the image of the receipt into tokens. The online concierge system may then determine at least one token associated with a tax item and the tax amount associated with the tax item. The online concierge system communicates the tax amount to the store for reimbursement based on the tax amount and the confidence score.
An online concierge system performs asynchronous automated correction handling of incorrectly sorted items using point-of-sale data. The online concierge system receives orders from customer client devices and determines a batched order based on the received orders. The online concierge system sends the batched order to a shopper client device for fulfillment. The online concierge system receives transaction data associated with the batched order from a third party system. The online concierge system determines whether a sorting error occurred based on the transaction data and the batched order. In response to determining that a sorting error occurred, the online concierge system sends an instruction to correct the sorting error to the shopper client device.
An online concierge system receives a search query from a client device. The online concierge system identifies a set of matching items from an item database. The matching items correspond to the received search query. The online concierge system obtains, from a hierarchical item taxonomy, a category label for each matching item. The item taxonomy relates each item in the item database to one of a plurality of category labels. The online concierge system groups the matching items by the category labels for each of the matching items into one or more groups. The online concierge system generates instructions for a user interface. The user interface includes a scrollable list of one or more carousels. Each carousel includes a scrollable list of a group of the one or more groups. The online concierge system sends the instructions of the user interface to the client device for display.
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
G06F 3/048 - Techniques d’interaction fondées sur les interfaces utilisateur graphiques [GUI]
G06Q 50/00 - Systèmes ou procédés spécialement adaptés à un secteur particulier d’activité économique, p.ex. aux services d’utilité publique ou au tourisme
72.
DISTRIBUTED APPROXIMATE NEAREST NEIGHBOR SERVICE ARCHITECTURE FOR RETRIEVING ITEMS IN AN EMBEDDING SPACE
An online system maintains item embeddings for items. As a number of items maintained by the online system increases, maintaining a single index of the item embeddings is increasingly difficult. To increase scalability, the online system partitions item embeddings into multiple indices, with each index corresponding to a value of a specific attribute maintained by the online system for items. For example, an online system generates indices that each correspond to a different warehouse offering items. To expedite retrieval of item embeddings, the online system allocates each index to one of a number of shards. When the online system receives a query, the online system determines an embedding for the query and retrieves an index from a shard based on metadata received with the query. Based on distances between the query for the embedding and the item embeddings in the retrieved index, the online system selects one or more items.
An online concierge system maintains various items and an item embedding for each item. When the online concierge system receives a query for retrieving one or more items, the online concierge system generates an embedding for the query. The online concierge system trains a machine-learned model to determine a measure of relevance of an embedding for a query to item embeddings by generating training data of examples including queries and items with which users performed a specific interaction. The online concierge system generates a subset of the training data including examples satisfying one or more criteria and further trains the machine-learned model by application to the examples of the subset of the training data and stores parameters resulting from the further training as parameters of the machine-learned model.
G06Q 10/08 - Logistique, p.ex. entreposage, chargement ou distribution; Gestion d’inventaires ou de stocks
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
74.
SEARCH RELEVANCE MODEL USING SELF-ADVERSARIAL NEGATIVE SAMPLING
To train an embedding-based model to determine relevance between items and queries, an online system generates training data from previously received queries and interactions with results for the queries. The training data includes positive training examples including a query and an item with which a user performed a specific interaction after providing the query. To generate negative training examples for the query to include in the training data, the online system determines measures of similarity between items with which the specific interaction was not performed and the query. The online system may weight a loss function for the embedding-based model by the measure of similarity for a negative example, increasing the effect of a negative example including a query and an item with a larger measure of similarity. In other embodiments, the online system selects negative training examples based on the measures of similarities between items and queries in pairs.
An online concierge system displays a search interface to users. When displaying suggestions for a query, or displaying results, the online concierge system retrieves candidate suggestions and ranks the candidate suggestions. The online concierge system also obtains an embedding for each candidate suggestion. The online concierge system determines measures of similarity between embeddings for different pairs of candidate suggestion. If a candidate suggestion in a pair has at least a threshold measure of similarity to the other candidate suggestion in the pair, the online concierge system removes one of the candidate suggestions from the pair when displaying candidate suggestions. The online concierge system may remove a candidate suggestion having a lower position in the ranking in a pair of candidate suggestions.
An online system leverages stored interactions with items made by users after the online system received queries to determine display of items satisfying the query. For example, the online system trains a model to predict a likelihood of a user performing an interaction with an item displayed after a query was received. As different items receive different amounts of interaction from users, limited historical interaction with certain items may limit accuracy of the model. The online system generates embeddings for previously received queries and uses measures of similarity between embeddings for queries to generate clusters of queries. Previous interactions with queries in a cluster are combined, with the combined data being used for determining display of items in response to a query.
G06F 16/2458 - Types spéciaux de requêtes, p.ex. requêtes statistiques, requêtes floues ou requêtes distribuées
77.
MACHINE LEARNING MODEL FOR DETERMINING A TIME INTERVAL TO DELAY BATCHING DECISION FOR AN ORDER RECEIVED BY AN ONLINE CONCIERGE SYSTEM TO COMBINE ORDERS WHILE MINIMIZING PROBABILITY OF LATE FULFILLMENT
An online concierge identifies orders to shoppers, allowing shoppers to select orders for fulfillment. The online concierge system may generate batches that include multiple orders, allowing a shopper to select a batch to fulfill multiple orders. As orders are continuously being received, delaying identification of orders to shoppers may allow greater batching of orders. To allow greater opportunities for batching, the online concierge sy stem estimates a benefit for delaying identification of an order by different time intervals and predicts an amount of time to fillfill the order. The online concierge system then delays assigning orders for which there is a threshold benefit for delaying and selects a time interval for delaying identificati on of the order that does not result in greater than a threshold likelihood of a late fulfillment of the order.
An online system maintains various items and maintains values for different attributes of the items, as well as an item embedding for each item. When the online system receives a query for retrieving one or more items, the online system generates an embedding for the query. Based on measures of similarity between the embedding for the query and item embeddings, the online system selects a set of items. The online system identifies a specific attribute of items and generates a whitelist of values for the specific attribute based on measures of similarity between item embeddings for items in the selected set and the embedding for the query. The online system removes items having values for the selected attribute outside of the whitelist of values from the selected set of items to identify items more likely to be relevant to the query.
Self-checkout vehicle systems and methods comprising a self-checkout vehicle having a camera(s), a weight sensor(s), and a processor configured to: (i) identify via computer vision a merchandise item selected by a shopper based on an identifier affixed to the selected item, and (ii) calculate a price of the merchandise item based on the identification and weight of the selected item. Computer vision systems and methods for identifying merchandise selected by a shopper comprising a processor configured to: (i) identify an identifier affixed to the selected merchandise and an item category of the selected merchandise, and (ii) compare the identifier and item category identified in each respective image to determine the most likely identification of the merchandise.
G06Q 20/20 - Systèmes de réseaux présents sur les points de vente
B62B 3/14 - Voitures à bras ayant plus d'un essieu portant les roues servant au déplacement; Dispositifs de direction à cet effet; Appareillage à cet effet caractérisées par des moyens pour l'emboîtement ou l'empilage, p.ex. chariots pour achats
B62B 5/00 - Accessoires ou détails spécialement adaptés aux voitures à bras
G01G 19/41 - Appareils ou méthodes de pesée adaptés à des fins particulières non prévues dans les groupes avec dispositions pour indiquer, enregistrer ou calculer un prix ou d'autres quantités dépendant du poids utilisant des moyens de calcul mécaniques
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
G06K 19/06 - Supports d'enregistrement pour utilisation avec des machines et avec au moins une partie prévue pour supporter des marques numériques caractérisés par le genre de marque numérique, p.ex. forme, nature, code
G06K 19/07 - Supports d'enregistrement avec des marques conductrices, des circuits imprimés ou des éléments de circuit à semi-conducteurs, p.ex. cartes d'identité ou cartes de crédit avec des puces à circuit intégré
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
DETERMINING ESTIMATED DELIVERY TIME OF ITEMS OBTAINED FROM A WAREHOUSE FOR USERS OF AN ONLINE CONCIERGE SYSTEM TO REDUCE PROBABILITIES OF DELIVERY AFTER THE ESTIMATED DELIVERY TIME
An online concierge system displays an interface to a user identifying an estimated time of arrival for an order. To generate the estimated time of arrival for the order, the online concierge system trains a prediction engine to predict delivery time based on a predicted selection time for a shopper to select the order for fulfillment and predicted travel time for the shopper to deliver items of the order to a location identified by the order. The online concierge system generates a policy optimization model that computes an adjustment for the predicted delivery time. The adjustment is determined by solving a stochastic optimization problem with a constraint on a probability of the order being delivered after the estimated time of arrival. The predicted delivery time combined with the adjustment determines the estimated time of delivery displayed to the user to balance between minimizing late deliveries and wait times.
An online concierge system allows users to order items within discrete time intervals later than a time when an order was received. Each order may require a different set of characteristics for fulfilment by shoppers. Because different shoppers may have different capabilities, it is most efficient to reserve shoppers with specialized characteristics for orders that require them. The online concierge system maintains a set of hierarchical structures for different characteristics of shoppers, with each level in a hierarchical structure having a value. To select a shopper to fulfill an order, the online concierge system scores identifies groups of shoppers having characteristics capable of fulfilling the order based on levels in the hierarchical structure for each characteristic of a group. A shopper from a group having a minimum score is selected to fulfill the order.
G06Q 10/08 - Logistique, p.ex. entreposage, chargement ou distribution; Gestion d’inventaires ou de stocks
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
G06Q 10/06 - Ressources, gestion de tâches, des ressources humaines ou de projets; Planification d’entreprise ou d’organisation; Modélisation d’entreprise ou d’organisation
82.
USER INTERFACE FOR SHOWING AVAILABILITY OF ORDERS FOR CONCIERGE SHOPPING SERVICE
For each retailer in the geographic region, an online system predicts a number of orders placed at the retailer and a capacity to fulfill orders during a forecast time period. The capacity of the retailer is predicted based on a number of pickers expected to be available to the retailer during the forecast time period. The online system determines demand for the services of a picker at the retailer based on a comparison of the predicted number of orders and the predicted capacity to fulfill those orders. The online system displays a user interactive map of the geographic region to the picker. The map displays a pin at the location of each retailer in the geographic region, which describes the categorization determined for the retailer. The picker selects a pin, which causes the user interactive map to display a notification characterizing the demand for services at the retailer.
An item recognition system uses a top camera and one or more peripheral cameras to identify items. The item recognition system may use image embeddings generated based on images captured by the cameras to generate a concatenated embedding that describes an item depicted in the image. The item recognition system may compare the concatenated embedding to reference embeddings to identify the item. Furthermore, the item recognition system may detect when items are overlapping in an image. For example, the item recognition system may apply an overlap detection model to a top image and a pixel-wise mask for the top image to detect whether an item is overlapping with another in the top image. The item recognition system notifies a user of the overlap if detected.
An online concierge system maintains information about items offered for purchase and users of the online concierge system. Based on prior purchases of items by users, the online concierge system trains a model to determine a likelihood of a user purchasing an item based on an embedding for the object and embedding for the user. The online concierge system identifies a collection of items and generates an embedding for the collection. The collection may be a cluster of items determined from similarities between embeddings of items. Alternatively, the collection may be a group of items having a common category. The online concierge system includes one or more collections of items along with individual items when recommending items for the users, so the trained model is applied to embeddings of the individual items and to embeddings of the one or more collections to generate recommendations for a user.
A customer places an order of items to be purchased with an online concierge system. The online concierge system provides the order to a picker who shops for the items at a retailer and delivers them. The online concierge system requests an image of a receipt of the order from the picker. The online concierge system performs image processing on the image of the receipt and uses machine learning and optical character recognition to determine the actual amounts purchased of items. The online concierge system charges the customer based on the actual amounts purchased of each item.
An online system provides options for selection by a user. The online system receives a query entered on a client device. The online system queries an item database to retrieve a set of items related to the query and assigns each item to a product category in a predefined taxonomy that maps items to product categories. The online system inputs each item into a prediction model trained to predict a probability that an item is available at a warehouse location. The online system determines that a first product category has low availability based on predicted probabilities for items in the first product category. Responsive to determining that a first product category has low availability, the online system generates a generic item for the first product category and sends a list of items including the generic item to the client device for display responsive to the query.
G06Q 50/28 - Logistique, p.ex. stockage, chargement, distribution ou expédition
G06Q 10/06 - Ressources, gestion de tâches, des ressources humaines ou de projets; Planification d’entreprise ou d’organisation; Modélisation d’entreprise ou d’organisation
G06Q 10/08 - Logistique, p.ex. entreposage, chargement ou distribution; Gestion d’inventaires ou de stocks
G06Q 30/06 - Transactions d’achat, de vente ou de crédit-bail
87.
LEVERAGING INFORMATION ABOUT PRIOR ORDERS FROM VARIOUS USERS ASSOCIATED WITH AN ACCOUNT WHEN RECEIVING AN ORDER FROM A USER ASSOCIATED WITH THE ACCOUNT
Multiple users of a household can each have a different profile associated with a common account for an online concierge system. This association of different profiles with the common accounts allows the concierge system to show a user of the household what other users of the household purchased and rank items for suggestion to the user based one purchases of other users, facilitating order building. The online concierge system also enables a user profile to designate a user profile associated with the common account for an order pickup or as a contact for a home delivery. Additionally, association of different user profiles with the common account may be used for account recovery of one of the user profiles. Further, different user profiles may have different permissions for creating an order with the online concierge system.
In an online concierge system, a customer adds items to an online shopping cart. The online concierge system determines key ingredients from the items in the online shopping cart by mapping the items to generic items and removing non-ingredient items and staple items. The online concierge system retrieves recipes including at least one of the key ingredients. The online concierge system determines complementary ingredients based on the other ingredients in the recipes and calculates co-occurrence scores for the complementary ingredients. Using the co-occurrence scores, the online concierge system ranks the complementary ingredients and sends for display a subset of the complementary ingredients as recommended items.
In a delivery service, a picker retrieves items specified in an order by a customer. If a picker encounters an issue with an item in the order, the picker may select, via a user interface, the item and an associated template message, which requests input from the customer regarding a course of action for the item, to send to the customer. The customer may select, via another user interface, a template message describing a course of action for the item. In response to receiving one of a subset of template messages, the online concierge system displays via the user interface, a set of replacement options to the customer, who may select one of the replacement options to be sent to the picker with the template message.
An online concierge system receives an order from a customer. The online concierge system transmits a notification to the customer's client device indicating that the order is ready for pick up and receives location data from the customer's client device as the customer travels to a pickup location. In response to the online concierge system receiving a first indication that the customer has entered an outer geofence, the online concierge system transmits a second notification to a runner's client device that the customer is in transit. In response to the online concierge system receiving a second indication that the customer has entered an inner geofence, the online concierge system starts a timer. When the online system receives a confirmation that the order has been picked up by the customer, it stops the timer and computes a wait time for pick up of the order.
Based on orders fulfilled by shoppers of an online concierge system, the online concierge system identifies items in an order that are difficult to find in a warehouse in which the order is fulfilled. When a shopper obtains a difficult to find item from the warehouse, the online concierge system prompts the shopper to provide information for finding the difficult to find item in the warehouse. The online concierge system stores the information for finding the difficult to find item from the shopper in association with the difficult to find item and with the warehouse. Subsequently, when a different shopper is fulfilling an order from the warehouse including the difficult to find item, the online concierge system displays the information for finding the difficult to find item in the warehouse to the different shopper.
A method for populating an inventory catalog includes receiving an image showing an item in the inventory catalog and comprising a plurality of pixels. A machine learned segmentation neural network is retrieved to determine location of pixels in an image that are associated with an image label and the property. The method determines a subset of pixels associated with the item label in the received image and identifies locations of the subset of pixels of the received image, and extracts the subset of pixels from the received image. The method retrieves a machine learned classifier to determine whether an image shows the item label. The method determines, using the machine learned classifier, that the extracted subset of pixels shows the item label. The method updates the inventory catalog for the item to indicate that the item has the property associated with the item label.
G06K 9/46 - Extraction d'éléments ou de caractéristiques de l'image
G06K 9/66 - Méthodes ou dispositions pour la reconnaissance utilisant des moyens électroniques utilisant des comparaisons ou corrélations simultanées de signaux images avec une pluralité de références, p.ex. matrice de résistances avec des références réglables par une méthode adaptative, p.ex. en s'instruisant
An online shopping concierge service allows shoppers to purchase items on behalf of customers and checkout using a mobile application, circumventing traditional point-of-sale check-out systems. A customer places an order using a mobile application or website associated with the online shopping concierge service. The online shopping concierge service charges a payment instrument of the customer in the value of the selected items. The system transmits the order to a shopper, who receives an order for fulfillment on a mobile device. The shopper collects and scans items using a mobile application. The mobile application transmits an identification of the items for purchase and their total cost to the online shopping concierge service, which transmits payment to the retailer. Alternatively, the mobile application encodes an identification of the items for purchase into an encoded image, which is scanned by a cashier, allowing the shopper to complete an accelerated check-out.
brevets
