The disclosure introduces systems, devices, methods, and instructions for autonomously identifying recurring patterns (e.g., pulse, respiration) in video content using unsupervised learning. The embodiments overcome the limitations of traditional supervised methods that require extensive labeled datasets, particularly for detecting subtle periodic signals like heart rate and respiration. The disclosure utilizes feature extraction, clustering algorithms, and validation to analyze video data for these temporal patterns, offering potential applications in various fields such as border or gate security, deception detection, healthcare, and entertainment without the need for manual annotation.
G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
G06V 20/52 - Activités de surveillance ou de suivi, p. ex. pour la reconnaissance d’objets suspects
2.
VIDEO BASED UNSUPERVISED LEARNING OF PERIODIC SIGNALS
The disclosure introduces systems, devices, methods, and instructions for autonomously identifying recurring patterns (e.g., pulse, respiration) in video content using unsupervised learning. The embodiments overcome the limitations of traditional supervised methods that require extensive labeled datasets, particularly for detecting subtle periodic signals like heart rate and respiration. The disclosure utilizes feature extraction, clustering algorithms, and validation to analyze video data for these temporal patterns, offering potential applications in various fields such as border or gate security, deception detection, healthcare, and entertainment without the need for manual annotation.
Systems, devices, methods, and non-transitory computer-readable instructions for determining a physiological signal from a video stream, comprising capturing the video stream of a subject, the video stream including a sequence of frames, processing each frame of the video stream to identify a facial portion of the subject in each frame, determining a periodic physiological signal of the subject from the video stream using a plurality of datasets in which one or more augmentations were applied to the plurality of datasets.
Systems, devices, methods, and non-transitory computer-readable instructions for determining a physiological signal from a video stream, comprising capturing the video stream of a subject, the video stream including a sequence of frames, processing each frame of the video stream to identify a facial portion of the subject in each frame, determining a periodic physiological signal of the subject from the video stream using a plurality of datasets in which one or more augmentations were applied to the plurality of datasets.
Liveness detection includes systems, devices, methods, and non-transitory instructions for detecting liveness of a subject from a media stream, including capturing a media stream of the subject, the media stream including a sequence of frames, processing each frame of the media stream to track one or more biometrics, and determining whether the subject in the media stream is live based on the one or more biometrics detected in the media steam.
G06V 40/16 - Visages humains, p. ex. parties du visage, croquis ou expressions
G06V 40/18 - Caractéristiques de l’œil, p. ex. de l’iris
G10L 25/51 - Techniques d'analyse de la parole ou de la voix qui ne se limitent pas à un seul des groupes spécialement adaptées pour un usage particulier pour comparaison ou différentiation
G06V 10/25 - Détermination d’une région d’intérêt [ROI] ou d’un volume d’intérêt [VOI]
Liveness detection includes systems, devices, methods, and non-transitory instructions for detecting liveness of a subject from a media stream, including capturing a media stream of the subject, the media stream including a sequence of frames, processing each frame of the media stream to track one or more biometrics, and determining whether the subject in the media stream is live based on the one or more biometrics detected in the media steam.
H04N 21/4415 - Acquisition de l'identification d'un utilisateur final utilisant les caractéristiques biométriques de l'utilisateur, p. ex. par reconnaissance de la voix ou balayage d'empreintes digitales
G06V 10/25 - Détermination d’une région d’intérêt [ROI] ou d’un volume d’intérêt [VOI]
G06V 10/80 - Fusion, c.-à-d. combinaison des données de diverses sources au niveau du capteur, du prétraitement, de l’extraction des caractéristiques ou de la classification
G06V 40/10 - Corps d’êtres humains ou d’animaux, p. ex. occupants de véhicules automobiles ou piétonsParties du corps, p. ex. mains
G06V 40/40 - Détection d’usurpation, p. ex. détection d’activité
H04N 21/422 - Périphériques d'entrée uniquement, p. ex. système de positionnement global [GPS]
7.
TRAVEL DOCUMENT VALIDATION USING ARTIFICIAL INTELLIGENCE AND UNSUPERVISED LEARNING
Systems, devices, methods, and instructions for travel document validation, including receiving data for one or more travel documents, generating a set of features for artificial intelligence model training, validating, and testing, upon receiving data for a plurality of travel documents, data from a first subset of travel documents is used to train an artificial intelligence model, a second subset of travel documents is used to validate the artificial intelligence model, and a third subset of travel documents is used to test the artificial intelligence model.
G06V 30/413 - Classification de contenu, p. ex. de textes, de photographies ou de tableaux
G06V 30/416 - Extraction de la structure logique, p. ex. chapitres, sections ou numéros de pageIdentification des éléments de document, p. ex. des auteurs
8.
NON-CONTRASTIVE UNSUPERVISED LEARNING OF PHYSIOLOGICAL SIGNALS FROM VIDEO
Systems, devices, methods, and non-transitory computer-readable instructions for non-contrastive unsupervised learning of a physiological signal from a video stream, the computer-implemented method including capturing the video stream of a subject, the video stream including a sequence of frames; processing each frame of the video stream to update a physiological signal detection function; determining the physiological signal from the video stream, and applying the updated physiological signal detection function to a subsequent video steam.
G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
G06V 10/80 - Fusion, c.-à-d. combinaison des données de diverses sources au niveau du capteur, du prétraitement, de l’extraction des caractéristiques ou de la classification
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
9.
NON-CONTRASTIVE UNSUPERVISED LEARNING OF PHYSIOLOGICAL SIGNALS FROM VIDEO
Systems, devices, methods, and non-transitory computer-readable instructions for non-contrastive unsupervised learning of a physiological signal from a video stream, the computer-implemented method including capturing the video stream of a subject, the video stream including a sequence of frames; processing each frame of the video stream to update a physiological signal detection function; determining the physiological signal from the video stream, and applying the updated physiological signal detection function to a subsequent video steam.
G16H 30/40 - TIC spécialement adaptées au maniement ou au traitement d’images médicales pour le traitement d’images médicales, p. ex. l’édition
G16H 30/20 - TIC spécialement adaptées au maniement ou au traitement d’images médicales pour le maniement d’images médicales, p. ex. DICOM, HL7 ou PACS
G06V 10/25 - Détermination d’une région d’intérêt [ROI] ou d’un volume d’intérêt [VOI]
Systems, devices, methods, and non-transitory computer-readable instructions for detecting deception of a subject from a media stream that capture a media stream of the subject including, the media stream including a sequence of frames, process each frame of the media stream to track a plurality of biometrics, and determine whether the subject in the media stream is deceptive based upon changes to respective biometrics.
G06V 40/70 - Biométrique multimodale, p. ex. combinaison d’informations de modalités biométriques distinctes
G06V 40/40 - Détection d’usurpation, p. ex. détection d’activité
G06V 10/26 - Segmentation de formes dans le champ d’imageDécoupage ou fusion d’éléments d’image visant à établir la région de motif, p. ex. techniques de regroupementDétection d’occlusion
A61B 5/01 - Mesure de la température de parties du corps
A61B 5/024 - Mesure du pouls ou des pulsations cardiaques
A61B 5/16 - Dispositifs pour la psychotechnieTest des temps de réaction
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING UNIVERSITY OF NOTRE DAME (USA)
Inventeur(s)
Vance, Nathan
Speth, Jeremy
Khan, Siamul
Czajka, Adam
Bowyer, Kevin
Wright, Diane
Flynn, Patrick
Carpenter, Nathan
Olie, Leandro
Abrégé
Systems, devices, methods, and non-transitory computer-readable instructions for detecting deception of a subject from a media stream that capture a media stream of the subject including, the media stream including a sequence of frames, process each frame of the media stream to track a plurality of biometrics, and determine whether the subject in the media stream is deceptive based upon changes to respective biometrics.
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Compiling indexes of information Computer services, namely, creating computer-network based indexes and developing databases of information; Database development services
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Compiling indexes of information Computer services, namely, creating computer-network based indexes and developing databases of information; Database development services
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Providing online non-downloadable computer software, namely,
software for travelers to manage and submit data and make
payments required by country policy prior to travel.
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Providing online non-downloadable computer software, namely, software for travelers to manage and submit data and make payments required by country policy prior to travel
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING UNIVERSITY OF NOTRE DAME (USA)
Inventeur(s)
Speth, Jeremy
Flynn, Patrick
Czajka, Adam
Bowyer, Kevin
Carpenter, Nathan
Olie, Leandro
Abrégé
The video based detection of pulse waveform includes systems, devices, methods, and computer-readable instructions for capturing a video stream including a sequence of frames, processing each frame of the video stream to spatially locate a region of interest, cropping each frame of the video stream to encapsulate the region of interest, processing the sequence of frames, by a 3-dimensional convolutional neural network, to determine the spatial and temporal dimensions of each frame of the sequence of frames and to produce a pulse waveform point for each frame of the sequence of frames, and generating a time series of pulse waveform points to generate the pulse waveform of the subject for the sequence of frames.
The video based detection of pulse waveform includes systems, devices, methods, and computer-readable instructions for capturing a video stream including a sequence of frames, processing each frame of the video stream to spatially locate a region of interest, cropping each frame of the video stream to encapsulate the region of interest, processing the sequence of frames, by a 3-dimensional convolutional neural network, to determine the spatial and temporal dimensions of each frame of the sequence of frames and to produce a pulse waveform point for each frame of the sequence of frames, and generating a time series of pulse waveform points to generate the pulse waveform of the subject for the sequence of frames.
A61B 5/00 - Mesure servant à établir un diagnostic Identification des individus
A61B 5/024 - Mesure du pouls ou des pulsations cardiaques
A61B 5/11 - Mesure du mouvement du corps entier ou de parties de celui-ci, p. ex. tremblement de la tête ou des mains ou mobilité d'un membre
G06F 17/14 - Transformations de Fourier, de Walsh ou transformations d'espace analogues
G06V 10/25 - Détermination d’une région d’intérêt [ROI] ou d’un volume d’intérêt [VOI]
G06V 10/80 - Fusion, c.-à-d. combinaison des données de diverses sources au niveau du capteur, du prétraitement, de l’extraction des caractéristiques ou de la classification
G06V 10/82 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant les réseaux neuronaux
G06V 20/40 - ScènesÉléments spécifiques à la scène dans le contenu vidéo
G06V 40/16 - Visages humains, p. ex. parties du visage, croquis ou expressions
20.
Travel document validation using artificial intelligence and unsupervised learning
Systems, devices, methods, and instructions for travel document validation, including receiving data for one or more travel documents, generating a set of features for artificial intelligence model training, validating, and testing, upon receiving data for a plurality of travel documents, data from a first subset of travel documents is used to train an artificial intelligence model, a second subset of travel documents is used to validate the artificial intelligence model, and a third subset of travel documents is used to test the artificial intelligence model.
G06V 30/413 - Classification de contenu, p. ex. de textes, de photographies ou de tableaux
G06V 30/416 - Extraction de la structure logique, p. ex. chapitres, sections ou numéros de pageIdentification des éléments de document, p. ex. des auteurs
Within a vehicle, and at a border crossing, a verification device enables unsupervised or automatic biometric authentication of subjects moving between secured areas. Verification device is configured to store reference biometric information for one or more vehicle occupants. Upon approaching a verification station at a border crossing, user(s) supply one or more biometrics for validation against the reference biometric information. Upon validation, verification device transmits a validated signal to the verification station to enable the vehicle to pass the border crossing without stopping at the immigration booth. For example, the receipt of a validated signal may trigger the opening of a gate at a border crossing. If verification device cannot validate the user's biometric against the reference biometric information, the verification device may transmit a not-validated signal to the verification station, and the user proceeds to stop at the immigration booth.
G07C 9/00 - Enregistrement de l’entrée ou de la sortie d'une entité isolée
G07C 9/37 - Enregistrement de l’entrée ou de la sortie d'une entité isolée ne comportant pas l’utilisation d’un laissez-passer combiné à une vérification d’identité utilisant des données biométriques, p. ex. des empreintes digitales, un balayage de l’iris ou une reconnaissance de la voix
B60R 25/25 - Moyens pour enclencher ou arrêter le système antivol par biométrie
G06F 21/32 - Authentification de l’utilisateur par données biométriques, p. ex. empreintes digitales, balayages de l’iris ou empreintes vocales
G06F 21/45 - Structures ou outils d’administration de l’authentification
G06K 7/10 - Méthodes ou dispositions pour la lecture de supports d'enregistrement par radiation électromagnétique, p. ex. lecture optiqueMéthodes ou dispositions pour la lecture de supports d'enregistrement par radiation corpusculaire
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
Within a vehicle, and at a border crossing, a verification device enables unsupervised or automatic biometric authentication of subjects (i.e., persons or travelers) moving between secured areas (e.g., across a border or into a secured facility, for example). Verification device is configured to store reference biometric information for one or more vehicle occupants. Upon approaching a verification station at a border crossing, user(s) supply one or more biometrics (e.g., fingerprint, facial recognition, voice recognition) for validation against the reference biometric information. Upon validation, verification device transmits a validated signal to the verification station to enable the vehicle to pass the border crossing without stopping at the immigration booth. For example, the receipt of a validated signal may trigger the opening of a gate at a border crossing. If verification device cannot validate the user's biometric against the reference biometric information, the verification device may transmit a not-validated signal to the verification station, and the user proceeds to stop at the immigration booth.
G06Q 50/26 - Services gouvernementaux ou services publics
G06K 7/10 - Méthodes ou dispositions pour la lecture de supports d'enregistrement par radiation électromagnétique, p. ex. lecture optiqueMéthodes ou dispositions pour la lecture de supports d'enregistrement par radiation corpusculaire
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
23.
AUGMENTED REALITY MONITORING OF BORDER CONTROL SYSTEMS
An augmented-reality device is provided. The augmented-reality device is configured to retrieve security information for a plurality of persons at respective security checkpoints. In addition, the augmented-reality device is configured to concurrently display the security information for each of the plurality of persons on an augmented-reality display. Security information is superimposed on or adjacent to each of the plurality of persons located at respective security checkpoints, the display configured to maintain visibility of the security checkpoint.
G02B 27/32 - Repères fiduciels ou échelles de mesure à l'intérieur du système optique
G06T 19/00 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie
G07C 9/00 - Enregistrement de l’entrée ou de la sortie d'une entité isolée
G06Q 50/26 - Services gouvernementaux ou services publics
G07C 9/25 - Enregistrement de l’entrée ou de la sortie d'une entité isolée comportant l’utilisation d’un laissez-passer combiné à une vérification d’identité du titulaire du laissez-passer utilisant des données biométriques, p. ex. des empreintes digitales, un balayage de l’iris ou une reconnaissance de la voix
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Providing online non-downloadable computer software, namely, analytical software program used by police and investigative authorities, immigration and board control personnel and intelligence analysts to vet individuals attempting to enter or depart a country via any of the common modes of border crossing by establishing a holistic view of all available data collected about that individual, and the relationships between those data elements, for the purpose of conducting investigations and making clearance decisions
A multi-function biometric scanner is provided. The multi-function biometric scanner includes a housing that includes a dome-shaped or semi-dome shaped user interface, the user interface including a capacitive film for fingerprint capture that is disposed along an outer-surface of the housing and a plurality of biometric sensors that are disposed within the housing and that are configured to concurrently retrieve a plurality of biometrics from a user, each sensor being configured to measure a respective biometric of the plurality of biometrics. Fingerprints and the plurality of biometrics are compared to threat information in one or more threat databases to identify a person of interest.
A wearable device may store a biometric token associated with a wearer of the wearable device, the wearable device including: a wireless communications interface; a processing circuitry; a memory configured to store a biometric token associated with a wearer of the wearable device, the biometric token including a device identifier that is associated with the wearable device, a biometric template for each of one or more biometric scans of the wearer of the wearable device, and an indication of whether or not the biometric token is valid, wherein the biometric token, if valid, establishes a trust that wearer identifying information, linked to the biometric token, is associated with the wearer; an invalidating event detector configured to determine if an invalidating event has occurred; wherein the processing circuitry is configured to invalidate the biometric token in response to detecting that an invalidating event has occurred for the biometric token.
G06F 21/32 - Authentification de l’utilisateur par données biométriques, p. ex. empreintes digitales, balayages de l’iris ou empreintes vocales
A61B 5/00 - Mesure servant à établir un diagnostic Identification des individus
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
H04L 29/06 - Commande de la communication; Traitement de la communication caractérisés par un protocole
G06F 21/35 - Authentification de l’utilisateur impliquant l’utilisation de dispositifs externes supplémentaires, p. ex. clés électroniques ou cartes à puce intelligentes communiquant sans fils
27.
Parallel image processing for multiple biometrics capture
According to an implementation, a biometric camera device includes a plurality of image sensors including a first image sensor and a second image sensor, and a plurality of biometric processors including a first biometric processor connected to the first image sensor and a second biometric processor connected to the second image sensor. The first biometric processor is configured to receive and process image data from the first image sensor according to a first biometric algorithm, and the second biometric processor is configured to receive and process image data from the second image sensor according to a second biometric algorithm. The biometric camera device includes a controller connected to each of the plurality of biometric processors. The controller is configured to receive processed biometric data from each of the biometric plurality of biometric processors.
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
28.
MULTI-MODE DATA COLLECTION AND TRAVELER PROCESSING
A technique includes receiving, for a traveler, traveler information via a plurality of different information collection modes, determining a reliability score for each of the plurality of information collection modes, determining a cumulative score for the traveler based on the reliability score for each of the plurality of information collection modes, determining whether the cumulative score is greater than or equal to a threshold, performing traveler processing based on the received traveler information if the cumulative score is greater than or equal to the threshold, and otherwise, receiving for the traveler, traveler information via an additional different information collection mode if the cumulative score is less than the threshold.
An augmented-reality device is provided. The augmented-reality device is configured to retrieve security information for a plurality of persons at respective security checkpoints. In addition, the augmented-reality device is configured to concurrently display the security information for each of the plurality of persons on an augmented-reality display. Security information is superimposed on or adjacent to each of the plurality of persons located at respective security checkpoints, the display configured to maintain visibility of the security checkpoint.
G06T 19/00 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie
G02B 27/32 - Repères fiduciels ou échelles de mesure à l'intérieur du système optique
G07C 9/00 - Enregistrement de l’entrée ou de la sortie d'une entité isolée
G06Q 50/26 - Services gouvernementaux ou services publics
G07C 9/25 - Enregistrement de l’entrée ou de la sortie d'une entité isolée comportant l’utilisation d’un laissez-passer combiné à une vérification d’identité du titulaire du laissez-passer utilisant des données biométriques, p. ex. des empreintes digitales, un balayage de l’iris ou une reconnaissance de la voix
A multi-function biometric scanner is provided. The multi-function biometric scanner includes a housing that includes a dome-shaped or semi-dome shaped user interface, the user interface including a capacitive film for fingerprint capture that is disposed along an outer-surface of the housing and a plurality of biometric sensors that are disposed within the housing and that are configured to concurrently retrieve a plurality of biometrics from a user, each sensor being configured to measure a respective biometric of the plurality of biometrics. Fingerprints and the plurality of biometrics are compared to threat information in one or more threat databases to identify a person of interest.
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G10L 17/10 - Systèmes multimodaux, c.-à-d. basés sur l’intégration de moteurs multiples de reconnaissance ou de fusion de systèmes experts
G10L 17/06 - Techniques de prise de décisionStratégies d’alignement de motifs
09 - Appareils et instruments scientifiques et électriques
Produits et services
computer software, namely, an application for secondary border security screening by using visualization of multiple data feeds and real-time analytic results on a person of interest or watchlist flagged individual
37 - Services de construction; extraction minière; installation et réparation
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Consulting in the field of maintenance and installation of computer hardware that scans, stores and analyzes, applies proprietary data mining techniques, traveler's demographic and biometric data for use by governmental agencies in the fields of immigration, security and law enforcement personnel for airports and border access control Consulting services, namely, designing, creating, implementing and maintaining computer software in the field of software that scans, stores and analyzes, applies proprietary data mining techniques, traveler's demographic and biometric data for use by governmental agencies in the fields of immigration, security and law enforcement personnel for airports and border access control
34.
SYSTEMS, METHODS AND APPARATUSES FOR IDENTIFYING PERSON OF INTEREST
The present disclosure describes systems, methods, and apparatuses for identifying a person of interest. An exemplary method may comprise storing external data received from a variety external sources into a parameterized table, creating a first set of category views on the parameterized table, creating a second set of category views based at least in part on data to be derived from a traveler's personal information to be received, receiving the traveler's personal information generated by an input device and determining whether the traveler is a person of interest by evaluating the personal information against one or more pre-defined profiles using the first and second sets of category views. Each of the one or more pre-defined profiles may comprise one or more rules and a threshold value for determining a likelihood for the traveler to be matched in each of the one or more pre-defined profiles.
The present disclosure describes systems, methods, and apparatuses for identifying a person of interest. An exemplary method may comprise storing external data received from a variety external sources into a parameterized table, creating a first set of category views on the parameterized table, creating a second set of category views based at least in part on data to be derived from a traveler's personal information to be received, receiving the traveler's personal information generated by an input device and determining whether the traveler is a person of interest by evaluating the personal information against one or more pre-defined profiles using the first and second sets of category views. Each of the one or more pre-defined profiles may comprise one or more rules and a threshold value for determining a likelihood for the traveler to be matched in each of the one or more pre-defined profiles.
G06N 5/04 - Modèles d’inférence ou de raisonnement
H04L 29/06 - Commande de la communication; Traitement de la communication caractérisés par un protocole
G07C 9/22 - Enregistrement de l’entrée ou de la sortie d'une entité isolée comportant l’utilisation d’un laissez-passer combiné à une vérification d’identité du titulaire du laissez-passer
G07C 9/00 - Enregistrement de l’entrée ou de la sortie d'une entité isolée
G06F 21/32 - Authentification de l’utilisateur par données biométriques, p. ex. empreintes digitales, balayages de l’iris ou empreintes vocales
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Consulting services to governments related to the installation, operation and maintenance of computer hardware and software that scan, store and analyze, applying proprietary data mining techniques, traveler's demographic and biometric data for use by immigration, security and law enforcement personnel in airports and border-crossing.
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Technological consulting services in the field of installation, operation and maintenance of computer hardware and software that scan, store and analyze, applying proprietary data mining techniques, traveler's demographic and biometric data for use by governmental agencies in the fields of immigration, security and law enforcement personnel for airports and border access control
