Abstract

Systems, methods and non-transitory computer readable media for analysis of videos of surgical procedures are provided. One example includes surgical video analysis to inspect operative reports. Another example includes surgical video analysis for operative report text generation. Yet another example includes surgical video analysis for synchronized browsing of surgical videos and operative reports. An additional example includes surgical video analysis for resolving inconsistencies between surgical footages and operative reports.

IPC Classes  ?

• B66F 9/18 - Load gripping or retaining means
• A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• A61B 17/00 - Surgical instruments, devices or methods
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• A61B 34/30 - Surgical robots
• A61B 34/37 - Leader-follower robots
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• B25J 9/16 - Programme controls
• B65G 1/08 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level the articles being fed by gravity
• G06F 16/71 - IndexingData structures thereforStorage structures
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G06N 20/00 - Machine learning
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G06F 40/20 - Natural language analysis
• G06Q 10/10 - Office automationTime management
• G06Q 30/018 - Certifying business or products
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 10/70 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning
• G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/67 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines

Abstract

Systems and methods for analysis and review of surgical videos are disclosed. The systems and methods may include analyzing video frames of prior surgical procedures performed by a particular surgeon to ascertain a skill level of the particular surgeon; accessing a data structure containing patient characteristics associated with the prior surgical procedures; accessing a surgical schedule including prospective surgical procedures overlapping in time; obtaining patient characteristics associated with the prospective surgical procedures; analyzing the plurality of video frames to ascertain an expected amount of time for the particular surgeon to perform a particular prospective surgical procedure; determining requirements for particular prospective surgical procedure; determining whether the particular surgeon meets the requirements; and outputting an indicator that the particular surgeon meets the requirements.

IPC Classes  ?

• G06Q 10/0639 - Performance analysis of employeesPerformance analysis of enterprise or organisation operations
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G06N 20/00 - Machine learning
• G06T 7/00 - Image analysis
• G06T 7/20 - Analysis of motion
• G06T 7/70 - Determining position or orientation of objects or cameras
• G06T 7/90 - Determination of colour characteristics
• G06V 10/764 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
• G06V 20/40 - ScenesScene-specific elements in video content
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G11B 27/11 - IndexingAddressingTiming or synchronisingMeasuring tape travel by using information not detectable on the record carrier
• G11B 27/34 - Indicating arrangements
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines

Abstract

Systems, methods and non-transitory computer readable media for analysis of videos of surgical procedures are provided. One example includes surgical video analysis to inspect operative reports. Another example includes surgical video analysis for operative report text generation. Yet another example includes surgical video analysis for synchronized browsing of surgical videos and operative reports. An additional example includes surgical video analysis for resolving inconsistencies between surgical footages and operative reports.

IPC Classes  ?

• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture

Abstract

Systems and methods for automatically populating a post-operative report of a surgical procedure are disclosed. A system may include at least one processor configured to receive an identifier of a patient, an identifier of a healthcare provider, and surgical footage of a surgical procedure performed on the patient by the health care provider; analyze the surgical footage to identify a surgical event within the surgical footage; analyze a plurality of frames of the surgical footage to derive image-based information for populating a post-operative report of the surgical procedure, the derived image-based information is based on the identified surgical event; and cause the derived image-based information to populate the post-operative report of the surgical procedure.

IPC Classes  ?

• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• A61B 17/00 - Surgical instruments, devices or methods
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• A61B 34/30 - Surgical robots
• A61B 34/37 - Leader-follower robots
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• B25J 9/16 - Programme controls
• G06F 16/71 - IndexingData structures thereforStorage structures
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G06N 20/00 - Machine learning
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines

Abstract

Systems and methods for determining insurance reimbursement are disclosed. A system may include at least one processor configured to access video frames captured during a surgical procedure on a patient and analyze the video frames to identify a medical instrument, an anatomical structure, and an interaction between the medical instrument and the anatomical structure. The processor may access a database of reimbursement codes correlated to medical instruments, anatomical structures, and interactions between medical instruments and anatomical structures and compare the identified interaction between the medical instrument and the anatomical structure with information in the database of reimbursement codes to determine a reimbursement code associated with the surgical procedure and output the reimbursement code for use in obtaining an insurance reimbursement for the surgical procedure.

IPC Classes  ?

• B66F 9/18 - Load gripping or retaining means
• B65G 1/08 - Storage devices mechanical with means for presenting articles for removal at predetermined position or level the articles being fed by gravity

Goods & Services

Downloadable software for automatically generating surgical documentation from one or more of surgical video, audio, and other inputs Providing on-line non-downloadable software for automatically generating surgical documentation from one or more of surgical video, audio, and other inputs

Abstract

Systems, methods, and non-transitory computer readable media for automated analysis of video data during surgical procedures using artificial intelligence are provided. Surgical footage of an ongoing surgical procedure may be received and analyzed. The analysis may detect prospective adverse actions in surgical procedures based on the presence of a surgical instrument in a surgical cavity and a phase of the ongoing surgical procedure. The analysis may trigger removal of tissue for biopsy in an ongoing surgical procedure based on a likelihood that a feasible biopsy will cause a diagnosis of a condition other than a known condition of the patient. The analysis may facilitate addressing time sensitive situations in surgical procedures, for example by providing notification when no action to address a time sensitive situation is initiated within the selected time period.

IPC Classes  ?

• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Abstract

Systems, methods, and computer readable media related to providing intraoperative video review are disclosed. They involve receiving a plurality of video frames from a surgical video of an ongoing surgical procedure. Stored data based on prior surgical procedures may be accessed and at least one expected future event in the ongoing surgical procedure may be predicted based on the plurality of video frames and the stored data. At least one option to review at least one surgical video clip associated with the expected future event in the surgical procedure may be generated. A data structure containing the at least one surgical video clip may be accessed and the at least one surgical video clip associated with the expected future event may be outputted for intra-surgical presentation.

IPC Classes  ?

• A61B 5/05 - Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fieldsMeasuring using microwaves or radio waves
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• G06N 20/00 - Machine learning
• G06Q 10/0639 - Performance analysis of employeesPerformance analysis of enterprise or organisation operations
• G06T 7/00 - Image analysis
• G06T 7/20 - Analysis of motion
• G06T 7/70 - Determining position or orientation of objects or cameras
• G06T 7/90 - Determination of colour characteristics
• G06V 10/764 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
• G06V 20/40 - ScenesScene-specific elements in video content
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G11B 27/11 - IndexingAddressingTiming or synchronisingMeasuring tape travel by using information not detectable on the record carrier
• G11B 27/34 - Indicating arrangements
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Goods & Services

Downloadable computer software that captures, stores, and analyzes surgical video Providing temporary use of online non-downloadable computer software that captures, stores, and analyzes surgical video

Abstract

Systems and methods for automatically populating a post-operative report of a surgical procedure are disclosed. A system may include at least one processor configured to implement a method including receiving an identifier of a patient, an identifier of a healthcare provider, and surgical footage of a surgical procedure performed on the patient. The method may include analyzing frames of the surgical footage to identify phases of the surgical procedure based on interactions between medical instruments and biological structures and, based on the interactions, associate a name with each phase. The method may include determining a beginning of each phase and associating a time marker with the beginning of each phase. The method may include populating a post-operative report with the patient identifier, the names of the phases, and time markers associated with the phases in a manner that enables the health care provider to alter the post-operative report.

IPC Classes  ?

• H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• A61B 17/00 - Surgical instruments, devices or methods
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• A61B 34/30 - Surgical robots
• A61B 34/37 - Leader-follower robots
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• B25J 9/16 - Programme controls
• G06F 16/71 - IndexingData structures thereforStorage structures
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G06N 20/00 - Machine learning
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G11B 27/00 - EditingIndexingAddressingTiming or synchronisingMonitoringMeasuring tape travel
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands
• H04N 5/93 - Regeneration of the television signal or of selected parts thereof

Abstract

Systems and methods for updating a predicted outcome during a surgical procedure are disclosed. The system may include at least one processor configured to perform operations that include receiving, from at least one image sensor, image data associated with a first event and image data associated with a second event during a surgical procedure. Operations may include determining, based on received image data associated with the first event, a predicted outcome associated with the surgical procedure. Operations may include determining, based on the received image data associated with the second event, a change in the predicted outcome, causing the predicted outcome to drop below a threshold. Operations may include accessing a data structure of image-related data based on prior surgical procedures, identifying, based on the data structure, a recommended remedial action, and outputting the recommended remedial action.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• A61B 17/00 - Surgical instruments, devices or methods
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• A61B 34/30 - Surgical robots
• A61B 34/37 - Leader-follower robots
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• B25J 9/16 - Programme controls
• G06F 16/71 - IndexingData structures thereforStorage structures
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G06N 20/00 - Machine learning
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms

Abstract

Apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims are described. The aspects utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G06F 40/20 - Natural language analysis
• G06Q 10/10 - Office automationTime management
• G06Q 30/018 - Certifying business or products
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 10/70 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning
• G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/67 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines

Abstract

An apparatus, system, method, and computer-readable medium include aspects for using surgical video analysis. The aspects utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G06F 40/20 - Natural language analysis
• G06Q 10/10 - Office automationTime management
• G06Q 30/018 - Certifying business or products
• G06Q 40/08 - Insurance
• G06T 7/00 - Image analysis
• G06V 10/70 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning
• G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/67 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G06Q 40/08 - Insurance
• G06Q 30/018 - Certifying business or products

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G06Q 40/08 - Insurance
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G06V 20/40 - ScenesScene-specific elements in video content

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G06Q 40/08 - Insurance
• G06Q 30/018 - Certifying business or products

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G06Q 40/08 - Insurance
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G06V 20/40 - ScenesScene-specific elements in video content

Abstract

Disclosed herein are apparatus, system, method, and computer-readable medium aspects for using surgical video analysis for improving compliance with medical guidelines and improving processing of medical bills, medical malpractice claims, and insurance claims. Aspects disclosed herein utilize intracorporeal video footage, image analysis, and notifications to optimize correspondences among medical procedure information, medical guidelines, and medical transaction information.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06Q 10/10 - Office automationTime management
• G06Q 30/018 - Certifying business or products
• G06T 7/00 - Image analysis
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 40/67 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G06F 40/20 - Natural language analysis
• G06Q 40/08 - Insurance
• G06V 10/70 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning
• G06V 10/774 - Generating sets of training patternsBootstrap methods, e.g. bagging or boosting

Abstract

Systems, methods, and non-transitory computer readable media for automated analysis of video data during surgical procedures using artificial intelligence are provided. Surgical footage of an ongoing surgical procedure may be received and analyzed. The analysis may detect prospective adverse actions in surgical procedures based on the presence of a surgical instrument in a surgical cavity and a phase of the ongoing surgical procedure. The analysis may trigger removal of tissue for biopsy in an ongoing surgical procedure based on a likelihood that a feasible biopsy will cause a diagnosis of a condition other than a known condition of the patient. The analysis may facilitate addressing time sensitive situations in surgical procedures, for example by providing notification when no action to address a time sensitive situation is initiated within the selected time period.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis

Abstract

Systems and methods for enabling determination and notification of an omitted event in a surgical procedure are disclosed. A system may include at least one processor configured to implement a method including accessing frames of video captured during a specific surgical procedure and accessing stored data identifying a recommended sequence of events for the surgical procedure. The method may include comparing the accessed frames with the recommended sequence of events to identify an indication of a deviation between the specific surgical procedure and the recommended sequence of events for the surgical procedure. The method may include determining a name of an intraoperative surgical event associated with the deviation and providing a notification of the deviation including the name of the intraoperative surgical event associated with the deviation.

IPC Classes  ?

• H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• G11B 27/00 - EditingIndexingAddressingTiming or synchronisingMonitoringMeasuring tape travel
• H04N 5/93 - Regeneration of the television signal or of selected parts thereof
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• A61B 34/30 - Surgical robots
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• B25J 9/16 - Programme controls
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G06N 20/00 - Machine learning
• G06T 7/00 - Image analysis
• G06V 20/40 - ScenesScene-specific elements in video content
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges

Abstract

Systems, methods, and computer readable media related to aggregating and associated captured medical data are disclosed. They involve receiving an ID of a piece of equipment in a medical facility, location information for the equipment, and medical information captured by the equipment; and ascertaining a time of information capture by the equipment. They further involve performing a lookup in a data record to determine an identity of a particular patient assigned to a location associated with the location information and performing a lookup in a data structure to identify a medical record of the particular patient. They further involve establishing an association between the medical information captured by the equipment and the medical record to thereby enable access to the medical information through access to the medical record of the particular patient.

IPC Classes  ?

• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• G06N 20/00 - Machine learning
• G06Q 10/0639 - Performance analysis of employeesPerformance analysis of enterprise or organisation operations
• G06T 7/00 - Image analysis
• G06T 7/20 - Analysis of motion
• G06T 7/70 - Determining position or orientation of objects or cameras
• G06T 7/90 - Determination of colour characteristics
• G06V 10/764 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
• G06V 20/40 - ScenesScene-specific elements in video content
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G11B 27/11 - IndexingAddressingTiming or synchronisingMeasuring tape travel by using information not detectable on the record carrier
• G11B 27/34 - Indicating arrangements
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Systems and methods for analysis and review of surgical videos are disclosed. The systems and methods may include deriving and aggregating statistics related to surgical procedures, determining whether an interface area is outside of a surgical plane, predicting an expected future event in an ongoing surgical procedure and generating an option to review surgical footage associated with the expected future event. They systems and methods may further include generating a competency-related score for a medical professional, identifying a patient identity and establishing an association with a patient record using location and time data, and assigning teams to surgical procedures based on requirements associated with the surgical procedure.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Abstract

Systems and methods for analyzing surgical procedures and assessing surgical competency of subjects are disclosed. A method may include receiving a plurality of video frames associated with at least one surgical procedure and accessing stored data based on prior surgical procedures. The method may further include processing, using the stored data, the video frames to assess at least one of tissue handling, economy of motion, depth perception and surgical procedure flow in the video frames. Based on the assessment of at least one of tissue handling, economy of motion, depth perception and surgical procedure flow, a competency-related score for a subject may be generated. The method may further include selecting, from the video frames, at least one video clip from which the competency score was derived, outputting the score, and presenting in association with the at least one score, a link to the at least one video clip.

IPC Classes  ?

• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• G06T 7/90 - Determination of colour characteristics
• G06T 7/70 - Determining position or orientation of objects or cameras
• G06T 7/00 - Image analysis
• G06T 7/20 - Analysis of motion
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• G11B 27/11 - IndexingAddressingTiming or synchronisingMeasuring tape travel by using information not detectable on the record carrier
• G11B 27/34 - Indicating arrangements
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• G06N 20/00 - Machine learning
• G06V 20/40 - ScenesScene-specific elements in video content
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus

Abstract

Systems, methods, and computer readable media related to detection in video of surgical instrumental deviations from surgical planes are disclosed. The methods may include receiving video frames from a surgical video feed. The frames are analyzed to identify a surgical instrument. The frames are evaluated with the identified surgical instrument to ascertain an interface area corresponding to a location of an interaction between the identified surgical instrument and tissue. Stored data is accessed characterizing a surgical plane corresponding to the interaction, and the stored data is used to determine whether the interface area is outside of the surgical plane. An out-of-surgical plane signal is outputted indicating a deviation from the surgical plane by the surgical instrument.

IPC Classes  ?

• A61B 5/05 - Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fieldsMeasuring using microwaves or radio waves
• A61B 34/20 - Surgical navigation systemsDevices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06T 7/70 - Determining position or orientation of objects or cameras
• G06T 7/20 - Analysis of motion
• G06T 7/00 - Image analysis
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• G06T 7/90 - Determination of colour characteristics

Abstract

Systems, methods, and computer readable media related to statistical analysis across surgical videos are disclosed. The methods may include receiving video frames across multiple surgical videos, each surgical video comprising multiple surgical procedures performed by a specific medical professional across differing patients. A set of surgical event-related categories may be accessed and video frames of each surgical video may be analyzed to identify surgical events defined by a subgroup of frames. Each subgroup of frames may be assigned to one of the surgical event-related categories to thereby interrelate subgroups of frames from differing surgical procedures to a common surgical event-related category. Statistics may be derived for each surgical event-related category and then aggregated within each category and displayed with the surgical event-related categories for selection. Upon receiving a selection, at least part of the frames assigned to the particular surgical event-related category may be presented.

IPC Classes  ?

• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus

Abstract

Systems and methods for automatically populating a post-operative report of a surgical procedure are disclosed. A system may include at least one processor configured to implement a method including receiving an identifier of a patient, an identifier of a healthcare provider, and surgical footage of a surgical procedure performed on the patient. The method may include analyzing frames of the surgical footage to identify phases of the surgical procedure based on interactions between medical instruments and biological structures and, based on the interactions, associate a name with each phase. The method may include determining a beginning of each phase and associating a time marker with the beginning of each phase. The method may include populating a post-operative report with the patient identifier, the names of the phases, and time markers associated with the phases in a manner that enables the health care provider to alter the post-operative report.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06Q 40/08 - Insurance
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/37 - Leader-follower robots
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 34/30 - Surgical robots
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• A61B 17/00 - Surgical instruments, devices or methods
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G06F 16/71 - IndexingData structures thereforStorage structures
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances

Abstract

Systems and methods for generating decision support data for surgical videos are disclosed, the system may include at least on processor configured to implement a method. The method may include receiving video footage of a surgical procedure performed by a surgeon on a patient in an operating room and implementing a model on the received video footage to determine an existence of a surgical decision-making junction. The model may be trained to detect decision-making junctions using training data based on historical video footage depicting surgical situations. The method may include accessing, in a data structure, a correlation between an outcome and a specific action taken at the decision-making junction, and, based on the existence of the decision-making junction and the correlation, outputting a recommendation to at least one of a user device or a user interface related to the specific action.

IPC Classes  ?

• H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• G11B 27/00 - EditingIndexingAddressingTiming or synchronisingMonitoringMeasuring tape travel
• H04N 5/93 - Regeneration of the television signal or of selected parts thereof
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• A61B 34/30 - Surgical robots
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• B25J 9/16 - Programme controls
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G06N 20/00 - Machine learning
• G06T 7/00 - Image analysis
• G06V 20/40 - ScenesScene-specific elements in video content
• A62B 1/04 - Single parts, e.g. fastening devices
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges

Abstract

Systems and methods for analysis and review of surgical videos are disclosed. The systems and methods may include indexing characterized surgical intraoperative events, analyzing and cataloging surgical footage based on complexity, generating an intraoperative surgical event summary, overlaying a timeline on a surgical video, and/or generating a compilation of surgical event footage. The systems and methods may further include analysis of surgical videos for estimating surgical pressure, estimating a source and extent of fluid leakage, detecting an omitted surgical event, predicting a post discharge risk for a patient, updating a predicted out- come, providing real time recommendations to a surgeon, determining insurance reimbursement, adjusting an operating room schedule, and/or populating a postoperative report.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Systems and methods for estimating contact force on an anatomical structure during a surgical procedure are disclosed. A system may include at least one processor configured to receive, from at least one image sensor in an operating room, image data of a surgical procedure and analyze the received image data to determine an identity of an anatomical structure and to determine a condition of the anatomical structure as reflected in the image data. The processor may select a contact force threshold associated with the anatomical structure, the selected contact force threshold being based on the determined condition of the anatomical structure, receive an indication of actual contact force on the anatomical structure, and compare the indication of actual contact force with the selected contact force threshold. The processor may then output a notification based on a determination that the indication of actual contact force exceeds the selected contact force threshold.

IPC Classes  ?

• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/37 - Leader-follower robots
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G06Q 40/08 - Insurance
• A61B 34/30 - Surgical robots
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• A61B 17/00 - Surgical instruments, devices or methods
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G06F 16/71 - IndexingData structures thereforStorage structures
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances

Abstract

Systems and methods for predicting post-discharge risk are disclosed. A system may include at least one processor configured to access frames of video captured during a specific surgical procedure on a patient and access stored historical data identifying intraoperative events and associated outcomes. The processor may analyze the accessed frames and, based on information obtained from the historical data, identify in the accessed frames at least one specific intraoperative event. The processor may further determine, based on information obtained from the historical data and the identified at least one intraoperative event, a predicted outcome associated with the specific surgical procedure, and output the predicted outcome in a manner associating the predicted outcome with the patient.

IPC Classes  ?

• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/37 - Leader-follower robots
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G06Q 40/08 - Insurance
• A61B 34/30 - Surgical robots
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• A61B 17/00 - Surgical instruments, devices or methods
• G06F 16/71 - IndexingData structures thereforStorage structures
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands

Abstract

Systems and methods for analysis of fluid leakage are disclosed. A system may include at least one processor configured to receive in real time, intracavitary video of a surgical procedure; analyze frames of the intracavitary video to determine an abnormal fluid leakage situation in the intracavitary video; and institute a remedial action when the abnormal fluid leakage situation is determined.

IPC Classes  ?

• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• G06Q 10/0631 - Resource planning, allocation, distributing or scheduling for enterprises or organisations
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• A61B 1/00 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor
• G06Q 40/08 - Insurance
• A61B 34/37 - Leader-follower robots
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 34/30 - Surgical robots
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• A61B 17/00 - Surgical instruments, devices or methods
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G06F 16/71 - IndexingData structures thereforStorage structures
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances

Abstract

Systems and methods for analyzing complexity of surgical footage are disclosed. A system may include at least one processor configured to analyze frames of the surgical footage to identify an anatomical structure in a first set of frames. The processor may access first historical data based on an analysis of first frame data captured from a first group of surgical procedures and analyze the first set of frames to determine a first complexity level. The processor may analyze the surgical footage to identify in a second set of frames a medical tool, an anatomical structure, and an interaction between the medical tool and the anatomical structure. The processor may access second historical data based on an analysis of a second frame data captured from a second group of surgical procedures and analyze the second set of frames to determine a second complexity level associated with the second set of frames.

IPC Classes  ?

• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/37 - Leader-follower robots
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• G06Q 40/08 - Insurance
• A61B 34/30 - Surgical robots
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• A61B 17/00 - Surgical instruments, devices or methods
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G06F 16/71 - IndexingData structures thereforStorage structures
• G06F 16/735 - Filtering based on additional data, e.g. user or group profiles
• G11B 27/10 - IndexingAddressingTiming or synchronisingMeasuring tape travel
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances

Abstract

Systems and methods for analysis and review of surgical videos are disclosed. The systems and methods may include indexing characterized surgical intraoperative events, analyzing and cataloging surgical footage based on complexity, generating an intraoperative surgical event summary, overlaying a timeline on a surgical video, and/or generating a compilation of surgical event footage. The systems and methods may further include analysis of surgical videos for estimating surgical pressure, estimating a source and extent of fluid leakage, detecting an omitted surgical event, predicting a post discharge risk for a patient, updating a predicted outcome, providing real time recommendations to a surgeon, determining insurance reimbursement, adjusting an operating room schedule, and/or populating a postoperative report.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Systems and methods for automatically populating a post-operative report of a surgical procedure are disclosed. A system may include at least one processor configured to implement a method including receiving an identifier of a patient, an identifier of a healthcare provider, and surgical footage of a surgical procedure performed on the patient. The method may include analyzing frames of the surgical footage to identify phases of the surgical procedure based on interactions between medical instruments and biological structures and, based on the interactions, associate a name with each phase. The method may include determining a beginning of each phase and associating a time marker with the beginning of each phase. The method may include populating a post-operative report with the patient identifier, the names of the phases, and time markers associated with the phases in a manner that enables the health care provider to alter the post-operative report.

IPC Classes  ?

• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• F16H 15/00 - Gearings for conveying rotary motion with variable gear ratio, or for reversing rotary motion, by friction between rotary members
• G06T 7/00 - Image analysis
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof

Abstract

Systems and methods for providing decision making support for surgical procedures are disclosed. A system may include at least one processor configured to implement a method comprising receiving video footage of a surgical procedure performed by a surgeon on a patient in an operating room. The method may comprise accessing at least one data structure including image-related data characterizing surgical procedures. The method may include analyzing received video footage using image-related data to determine an existence of a surgical decision making junction. The method may include accessing, in at least one data structure, a correlation between an outcome and a specific action taken at a decision making junction. Based on a determined existence of a decision making junction and an accessed correlation, the method may include outputting a recommendation to a surgeon to undertake a specific action or to avoid a specific action.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• A61B 34/30 - Surgical robots
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 10/40 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• B25J 9/16 - Programme controls
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G06N 20/00 - Machine learning
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges

Abstract

Systems and methods for surgical preparation are disclosed. A system may include at least one processor configured to access a repository surgical video footage. The processor may enable a surgeon preparing for a contemplated surgical procedure to input case-specific information corresponding to the contemplated surgical procedure and compare the case-specific information with data associated with the surgical video footage to identify a group of intraoperative events likely to be encountered during the contemplated surgical procedure. The processor may determine that a first set and a second set of video footage from differing patients contain frames associated with intraoperative events sharing a common characteristic and omit the second set from a compilation to be presented to the surgeon and include the first set in the compilation to be presented to the surgeon to enable the surgeon to view a presentation including the compilation.

IPC Classes  ?

• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G16H 50/20 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• A61B 34/30 - Surgical robots
• G06F 16/71 - IndexingData structures thereforStorage structures
• A61B 90/00 - Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups , e.g. for luxation treatment or for protecting wound edges
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/37 - Leader-follower robots
• A61B 5/00 - Measuring for diagnostic purposes Identification of persons
• G06Q 40/08 - Insurance
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• A61B 17/00 - Surgical instruments, devices or methods
• G16H 50/30 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indicesICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for individual health risk assessment
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 40/20 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 15/00 - ICT specially adapted for medical reports, e.g. generation or transmission thereof
• A61B 5/02 - Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
• A61B 5/103 - Measuring devices for testing the shape, pattern, size or movement of the body or parts thereof, for diagnostic purposes
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06V 20/20 - ScenesScene-specific elements in augmented reality scenes
• G06V 20/40 - ScenesScene-specific elements in video content
• G06V 20/52 - Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• A61B 90/92 - Identification means for patients or instruments, e.g. tags coded with colour
• A61B 1/04 - Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopesIlluminating arrangements therefor combined with photographic or television appliances
• G06V 40/10 - Human or animal bodies, e.g. vehicle occupants or pedestriansBody parts, e.g. hands

Abstract

Systems and methods for generating surgical summary footage are disclosed. A system may include at least one processor configured to implement a method including accessing particular surgical footage containing a first group of frames associated with at least one intraoperative surgical event and a second group of frames not associated with surgical activity. The method may include accessing historical data based on historical surgical footage of prior surgical procedures, wherein the historical data includes information that distinguishes portions of surgical footage into frames associated with intraoperative surgical events and frames not associated with surgical activity. The method may include distinguishing in the particular surgical footage the first group from the second group based on the information and, upon request of a user, presenting to the user an aggregate of the first group of the particular surgical footage while omitting presentation to the user of the second group.

IPC Classes  ?

• H04N 7/18 - Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• A62B 1/04 - Single parts, e.g. fastening devices
• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G06N 20/00 - Machine learning
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G11B 27/00 - EditingIndexingAddressingTiming or synchronisingMonitoringMeasuring tape travel
• H04N 5/93 - Regeneration of the television signal or of selected parts thereof

Abstract

Systems and methods for reviewing surgical videos are disclosed. A system may include at least one processor configured to implement a method including accessing at least one video of a surgical procedure and causing the at least one video to be output for display. The method may include overlaying on the at least one video outputted for display a surgical timeline, wherein the surgical timeline includes markers identifying at least one of a surgical phase, an intraoperative surgical event, and a decision making junction. The method may enable a surgeon, while viewing playback of the at least one video to select one or more markers on the surgical timeline, and thereby cause a display of the video to skip to a location associated with the selected marker.

IPC Classes  ?

• A61B 34/00 - Computer-aided surgeryManipulators or robots specially adapted for use in surgery
• A61B 34/10 - Computer-aided planning, simulation or modelling of surgical operations
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G16H 40/40 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the management of medical equipment or devices, e.g. scheduling maintenance or upgrades
• G06F 3/048 - Interaction techniques based on graphical user interfaces [GUI]
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture

Abstract

Systems and methods for analysis and presentation of videos of surgical procedures are provided. For example, a video of a surgical procedure may be obtained, time points corresponding to key intraoperative events may be obtained, and properties of the key intraoperative events may be obtained. Further, the properties of the key intraoperative events may be presented to a user, and a selection of a selected intraoperative event may be received from the user. In response, part of the video associated with the time point corresponding to the selected intraoperative event may be presented.

IPC Classes  ?

• G16H 70/20 - ICT specially adapted for the handling or processing of medical references relating to practices or guidelines
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G06K 9/00 - Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
• G06T 7/00 - Image analysis
• G16H 10/60 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
• G06K 9/32 - Aligning or centering of the image pick-up or image-field
• G16H 30/20 - ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
• G16H 40/63 - ICT specially adapted for the management or administration of healthcare resources or facilitiesICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
• G16H 20/40 - ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• G16H 30/40 - ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
• G16H 50/70 - ICT specially adapted for medical diagnosis, medical simulation or medical data miningICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
• G06F 40/20 - Natural language analysis