Abstract

Systems and methods for improving the analysis of results from a user experience study are provided. In some embodiments, study results are converted into text if needed. The text is segmented, and qualifiers and entity pairs are identified within the text (semantic analysis). Sentiment for these pairs is also determined. This information is utilized to generate one or more of different analyses of the study results. This includes, for example, the automatic generation of video and/or text clips from the study results that are of greatest interest to the user. This is performed by scoring certain keywords in the segments, generating the clips based upon the scores, and then filtering using trained machine learning models. Another analysis includes the generation of a semantic matrix with sentiment color coding. Intensity of the color may be defined by the frequency the entity-qualifier pair occurs.

IPC Classes  ?

• G06Q 30/0203 - Market surveysMarket polls

Abstract

Systems and methods for attribute determination in a usability study are provided. The system includes the ability to collect screener questions and response pairs and determine the type of question. The question and response pairs may be processed for topic and entity extractions using machine learning (ML) models. From the collected topics and entities, a dictionary of attributes may be generated and eventually expanded/added to as new information regarding the participant becomes available. This attribute dictionary may take the form of a vector dictionary, in some particular embodiments. In some cases, the type of question being posed may dictate how the response is processed. These include a Boolean style question, a quantitative question, a single response question and a multi-response type question.

IPC Classes  ?

• G06Q 30/0283 - Price estimation or determination
• G06N 5/04 - Inference or reasoning models
• G06N 20/00 - Machine learning

Abstract

Systems and methods for selecting participants for a user experience study are provided. In some embodiments the systems and methods first receive at least three features for each participant profile. The participant profile is scored by quantile-based discretization. Next the participants are grouped into clusters using an unsupervised machine learning (ML) clustering algorithm(s) for each participant profile. The clusters are ranked using a number of models. These models are a function of geography and study type. The participant profile is assigned to a single cluster for each model. Participants are sampled from the clusters by their ranking.

IPC Classes  ?

• G06Q 30/0203 - Market surveysMarket polls
• H04L 67/30 - Profiles

Abstract

Systems and methods for selecting participants for a user experience study are provided. In some embodiments the systems and methods first receive at least three features for each participant profile. The participant profile is scored by quantile-based discretization. Next the participants are grouped into clusters using an unsupervised machine learning (ML) clustering algorithm(s) for each participant profile. The clusters are ranked using a number of models. These models are a function of geography and study type. The participant profile is assigned to a single cluster for each model. Participants are sampled from the clusters by their ranking.

IPC Classes  ?

• G06F 16/28 - Databases characterised by their database models, e.g. relational or object models
• G06F 16/35 - ClusteringClassification
• G06F 16/23 - Updating
• G06F 18/23 - Clustering techniques
• G06N 20/00 - Machine learning

Abstract

Systems and methods for transcription analysis of a recording are provided. The recording includes an audio and screenshot/video portion. The audio portion is transcribed using a machine learned model. Models may be selected by the recording quality and potentially accents or other speech patterns that are present. The transcription is then linked to the video/screen capture chronology, so that automatic scrolling is enabled, clip selection from the transcription, and searching to a video time is possible. There is improvements to user experience question generation, review of study results, and in managing the study participants.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06F 16/432 - Query formulation
• G06F 16/483 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
• G06N 3/08 - Learning methods
• G06Q 30/0203 - Market surveysMarket polls

Abstract

Systems and methods for AI assisted analysis of a user experience study are provided. A study objective (a goal of the study) and data relating to all possible navigation routes within a digital interface are received. Simulated clickstreams for navigating from any state of the digital interface to the study objective are generated. This simulated clickstream data is then used to train one or more machine learning models to determine a most efficient path to achieve the study objective from any state of the digital interface. Subsequently, study results from many different participants is received. Key events are then identified within the study results. Additionally, the likelihood of failure for each of the plurality of study results is predicted using the machine learning model, and information density of the plurality of study results is determined.

IPC Classes  ?

• H01Q 1/22 - SupportsMounting means by structural association with other equipment or articles
• H01Q 9/04 - Resonant antennas
• H01L 23/31 - Encapsulation, e.g. encapsulating layers, coatings characterised by the arrangement
• H01L 23/66 - High-frequency adaptations

Abstract

Systems and methods for generating and analyzing a user experience score (QXscore) are provided. A plurality of success metrics for tasks on a website are collected and averaged together to generate a single success percentage value. This percentage value may be converted into a five-point scale (the behavior metric). Users are presented a series of statements and a question which are averaged to yield a score for the trust, appearance, ease of user (usability), and loyalty attitudes. Subsequently, all four attitude measurements are averaged to generate the final attitude value. This average may be a straight average, or may be a weighted average. The final attitude value and the behavior metric are then combined (again either by straight or weighted averaging) to generate the raw QXscore. This can be converted back into a 100-point scale for assisting in the comparison of the given QXscore to other websites' QXscore values.

IPC Classes  ?

• G06F 3/048 - Interaction techniques based on graphical user interfaces [GUI]
• G06F 7/04 - Identity comparison, i.e. for like or unlike values
• G06F 16/95 - Retrieval from the web
• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06Q 10/10 - Office automationTime management
• G06Q 30/02 - MarketingPrice estimation or determinationFundraising
• G06Q 30/06 - Buying, selling or leasing transactions

Abstract

Systems and methods for generating and analyzing a user experience score (QXscore) are provided. A plurality of success metrics for tasks on a website are collected and averaged together to generate a single success percentage value. This percentage value may be converted into a five-point scale (the behavior metric). Users are presented a series of statements and a question which are averaged to yield a score for the trust, appearance, ease of user (usability), and loyalty attitudes. Subsequently, all four attitude measurements are averaged to generate the final attitude value. This average may be a straight average, or may be a weighted average. The final attitude value and the behavior metric are then combined (again either by straight or weighted averaging) to generate the raw QXscore. This can be converted back into a 100-point scale for assisting in the comparison of the given QXscore to other websites' QXscore values.

IPC Classes  ?

• G06Q 30/02 - MarketingPrice estimation or determinationFundraising

Abstract

Systems and methods for sourcing participants for a usability study are provided. In some embodiments the systems and methods receive study parameters including the type of study, time-to-field of the study, required number of participants, and required participant attributes. Additionally, a set of business rules for the study are received. These business rules may be received from a client, extrapolated from a service contract with a client for which the study is being performed, or generated based on the monitored outcomes of sourcing of previous studies. Next, panel sources for potential participants and pricing data are queried, and a set of the sources are selected based upon the pricing data. Participants are then received from these sources, which are then fielded in the study and monitored for outcomes.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06Q 30/0283 - Price estimation or determination
• G06N 5/04 - Inference or reasoning models
• G06N 20/00 - Machine learning

Goods & Services

Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software, and websites. Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (saas) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others and for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, conducting online marketing studies and surveys by market research panels and managing and collecting electronic data relating to panels of market research study participants.

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software, and websites. Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (saas) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others and for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, conducting online marketing studies and surveys by market research panels and managing and collecting electronic data relating to panels of market research study participants.

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software, and websites. Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (saas) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others and for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, conducting online marketing studies and surveys by market research panels and managing and collecting electronic data relating to panels of market research study participants.

Goods & Services

Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation pertaining to digital interfaces in the field of market and business research and analysis; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site featuring a directory of market research panels for consumers. Computer software design for others in the field of market and business research and analysis; computer software design in the field of market and business research and analysis; computer programming in the field of market and business research and analysis; maintenance of computer software in the field of market and business research and analysis; software as a service (SAAS) services featuring market and business research and analysis software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, for managing and collecting electronic data relating to panels of market research study participants, and for providing benchmark analysis, namely, providing comparative analysis of market participants and industries using market research and user experience data.

Abstract

Systems and methods for generating, administering and analyzing a user experience study are provided. In particular, intents can be generated from a user experience study by applying one or more screener questions to participants and subjecting the screened participants to one or more tasks. Corresponding clickstreams and success data for each participant engaging in the tasks can be recorded. The success and clickstream data can also be aggregated for all the screened participants as aggregated results. Video data including audio for each of the screened participants can also be recorded.

IPC Classes  ?

• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
• G06F 16/957 - Browsing optimisation, e.g. caching or content distillation
• G06F 16/783 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
• G06Q 30/0601 - Electronic shopping [e-shopping]
• G06Q 30/0203 - Market surveysMarket polls
• G06F 16/683 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
• G06F 11/36 - Prevention of errors by analysis, debugging or testing of software
• G06Q 30/0217 - Discounts or incentives, e.g. coupons or rebates involving input on products or services in exchange for incentives or rewards
• G06Q 30/0207 - Discounts or incentives, e.g. coupons or rebates

Abstract

Systems and methods for monitored usability testing are provided. A participant is identified, scheduled and their system is checked for suitability'. The participant is placed in a waiting room and asked to present their screen. A video thumbnail is displayed over the shared screen. The participant is presented with a unique link and added into the study session to complete a task. The task may include any of a navigation activity, a questionnaire, a click test, and a card sorting activity. A set of note takers and/or observers are present in the study, but their presence is not known to the participant. The only interaction the participant has is between the study prompts and questions, and with one or more moderators. The study moderator(s), observer(s) and not taker(s) are all able to communicate with one another over a private channel.

IPC Classes  ?

• G06Q 30/02 - MarketingPrice estimation or determinationFundraising
• G06F 11/00 - Error detectionError correctionMonitoring
• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
• G06F 11/36 - Prevention of errors by analysis, debugging or testing of software
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06Q 30/00 - Commerce

Abstract

Systems and methods for monitored usability testing are provided. A participant is identified, scheduled and their system is checked for suitability. The participant is placed in a waiting room and asked to present their screen. A video thumbnail is displayed over the shared screen. The participant is presented with a unique link and added into the study session to complete a task. The task may include any of a navigation activity, a questionnaire, a click test, and a card sorting activity. A set of note takers and/or observers are present in the study, but their presence is not known to the participant. The only interaction the participant has is between the study prompts and questions, and with one or more moderators. The study moderator(s), observer(s) and not taker(s) are all able to communicate with one another over a private channel.

IPC Classes  ?

• G09B 7/02 - Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by the student
• H04L 29/06 - Communication control; Communication processing characterised by a protocol
• H04L 12/18 - Arrangements for providing special services to substations for broadcast or conference
• G09B 5/02 - Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip

Abstract

A system for performing remote usability testing of a website includes a module for generating particular tasks, a module for moderating a session with a number of participants, and a module for receiving usability data. The system further includes an analytics module for analyzing the received usability data. The module for generating the particular tasks includes a research server configured to interface with user experience researchers and storing multiple testing modules for selecting qualified participants from the number of participants and for generating the particular tasks having research metrics associated with a target web site. In an embodiment, the research server randomly assigns one or more of the multiple testing modules to one of the participants. The multiple testing modules may include card sorting studies for optimizing a web site's architecture or layout.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06F 11/36 - Prevention of errors by analysis, debugging or testing of software

Abstract

Systems and methods for sourcing participants for a usability study are provided. In some embodiments the systems and methods receive study parameters including the type of study, time-to-fieid of the study, required number of participants, and required participant attributes. Additionally, a set of business rules for the study are received. These business rules may be received from a client, extrapolated from a service contract with a client for which the study is being performed, or generated based on the monitored outcomes of sourcing of previous studies. Next, panel sources for potential participants and pricing data are queried, and a set of the sources are selected based upon the pricing data. Participants are then recei ved from these sources, which are then fielded in the study and monitored for outcomes.

IPC Classes  ?

• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06Q 30/02 - MarketingPrice estimation or determinationFundraising
• G06Q 50/00 - Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
• G16H 10/00 - ICT specially adapted for the handling or processing of patient-related medical or healthcare data

Goods & Services

Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation pertaining to digital interfaces in the field of market and business research and analysis; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site with a directory of market research panels for consumers. Computer software design for others in the field of market and business research and analysis; computer software design in the field of market and business research and analysis; computer programming in the field of market and business research and analysis; maintenance of computer software in the field of market and business research and analysis; software as a service (SAAS) services featuring market and business research and analysis software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information; software as a service (SAAS) services for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface; software as a service (SAAS) services for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others; software as a service (SAAS) services for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others; software as a service (SAAS) services for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys; software as a service (SAAS) services for conducting online marketing studies and surveys by market research panels, for managing and collecting electronic data relating to panels of market research study participants; software as a service (SAAS) services for providing benchmark analysis, namely, providing comparative analysis of market participants and industries using market research and user experience data.

Abstract

Systems and methods for sourcing participants for a usability study are provided. In some embodiments the systems and methods receive study parameters including the type of study, time-to-field of the study, required number of participants, and required participant attributes. Additionally, a set of business rules for the study are received. These business rules may be received from a client, extrapolated from a service contract with a client for which the study is being performed, or generated based on the monitored outcomes of sourcing of previous studies. Next, panel sources for potential participants and pricing data are queried, and a set of the sources are selected based upon the pricing data. Participants are then received from these sources, which are then fielded in the study and monitored for outcomes.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06Q 30/02 - MarketingPrice estimation or determinationFundraising
• G06N 5/04 - Inference or reasoning models
• G06N 20/00 - Machine learning

Abstract

Systems and methods for AI assisted analysis of a user experience study are provided. A study objective (a goal of the study) and data relating to all possible navigation routes within a digital interface are received. Simulated clickstreams for navigating from any state of the digital interface to the study objective are generated. This simulated clickstream data is then used to train one or more machine learning models to determine a most efficient path to achieve the study objective from any state of the digital interface. Subsequently, study results from many different participants is received. Key events are then identified within the study results. Additionally, the likelihood of failure for each of the plurality of study results is predicted using the machine learning model, and information density of the plurality of study results is determined.

IPC Classes  ?

• G06F 9/455 - EmulationInterpretationSoftware simulation, e.g. virtualisation or emulation of application or operating system execution engines
• G06N 99/00 - Subject matter not provided for in other groups of this subclass
• G06Q 10/06 - Resources, workflows, human or project managementEnterprise or organisation planningEnterprise or organisation modelling
• G06Q 50/18 - Legal services
• H04L 12/24 - Arrangements for maintenance or administration

Abstract

Systems and methods for AI assisted analysis of a user experience study are provided. A study objective (a goal of the study) and data relating to all possible navigation routes within a digital interface are received. Simulated clickstreams for navigating from any state of the digital interface to the study objective are generated. This simulated clickstream data is then used to train one or more machine learning models to determine a most efficient path to achieve the study objective from any state of the digital interface. Subsequently, study results from many different participants is received. Key events are then identified within the study results. Additionally, the likelihood of failure for each of the plurality of study results is predicted using the machine learning model, and information density of the plurality of study results is determined.

IPC Classes  ?

• G06F 11/07 - Responding to the occurrence of a fault, e.g. fault tolerance
• G06F 16/2458 - Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
• G06N 20/00 - Machine learning

Goods & Services

Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation pertaining to digital interfaces in the field of market and business research and analysis; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site featuring a directory of market research panels for consumers Computer software design for others in the field of market and business research and analysis; computer software design in the field of market and business research and analysis; computer programming in the field of market and business research and analysis; maintenance of computer software in the field of market and business research and analysis; software as a service (SAAS) services featuring market and business research and analysis software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, for managing and collecting electronic data relating to panels of market research study participants, and for providing benchmark analysis, namely, providing comparative analysis of market participants and industries using market research and user experience data

Goods & Services

Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation pertaining to digital interfaces in the field of market and business research and analysis; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site featuring a directory of market research panels for consumers Computer software design for others in the field of market and business research and analysis; computer software design in the field of market and business research and analysis; computer programming in the field of market and business research and analysis; maintenance of computer software in the field of market and business research and analysis; software as a service (SAAS) services featuring market and business research and analysis software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, for managing and collecting electronic data relating to panels of market research study participants, and for providing benchmark analysis, namely, providing comparative analysis of market participants and industries using market research and user experience data

Abstract

A remote website participant activity tracker accesses, at a participant device, codes including a virtual tracking code, a task display code, a response collection code, and a card-sorting redirection code. The task display code includes a plurality of tasks associated with a target website displayed at the participant device. The plurality of tasks includes one or more card sorting study for optimizing an architecture and a layout of the target web site. The card sorting study can be randomized to save time and cost.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06F 11/36 - Prevention of errors by analysis, debugging or testing of software

Abstract

Systems and methods for transcription analysis of a recording are provided. The recording includes an audio and screenshot/video portion. The audio portion is transcribed using a machine learned model. Models may be selected by the recording quality and potentially accents or other speech patterns that are present. The transcription is then linked to the video/screen capture chronology, so that automatic scrolling is enabled, clip selection from the transcription, and searching to a video time is possible. There is improvements to user experience question generation, review of study results, and in managing the study participants.

IPC Classes  ?

• G06F 3/048 - Interaction techniques based on graphical user interfaces [GUI]

Abstract

Systems and methods for improving an algorithm using physically or logically partitioned datasets, m compliance with use restrictions, is provided. The datasets belong to various customers in local data modules. A policy database is queried for use restrictions (contractual or legal) on the partitioned datasets. The datasets are then cataloged, and a set of functionalities are generated and then deployed. This deployment may include running the functionality on a central system on partitions of the datasets adhering to the restrictions, or packaging the functionality into discrete bins for each of the datasets, and delivering the bins to local computational devices at each local data module. The output of the functionalities are then aggregated, typically with a weighted function, and then used to train a unified algorithm.

IPC Classes  ?

• G06N 20/00 - Machine learning
• G06F 16/00 - Information retrievalDatabase structures thereforFile system structures therefor

Abstract

Systems and methods for transcription analysis of a recording are provided. The recording includes an audio and screenshot/video portion. The audio portion is transcribed using a machine learned model. Models may be selected by the recording quality and potentially accents or other speech patterns that are present. The transcription is then linked to the video/screen capture chronology, so that automatic scrolling is enabled, clip selection from the transcription, and searching to a video time is possible. There is improvements to user experience question generation, review of study results, and in managing the study participants.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06F 16/432 - Query formulation
• G06N 3/08 - Learning methods
• G06F 16/483 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
• G06Q 30/02 - MarketingPrice estimation or determinationFundraising

Abstract

Systems and methods for generating, administering and analyzing a click test study are provided. This includes uploading a static image and selecting portions of the static image as answers. The study author also generates a prompt for a participant, which is then presented, along with the static image. The participant then clicks with a cursor, or other selection mechanism, and the selection location(s) are recorded. Delay between the prompt display and the click is measuring in some embodiments. The recorded clicks are used to generate a heat map when aggregated with the results of other users. Likewise, the at least one click location may be compared to the selected portions to generate success metrics. In addition to the regular heat map, a high-contrast negative image heat map may likewise be generated.

IPC Classes  ?

• G06Q 30/02 - MarketingPrice estimation or determinationFundraising
• G06F 3/0482 - Interaction with lists of selectable items, e.g. menus
• G06F 16/50 - Information retrievalDatabase structures thereforFile system structures therefor of still image data
• G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour

Abstract

Systems and methods for generating, administering and analyzing a user experience study are provided. They include the selection of participants as either ones supplied by the user, or ones the system provides. The participants the system provides includes screening a large pool of participants by a set of basic metrics (age, gender and income) or by advanced query questions have branched answers. These screener questions may be nested to allow for various participant groups to be generated. After the participants are screened, they may be invited to join the study. The study itself may be a card sorting exercise, survey, tree study, click test, basic navigation, or advanced recorded study. Results from the study may be filtered across various participant dimensions and validation criteria. Video recording analysis includes transcriptions to allow for searches and automatic clip generation.

IPC Classes  ?

• G06Q 30/00 - Commerce

Abstract

Systems and methods for generating, administering and analyzing a user experience study are provided. In particular, intents can be generated from a user experience study by applying one or more screener questions to participants and subjecting the screened participants to one or more tasks. Corresponding clickstreams and success data for each participant engaging in the tasks can be recorded. The success and clickstream data can also be aggregated for all the screened participants as aggregated results. Video data including audio for each of the screened participants can also be recorded.

IPC Classes  ?

• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
• G06F 16/957 - Browsing optimisation, e.g. caching or content distillation
• G06F 16/783 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
• G06Q 30/06 - Buying, selling or leasing transactions
• G06Q 30/02 - MarketingPrice estimation or determinationFundraising
• G06F 16/683 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
• G06F 11/36 - Prevention of errors by analysis, debugging or testing of software

Abstract

Advanced user experience study can be accomplished by enabling recording on a device such as a smart phone, providing a participant with one or more survey questions and a task. Typically, the participants are recorded and redirected to a starting URL. The recording can be terminated when the participant reaches a validation condition. Results, for example, videos, survey results, click flows, and heat maps may be filterable across any participant feature or any study validation criteria. Validation criteria includes time taken to complete a given action, ending up at a particular URL (or class of URLs), based upon question answers, or any combination thereof. These criteria can be classified as either a successful completion of the study, or a failed attempt. Additionally, the validation criteria can also include a decision by the participant to abandon the study.

IPC Classes  ?

• G06F 16/955 - Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
• G06F 11/34 - Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation
• G06F 16/954 - Navigation, e.g. using categorised browsing
• G06F 16/957 - Browsing optimisation, e.g. caching or content distillation
• G06Q 30/0203 - Market surveysMarket polls
• G06Q 30/0601 - Electronic shopping [e-shopping]

Goods & Services

Downloadable software and downloadable mobile applications used in the field of market and business research and analysis for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, and for managing and collecting electronic data relating to panels of market research study participants Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation pertaining to digital interfaces in the field of market and business research and analysis; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site featuring a directory of market research panels for consumers Computer software design for others in the field of market and business research and analysis; computer software design in the field of market and business research and analysis; computer programming in the field of market and business research and analysis; maintenance of computer software in the field of market and business research and analysis; software as a service (SAAS) services featuring market and business research and analysis software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, and for managing and collecting electronic data relating to panels of market research study participants

Goods & Services

Computer software, downloadable software, and downloadable mobile applications for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; software for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites; software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites; software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels; software for transmitting and sharing recruitment information to market research panel participants, organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, conducting online marketing studies and surveys by market research panels, and managing and collecting electronic data relating to panels of market research study participants. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site featuring a directory of market research panels for consumers. Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (SAAS) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research; Software as a service (SAAS) services featuring software for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information; Software as a service (SAAS) services featuring software for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others; Software as a service (SAAS) services featuring software for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, conducting online marketing studies and surveys by market research panels, and managing and collecting electronic data relating to panels of market research study participants.

Goods & Services

Computer software, downloadable software, and downloadable mobile applications for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; software for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites; software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites; software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels; software for transmitting and sharing recruitment information to market research panel participants, organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, conducting online marketing studies and surveys by market research panels, and managing and collecting electronic data relating to panels of market research study participants. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; market analysis and research services; market research services in the nature of conducting, maintaining, coordinating, and providing market research panels for others; market research services in the nature of organizing, conducting, and providing market research studies and surveys by market research panels; market research services in the nature of recruiting and sourcing market research panel participants and users; providing a web site featuring a directory of market research panels for consumers. Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (SAAS) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research; Software as a service (SAAS) services featuring software for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information; Software as a service (SAAS) services featuring software for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others; Software as a service (SAAS) services featuring software for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, conducting online marketing studies and surveys by market research panels, and managing and collecting electronic data relating to panels of market research study participants.

Goods & Services

Downloadable computer software and downloadable mobile applications used in the field of market and business research and analysis for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of market and business research and analysis data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of market and business research and analysis data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, and for managing and collecting electronic data relating to panels of market research study participants Computer software design for others in the field of market and business research and analysis; computer software design in the field of market and business research and analysis; computer programming in the field of market and business research and analysis; maintenance of computer software in the field of market and business research and analysis; software as a service (SAAS) services featuring market and business research and analysis software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of market and business research and analysis data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others, for organizing and managing electronic data and information relating to market research panels, for transmitting and sharing recruitment information to market research panel participants, for organizing, collecting, allocating, and providing market research panel participants for online market research studies and surveys, for conducting online marketing studies and surveys by market research panels, and for managing and collecting electronic data relating to panels of market research study participants

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analyzing and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface; computer software that provides web-based access to applications and services through a web portal interface. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software and websites. Data transmission and reception services via telecommunication means; communication by electronic computer terminals; communications by computer terminals; communication services, namely, electronic transmission of data and documents among users of computers; transmission of information by electronic communications networks; providing multiple-user access to a global computer information network. Computer software design for others; computer software design, computer programming, or maintenance of computer software; software as a service (saas) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analyzing, and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online studies and surveys, for conducting market research, for tracking and testing user experience with the websites, software applications, personal computers, tablets, phones, televisions, electronic screens, and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio, and electronic screenshots, for providing consumer solutions, and for panel management.

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analyzing and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface; computer software that provides web-based access to applications and services through a web portal interface. Conducting marketing studies; Advisory services relating to business management and business operations; Business advisory services, consultancy and information; Business management and consultation in the field of digital interfaces; Professional business consultation; Advertising services. Data transmission and reception services via telecommunication means; Communication by electronic computer terminals; Communications by computer terminals; Communication services, namely, electronic transmission of data and documents among users of computers; Transmission of information by electronic communications networks; Providing multiple-user access to a global computer information network. Computer software design for others; Computer software design, computer programming, or maintenance of computer software; Software as a service [SAAS] services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analyzing and sharing of data and information; for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online studies and surveys, for conducting market research; for tracking and testing user experience with the websites, software applications, personal computers, tablets, phones, televisions, electronic screens, and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio, and electronic screenshots, for providing consumer solutions and for panel management.

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analyzing and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface; computer software that provides web-based access to applications and services through a web portal interface. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services. Data transmission and reception services via telecommunication means; communication by electronic computer terminals; communications by computer terminals; communication services, namely, electronic transmission of data and documents among users of computers; transmission of information by electronic communications networks; providing multiple-user access to a global computer information network. Computer software design for others; computer software design, computer programming, or maintenance of computer software; software as a service (saas) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analyzing, and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online studies and surveys, for conducting market research, for tracking and testing user experience with the websites, software applications, personal computers, tablets, phones, televisions, electronic screens, and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio, and electronic screenshots, for providing consumer solutions, and for panel management.

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analyzing and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface; computer software that provides web-based access to applications and services through a web portal interface. Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software, and websites. Data transmission and reception services via telecommunication means; communication by electronic computer terminals; communications by computer terminals; communication services, namely, electronic transmission of data and documents among users of computers; transmission of information by electronic communications networks; providing multiple-user access to a global computer information network. Computer software design for others; computer software design, computer programming, or maintenance of computer software; software as a service (saas) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analyzing, and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online studies and surveys, for conducting market research, for tracking and testing user experience with the websites, software applications, personal computers, tablets, phones, televisions, electronic screens, and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio, and electronic screenshots, for providing consumer solutions, and for panel management.

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software, and websites Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (SAAS) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others and for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, conducting online marketing studies and surveys by market research panels and managing and collecting electronic data relating to panels of market research study participants

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services; all relating to the monitoring and analysis of user experiences of digital applications, digital interfaces, software, and websites Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (SAAS) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others and for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, conducting online marketing studies and surveys by market research panels and managing and collecting electronic data relating to panels of market research study participants

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analysis and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface Conducting marketing studies; advisory services relating to business management and business operations; business advisory services, consultancy and information; business management and consultation in the field of digital interfaces; professional business consultation; advertising services Computer software design for others; computer software design; computer programming; maintenance of computer software; software as a service (SAAS) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analysis and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online marketing studies and surveys, for conducting market research, for tracking and testing user experiences with the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio and electronic screenshots of data and information, for transmitting and sharing market research data and information relating to user experiences involving the websites, software applications, personal computers, tablet computers, phones, televisions, electronic screens, consumer electronic devices and digital interfaces of others and for organizing and managing electronic data and information relating to market research panels, transmitting and sharing recruitment information to market research panel participants, conducting online marketing studies and surveys by market research panels and managing and collecting electronic data relating to panels of market research study participants

Goods & Services

Market analysis and research services; Market research services in the nature of conducting, maintaining, and providing market research panels for others; Providing a web site featuring a directory of market research panels for consumers

Goods & Services

Software as a service (SAAS) services featuring software for the collection, editing, organizing, modifying, bookmarking, transmission, storage, analyzing, and sharing of data and information, for providing real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface, for conducting online studies and surveys, for conducting market research, for tracking and testing user experience with the websites, software applications, personal computers, tablets, phones, televisions, electronic screens, and consumer electronic devices of others, for integrating data with third party vendors, for collection and recording of video, audio, and electronic screenshots, for providing consumer solutions, and for panel management

Abstract

A system for performing remote usability testing of a website includes a module for generating particular tasks, a module for moderating a session with a number of participants, and a module for receiving usability data. The system further includes a analytics module for analyzing the received usability data. The module for generating the particular tasks includes a research server configured to interface with user experience researchers and storing multiple testing modules for selecting qualified participants from the number of participants and for generating the particular tasks having research metrics associated with a target web site. In an embodiment, the research server randomly assigns one or more of the multiple testing modules to one of the participants. The multiple testing modules may include card sorting studies for optimizing a web site's architecture or layout.

IPC Classes  ?

• G06Q 10/00 - AdministrationManagement
• G06F 11/36 - Prevention of errors by analysis, debugging or testing of software

Goods & Services

Computer software for the collection, editing, organizing, modifying, book marking, transmission, storage, analyzing and sharing of data and information; computer software that provides real-time, integrated business management intelligence by combining information from various databases and presenting it in an easy-to-understand user interface; computer software that provides web-based access to applications and services through a web portal interface

Goods & Services

Conducting marketing studies; Advisory services relating to business management and business operations; Business advisory services, consultancy and information; Business management and consultation in the field of digital interfaces; Professional business consultation; Advertising services Data transmission and reception services via telecommunication means; Communication by electronic computer terminals; Communications by computer terminals; Communication services, namely, electronic transmission of data and documents among users of computers; Transmission of information by electronic communications networks; Providing multiple-user access to a global computer information network Computer software design for others; Computer software design, computer programming, or maintenance of computer software

Goods & Services

Conducting marketing studies; Advisory services relating to business management and business operations; Business advisory services, consultancy and information; Business management and consultation in the field of digital interfaces; Professional business consultation; Advertising services

Goods & Services

Marketing studies; commercial or industrial management assistance; business management advisory services; management consultancy; Business management consultation; professional business consultancy; advertising services. Telecommunications services; services relating to communications by computer terminals; computer-aided receipt and transmission of messages and images and electronic mail; communications via global computer networks. Computer programming and software design.