Techniques for processing a dataset comprising data stored in fields to identify field labels. The field labels describe data stored in the dataset fields. The techniques determine whether any field labels in a field label glossary match a field. If none of the field labels in the field label glossary match the field, the techniques generate a new field label using the name of the field. The generated field label may be assigned to the field.
Some embodiments relate to generating a list of data fields referenceable at a point in a graph (there are different lists for each point). This list may be used as part of programming a dataflow graph to select data (e.g., at an input node of a component to select data processed in that component). One aspect relates to display of the list of data fields, because some of the data field names may be overloaded. Accordingly, the data fields may be presented hierarchically if necessary, showing the source for each overloaded data field name. Otherwise, the user may select whether the list of referenceable fields is grouped by source.
A data processing system with a dataset multiplexer that enables applications to be written to specify access to datasets as operations on logical datasets. During execution of an application by the data processing system, the physical dataset used for performing data access operations may be selected based on current context. Current context may be specified based on values of system parameters and/or user specified values. The physical dataset accessed may be identified by selecting a record from multiple records in a dataset catalog associated with the logical dataset. Each record includes information to access a physical dataset associated with the selected record and context information to indicate the context in which the specific physical dataset is to be selected.
Techniques for determining processing layouts to nodes of a dataflow graph. The techniques include: obtaining information specifying a dataflow graph, the dataflow graph comprising a plurality of nodes and a plurality of edges connecting the plurality nodes, the plurality of edges representing flows of data among nodes in the plurality of nodes, the plurality of nodes comprising: a first set of one or more nodes; and a second set of one or more nodes disjoint from the first set of nodes; obtaining a first set of one or more processing layouts for the first set of nodes; and determining a processing layout for each node in the second set of nodes based on the first set of processing layouts and one or more layout determination rules, the one or more layout determination rules including at least one rule for selecting among processing layouts having different degrees of parallelism, and information indicating that data generated by at least one node in the first and/or third set of nodes is not used by any nodes in the dataflow graph downstream from the at least one node.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for data processing and management, namely, downloadable software that allows users to process and manage data by specifying, verifying, executing and testing rules for processing data in structured business records maintained in datasets; Downloadable computer software for management and configuration of digital data processing systems, namely, computer software for managing, tracking and reporting data in structured business records maintained in datasets
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for data processing and management, namely, downloadable software that allows users to process and manage data by specifying, verifying, executing and testing rules for processing data in structured business records maintained in datasets; Downloadable computer software for management and configuration of digital data processing systems, namely, computer software for managing, tracking and reporting data in structured business records maintained in datasets.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer software for data processing and data management. Consulting services in the field of computer software for enterprise-wide data processing and data management.
09 - Scientific and electric apparatus and instruments
41 - Education, entertainment, sporting and cultural services
42 - Scientific, technological and industrial services, research and design
Goods & Services
Scientific, nautical, surveying, photographic, cinematographic, optical, weighing, measuring, signalling, checking (supervision), life-saving and teaching apparatus and instruments; apparatus and instruments for conducting, switching, transforming, accumulating, regulating or controlling electricity; apparatus for recording, transmission or reproduction of sound or images; magnetic data carriers, recording discs; automatic vending machines and mechanisms for coin-operated apparatus; cash registers, calculating machines, data processing equipment and computers; fire-extinguishing apparatus; computer software for initiating, monitoring and controlling collections of computer processes and resources; computer software, namely, computer software for controlling and integrating enterprise-wide computer resources, applications, metadata, and data. Education; providing training; entertainment; sporting and cultural events. Scientific and technological services and research and design relating thereto; industrial analysis and research services; design and development of computer hardware and software; computer software design for others and support for others, namely, installation, maintenance and repair of computer software; computer consultation; consulting services in the field of computer software for enterprise-wide data processing and data management.
09 - Scientific and electric apparatus and instruments
35 - Advertising and business services
42 - Scientific, technological and industrial services, research and design
Goods & Services
(1) Computer software, namely, computer software for controlling and integrating enterprise-wide computer resources, applications, metadata, and data. (1) Consulting services in the field of computer software for enterprise-wide data processing and data management.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Downloadable computer software for the management, maintenance and administration of enterprise datastores used in or resulting from processing of data.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for graphically managing and monitoring informational data, namely, metadata, system data lineage, business definitions, logical models, and statistics that characterize source datasets or target datasets, and application results, performance, and characteristics within a computer system.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for graphically managing and monitoring informational data, namely, metadata, system data lineage, business definitions, logical models, and statistics that characterize source datasets or target datasets, and application results, performance, and characteristics within a computer system.
A service request is processed according to a computation graph associated with the service by receiving inputs for the computation graph from a service client, providing the inputs to the computation graph as records of a data flow, receiving output from the computation graph, and providing the output to the service client. Data flows are processed concurrently in a graph-based computation by potentially concurrent execution of different types of requests, potentially concurrent execution of similar request types, and/or potentially concurrent execution of work elements within a request.
G06F 15/173 - Interprocessor communication using an interconnection network, e.g. matrix, shuffle, pyramid, star or snowflake
G06F 15/16 - Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computerOutput arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 9/44 - Arrangements for executing specific programs
G06F 13/00 - Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
Executing graph-based computations includes: accepting a specification of a computation graph in which data processing elements are joined by linking elements; dividing the data processing elements into sets, at least one of the sets including multiple of the data processing elements; assigning to each set a different computing resource; and processing data according to the computation graph, including performing computations corresponding to the data processing elements using the assigned computing resources.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for the full range of enterprise computing, from operational systems to business intelligence, namely, for deployment of information technology needs in business environments
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for the full range of enterprise computing, from operational systems to business intelligence, namely for deployment of information technology needs in business environments.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for the full range of enterprise computing, from operational systems to business intelligence, namely for deployment of information technology needs in business environments.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer software for use in the rapid creation and
deployment of user-defined data processing applications for
the purpose of data extraction, reporting, and data
exploration.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer software for enabling communication of data between
computers running on different operating systems; computer
software for controlling and integrating enterprise-wide
computer resources, applications, metadata, and data;
computer software for building component-based parallel
and/or distributed applications; computer software for
integrating the functions of multiple computers; computer
software for interacting or co-operating with native
operating systems on multiple computers; computer software
for developing, combining, integrating, transforming,
executing, and managing processors, data, and applications.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer programs for the management and maintenance of a
data processing repository for metadata, application
programs, and application program execution results;
computer programs for communicating and processing data
among multiple computer systems and operating systems; data
processing computer programs for processing large volumes of
data.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer programs for the management and maintenance of a
data processing repository for metadata, application
programs, and application program execution results;
computer programs for communicating and processing data
among multiple computer systems and operating systems; data
processing computer programs for processing large volumes of
data.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer programs for analyzing characteristics of data,
namely, computer programs for analyzing the descriptive
information that reflects the content of data to discern
correlations between data fields and statistics.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer software, namely, general purpose programming
platform for processing large volumes of data. Computer consultation services; custom computer software
design and development services for others; providing
consultation on the use, integration and operation of
computer software programs; installation of computer
software programs; and maintenance and support of computer
software programs.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer programs for data warehousing, batch processing, clickstream processing, data management, data transformation, and analytics applications.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer programs comprising a general purpose data processing platform for enterprise class applications, namely, data warehouses, batch processing, clickstream processing, data management, a meta data repository, data extraction, data transformations, data loading, data processing scheduling, and analytics