Techniques for executing a data processing application in an environment in which there can be a plurality of data sources including continuous data sources and batch data sources. A data processing application may be representable as a plurality of input nodes and a plurality of processing nodes. The techniques include: for a node of the plurality of processing nodes having a first input configured at the time of execution of the application to receive batch data and a second input configured to receive continuous data: computing first data by executing data processing operations of the data processing application between the first input of the node and one or more data sources of the plurality of data sources on data from the one or more data sources; and storing the first data; and configuring the data processing system to, when executing the data processing application, use the stored first data as the first input to the node.
A method for managing credentials in a heterogeneous cloud computing system, includes receiving, at a local computing system, a request to access a cloud resource on behalf of an end user, the request including a unique identifier associated with the end user and a resource identifier associated with the cloud resource, identifying, using the resource identifier, a predefined procedure for obtaining credentials for accessing the cloud resource, performing the predefined procedure to obtain the credentials for accessing the cloud resource, and accessing the cloud resource on behalf of the end user using the credentials.
Techniques for processing a dataset comprising data stored in fields to identify field labels. The field labels describe data stored in the dataset fields. The techniques determine whether any field labels in a field label glossary match a field. If none of the field labels in the field label glossary match the field, the techniques generate a new field label using the name of the field. The generated field label may be assigned to the field.
Some embodiments relate to generating a list of data fields referenceable at a point in a graph (there are different lists for each point). This list may be used as part of programming a dataflow graph to select data (e.g., at an input node of a component to select data processed in that component). One aspect relates to display of the list of data fields, because some of the data field names may be overloaded. Accordingly, the data fields may be presented hierarchically if necessary, showing the source for each overloaded data field name. Otherwise, the user may select whether the list of referenceable fields is grouped by source.
A data processing system with a dataset multiplexer that enables applications to be written to specify access to datasets as operations on logical datasets. During execution of an application by the data processing system, the physical dataset used for performing data access operations may be selected based on current context. Current context may be specified based on values of system parameters and/or user specified values. The physical dataset accessed may be identified by selecting a record from multiple records in a dataset catalog associated with the logical dataset. Each record includes information to access a physical dataset associated with the selected record and context information to indicate the context in which the specific physical dataset is to be selected.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for data processing and management, namely, downloadable software that allows users to process and manage data by specifying, verifying, executing and testing rules for processing data in structured business records maintained in datasets; Downloadable computer software for management and configuration of digital data processing systems, namely, computer software for managing, tracking and reporting data in structured business records maintained in datasets
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for data processing and management, namely, downloadable software that allows users to process and manage data by specifying, verifying, executing and testing rules for processing data in structured business records maintained in datasets; Downloadable computer software for management and configuration of digital data processing systems, namely, computer software for managing, tracking and reporting data in structured business records maintained in datasets.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Computer software for data processing and data management. Consulting services in the field of computer software for enterprise-wide data processing and data management.
09 - Scientific and electric apparatus and instruments
41 - Education, entertainment, sporting and cultural services
42 - Scientific, technological and industrial services, research and design
Goods & Services
Scientific, nautical, surveying, photographic, cinematographic, optical, weighing, measuring, signalling, checking (supervision), life-saving and teaching apparatus and instruments; apparatus and instruments for conducting, switching, transforming, accumulating, regulating or controlling electricity; apparatus for recording, transmission or reproduction of sound or images; magnetic data carriers, recording discs; automatic vending machines and mechanisms for coin-operated apparatus; cash registers, calculating machines, data processing equipment and computers; fire-extinguishing apparatus; computer software for initiating, monitoring and controlling collections of computer processes and resources; computer software, namely, computer software for controlling and integrating enterprise-wide computer resources, applications, metadata, and data. Education; providing training; entertainment; sporting and cultural events. Scientific and technological services and research and design relating thereto; industrial analysis and research services; design and development of computer hardware and software; computer software design for others and support for others, namely, installation, maintenance and repair of computer software; computer consultation; consulting services in the field of computer software for enterprise-wide data processing and data management.
09 - Scientific and electric apparatus and instruments
35 - Advertising and business services
42 - Scientific, technological and industrial services, research and design
Goods & Services
(1) Computer software, namely, computer software for controlling and integrating enterprise-wide computer resources, applications, metadata, and data. (1) Consulting services in the field of computer software for enterprise-wide data processing and data management.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Downloadable computer software for the management, maintenance and administration of enterprise datastores used in or resulting from processing of data.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for graphically managing and monitoring informational data, namely, metadata, system data lineage, business definitions, logical models, and statistics that characterize source datasets or target datasets, and application results, performance, and characteristics within a computer system.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for graphically managing and monitoring informational data, namely, metadata, system data lineage, business definitions, logical models, and statistics that characterize source datasets or target datasets, and application results, performance, and characteristics within a computer system.
A service request is processed according to a computation graph associated with the service by receiving inputs for the computation graph from a service client, providing the inputs to the computation graph as records of a data flow, receiving output from the computation graph, and providing the output to the service client. Data flows are processed concurrently in a graph-based computation by potentially concurrent execution of different types of requests, potentially concurrent execution of similar request types, and/or potentially concurrent execution of work elements within a request.
G06F 15/173 - Interprocessor communication using an interconnection network, e.g. matrix, shuffle, pyramid, star or snowflake
G06F 15/16 - Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
G06F 3/00 - Input arrangements for transferring data to be processed into a form capable of being handled by the computerOutput arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
G06F 9/44 - Arrangements for executing specific programs
G06F 13/00 - Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for the full range of enterprise computing, from operational systems to business intelligence, namely, for deployment of information technology needs in business environments
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for the full range of enterprise computing, from operational systems to business intelligence, namely for deployment of information technology needs in business environments.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer software for the full range of enterprise computing, from operational systems to business intelligence, namely for deployment of information technology needs in business environments.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer software for enabling communication of data between
computers running on different operating systems; computer
software for controlling and integrating enterprise-wide
computer resources, applications, metadata, and data;
computer software for building component-based parallel
and/or distributed applications; computer software for
integrating the functions of multiple computers; computer
software for interacting or co-operating with native
operating systems on multiple computers; computer software
for developing, combining, integrating, transforming,
executing, and managing processors, data, and applications.
09 - Scientific and electric apparatus and instruments
Goods & Services
(1) Computer programs for data warehousing, batch processing, clickstream processing, data management, data transformation, and analytics applications.
