To use compute engines such as MaxCompute or Hologres in DataWorks, first associate them with your DataWorks workspace as computing resources. This topic describes how to create and manage computing resources for subsequent data development and task scheduling.
Background information
DataWorks supports the association and use of various computing resources. After a resource is associated, you can directly use it in DataStudio to perform complex data processing and develop periodic scheduling tasks. In most cases, when a computing resource is associated with a workspace, a data source with the same name is automatically created. You can then use the Data Integration module to perform data synchronization operations based on this data source.
Differences between computing resources and data sources:
Computing resources are instances, such as MaxCompute projects (quota groups) and Hologres instances, used by compute engines to execute data processing and analysis tasks.
Data sources are used to connect to different data storage services. Before configuring data integration tasks, define the source and destination data sources so you can select them by name when setting up synchronization. A workspace supports multiple data source instances.
Supported computing resources
DataWorks supports associating the following computing resources for data development.
Category | Computing resource | References | DataStudio (new version) | DataStudio (old version) |
Offline computing |
|
| ||
|
| |||
Real-time query |
|
| ||
|
| |||
|
| |||
|
| |||
|
| |||
|
| |||
|
| |||
Real-time computing |
|
| ||
Multimodal search |
|
| ||
Cluster management |
|
| ||
|
|
When associating MaxCompute, AnalyticDB for MySQL, AnalyticDB for PostgreSQL, AnalyticDB for Spark, ClickHouse, Hologres, Lindorm, EMR Serverless StarRocks, or OpenSearch as computing resources, a data source with the same name will be automatically created in the current workspace.
Permission requirements
Only workspace members with the O&M or administrator role, or those with the AliyunDataWorksFullAccess or AdministratorAccess permission, can create computing resources. For details, see Manage permissions on workspace-level services and Grant permissions to a RAM user.
Some computing resources require additional permissions during creation. Follow the console prompts to complete authorization.
Associate computing resources
Depending on whether Participate in Public Preview of Data Studio is enabled, associate computing resources from the appropriate entry point.
For workspaces in DataStudio (new version)
1. Log on to the DataWorks console and switch to the target region.
2. In the left navigation pane, go to .
3. In the drop-down list, select the target workspace and click Go to Management Center.
4. Click Computing Resource in the left navigation pane to go to the list page. Follow the relevant documents to associate the required computing resource.
DataStudio (new version): Associate a MaxCompute computing resource
DataStudio (new version): Associate an AnalyticDB for MySQL (V3.0) computing resource
DataStudio (new version): Associate an AnalyticDB for PostgreSQL computing resource
DataStudio (new version): Associate a ClickHouse computing resource
DataStudio (new version): Associate a Hologres computing resource
DataStudio (new version): Associate a CDH computing resource
DataStudio (new version): Associate an EMR computing resource
For workspaces in DataStudio (old version)
1. Log on to the DataWorks console and switch to the target region.
2. In the left navigation pane, go to .
3. In the drop-down list, select the target workspace and enter DataStudio.
4. Click the 
icon in the left navigation menu to go to the computing resource page. Follow the relevant documents to associate the required computing resource.
To create a computing resource, click Create Computing Resource in the upper-right corner.
DataStudio (old version): Associate a MaxCompute computing resource
DataStudio (old version): Associate an AnalyticDB for MySQL (V3.0) computing resource
DataStudio (old version): Associate an AnalyticDB for PostgreSQL data source
DataStudio (old version): Associate a ClickHouse computing resource
DataStudio (old version): Associate a Hologres computing resource
To create a cluster, click Create Cluster in the upper-right corner.
Disassociate computing resources
Disassociating a computing resource may impact tasks in multiple modules, including Data Integration, Operation Center, Data Analysis, Data Service, and Data Quality. Make sure to read the console warnings carefully and migrate any tasks using the resource to other computing resources before disassociating it.
To disassociate a computing resource from DataWorks, go to the Computing Resource page, find the associated resource, and click Disassociate.
Appendix: Execution environments
In standard-mode workspaces, each computing resource instance contains two configurations: one for the development environment and one for the production environment. You can assign different databases or instances to each environment.
The system automatically maps to different computing resources based on the runtime environment to isolate development and testing from production scheduling. For example, when an offline synchronization task is executed, the development environment accesses the preconfigured development database, while the production environment accesses the production database.
In basic-mode workspaces, only one environment is available, and development and production are not separated. For details, see Differences between workspaces in basic mode and workspaces in standard mode.
If a basic-mode workspace is upgraded to standard mode, the original computing resource will be split into two: one for development and one for production. Workspaces created in DataStudio (new-version) cannot be upgraded. For details, see Scenario: Upgrade a workspace from the basic mode to the standard mode.
