Apache Spark stack services
This page shows the capabilities provided by the services in the Apache Spark stack and the connections, configs, settings, cron schedules, actions, volumes, backups, imports, and other customizations attached to them for this specific stack.
| Stack service | Base service | Versions | Role |
|---|---|---|---|
| Apache Spark master | 4.1 | Primary | |
| Apache Spark worker | 4.1 | Required |
- Additional services can be added or removed.
- When one of the services in the stack updates, the stack can be upgraded to a new revision.
- Stack changes can then be rolled out to environments on your schedule.
Settings
Tune service behavior per environment while keeping one reusable stack baseline.
Spark worker
Worker CPU cores
Default value: 2.
Spark worker
Worker memory
Default value: 2g.
Service links
See how services are wired together so dependencies stay consistent across environments.
Spark worker
Apache Spark master
Linked to Spark master. Required.