Spark worker in the Apache Spark stack

This page explains what Spark worker means in the Apache Spark stack: how it is included, which base service it uses, and how it connects to the rest of the stack.

Spark worker is included by default and treated as a required part of the Apache Spark stack.

Role

Required

Base service

Apache Spark worker

Type

service

Delivery

Prebuilt service image

Stack fit

How Spark worker fits into this stack

Spark worker is included by default and treated as a required part of the Apache Spark stack.

This stack service is based on Apache Spark worker and keeps the service-specific setup for Apache Spark in one place.

It is linked to Spark master inside the stack.

Version policy

Available versions include 4.1.

Inclusion

Enabled by default: Yes

Required: Yes

Primary: No

Storage

This stack service does not define persistent volume sizes.

Stack-specific technical details

Review the operational capabilities exposed by Spark worker inside this stack, including backups, imports, configs, settings, cron, actions, storage, and service links where they exist.

Settings

Tune service behavior per environment while keeping one reusable stack baseline.

Worker CPU cores
Default value: 2.
Worker memory
Default value: 2g.