pricing
Analyze Spark logs for free. Detect regressions across many runs with Pro.
Open Source is for single-run local diagnostics. Pro is for teams that need regression detection, CI enforcement, historical comparisons, and repeatable Spark performance workflows. Every tier runs locally or self-hosted, so Spark event logs stay inside your environment.
Open Source
Free
Apache 2.0 licensed
Analyze individual Spark event logs locally.
The open-source CLI helps engineers diagnose one Spark event log at a time. It runs locally and produces evidence-backed reports without requiring a Spark History Server or uploading logs.
- ·Local Spark event-log analysis
- ·Skew, spill, shuffle, retry, and failure detection
- ·SQL execution extraction and physical plan output
- ·SQL DOT graph export
- ·JSON analysis report
- ·Markdown recommendations
- ·Apache 2.0 licensed
SparkDoctor Pro
$24,000 / year
Billed annually
Catch Spark performance regressions before they reach production.
SparkDoctor Pro turns single-run Spark diagnostics into a repeatable team workflow. Compare baseline and current runs, detect regressions in runtime, shuffle, spill, failures, and bottlenecks, and fail CI when Spark jobs cross configured thresholds.
Pro keeps the same local-first model: run it inside your environment, keep Spark event logs under your control, and avoid sending sensitive Spark metadata to a SaaS platform.
- ·Compare baseline vs current Spark runs
- ·Detect runtime, shuffle, spill, failure, and bottleneck regressions
- ·Fail CI when configured regression thresholds are crossed
- ·Track performance trends across many Spark job runs
- ·Store run history in a local or customer-controlled database
- ·Batch analyze directories of Spark event logs
- ·Configure team thresholds and regression policies
- ·Generate team-ready reports for pull requests, incidents, and reviews
- ·Support local/self-hosted deployment workflows
Enterprise
Contact us
Custom agreement
For platform teams running Spark at scale.
Enterprise is for organizations that need higher-volume event-log analysis, team-wide Spark performance visibility, custom deployment support, cloud storage ingestion, Databricks workflows, security review support, and priority engineering help.
- ·Everything in Pro
- ·Databricks job/run import workflows
- ·S3 or cloud storage event-log ingestion
- ·Organization-wide Spark performance trends
- ·Custom rule packs and thresholds
- ·Deployment support for private environments
- ·Security and compliance review support
- ·Priority support and feature requests
Feature comparison
| Feature | Open Source | Pro | Enterprise |
|---|---|---|---|
| Local Spark event-log analysis | ✓yes | ✓yes | ✓yes |
| Runs locally / self-hosted | ✓yes | ✓yes | ✓yes |
| Compressed event-log support (gzip, zstd, lz4, snappy) | ✓yes | ✓yes | ✓yes |
| Spark 4 event-log directory support | ✓yes | ✓yes | ✓yes |
| Skew, spill, shuffle, retry, failure detection | ✓yes | ✓yes | ✓yes |
| SQL execution extraction and physical plan output | ✓yes | ✓yes | ✓yes |
| SQL DOT graph export | ✓yes | ✓yes | ✓yes |
| JSON analysis report | ✓yes | ✓yes | ✓yes |
| Markdown recommendations | ✓yes | ✓yes | ✓yes |
| Single-run diagnostics | ✓yes | ✓yes | ✓yes |
| Baseline vs current run comparison | -no | ✓yes | ✓yes |
| Regression detection across Spark metrics | -no | ✓yes | ✓yes |
| CI failure gates on configured thresholds | -no | ✓yes | ✓yes |
| Historical trend analysis across many runs | -no | ✓yes | ✓yes |
| Local / customer-controlled run database | -no | ✓yes | ✓yes |
| Batch analysis over directories of event logs | -no | ✓yes | ✓yes |
| Team thresholds and regression policies | -no | ✓yes | ✓yes |
| Pull request and incident-ready reports | -no | ✓yes | ✓yes |
| Databricks job/run import workflows | -no | -no | ✓yes |
| S3 / cloud storage event-log ingestion | -no | -no | ✓yes |
| Organization-wide Spark performance trends | -no | -no | ✓yes |
| Custom rule packs and thresholds | -no | -no | ✓yes |
| Deployment support for private environments | -no | -no | ✓yes |
| Security and compliance review support | -no | -no | ✓yes |
| Support | ○community | ○included | ○priority |
| License | ○Apache 2.0 | ○commercial | ○commercial |
Open Source is for single-run local diagnostics. Pro adds the team layer: regression detection, CI gates, historical comparison, and local performance tracking. Enterprise extends Pro with cloud ingestion, Databricks workflows, organization-wide trends, and dedicated support.