Terality Docs
  • What is Terality?
  • Documentation
    • Quickstart
      • Setup
      • Tutorial
      • Next steps
    • User guide
      • Supported configurations
      • User dashboard
      • Importing and exporting data
        • Reading/writing to storage
        • Reading from multiple files
        • Writing to multiple files
        • Storage services
        • Data formats
        • From/to pandas
      • .apply() and passing callables
      • Caching
      • Best practices and anti-patterns
      • Upgrading your client version
      • Client configuration (CLI)
      • Support for external packages
      • Advanced topics
        • Data mutability and ownership: Terality vs pandas
    • API Reference
      • Conversion from/to pandas
      • Write to multiple files
    • Deploy Terality in your own AWS account
    • Releases
  • FAQ
    • Differences with
      • Terality and Pandas
      • Terality vs Spark
      • Terality vs Dask
    • Pricing
    • Security
    • Support & contact
    • Common setup issues
Powered by GitBook
On this page
  • Terality and Spark (Auto-managed)
  • Terality and Spark (managed via EMR, Dataproc, Databricks...)

Was this helpful?

  1. FAQ
  2. Differences with

Terality vs Spark

Terality makes Pandas as scalable as Apache Spark just by changing the import, and without thinking about servers or clusters. Terality handles all the infrastructure and scaling behind the scenes.

Terality and Spark (Auto-managed)

Spark

Terality

Dataset's size

Small to Large

Small to Large

Parallelization on multiple cores for lightning speed

Yes

Yes

Infrastructure

Custom

Serverless

Syntax

Scala or PySpark or SparkSQL

Pandas

Data scientist's autonomy

No

Yes

Support

None

Yes

Terality and Spark (managed via EMR, Dataproc, Databricks...)

EMR/Dataproc/Databricks

Terality

Dataset's size

Small to Large

Small to Large

Parallelization on multiple cores for lightning speed

Yes

Yes

Infrastructure

Semi-managed

Serverless

Syntax

Scala or PySpark or SparkSQL

Pandas

Data scientist's autonomy

No

Yes

Support

Yes

Yes

PreviousTerality and PandasNextTerality vs Dask

Last updated 3 years ago

Was this helpful?