Skip to content

NVIDIA/spark-rapids-tools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

9613aa1 · Sep 10, 2024
Sep 5, 2024
Sep 6, 2024
Jul 8, 2024
Sep 10, 2024
Sep 10, 2024
Apr 24, 2024
Jul 22, 2024
Jul 26, 2024
Sep 4, 2024
Dec 12, 2022
Aug 23, 2024
Jan 18, 2023
Aug 23, 2024
Nov 30, 2023
Nov 4, 2022

Repository files navigation

RAPIDS Accelerator for Apache Spark Tools

This repo provides the tools to use RAPIDS Accelerator for Apache Spark.

Catalog

  • RAPIDS core tools: Tools that help developers getting the most out of their Apache Spark applications without any code change:
    • Report acceleration potential of RAPIDS Accelerator for Apache Spark on a set of Spark applications.
    • Generate comprehensive profiling analysis for Apache Sparks executing on accelerated GPU instances. This information can be used to further tune and optimize the application.
  • spark-rapids-user-tools: A simple wrapper process around cloud service providers to run RAPIDS core tools across multiple cloud platforms. In addition, the output educates the users on the cost savings and acceleration potential of RAPIDS Accelerator for Apache Spark and makes recommendations to tune the application performance based on the cluster shape.