Python scripts utilizing the PySpark API to convert a huge data set (about 3.5 GB) of flight data into various data storage formats such as CSV, JSON, Sequence file system
-
Updated
Jul 27, 2017 - Python
#
pyspark-api
Here are 8 public repositories matching this topic...
-
Updated
Oct 8, 2021 - Python
The PySpark Custom Data Source Template makes it easy to build and test custom data sources for Apache PySpark. It simplifies environment setup, debugging, and test data management while providing a structured, ready-to-use foundation.
-
Updated
Feb 21, 2025 - Python
This is a template API via PySpark!
-
Updated
Aug 17, 2023 - Python
Final submission. Topic: Apache Spark's Pyspark API
-
Updated
Oct 11, 2023 - Python
This is a template API via PySpark!
-
Updated
Oct 23, 2023 - Python
Designing and the implementation of different Spark applications to accomplish different jobs used to analyze a dataset on Covid-19 disease created by Our World In Data.
python spark yarn python3 pyspark python-3 pyspark-api pyspark-python covid-19 covid-virus covid covid19 covid19-data covid-19-data
-
Updated
Jun 26, 2023 - Python
This is technically a RESTful API, but using PySpark module instead of the restful module! In this case, this is a template using PySpark for website development!
-
Updated
Jan 9, 2024 - Python
Improve this page
Add a description, image, and links to the pyspark-api topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the pyspark-api topic, visit your repo's landing page and select "manage topics."