# Miscellaneous

**Repository Path**: xiewangsun/Miscellaneous

## Basic Information

- **Project Name**: Miscellaneous
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2025-11-19
- **Last Updated**: 2025-11-19

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Miscellaneous Projects, Tools, and Scripts
[![DOI](https://zenodo.org/badge/41567115.svg)](https://doi.org/10.5281/zenodo.15313041)  
Contact: Luca.Canali@cern.ch

## Performance Engineering and Apache Spark

| Folder                                                           | Description
|------------------------------------------------------------------| -------------------------------------------------------------------------------------
| [**Spark Dashboard**](Spark_Dashboard)                           | A tool for Apache monitoring, use to build a performance dashboard and troubleshoot Spark jobs.
| [**Spark Notes**](Spark_Notes)                                   | Miscellaneous tips and code snippets about Apache Spark.
| [**Spark for Physics**](Spark_Physics)                           | Examples, with code and data of using Apache Spark for High Energy Physics data analysis.
| [**Performance Testing**](Performance_Testing)                   | Includes: <br>- TPCDS-PySpark, run TPCDS bemchmark at scale with PySpark and collect execution metrics<br>- Load testing tools for CPU benchmarking, in Python and Rust<br>- Notes on how to use various tools for performance investigations 


## Data Engineering and Data Science

| Folder                                                                | Description
|-----------------------------------------------------------------------| -------------------------------------------------------------------------------------
| [**Kepler Analysis**](Data_Analyses/Kepler)                           | A curated collection of interactive notebooks for executing Kepler's orbital analysis on Mars.                                       
| [**Deep Learning Notes**](DeepLearning_Notes)                         | Notes and examples on Deep Learning tools and related data pipelines.                                        
| [**Pyspark_SQL_Magic_Jupyter**](Pyspark_SQL_Magic_Jupyter)            | How to write Jupyter SQL magic functions for PySpark and Spark SQL.
| [**Trino and Presto on Jupyter**](Trino_Presto_Jupyter)               | Example of using Trino or Presto on a Jupyter notebook.
| [**PostgreSQL and YugabyteDB on Jupyter**](Trino_Presto_Jupyter)      | Example of using PostgreSQL or YugabyteDB on a Jupyter notebook.
| [**Oracle_Jupyter**](Oracle_Jupyter)                                  | Examples of how to query Oracle using Jupyter/IPython notebooks.
| [**Impala_SQL_Jupyter**](Impala_SQL_Jupyter)                          | Examples of how to run SQL on Apache Impala using Jupyter/IPython notebooks.
| [**SQL_color_Mandelbrot**](SQL_color_Mandelbrot)                      | How to use SQL to compute and display the Mandelbrot set with colors. Examples for Oracle and PostgreSQL.
| [**PLSQL_Neural_Network**](PLSQL_Neural_Network)                      | An example of neural network inference using Oracle RDBMS and PL/SQL.