Advanced API Topics

These are topics covering non-Openstack native API topics. The Jetstream team is working with ECSS and individual users that are trailblazing use cases of Jetstream's cloud functionality. While we maintain this page, we do not guarantee that the various tutorials or walkthroughs are up to date and functional.

• Deploy Kubernetes on Jetstream with Kubespray (Updated 2-1-2021)
  • Autoscaling script for JupyterHub on top of Kubespray
  • Gateways 2020 paper about Kubernetes and JupyterHub on Jetstream
• Deploy scalable Jupyterhub with Kubernetes on Jetstream
• Deploy Kubernetes and JupyterHub on Jetstream with OpenStack Magnum
  • Deploy Cluster Autoscaler for Kubernetes on Jetstream
• Bootstrapping Kubernetes on Jetstream
• Using Zarr on Jetstream
• How to set up a Slurm cluster on Jetstream with shared mounts
• Launch a shared dask cluster in Kubernetes alongside JupyterHub on Jetstream
• Setup private dask clusters in Kubernetes alongside JupyterHub on Jetstream
• Kubernetes monitoring with Prometheus and Grafana
• Deploy CVMFS on Kubernetes
• Elastic Slurm clusters on Jetstream (Direct GitHub link - https://github.com/XSEDE/CRI_Jetstream_Cluster)

Zero to JupyterHub - https://readthedocs.org/projects/zero-to-jupyterhub/

PEARC18 Tutorial on using Slurm for virtual clusters on Jetstream

First half deals with the OpenStack API and walks you through creating a headnode that you'll use in the second half for making a virtual cluster with Slurm:
https://github.com/jlf599/JetstreamAPITutorial/blob/master/PEARC18.md

Second half is the more complete Slurm portion and covers using cloud-aware compute nodes
https://github.com/ECoulter/Tutorial_Practice/tree/PEARC2018