This is an [Apptainer](https://apptainer.org/) definition file that creates an Ubuntu 22.04 system with NVIDIA CUDA 12.2 support. It's intended to be used on the [Digital Research Alliance of Canada](https://alliancecan.ca/en)'s compute stack (I test on Cedar, but it should probably work on any of DR's machines).

To build:

[Install](https://apptainer.org/docs/admin/main/installation.html) Apptainer into your OS.

Build with `apptainer build ubuntu-nvidia-12.2.sif ubuntu-nvidia-12.2.def` 

If you require pytorch and axolotl for finetuning LLMs, build with `apptainer build ubuntu-pytorch-axolotl-nvidia-12.2.sif ubuntu-pytorch-axolotl-nvidia-12.2.def`
 
Note that Digital Research's CUDA level may change, in which case I'll have to rebuild this with the appropriate CUDA. To check the CUDA level on any machine that has CUDA support, run the command `nvidia-smi -q`. 

Don't try to build this *on* DRAC's infrastructure -- the [network filesystems](https://apptainer.org/docs/admin/main/installation.html#fakeroot-with-uid-gid-mapping-on-network-filesystems) do not support sandbox Apptainer files which are necessary for the build process. The SIF file created by the build process will work just fine on DRAC, just not sandbox or builds themselves.