Briefly record the conclusions and methods that appear in the official documentation of hugging face. By the way, record some personal thinking and confusion, so that it is convenient to go back and solve the problem later. Welcome to comment.
No root access on the remote server, but still want a newer PyTorch and transformers setup? These are my notes on using Conda to install CUDA and the tools I need without changing the system driver. I cover version choices, checking that PyTorch can use the GPU, pointing programs to the Conda CUDA installation, and watching out for xformers dependency changes.