Building Flash Attention from Source

Notes from compiling Flash Attention on an A800 box. If you’re hitting endless build times or OOM “killed” errors, the key env vars and pitfalls here may save you time.

2025-07-26    610 words    3 min

VS Code for Remote Python Development

A quick guide to using VS Code with SSH for remote development, plus a plug for notebooks. Once you know the flow, spinning up a remote Python/Notebook workflow is incredibly convenient.

2025-01-14    2025-01-19    1267 words    6 min

Back Up and Migrate Conda Environments

I recently needed to move a Conda environment. Deep learning stacks are usually tightly coupled to driver versions and package versions, so being able to package a working environment and drop it onto another box saves a lot of time.

2024-06-29    516 words    3 min

Hugo Image Optimization: Fancybox, Webp and Watermarks

Recently switching my blog from Hexo to Hugo, I discovered Hugo's powerful customization capabilities, including image customization. After some fiddling around, I successfully converted the original images to Webp format, added fancybox gallery and blog watermark.

2024-04-08    1670 words    4 min

Notes While Reading Hugging Face Transformers Docs

Briefly record the conclusions and methods that appear in the official documentation of hugging face. By the way, record some personal thinking and confusion, so that it is convenient to go back and solve the problem later. Welcome to comment.

2024-03-11    2024-03-14    1100 words    6 min

Install CUDA and an NLP Stack with Conda (No Root)

How a non-root user can install a newer version of the transformers suite without being able to change the version of the installed cuda driver.

2024-03-10    684 words    4 min