Preface I used to use Hexo framework. But with the increasing number of articles, custom projects are more and more, coupled with the NPM plug-ins are in constant conflict, have not dared to arbitrarily install new plug-ins, the difficulty of maintenance has risen greatly. Former Hexo blog project file has been a “shit”. As the saying goes, “break and then stand up”, taking advantage of this period of time is...
Single GPU Optimization Resource: Hugging Face Doc Method/tool Improves training speed Optimizes memory utilization Batch size choice Yes Yes Gradient accumulation No Yes Gradient checkpointing No Yes Mixed precision training Yes (No) Optimizer choice Yes Yes Data preloading Yes No DeepSpeed Zero No Yes torch.compile Yes No Parameter-Efficient Fine Tuning (PEFT) No Yes FP16 If your model doesn’t work well with mixed precision, for example if it wasn’t pretrained in mixed precision, you may encounter overflow or underflow issues which can cause NaN loss....
Non-ROOT users configure a remote CUDA server for a deep learning environment, below is an example of Pytorch. CUDA driver Check the version of CUDA already installed on the server: 1 nvcc -V Showing version 11.4 here, but it doesn’t matter. Next to check the driver version, this relates to the latest CUDA version that we can install in the conda virtual environment. 1 2 3 4 nvidia-smi ### Output ### Driver Version: 535....
Preface Recently, I need to recompile an iOS jailbreak plugin named PassBy, and found that it reported errors frequently on my new device, so I recorded the exploration and solution process below. Since I’m not a professional, and I don’t even know much about iOS development, this is a record of my exploration with the attitude of learning. If there are any mistakes, welcome to criticize and correct in the comment section....
Preface My other post describes using Conda installing R kernel Notebook on a Linux remote server, but I’ve found that conda doesn’t handle various dependency conflicts very well, often resulting in installations that don’t I found that conda doesn’t handle dependency conflicts well, which often leads to unsuccessful installations. Later, I also used brew to install it on my macOS system, and found that it was easier and faster, so I summarized the steps....
Introduction What is Oh My Zsh Oh My Zsh is a community-driven command line tool, and as its homepage says, Oh My Zsh is a way of life. It is based on the zsh command line and offers theme configuration, plugin mechanism, and already built-in convenience operations. It gives us a whole new way to use the command line. Oh My Zsh is an extended toolset based on the zsh...