Post
-
OOMwrap keeps DGX Spark agents from freezing
DGX Spark users Make your agents run your inference engines with OOMwrap Protect your machine from freezing up if they accidentally launch something that takes too much memory, like a model with wrong concurrency or context settings Couple this with rfjakob/earlyoom, and your DGX Spark will never freeze again The difference is that earlyoom is a global watcher, and oomwrap (by me) watches individual processes that are run through it oomwrap includes a memory-safe-launch skill, when installed, makes the agent use it by default for running inference engines I will make a video about this very soon! Repo:Image hidden