RUN:

Run with no logs: GGML_LOG_LEVEL=0 ./lex
Run with error logs: GGML_LOG_LEVEL=error ./lex

TEST

# slowcgi -d -v -s /var/www/run/slowcgi_debug.sock

CHROOT:

# Create the jail root
mkdir -p /var/empty/dict_jail/dev

# Copy or move your model file into the jail
cp Qwen2.5-7B-Instruct-Q4_K_M.gguf /var/empty/dict_jail/

# Create necessary device nodes inside the jail
mknod -m 666 /var/empty/dict_jail/dev/null c 2 2
mknod -m 666 /var/empty/dict_jail/dev/zero c 2 12

# Fix permissions so 'nobody' can read the model file
chown -R root:wheel /var/empty/dict_jail
chmod 755 /var/empty/dict_jail
chmod 644 /var/empty/dict_jail/Qwen2.5-7B-Instruct-Q4_K_M.gguf

SERVER

Set up chroot.

  1. Create symlink to slowcgi: $ ln -s /etc/rc.d/slowcgi /etc/rc.d/slowcgi_lex
  2.