WordPress permalinks index.php in new ISPConfig server

Just installed a new server:
- Ubuntu 24.04 (LTS) x64
- ISPConfig 3.3
- WordPress 6.8

In the new server, wordpress hard coded index.php in Permalink. I found that wordpress cannot even create .htaccess in it. I can manually create .htaccess file and rewrite works. However, the Permalink is still there and URL still have index.php in it. Not sure is it because some security settings. Another old ISPconfig server has no problem.

apt-get install libapache2-mod-security2 -y
apt install libapache2-mod-evasive -y
sudo a2enmod heade

 

Yes, I am sure that it has the correct permission. I even tried to set the web folder in 777.

total 228
drwxrwxrwx 7 web5 client3 4096 Jun 5 07:47 ./
drwxr-xr-x 12 root root 4096 May 30 10:22 ../
-rw-r--r-- 1 web5 client3 564 Jun 4 11:05 .htaccess
drwxr-xr-x 2 web5 client3 4096 Jun 3 23:47 error/
-rw-r--r-- 1 web5 client3 405 Jun 4 10:35 index.php
drwxr-xr-x 2 web5 client3 4096 Jun 4 08:06 stats/
-rw-r--r-- 1 web5 client3 7387 Jun 4 10:35 wp-activate.php
drwxr-xr-x 9 web5 client3 4096 Jun 4 10:35 wp-admin/
-rw-r--r-- 1 web5 client3 351 Jun 4 10:35 wp-blog-header.php
-rw-r--r-- 1 web5 client3 2323 Jun 4 10:35 wp-comments-post.php
-rw-r--r-- 1 web5 client3 3660 Jun 4 10:35 wp-config.php
drwxr-xr-x 5 web5 client3 4096 Jun 4 10:46 wp-content/
-rw-r--r-- 1 web5 client3 5617 Jun 4 10:35 wp-cron.php
drwxr-xr-x 30 web5 client3 16384 Jun 4 10:35 wp-includes/
-rw-r--r-- 1 web5 client3 2502 Jun 4 10:35 wp-links-opml.php
-rw-r--r-- 1 web5 client3 3937 Jun 4 10:35 wp-load.php
-rw-r--r-- 1 web5 client3 51414 Jun 4 10:35 wp-login.php
-rw-r--r-- 1 web5 client3 8727 Jun 4 10:35 wp-mail.php
-rw-r--r-- 1 web5 client3 30081 Jun 4 10:35 wp-settings.php
-rw-r--r-- 1 web5 client3 34516 Jun 4 10:35 wp-signup.php
-rw-r--r-- 1 web5 client3 5102 Jun 4 10:35 wp-trackback.php
-rw-r--r-- 1 web5 client3 3205 Jun 4 10:35 xmlrpc.php​