I used aaPanel version 7.0.8 on Ubuntu 22.04 and installed the Fail2ban plugin. I tried to ban an IP using Fail2ban and I felt like it worked.
Then I detected and tested the connection to my website from the banned IP but it worked fine. Then I tried to use command reload nginx "/etc/init.d/nginx reload" and the firewall ufw blocked that IP.
I tried to deny one IP manually using the ufw command "ufw insert 1 reject from x.x.x.x" and it also didn't work. Then I reload or restart nginx and my firewall worked fine.
I think this is a bug because when Fail2ban detected the IP blocking, the firewall added IP into list deny, but the firewall still didn't work if you didn't reload your nignx