aapanel server much slower then hestia cp based server

neotheghost

how can it be, that an aapanel based apache server performs only around 50% of the speed of an hestia cp based apache server?

I have hosted 2 identical VPS ARM Servers on Oracle Cloud. Server 1 got Hestia, Server 2 AAPanel installed.
Then i set up Wordpress on both servers and install PHP/MySQL CPU performance statistics Plugin for testing.

Hestia Results:

Server: test1.domain.eu@10.0.0.111
PHP host information: Linux ws2.domain.eu 5.11.0-1027-oracle #30₂₀.04.1-Ubuntu SMP Thu Jan 13 09:43:40 UTC 2022 aarch64
PHP version: 7.4.27
PHP memory limit: 512M
PHP post_max_size: 512M
PHP upload_max_size: 512M
PHP max_execution_time: 30 seconds
PHP extensions loaded Core date libxml openssl pcre zlib filter hash Reflection SPL session standard sodium cgi-fcgi mysqlnd PDO xml apcu bcmath bz2 calendar ctype curl dom mbstring FFI fileinfo ftp gd gettext iconv imagick imap intl json ldap exif mysqli pdo_mysql apc posix pspell readline shmop SimpleXML soap sockets sysvmsg sysvsem sysvshm tokenizer xmlreader xmlwriter xsl zip Phar Zend OPcache
PHP ini file location: /etc/php/7.4/fpm/php.ini
Webserver: Test not implemented yet/unknown web server
Loaded webserver modules: T
Platform: Linux
Gateway interface: CGI/1.1
Path to files: /home/admin/web/test1.domain.eu/public_html/wp-admin
MySQL version 10.6.5-MariaDB-1:10.6.5+maria_focal
Server load now: 0.04
Server load avg. 5 minutes: 0.01
Server load avg. 15 minutes: 0.00
MySQL test:
Time to perform: Query test (200 times) : 0.54 seconds (370/sec)
MySQL tests:
Time to perform: select BENCHMARK(500000000, EXTRACT(YEAR FROM NOW())) : 5.73 seconds
Time to perform: select BENCHMARK(10000000,ENCODE('hello','goodbye')) : 0.64 seconds
Time to perform: select BENCHMARK(25000000,1+1*2); : 0.49 seconds
Total time (all MySQL tests) : 7.40 seconds
PHP test:
Time to perform: Math test : 0.05 seconds
Time to perform: StringManipulation test : 0.19 seconds
Time to perform: test Loop test : 0.07 seconds
Time to perform: test IfElse : 0.08 seconds
Total time (all PHP tests) : 0.39 seconds
Network test:
Network test 1: Fetch data from nearest google CDN point : 60.93 Mbps
All tests:
Total time (all MySQL + PHP tests) : 7.79 seconds

AAPanel Results:

Server: test2.domain.eu@10.0.0.187
PHP host information: Linux aapanel-apache-redis-test 5.11.0-1027-oracle #30₂₀.04.1-Ubuntu SMP Thu Jan 13 09:43:40 UTC 2022 aarch64
PHP version: 7.4.27
PHP memory limit: 512M
PHP post_max_size: 512M
PHP upload_max_size: 512M
PHP max_execution_time: 300 seconds
PHP extensions loaded Core date libxml openssl pcre sqlite3 zlib bcmath ctype curl dom filter ftp gd gettext hash iconv intl json mbstring SPL session pcntl standard PDO mysqlnd pdo_sqlite Phar posix Reflection pdo_mysql shmop SimpleXML soap sockets sodium mysqli sysvsem tokenizer xml xmlreader xmlrpc xmlwriter cgi-fcgi zip apcu fileinfo Zend OPcache
PHP ini file location: /www/server/php/74/etc/php.ini
Webserver: Test not implemented yet/unknown web server
Loaded webserver modules:
Warning: count(): Parameter must be an array or an object that implements Countable in /www/wwwroot/test2.domain.eu/wp-content/plugins/mywebtonet-performancestats/mywebtonet-performancestats.php on line 516
T
Platform: Linux
Gateway interface: CGI/1.1
Path to files: /www/wwwroot/test2.domain.eu/wp-admin
MySQL version 10.4.19-MariaDB-log
Server load now: 0.05
Server load avg. 5 minutes: 0.33
Server load avg. 15 minutes: 0.59
MySQL test:
Time to perform: Query test (200 times) : 0.97 seconds (206/sec)
MySQL tests:
Time to perform: select BENCHMARK(500000000, EXTRACT(YEAR FROM NOW())) : 6.54 seconds
Time to perform: select BENCHMARK(10000000,ENCODE('hello','goodbye')) : 0.62 seconds
Time to perform: select BENCHMARK(25000000,1+1*2); : 0.50 seconds
Total time (all MySQL tests) : 8.63 seconds
PHP test:
Time to perform: Math test : 0.23 seconds
Time to perform: StringManipulation test : 0.89 seconds
Time to perform: test Loop test : 0.23 seconds
Time to perform: test IfElse : 0.23 seconds
Total time (all PHP tests) : 1.58 seconds
Network test:
Network test 1: Fetch data from nearest google CDN point : 48.42 Mbps
All tests:
Total time (all MySQL + PHP tests) : 10.21 seconds

Result:
Looking at only the MySql Tests per Second results we can see that the Hestia Server is 2x as fast as AApanel.
When working in the Wordpress backend, i can confirm this result, as loading of the interface, like plugins, dashboard etc.......takes 2 times as long on the AApanel version. (measured by page load times)

WHY IS THAT? OPcache and Apcu are enabled on both servers.

aaPanel_Jose

Hello neotheghost
Thanks for the feedback, we will also schedule a time to test this

szone

neotheghost Great insights.

Have you also performed these benchmark tests on non-ARM VPS? Please share the results too.

I have been using x86 based non-arm linux / centos vps and I feel the performance is as good as other stacks.

But yes, I have felt the sluggishness with apache/nginx when using ARM based VPS on Oracle Linux 8. So I might give a try to use HestiaCP next time.

Stealth

neotheghost

Because Hestia using Nginx and Apache at same time. aaPanel only Nginx or Apache, old settings. Try the OpenLiteSpeed, it will be faster than Hestia, but not fast like CyberPanel. aaPanel very not support the best OpenLiteSpeed...

Tosko

aaPanel_Jose

i think it's good you guys schedule this. I can confirm this and has influence on the scores on search engines.
I believe it's crucial to have a stable base so hope you guys can dedicate the next release towards improvements of the code.

While I believe expanding is also good on new plugins, and i completely understand you guys are trying to gather some income. But this is an environment where competition is brutal at times and you lose valuable customers over time.

aaPanel will remain the panel for my backup sites but not for my primary ones for now.

neotheghost

aaPanel_Jose

could you test this already? i can provide a server if necessary.
I tested all different combinations, apache, nginx, php 7.3, 7.4, 8..........no matter what i tried, i got the same results, a substantial difference in performance between aapanel and other panels.

neotheghost

Same is true for the stacks from https://webinoly.com/ or https://easyengine.io/ or https://wordops.net/

They all perform so much faster then a server setup with AAPanel. I don't understand why. I love the functionality of aapanel, i really dont want to switch, but those performance differences are day and night.

Give it a try. I hope you can figure out the difference and adopt those settings in AApanel.

JAY

neotheghost
aapanel panel need a lot of fine tuning which are not fixing now they are more in implementing paid plugins
but they forgot if main script will not will not work outbox then plugin will not sell

aaPanel_Jose

neotheghost
I tried to install hestia cp but it didn't work, do you have a test server with hestia cp installed?

If you can provide login information please send to jose@aapanel.com

neotheghost

szone ARM Servers perform similar to x64 Servers. Both act snappy on a normal LEMP setup, but behave sluggish on aapanels LEMP setup. Benchmarks and real life use confirm the performance differences.

While on a fresh Wordpress Install, you might not notice a difference, using a mature wordpress site, with quite some plugins running you will see a HUGE difference in performance, since it scales by a factor of 3.

Example: A list of WooCommerce orders needs 4 seconds to generate shipping labels. The same task will need 12 seconds on an AApanel based server.

Thats why i think this issue is really critical for the success of aapanel and must be fixed.
Considering that this issue exists for years now, i don't think there will be a quick solution.

JAY

this is my site reports running on aapanel.

neotheghost

I sent sent you the login information.

neotheghost

well after 3 weeks of waiting and nobody of the development team trying to test the server, i will take it down.

i will give aaPanel another shot in 2023. have a good time everyone!

JAY

@aaPanel_Jose
aapanel is problem in wordpress base cms sites you need to upgrade your cache plugin to work faster in wordpress site.

neotheghost

JAY
yes you are right. if you setup caching you can get the sites to load fast, so it's useable for your customers.
but this solves nothing - it just means that even with aapanel, you can serve a static page fast with proper configuration.

my problem is real work processes, real tasks running on the server, dynamic sites.

example: even with a properly cached website, eventually your customer will checkout to buy something.
this part is dynamic, the server needs to send an email to the customer and maybe generate a pdf invoice.
this takes so incredible long on aapanel, so that people will press the refresh button since nothing seems to happen or leave the site. its just not the web experience i want my customers to have and it's not because of to many plugins or anything, the exact same site works reasonably fast on a non aapanel server.

rebecca_white

neotheghost which one you are going now server

neotheghost

rebecca_white
If you need a grafical interface i would recommend CyberPanel. The interface is not as good as AAPanel, but the performance is really good. If you can work with a command lines in a terminal, i would recommend Webinoly. Performance is also excellent.

aaP_enigumeni4

neotheghost any good suggestion about stable mail server?
I have try cyberpanel and other panels but think aapanel is the best ever.

I have a server with 6v core 8Ram and 200 nvme storage runing a portal with 100.000k visits daily with openlitespeeed webserver. Is very very fast 🙂

Tanks Aapanel team.

heringer

neotheghost How did you manage to use cyberpanel with Arm?

rebecca_white

aaP_enigumeni4 can you check my question here please
https://www.aapanel.com/forum/d/12653-not-getting-the-storage-size-in-aapanel-for-oracle-cloud

neotheghost

aaP_enigumeni4 For a stable mailsever i would recommend mailcow. i run it for 3 years straight now, with no downtime. I would never mix mails with a webserver, as both services are to critical to fail or be dependent on each other.

steve_patco

aaP_enigumeni4 I cannot get mailserver to work on Oracle 7.8 centos. Mailserver installs but thunderbird cannot find server. Major configuration problems for aapanel mailserver.

neotheghost

heringer i didn't. i used webinoly on oracle since arm isnt supported by cyberpanel. but i am hosting all critical services on contabo. oracle is my testground.