Query Admin
System Administration Tips, Security, Internet
Skip to contentHome
About Me
500 Million hits/day with Nginx + PHP-FPM + MySQL
I have recently registered to blitz.io, a very interested cloud service which allows users to stress-test a web server simulating up to 50K concurrent connections, with the possibility to specify different regions to originate requests, the HTTP method, the timeout and much more. This service can help to properly configure the web server (Nginx, Lighttpd, etc), the PHP-FPM and the MySQL to handle as more concurrent connections as possible.
I wanted to test how many concurrent connections Nginx + PHP-FPM + MySQL (Percona) could handle in one dedicated server and the results are very promising as the server handled more than 10,000 concurrent connections with an average CPU usage of 50% / 65%.
The dedicated server has the following hardware specs: Intel Xeon E3 1230v3 (4 cores 8 threads at 3.3 GHz), 32 GB DDR3 ECC, 120 GB SSD, 300 Mbit/s Bandwidth. The Nginx version used is 1.4.5-stable, the MySQL (Percona Server) version used is 5.6.15-63.0 and the PHP-FPM version used is PHP 5.5.9-1~dotdeb.1 (fpm-fcgi).
The test involved the GET request of a remote PHP web page (/test.php?item=testing-12444) used to query the MySQL database with a table of more than 100K rows and print the found row’s items in a HTML web page. So we have not tested the serving of a static file but a PHP page used to display dynamic content.
The following parameters were used in the Blitz rush test:
This is a screenshot of the Nginx status page showing active connections:
This is a screenshot of the output generated by the “top” command:
This is a screenshot of the PHP-FPM status page:
Now lets see how I have configured Nginx, PHP-FPM, MySQL and Sysctl.conf file.
/etc/nginx/nginx.conf:
user nginx;worker_processes 8;error_log /var/log/nginx/error.log warn;pid /var/run/nginx.pid;worker_rlimit_nofile 150000; events { worker_connections 150000; multi_accept on; use epoll;} http { include /etc/nginx/mime.types; default_type application/octet-stream; log_format main '$remote_addr - $remote_user [$time_local] "$request" ' '$status $body_bytes_sent "$http_referer" ' '"$http_user_agent" "$http_x_forwarded_for"'; access_log /var/log/nginx/access.log main; sendfile on; tcp_nopush on; keepalive_timeout 65; reset_timedout_connection on; types_hash_max_size 2048; server_tokens off; server_names_hash_bucket_size 256; client_max_body_size 32k; client_body_buffer_size 32k; client_body_in_single_buffer on; client_body_timeout 180s; client_header_timeout 180s; client_header_buffer_size 32k; large_client_header_buffers 4 32k; include /etc/nginx/conf.d/*.conf;} |
/etc/nginx/fastcgi_params:
...# Custom parametersfastcgi_connect_timeout 180s;fastcgi_send_timeout 600s;fastcgi_read_timeout 600s;fastcgi_intercept_errors on;fastcgi_max_temp_file_size 0;fastcgi_pass 127.0.0.1:9000;fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;fastcgi_index index.php; |
/etc/php5/fpm/pool.d/www.conf:
...listen = 127.0.0.1:9000pm = staticpm.max_children = 4000pm.max_requests = 50000... |
/etc/sysctl.conf:
fs.file-max = 150000net.core.netdev_max_backlog=32768net.core.optmem_max=20480#net.core.rmem_default=65536#net.core.rmem_max=16777216net.core.somaxconn=50000#net.core.wmem_default=65536#net.core.wmem_max=16777216net.ipv4.tcp_fin_timeout=120#net.ipv4.tcp_keepalive_intvl=30#net.ipv4.tcp_keepalive_probes=3#net.ipv4.tcp_keepalive_time=120net.ipv4.tcp_max_orphans=262144net.ipv4.tcp_max_syn_backlog=524288net.ipv4.tcp_max_tw_buckets=524288#net.ipv4.tcp_mem=1048576 1048576 2097152#net.ipv4.tcp_no_metrics_save=1net.ipv4.tcp_orphan_retries=0#net.ipv4.tcp_rmem=4096 16384 16777216#net.ipv4.tcp_synack_retries=2net.ipv4.tcp_syncookies=1#net.ipv4.tcp_syn_retries=2#net.ipv4.tcp_wmem=4096 32768 16777216 |
/etc/mysql/my.cnf:
# Generated by Percona Configuration Wizard (http://tools.percona.com/) version REL5-20120208 [mysql] # CLIENT #port = 3306socket = /var/run/mysqld/mysqld.sock [mysqld] # GENERAL #user = mysqldefault-storage-engine = InnoDBsocket = /var/run/mysqld/mysqld.sockpid-file = /var/run/mysqld/mysqld.pidtmpdir = /tmp # MyISAM #key-buffer-size = 32Mmyisam-recover = FORCE,BACKUP # SAFETY #max-allowed-packet = 16Mmax-connect-errors = 1000000skip-name-resolvesysdate-is-now = 1innodb = FORCEinnodb-strict-mode = 1 # DATA STORAGE #datadir = /var/lib/mysql # CACHES AND LIMITS #tmp-table-size = 32Mmax-heap-table-size = 32Mquery-cache-type = 0query-cache-size = 0max-connections = 15000thread-cache-size = 50open-files-limit = 65535table-definition-cache = 1024table-open-cache = 2048 # INNODB #innodb-flush-method = O_DIRECTinnodb-log-files-in-group = 2innodb-log-file-size = 128Minnodb-flush-log-at-trx-commit = 2innodb-file-per-table = 1innodb-buffer-pool-size = 1456Minnodb_fast_shutdown = 0 # LOGGING #log-error = /var/log/mysql/mysql-error.loglog-queries-not-using-indexes = 0slow-query-log = 1slow-query-log-file = /var/log/mysql/mysql-slow.log # REDUCE MEMORY USAGE #performance_schema = 0 |
Finally, this is the screenshot of the Blitz rush test results:
As you can see, the test generated 344,447 successful hits in 60.00 seconds and it transferred 3.39 GB of data in and out of our PHP web page (that involved queries to our database of 100K rows). The average hit rate of 5,740.78/second translates to about 496,003,680 hits/day.
This is a screenshot of the hit rate graph:
This is a screenshot of the responses time:
Contact me if you have any questions.
Stay Updated
Receive News Directly on Your Email
Become a Fan on Our Facebook Page
Subscribe to RSS Feeds
Other Posts
1 Billion hits/day with Nginx + PHP5-FPM + MySQL
Building a simple multilingual PHP website
New wave of spam emails that spread zBot trojan
SMTP ERROR: Password command failed: 534-5.7.14
Automatically close alert message on Twitter Bootstrap
How to use MySQL LOAD DATA LOCAL INFILE
Flush and clear cached memory in Linux server
Import large bulk of data into MySQL InnoDB
Random Posts
500 Million hits/day with Nginx + PHP-FPM + MySQL
Fix the Nginx 504 gateway timeout
Optimize Linux Sysctl.conf Parameters
Connect() to unix:/var/run/php5-fpm.sock failed
Configure FastCGI_Cache for WordPress and Nginx
Enable Nginx status page
Configure PHP-CGI without Spawn-FCGI
111 Connection refused while connecting to upstream
This entry was posted in Nginx and tagged blitz io test, blitz site test, concurrent connections, nginx benchmark, nginx concurrent connections on February 23, 2014.
Post navigation
← Fix the Nginx 504 gateway timeout Free world flags icon sets →
Search for:
Categories
Apache (8)
Free Icons (1)
Htaccess (6)
Lighttpd (9)
Linux (55)
Microsoft Windows (12)
MySQL (21)
Nginx (19)
Raspberry Pi (7)
Uncategorized (18)
WordPress (21)
Recent Posts
Check if Hardware DEP is enabled on Windows OS
Check if PAE is enabled on Windows 7
XenServer VM virtual disk could not be found
Create a screenshot of a website with PHP
css3Pie Basic Usage
jQuery $( document ).ready(function()
Check if Bootstrap modal is already open
Delay display of Bootstrap 3 modal after click
WordPress get Page ID outside the Loop
PHP readfile() corrupted ZIP file
Fixed height and vertical scrollbar on SyntaxHighlighter Evolved
Organize uploads folder by Post ID, Slug, Author, Media Type
Use meta tags to disable caching in web browsers
Enable DEP and ASLR on a Delphi XE executable
Automate Code Signing with InnoSetup
Proudly powered by WordPress