PHP Frameworks Bench
This project attempts to measure the minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.
So I think the minimum should not include:
- cost of template engine (HTML output)
- cost of database manipulation
- cost of debugging information
Components like Template engines or ORM/Database libraries are out of scope in this project.
Benchmarks
Latest
Environment
- Ubuntu 22.04 LTS 64bit
- PHP 8.1.6
- OPCache enabled
- Apache 2.4.52
- CPU Core i7 2600K@4Ghz
- Memory 16G
Results (2022/5/22)
These are my benchmarks, not yours. I encourage you to run on your (production equivalent) environments.
| framework | requests per second | relative | peak memory | relative |
|---|---|---|---|---|
| pure-php | 42,114.24 | 52.1 | 0.34 | 1.0 |
| phroute-2.2 | 33,424.47 | 42.4 | 0.34 | 1.0 |
| fastroute-1.3 | 33,190.14 | 42.1 | 0.34 | 1.0 |
| siler-1.7.9 | 22,152.74 | 28.8 | 0.36 | 1.1 |
| leaf-3.0 | 20,685.10 | 26.3 | 0.36 | 1.1 |
| fatfree-3.8.0 | 19,282.52 | 24.5 | 0.39 | 1.1 |
| frameworkx-dev | 18,033.22 | 22.9 | 0.37 | 1.1 |
| slim-4.10 | 14,958.27 | 19.0 | 0.38 | 1.1 |
| slim-3.12 | 14,714.84 | 18.7 | 0.39 | 1.1 |
| yii-2.0-basic | 11,831.91 | 15.0 | 0.70 | 2.1 |
| ubiquity-2.4.x.dev | 11,669.47 | 14.8 | 0.38 | 1.1 |
| silex-2.3 | 10,415.74 | 13.2 | 0.39 | 1.1 |
| symfony-5.4 | 9,761.44 | 12.4 | 0.46 | 1.4 |
| symfony-6.0 | 9,737.48 | 12.4 | 0.45 | 1.3 |
| lumen-9.0 | 6,205.79 | 7.7 | 0.39 | 1.1 |
| cakephp-4.3 | 5,562.91 | 7.0 | 0.43 | 1.3 |
| laminas-2.0.x.dev | 5,015.71 | 6.4 | 0.49 | 1.4 |
| fuelphp-1.9 | 4,894.22 | 6.2 | 0.45 | 1.3 |
| codeigniter-4.1 | 1,938.43 | 2.5 | 1.46 | 4.3 |
| laravel-9.1 | 788.76 | 1.0 | 0.55 | 1.6 |
Benchmarking Policy
This is master branch.
- Install a framework via
composeraccording to the official documentation. - Use the default configuration.
- Don't remove any components/configurations even if they are not used.
- With minimum changes to run this benchmark.
- Set environment production/Turn off debug mode.
- Run the general optimization in your production environment, like
--optimize-autoloaderfor the composer. - Use controller class.
Some frameworks are optimized, some are not, so some people may think using default configuration is not fair. The dept of optimizing a framework depends on the developer's experienced too, so it's the rabbit hole and there is no point in that for benchmarking. I think the default configuration of frameworks is a good starting point to have the ranking points.
If you find something wrong with my code, feel free to send PR. But please note optimizing for the "Hello World" is not acceptable! Building the fastest "Hello World" application is not the goal of this project.
How to Benchmark
If you want to benchmark PHP extension frameworks like Phalcon, you need to install the extenstions.
1- Download & install the library in your localhost:
# you can put --branch vx.x
$ git clone https://github.com/myaghobi/php-frameworks-bench.git
$ cd php-frameworks-bench
# run the setup & follow the progress
$ bash setup.sh2- To make sure everything is ok:
# this is optional
$ bash check.sh3- Run benchmarks:
$ bash benchmark.sh4- Check the resuts:
http://localhost/php-frameworks-bench/
Commands
# composer update for each framework
$ bash update.sh
# to clean them all
# trouble? run it then
# you can use setup.sh
$ bash clean.sh
# clear the cache of frameworks
$ bash clear-cache.sh
# show the table of last benchmark
$ bash show-table.shTo specify the frameworks, put them after each command:
$ bash benchmark.sh laravel-9.1/ slim-4.10/ fatfree-3.8.0/
...References
Note: This project is based on php-framework-benchmark. It was very old and abandoned, so I decided to split it from the origin and update it separately.
- CakePHP
- CodeIgniter
- FastRoute
- FatFree
- FrameworkX
- FuelPHP
- Laminas
- Laravel
- Leaf
- Lumen
- PhRoute
- Siler
- Silex
- Slim
- Symfony
- Ubiquity
- Yii
License
You are allowed to use this plugin/project under the terms of the GNU General Public License version 2.
Copyright (C) 2022 Mohammad Yaghobi