https://db-benchmarks.com is a platform and a framework for making the most fair, transparent and open source database and search engines benchmarks. No more benchmarketing, because:
* anyone can easily reproduce all the results on their hardware
* the results you can see on the website are under version control on GitHub and anyone can run the same website locally in just a minute
* every byte of the project is 100% open source including test results and detailed test log
* the results are highly accurate with low coefficient of variation
The first release has Clickhouse, Elasticsearch, Manticore Search and MySQL covered on small / medium and big data realistic data collections. In plans: Percona Server, MongoDB, CocroachDB, FerretDB
Links:
https://db-benchmarks.com
https://github.com/db-benchmarks/db-benchmarks
https://github.com/db-benchmarks/ui
Disclaimer: I'm a member of Manticore Search team and the framework was initially made to compare Manticoresearch with Elasticsearch, but I did my best to not give any unfair advantage to Manticore since it's important for the team to understand the real situation. However, if you see something is missing or wrong feel free to make a pull request or an issue on Github. Or make your own fork with even more fair results!
Ideas/thoughts/comments?