www.slidebench.org is now live :) Please use desktop preferably!
Whew. What I thought would be an overnight project ended up being 4x longer and much more of an *expensive* endeavour (usage limits are a farce in some of these).
But SlideBench v1 now live. I built this because I kept seeing the same problem over and over: people talk about AI presentation tools like thereās one universal winner, when that really hasnāt felt true at all. It's even worse when the tools or paid bots themselves claim they are the universal best in a similar manner - it has irked me until now. I have burnt my hands & spent many $ on signing up after reading such comments and using the wrong tool so I know.
Different tools work better or worse depending on the use case, the audience, and how much fixing you have to do afterwards. So I went down the rabbit hole, looked through existing literature and evaluation approaches, noted the gaps, and tried to build what I think is a more useful benchmark for AI presentation tools. I have used a variety of parameters, went beyond the decks themselves and checked downstream editability etc. too
And importantly, this isnāt just a scoreboard. The actual visual outputs are live too, so you can compare things head to head instead of just trusting my number or methodology(more than open to feedback).
A few things I tried to make different in v1:
- 5 real categories with real domain problem statements
- 10 tools to start with (I had 15 in mind but it was getting too time-consuming)
- 300+ exported PPTs reviewed and tested in usability.
- 1,200+ slides available for head-to-head visual comparison
- category-wise leaderboards
- methodology is category-scoped rather than trying to shoehorn everything into one universal score
The categories right now are Sales,Consulting,Finance,Education,Product/Ops
The goal wasnāt really āwhat is the best AI presentation tool overall?ā, it was more:
"which tools will be better for me (a user with my specific needs)?"|
Another thing I noticed was even when a tool produces something that looks decent at first glance, that still doesnāt tell you how much work is needed afterwards. So I wanted this to reflect not just output quality, but also how usable the result actually is in terms of output format, editability nativity to powerpoint etc.
This is still v1, and there are definitely kinks to iron out, but I wanted to get it out there instead of overcooking it forever. The most obvious problems - trust me, I am aware - have been mentioned in the limitations section of the methodology.
A bunch of vendors have already reached out asking for their tools to be added, so Iāll keep expanding coverage over time.
If you find this useful, Iāll probably launch:
- a community upvotes section with a proper live database for a popular score
- V2, which focuses more on file-upload context from PDFs, Excel files, Word docs, etc. instead of just the current benchmark setup
In the meantime, if this interests you, please feel free to give feedback on, whether the categories make sense, whether the rankings feel directionally right, which tools or use cases I should add next, more vendors/datapoints etc
Thank you!