Plugin Pulse Beta
← Rankings

wp.org search vs our merit ranking: “email notify on reply”

wp.org orders by popularity, so a plugin a host bundled onto millions of sites, or a big-brand one that's slow and mediocre, can sit at the top. Our ranking is built to answer a different question: which of these is actually worth installing. How this works →

For “email notify on reply”, we agree with wp.org on the top plugin, and our order differs from theirs on 11 of the top 20.

wp.org search ranks on

Install count (uncapped), the raw star average, freshness, and support. Popularity dominates, so the biggest install base usually wins regardless of how it got there.

We add

A cap on the install boost, volume-weighted ratings, and signals wp.org can't see: whether the install base is organic or host-pushed, and its risk of being pulled.

Ranked above its merit

Notification Master – Real-Time WordPress Notifications With Email, SMS, Webhooks & More shows at wp.org #11 but places #22 on merit, a gap of 11 places. Its 1K+ installs carry it up the search order; its 5.0★ average from 4 reviews, plus freshness and upkeep, place it lower on our volume-weighted scale.

Buried gem

Temporary Login Without Password places #8 on merit, 5.0★ from 1,550 reviews, but shows at wp.org #17. A smaller install base keeps it further down the default search order than its quality signals alone would.

How this rank is calculated

Each plugin's merit score multiplies these inputs together: how recently it was updated, how current its "tested up to" WordPress version is, its install base (log scale, capped at 10 million), its support thread resolution rate, and a rating score. The rating score weights the star average by review volume against a sitewide prior, then scales it by the lower bound of the share of 4 and 5 star reviews. A plugin with 3.7 stars from tens of thousands of reviews can still outscore a 4.9 with a few dozen, because the small sample carries less certainty.

A health factor between 0.4 and 1.15 then adjusts that score for what wp.org's search can't see: PHP fatals or failed activations on a test install, PHP and WordPress compatibility, memory and page-speed footprint, suspicious review patterns, closure risk, and a large install base with very few reviews. Clean, adopted plugins earn a small lift.

A keyword ranking starts from wp.org's search order for the term, weighting each position by 1 divided by its place, then applies the merit correction and health factor above. Relevance to the keyword stays in the result, so the order can differ from the all-categories list on /best, which scores plugins with no search term.

Hover a row to see the main reason for its position.

merit plugin wp.org
1 bbPress Notify (No-Spam) 2K+ · 4.8★ (40) wp.org #1 ↑2 2 Check & Log Email – Easy Email Testing & Mail logging 90K+ · 4.8★ (292) wp.org #2 ↓1 3 FluentSMTP – WP Mail SMTP Plugin with Amazon SES, SendGrid, Mailgun, Postmark, Cloudflare, toSend, Gmail and Any SMTP 700K+ · 4.8★ (412) wp.org #3 ↓1 4 Post SMTP – Complete Email Delivery and SMTP Solution with Email Logs, Alerts, Backup SMTP & Mobile App 300K+ · 4.7★ (528) wp.org #4 5 Customize WordPress Emails and Alerts – Better Notifications for WP 30K+ · 4.8★ (184) wp.org #5 6 YayMail – WooCommerce Email Customizer 50K+ · 4.8★ (292) wp.org #6 7 Appointment Hour Booking – Booking Calendar 10K+ · 4.9★ (524) wp.org #10 wp.org ranks it 3 places below merit 8 Temporary Login Without Password 90K+ · 5.0★ (1,550) wp.org #17 ↓1 wp.org ranks it 9 places below merit 9 Customer Engagement System – Popup Builder, Forms, CRM & Email Marketing Automation 9K+ · 4.5★ (340) wp.org #13 ↓1 wp.org ranks it 4 places below merit 10 SureMail – SMTP and Email Logs Plugin with Amazon SES, Postmark, and Other Providers 200K+ · 4.7★ (25) wp.org #7 wp.org ranks it 3 places above merit 11 Additional Custom Emails & Recipients for WooCommerce 2K+ · 5.0★ (18) wp.org #8 wp.org ranks it 3 places above merit 12 Icegram Mailer – Reliable Email Deliverability, No-Code SMTP Replacement & Email Logs for WordPress 2K+ · 4.9★ (16) wp.org #9 wp.org ranks it 3 places above merit 13 WP Time Slots Booking Form 1K+ · 5.0★ (41) wp.org #15 wp.org ranks it 2 places below merit 14 FluentCart – Online Store Builder & eCommerce Checkout 9K+ · 4.5★ (47) wp.org #14 ↑1 15 WPO365 | MICROSOFT 365 GRAPH MAILER 10K+ · 5.0★ (40) wp.org #18 ↓1 wp.org ranks it 3 places below merit 16 Contact Form by Supsystic – Drag & Drop Form Builder with Templates & Form Statistics 6K+ · 4.7★ (92) wp.org #20 ↓1 wp.org ranks it 4 places below merit 17 Kali Forms — Contact Form & Drag-and-Drop Builder 10K+ · 4.8★ (89) wp.org #24 ↓1 wp.org ranks it 7 places below merit 18 Awesome Support – WordPress HelpDesk & Support Plugin 6K+ · 3.5★ (194) wp.org #19 ↓1 wp.org ranks it 1 place below merit 19 Comment Link Remove and Other Comment Tools 8K+ · 4.1★ (15) wp.org #12 ↓1 wp.org ranks it 7 places above merit 20 WP Notification Bell 700+ · 4.9★ (12) wp.org #16 ↓2 wp.org ranks it 4 places above merit 21 Recarto – Abandoned Cart Recovery for WooCommerce 3K+ · 4.5★ (28) wp.org #22 ↓1 wp.org ranks it 1 place below merit 22 Notification Master – Real-Time WordPress Notifications With Email, SMS, Webhooks & More 1K+ · 5.0★ (4) wp.org #11 ↓1 wp.org ranks it 11 places above merit 23 Webmention 900+ · 5.0★ (8) wp.org #21 ↓1 wp.org ranks it 2 places above merit 24 Post Status Notifier Lite 700+ · 3.9★ (17) wp.org #23 ↓1 wp.org ranks it 1 place above merit

Merit ranking caps the install boost at 10M (wp.org leaves it uncapped), replaces the raw star average with a volume-weighted score and a Wilson lower bound, and keeps wp.org's own freshness and compatibility decays. Method from the plugin-directory source; see Meta Trac #8298. Positions are tracked daily from the first visit to a keyword, so the small arrows show movement since tracking began.