SEO optimization dashboard showing keyword rank tracking, content gap analysis, on-page optimization scores, and organic traffic trend charts
All Projects
Content Marketing & Digital PublishingAI & Machine LearningData EngineeringFull-Stack Development

SEO Optimization Engine: Reversing a 420% Organic Traffic Decline for a Content Publisher

Rebuilt the SEO workflow for a content publisher with 2,000+ articles — lifting organic traffic 420% and keyword rankings 65% in 6 months.

+420%Organic Traffic Lift
+65%Keyword Ranking Boost
2,000+Articles Optimized
-40%Time to Rank

THWORKS built a full SEO optimization engine for a digital publisher with 2,000+ articles suffering an 18-month organic traffic decline. Using Python, Selenium, Elasticsearch, and a custom content-scoring pipeline, the system automates keyword research, content gap analysis, on-page optimization recommendations, and real-time rank tracking across thousands of target keywords. Result: 420% organic traffic lift, 65% keyword ranking improvement, and a 40% faster time-to-rank for new articles — all within 6 months of deployment.

The Challenge: 2,000 Articles Losing Traffic for 18 Months Straight

A digital publisher in the home-improvement niche had built a 2,000+ article library over 5 years that once drove 400K monthly organic visits. But Google's algorithm updates over 2024-2025 had punished their thin content and outdated optimization patterns — organic traffic had fallen steadily for 18 months, now sitting at 76K/month. Their SEO team of 2 editors couldn't audit and refresh articles fast enough to reverse the decline. They were refreshing maybe 10 articles per week while 200+ needed urgent attention.

In the post-Helpful Content era (2024+), Google prioritizes articles that demonstrably answer user intent with depth, freshness, and structured data. Generic SEO audits from tools like Ahrefs or Semrush produce long lists of 'issues' but don't prioritize which articles to fix first — wasting scarce editor time. The client needed a system that could scan their entire library continuously and tell them exactly which 20 articles would produce the biggest traffic lift this week.

Our Solution: Continuous Content Scoring with Priority-Based Optimization

We engineered a three-layer SEO system. The crawl layer uses Selenium and Playwright to scrape search rankings, competitor content, and keyword SERP features daily. The analysis layer runs each of the 2,000+ articles through a scoring pipeline measuring content depth, semantic coverage, E-E-A-T signals, structured data completeness, and link profile health. The recommendation layer uses an Elasticsearch-backed scoring model to surface the 20 articles with the highest 'fix-to-lift ratio' each week.

The key insight was that not all articles deserve equal attention. We built a prioritization model that combines current ranking position (articles on page 2 are higher priority than page 10), search volume, traffic potential, and estimated fix difficulty. Editors stopped playing whack-a-mole with the latest 'issue' list and started working a ranked queue — focusing on articles where small fixes would produce measurable traffic gains within weeks.

Key Technical Decisions

Continuous Crawling, Not On-Demand: The system crawls rankings and competitor content daily instead of on-demand — so the scoring model always works with fresh data and editors can trust the weekly priority list.

Fix-to-Lift Scoring: Instead of reporting raw 'issues,' the system estimates traffic lift per fix based on historical data (how much did similar fixes move similar articles?). Editors now see 'fix this and you'll gain ~2,400 monthly visits' instead of vague warnings.

Auto-Generated Content Briefs: For articles that need major rewrites, the system produces a brief that outlines the competing top-10 articles, missing semantic terms, suggested H2/H3 structure, and related entities — turning a 3-hour research task into a 15-minute review.

Results: 420% Organic Traffic Lift in 6 Months

420%
Organic Traffic
65%
Ranking Boost
8x
Articles / Week Updated

Before

18-month organic traffic decline from 400K to 76K monthly visits. 2 editors refreshing 10 articles per week — not enough to reverse the decline. No prioritization, just whack-a-mole against Ahrefs issue lists.

After

420% organic traffic lift in 6 months. Same 2-editor team refreshing 80+ articles per week with AI-generated briefs. Rankings improved on 65% of target keywords. Monthly organic visits back above pre-decline levels.

Technology Stack

PythonCore language for the SEO scoring pipeline, data processing, and ML-based prioritization model.
Selenium + PlaywrightHeadless browser crawling for SERP scraping and competitor content extraction — bypasses most anti-bot measures with residential proxies.
ElasticsearchFull-text search and aggregation engine powering the content-scoring queries across 2,000+ articles with sub-second response time.
Vue.jsEditor-facing dashboard with article queue, brief preview, and one-click approval workflow — picked over React for the client's existing stack.
Docker + KubernetesContainerized crawler workers scaling horizontally to handle daily rank tracking across 15,000+ target keywords.
PostgreSQLHistorical tracking of ranking movements, optimization changes, and traffic attribution for retroactive analysis.
"We'd tried every SEO tool on the market and they all gave us the same useless thing — massive lists of 'issues' with no prioritization. What THWORKS built tells us exactly which 20 articles to fix this week and how much traffic each fix will return. Our editors went from reactive to strategic in under a month."
Kavya IyerEditorial Director, HomeFolio Media

Frequently Asked Questions

Common questions about this project and our approach.

Traditional SEO tools surface issues and keyword gaps but leave prioritization to you — which means your team plays whack-a-mole against enormous issue lists. Our system scores each article by expected traffic lift per fix, so you work a ranked queue instead of reacting to whatever's flagged. The result is measurable traffic gains per editorial hour spent, instead of busywork.

Related Projects

Optimize Your SEO at Scale

Let's discuss how we can engineer the same level of technical excellence for your project.

Optimize Your SEO at Scale