Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

1 Commit
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Dev.to Articles Scraper β€” Posts by Tag & Author, Reactions & Tags

Apify Actor No API key Pay per result Developer content Export

Bulk-scrape developer articles and blog posts from Dev.to (Forem) by tag, author username, or the latest / top feed across all tags β€” with no login, no API key and no proxy. This Dev.to articles scraper returns clean, flat rows with title, description, tags, author handle, reaction and comment counts, reading time and cover image β€” ready for a spreadsheet, a BI tool or a content pipeline.

Leave everything empty and it pulls the latest articles across all of Dev.to; set a tag (javascript, ai, webdev, rust, python, devops…) or a username to scope the feed. It's the practical Dev.to API alternative for developer-content research, DevRel monitoring and building technical-writing datasets β€” with no rate-limit plumbing to write yourself.

15 fields per article Β· thousands of articles per run Β· tag + author filtering Β· no API key.


▢️ Run it now

Open Dev.to Articles Scraper on Apify Store β†’ and click Try for free. An empty input pulls the latest articles across all tags, so you get real data on the first run.


πŸ“¦ What you get

One flat row per article. Output fields:

Field Type Description
id integer Dev.to article ID (stable numeric identifier)
title string Article title
description string Short article summary / excerpt
url string Public Dev.to article URL
canonicalUrl string Author-declared canonical URL, if any
author string Author display name
authorUsername string Author's Dev.to username
organization string Publishing organization name, if any
tags array List of tags on the article
commentsCount integer Number of comments
reactionsCount integer Total public reactions (hearts, unicorns, bookmarks)
positiveReactionsCount integer Positive reactions count
readingTimeMinutes integer Estimated reading time in minutes
coverImage string Cover image URL
publishedAt string ISO 8601 publish timestamp
scrapedAt string ISO 8601 timestamp when the record was collected

πŸ’‘ Use cases

  • Content & trend research β€” track which developer topics (ai, rust, webdev, devops) are gaining traction by reactions and comments.
  • Developer-content newsletters β€” auto-build a fresh daily digest of trending articles for a tag.
  • DevRel & tool-adoption monitoring β€” follow how often your product, framework or language is written about, and by whom.
  • Author / influence tracking β€” pull every post from a specific writer to study output cadence and engagement.
  • LLM / NLP training corpora β€” assemble large, well-tagged technical-writing datasets for fine-tuning or RAG.
  • Competitive content intelligence β€” benchmark your tag's top posts against a competitor's ecosystem.
  • Editorial curation β€” surface high-reaction posts by tag for a community feed or roundup.

πŸš€ Quick start (4 ways)

1. Apify Console (no code)

  1. Open Dev.to Articles Scraper and click Try for free.
  2. Leave input empty for the latest feed, or set a Tag and/or Username; choose a Sort / feed (Latest, Top week/month/year/all-time, Relevant).
  3. Click Start, then export from the Output tab as JSON, CSV or Excel.

2. Apify CLI

npm install -g apify-cli
apify login
apify call logiover/devto-articles-scraper --input '{
  "tag": "ai",
  "maxArticles": 200
}'

3. API / cURL

curl -X POST \
  "https://api.apify.com/v2/acts/logiover~devto-articles-scraper/run-sync-get-dataset-items?token=YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"tag":"webdev","maxArticles":100}'

4. apify-client (JavaScript & Python)

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_TOKEN' });
const run = await client.actor('logiover/devto-articles-scraper').call({
  sort: 'top_week',
  tag: 'javascript',
  maxArticles: 200,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);
from apify_client import ApifyClient
client = ApifyClient("YOUR_TOKEN")
run = client.actor("logiover/devto-articles-scraper").call(run_input={
    "username": "ben",
    "maxArticles": 0,
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["title"], item.get("reactionsCount"))

More recipes: examples/cli.md Β· examples/api-curl.md Β· examples/javascript.md Β· examples/python.md


βš™οΈ Input

Everything is optional β€” an empty input pulls the latest articles across all tags.

Field Type Default Description
sort select latest Which feed: latest, top_week, top_month, top_year, top_infinity (all time), relevant (home feed).
tag select "" Filter by a single Dev.to tag from the dropdown (JavaScript, Python, AI, React, DevOps, Rust…). Blank = all tags.
customTag string "" Any tag not in the dropdown (e.g. astro, supabase). Overrides tag when set.
username string "" Filter to a specific author's articles (their Dev.to handle, without the @).
maxArticles integer 100 Max articles to save. 0 = all available for your filter.

Tips: set maxArticles: 0 with a tag to snapshot an entire topic feed, or schedule a small daily run (e.g. maxArticles: 50) to build a rolling trending-content digest. Combine tag + username to scope one writer's posts on a single topic. Use sort: top_week to rank the week's best posts for a tag.


πŸ“€ Output

Sample article

{
  "id": 1937482,
  "title": "Building an AI Agent from Scratch in TypeScript",
  "description": "A hands-on walkthrough of tool-calling, memory and planning loops without a framework.",
  "url": "https://dev.to/ben/building-an-ai-agent-from-scratch-in-typescript-1a2b",
  "canonicalUrl": "https://dev.to/ben/building-an-ai-agent-from-scratch-in-typescript-1a2b",
  "author": "Ben Halpern",
  "authorUsername": "ben",
  "organization": null,
  "tags": ["ai", "typescript", "webdev", "tutorial"],
  "commentsCount": 27,
  "reactionsCount": 342,
  "positiveReactionsCount": 342,
  "readingTimeMinutes": 9,
  "coverImage": "https://dev-to-uploads.s3.amazonaws.com/uploads/articles/cover.png",
  "publishedAt": "2026-07-04T08:15:32Z",
  "scrapedAt": "2026-07-10T12:00:00.000Z"
}

Export the whole dataset to JSON, CSV, Excel, JSONL or XML from the Output tab, or via the Apify API.


πŸ”— Integrations & automation

  • Schedules β€” capture trending developer content daily or hourly on a tag of interest.
  • Webhooks β€” POST dataset URLs to your own endpoint when a run finishes.
  • Google Sheets β€” sync articles to a spreadsheet for editorial review.
  • Cloud storage β€” export to Amazon S3, Google Drive or Azure.
  • Zapier / Make / n8n / Pipedream β€” auto-build content digests and DevRel dashboards.
  • AI agents (MCP) β€” callable from Claude, GPT and other MCP-enabled agents via the Apify MCP server.

πŸ“ Export formats

CSV Β· JSON Β· JSONL Β· Excel (XLSX) Β· XML β€” one click from the Output tab, or via ?format= on the Apify API.


❓ FAQ

How do I scrape Dev.to articles?

Open Dev.to Articles Scraper, set a Tag or Username (or leave empty for the latest feed), choose maxArticles, and click Start. Then export as CSV, JSON or Excel.

Do I need a Dev.to account or API key?

No. The scraper reads anonymous public endpoints β€” no login, no token, no proxy required (only an Apify account). It's a ready-made Dev.to API alternative.

Can I scrape all articles for a specific tag?

Yes. Set the Tag field and maxArticles: 0 to paginate the entire public feed for that tag; the Actor walks pages automatically until the feed is exhausted.

Can I scrape every article from one Dev.to author?

Yes. Enter the author's Username to pull all their published posts with titles, tags, reactions and comment counts. Combine it with a tag to scope by topic.

Can I get the top posts for a tag (this week/month/year)?

Yes. Set sort to top_week, top_month, top_year or top_infinity (all time) together with a tag to rank the most-reacted articles for that window.

Can I track trending content over time?

Yes. Schedule the Actor daily or hourly on a tag; each run captures reactionsCount and commentsCount, so you can rank and trend posts across snapshots.

How much data can I get?

Thousands of articles per run. Use maxArticles: 0 to pull the full feed for your filter, or set a cap for small, frequent runs.

How do I export Dev.to articles to CSV or JSON?

Run the Actor on a tag or username, then open the Output tab and download as CSV, JSON, JSONL, Excel or XML β€” or pull the same dataset via the Apify API.

Can I use a tag that isn't in the dropdown?

Yes. Put any tag (e.g. astro, supabase) in the customTag field; it overrides the dropdown.

Is it legal to scrape Dev.to?

The Actor collects only publicly available article metadata served by Dev.to's own public endpoints. You are responsible for using the data in compliance with Dev.to's terms and applicable laws.


πŸ”Ž Related actors by logiover

Browse all logiover scrapers on Apify Store β†’


πŸ“„ Documentation only β€” this repository contains no scraper source code. The Actor runs on the Apify platform.

Licensed under the MIT License Β· Β© 2026 logiover

About

Scrape Dev.to (Forem) articles by tag, author or top feed: title, tags, reactions & comments. No API key, no login.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors