Skip to content

Repository files navigation

Data Tools: clean web data for developers and AI agents

Ready-to-run Python examples for pay-per-use Apify Actors that turn search trends, news, competitor ads, documents, websites, YouTube, TikTok and Instagram videos and audio into clean JSON, Markdown, CSV and Excel.

🌐 Website: https://fernandoguiraud16-coder.github.io/data-tools/

Each example is a single short script plus a sample-output.json from a real cloud run, so you can see exactly what you get before running anything.

Sample output of the TikTok Transcript Scraper: real results from a cloud run

Examples

Example What it does Actor
google-trends Compare terms over time, export to CSV, see rising searches and what's trending now Google Trends Scraper
google-news Save news articles as Markdown files, or get alerts for new stories only Google News Scraper
google-ads-transparency Every Google Search, Display and YouTube ad of a competitor, longest-running first, and alerts for new ads Google Ads Transparency Scraper
trends-to-news Find the fastest rising searches on a topic and the news that explains them Trends + News
pdf-to-markdown PDF, Word, Excel, PowerPoint and scans to Markdown, or to RAG chunks in JSONL PDF to Markdown Extractor
pdf-table-extractor Every table in a PDF to an Excel workbook, one sheet per table PDF Table Extractor
tech-stack-whois Enrich a list of company domains: CMS, email provider, hosting, age, security grade Tech Stack Detector & WHOIS
bulk-whois Find available and soon-to-expire domains in a list Bulk WHOIS Lookup
audio-transcription Audio or video to text and SRT subtitles, 99 languages Audio & Video Transcription
podcast-transcripts Transcribe only the new episodes of your favourite podcasts Podcast Transcript Scraper
youtube-transcripts YouTube videos, Shorts, whole channels, playlists and keyword searches to Markdown with timestamps, SRT or text YouTube Transcript Scraper
Google Hotels guide Hotel prices per night and total stay for any city and dates, ratings, reviews, amenities; daily price monitor Google Hotels Scraper
Google Jobs guide Job listings from LinkedIn, Indeed and company sites with salary ranges and apply links; alerts for new jobs Google Jobs Scraper
LinkedIn & Indeed jobs guide Jobs listed on LinkedIn, Indeed, Monster and company career sites in one search, with every apply link Job Postings Aggregator
Company contacts guide Role emails, phones, address and social profiles of companies from their websites, one row per company Website Contact Scraper
YouTube channel guide · YouTube search guide Every video of a channel, or the top videos for a keyword, as transcripts YouTube Channel Transcripts · YouTube Search Transcripts
mcp-agents Use all of these as tools in Claude, Cursor or any MCP client Apify MCP server

Also in the family (same engine as Audio & Video Transcription, so the audio-transcription example works with them too):

Actor What it does
Instagram Reels Transcript Scraper Instagram Reels to text with author, date, likes and comments ($0.009 per Reel)
TikTok Transcript Scraper TikTok videos or whole accounts to text with views and likes ($0.009 per video)
Video to Text Transcriber TikTok, Instagram, X, Facebook and MP4 links to transcripts and readable subtitles, per minute
SRT Subtitle Generator Broadcast-formatted SRT/VTT subtitles (42 characters, 2 lines)

For AI agents

  • MCP: every tool is listed in the official MCP registry as io.github.fernandoguiraud16-coder/<tool> and served at https://mcp.apify.com/?tools=fguiraud/<tool>. See examples/mcp-agents.
  • Agent skills: npx skills add fernandoguiraud16-coder/data-tools installs 6 skills for Claude Code, Codex, Cursor and other coding agents.
  • llms.txt: a short index of all tools for LLMs.

Quick start

  1. Create a free Apify account and copy your API token from Console → Settings → API & Integrations.

  2. Install the client and set the token:

    pip install -r requirements.txt
    export APIFY_TOKEN=your_token          # Windows PowerShell: $env:APIFY_TOKEN="your_token"
  3. Run any example:

    python examples/google-trends/compare_terms.py "chatgpt, gemini, claude" --geo US

Pricing

All Actors are pay per result: you pay a fraction of a cent per item (term, article, ad, document, domain, video or audio minute), and failed or empty items are not charged. Apify's free plan includes monthly credits, enough to try every example. Exact prices are on each Actor's page.

Support

Found a bug or need a feature? Open an issue on the Actor's page in the Apify Store (replies within 48 hours), or an issue in this repository for problems with the examples.

License

The example code is MIT licensed: copy it into your own projects.

Releases

Packages

Contributors

Languages