Skip to content

luminati-io/yahoo-auctions-price-tracker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

6 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Yahoo! Auctions Japan Price Tracker

Bright Data Yahoo! Auctions Japan Price Tracker Python

Bright Insights Price Tracker

Real-time Yahoo! Auctions Japan price tracking - Japan's largest online auction platform. Two ways to get started: a fully managed intelligence platform or a custom scraper built with Bright Data's AI Scraper Builder.


Option 1: Bright Insights - AI-Powered Price Tracking (Recommended)

Bright Insights is Bright Data's fully managed retail intelligence platform. No scrapers to build, no infrastructure to maintain - just structured, analysis-ready price data delivered to dashboards, data feeds, or your BI tools.

Why teams choose Bright Insights:

  • πŸš€ Zero setup - Go live in minutes with ready-to-use dashboards and data feeds
  • πŸ€– AI-powered recommendations - A conversational AI assistant turns millions of data points into actionable insights instantly
  • ⚑ Real-time monitoring - Hourly to daily refresh rates with instant alerts (email, Slack, webhook)
  • 🌍 Unlimited scale - Any website, any geography, any refresh frequency
  • πŸ”— Plug-and-play integrations - AWS, GCP, Databricks, Snowflake, and more
  • πŸ›‘οΈ Fully managed - Bright Data handles schema changes, site updates, and data quality automatically

Key use cases:

  • βœ… Monitor Yahoo! Auctions Japan prices across all product categories
  • βœ… Track stock levels and availability in real time
  • βœ… Set up price alerts for products you care about
  • βœ… Monitor MAP policy compliance and detect pricing violations
  • βœ… Track competitor promotions and promotional dynamics
  • βœ… Feed clean, harmonized data directly into dynamic pricing algorithms or AI models

Starting from $250/month - Get a tailored quote β†’


Option 2: Build Your Own Yahoo! Auctions Japan Scraper

No pre-built Yahoo! Auctions Japan scraper API? No problem. Bright Data's AI Scraper Builder generates a custom Yahoo! Auctions Japan scraper in just a few clicks β€” no coding required.

Build your Yahoo! Auctions Japan scraper in minutes

Open the Yahoo! Auctions Japan AI Scraper Builder β†’

Choose the domain, outline your data requirements, and let our AI scraper builder automatically create the API.

  1. Describe data needs in plain English
  2. AI instantly generates the scraper API
  3. Run API requests for immediate results
  4. Edit the code in the built-in IDE, if needed

Once built, your scraper gets a Web Scraper ID (gd_xxxxxxxxxxxx) β€” copy it for the Setup step below.

Prerequisites

  • Python 3.9 or higher
  • A Bright Data account (free trial available)
  • A Bright Data API token (how to get one)
  • A Web Scraper ID for Yahoo! Auctions Japan (from the build step above)

Setup

  1. Clone this repository

    git clone https://github.com/luminati-io/yahoo-auctions-price-tracker.git
    cd yahoo-auctions-price-tracker
  2. Install dependencies

    pip install -r requirements.txt
  3. Configure credentials

    Copy .env.example to .env and fill in your values:

    cp .env.example .env
    BRIGHTDATA_API_TOKEN=your_api_token_here
    BRIGHTDATA_DATASET_ID=your_dataset_id_here

    Your Web Scraper ID Paste the Web Scraper ID from your AI Scraper Builder dashboard into BRIGHTDATA_DATASET_ID (format: gd_xxxxxxxxxxxx).


Usage

Once your Yahoo! Auctions Japan scraper is built and your Web Scraper ID is configured in .env, the Python interface works the same way:

1. Track Specific Products by URL

Pass a list of Yahoo! Auctions Japan product URLs to retrieve structured price data:

from price_tracker import track_prices

urls = [
    "https://www.auctions.yahoo.co.jp/product/sample-item-123456",
    # Add more product URLs here
]

results = track_prices(urls)
for item in results:
    print(f"{item.get('title')} - {item.get('final_price', item.get('price'))} {item.get('currency', '')}")

Or run directly:

python price_tracker.py

2. Discover Products by Keyword

Find products matching a keyword search:

from price_tracker import discover_by_keyword

results = discover_by_keyword("laptop", limit=50)

3. Browse Products by Category URL

Collect all products from a Yahoo! Auctions Japan category page:

from price_tracker import discover_by_category

results = discover_by_category(
    "https://auctions.yahoo.co.jp/category/example",
    limit=100,
)

Output Fields

Each result record contains the following fields:

Field Description
url Product page URL
title Product name / title
brand Brand or manufacturer
initial_price Original / list price
final_price Current selling price
currency Currency code (e.g. USD, EUR)
discount Discount amount or percentage
in_stock Whether the item is available
rating Average star rating
reviews_count Total number of reviews
seller_name Name of the seller
images Array of product image URLs
description Product description text
timestamp Data collection timestamp

Sample output

[
  {
    "url": "https://www.auctions.yahoo.co.jp/product/sample-item-123456",
    "title": "Example Product Name",
    "brand": "Example Brand",
    "initial_price": 59.99,
    "final_price": 44.99,
    "currency": "USD",
    "discount": "25%",
    "in_stock": true,
    "rating": 4.5,
    "reviews_count": 1234,
    "images": ["https://auctions.yahoo.co.jp/images/product1.jpg"],
    "description": "Product description text...",
    "timestamp": "2025-01-15T10:30:00Z"
  }
]

Advanced Options

The trigger_collection() function accepts optional parameters to control data collection:

Parameter Type Default Description
limit integer - Maximum number of records to return
include_errors boolean true Include error reports in results
notify string (URL) - Webhook URL to call when the snapshot is ready
format string json Output format: json, csv, or ndjson

Example with options:

from price_tracker import trigger_collection, get_results

inputs = [{"url": "https://www.auctions.yahoo.co.jp/product/sample-item-123456"}]
snapshot_id = trigger_collection(inputs, limit=200, notify="https://your-webhook.com/hook")
results = get_results(snapshot_id)

Resources


Built with Bright Data - the industry-leading web data platform.

About

Track prices from Yahoo Auctions - AI-powered via Bright Insights or self-service via Bright Data's Web Scraper API

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages