E-commerce
Monitor Amazon product data at scale
Use case: collect Amazon price, availability, and product data at scale across hundreds of products and zip codes, track pricing trends over time, and surface competitive patterns, all without managing proxies or CAPTCHAs.
Quick Start
Inputs
- Product categories Amazon product categories to pull best sellers from. Defaults to 10 categories: Electronics, Grocery, Health & Vitamins, Beauty, Toys, Pet Supplies, Sports, Tools, Kitchen, and Office Supplies.
- Zip codes US zip codes to track prices across. Defaults to 10 zip codes spanning 5 major cities and 5 rural towns.
Outputs
- Price history per product, zip code, and time window
- Products with price changes and per-product change amounts
- Geo pricing exceptions by region
- Title A/B tests detected by BSR impact
- MSRP change events
- Multi-signal cascade events: price, MSRP, and Subscribe & Save in the same run
- Per-product detail page: price, BSR, availability, and MSRP views
How it works
A 6-phase pipeline. Read the blog here for a deeper explanation.
- Discover top-selling Amazon products Nimble searches Amazon for 500 top-selling products across 10 product categories with the Amazon Best Sellers Agent.
- Schedule the hourly tracking job 5,000 product and zip code pairs are uploaded to a Nimble Agent Job with an hourly cron schedule, configured once and running autonomously across 5 major cities and 5 rural towns.
- Collect hourly product snapshots The Amazon Product Detail agent runs every hour for 4 days: 480,000 total agent calls, 60+ fields per product per run, with retries handled automatically by the Agent Job.
- Process raw data into signals Nimble's Amazon Extraction Template automatically parses raw data to create fields for prices, assortment, zip code medians, BSR trends, availability timelines, title change logs, and multi-signal event records.
- Surface pricing and demand patterns 8 data stories extracted: algorithmic repricing, geo pricing exceptions, title A/B tests, BSR demand patterns, out-of-stock gaps, MSRP shifts, Subscribe & Save as an inventory proxy, and multi-signal cascade events.
- Display results in a dashboard A 4-page Streamlit app with every data point linked to a product detail page showing price timeline, zip comparison, BSR trend, availability strip, and MSRP history.
Stack
Nimble primitives plus the full runtime stack.
Nimble APIs
What it does
- Nimble Agent Jobs Managed job runner that handles scheduling, retries, and concurrency for 480,000 agent calls over 96 hours.
- amazon_best_sellers A Nimble-managed agent that discovers top-selling ASINs by category and page, used to build the 500-ASIN tracking list across 10 categories.
- amazon_pdp A Nimble-managed agent that pulls the full product detail page, returning 60+ fields per product including web price, MSRP, availability, BSR rank, and Subscribe & Save.
3rd Party Tools
Role
- streamlit 4-page dashboard with URL-based routing and product detail drill-down for every ASIN.
- plotly Dumbbell charts, price timelines, availability heatmaps, BSR trend lines, and scatter charts.
- pandas + parquet Processing 4.6 GB raw data into approximately 60 MB of structured Parquet files across 8 datasets.
- python 3.9+ Phase scripts for ASIN collection, data processing, and signal extraction
Reach out if you have any questions.
Talk to an Expert