apify-ecommerce

E-commerce Data Extraction Extract product data, prices, reviews, and seller information from any e-commerce platform using Apify's E-commerce Scraping Tool. Prerequisites .env file with APIFY_TOKEN (at ~/.claude/.env ) Node.js 20.6+ (for native --env-file support) Workflow Selection User Need Workflow Best For Track prices, compare products Workflow 1: Products & Pricing Price monitoring, MAP compliance, competitor analysis. Add AI summary for insights. Analyze reviews (sentiment or quality) Workflow 2: Reviews Brand perception, customer sentiment, quality issues, defect patterns Find sellers across stores Workflow 3: Sellers Unauthorized resellers, vendor discovery via Google Shopping Progress Tracking Task Progress: - [ ] Step 1: Select workflow and determine data source - [ ] Step 2: Configure Actor input - [ ] Step 3: Ask user preferences (format, filename) - [ ] Step 4: Run the extraction script - [ ] Step 5: Summarize results Workflow 1: Products & Pricing Use case: Extract product data, prices, and stock status. Track competitor prices, detect MAP violations, benchmark products, or research markets. Best for: Pricing analysts, product managers, market researchers. Input Options Input Type Field Description Product URLs detailsUrls Direct URLs to product pages (use object format) Category URLs listingUrls URLs to category/search result pages Keyword Search keyword + marketplaces Search term across selected marketplaces Example - Product URLs { "detailsUrls" : [ { "url" : "https://www.amazon.com/dp/B09V3KXJPB" } , { "url" : "https://www.walmart.com/ip/123456789" } ] , "additionalProperties" : true } Example - Keyword Search { "keyword" : "Samsung Galaxy S24" , "marketplaces" : [ "www.amazon.com" , "www.walmart.com" ] , "additionalProperties" : true , "maxProductResults" : 50 } Optional: AI Summary Add these fields to get AI-generated insights: Field Description fieldsToAnalyze Data points to analyze: ["name", "offers", "brand", "description"] customPrompt Custom analysis instructions Example with AI summary: { "keyword" : "robot vacuum" , "marketplaces" : [ "www.amazon.com" ] , "maxProductResults" : 50 , "additionalProperties" : true , "fieldsToAnalyze" : [ "name" , "offers" , "brand" ] , "customPrompt" : "Summarize price range and identify top brands" } Output Fields name - Product name url - Product URL offers.price - Current price offers.priceCurrency - Currency code (may vary by seller region) brand.slogan - Brand name (nested in object) image - Product image URL Additional seller/stock info when additionalProperties: true Note: Currency may vary in results even for US searches, as prices reflect different seller regions. Workflow 2: Customer Reviews Use case: Extract reviews for sentiment analysis, brand perception monitoring, or quality issue detection. Best for: Brand managers, customer experience teams, QA teams, product managers. Input Options Input Type Field Description Product URLs reviewListingUrls Product pages to extract reviews from Keyword Search keywordReviews + marketplacesReviews Search for product reviews by keyword Example - Extract Reviews from Product { "reviewListingUrls" : [ { "url" : "https://www.amazon.com/dp/B09V3KXJPB" } ] , "sortReview" : "Most recent" , "additionalReviewProperties" : true , "maxReviewResults" : 500 } Example - Keyword Search { "keywordReviews" : "wireless earbuds" , "marketplacesReviews" : [ "www.amazon.com" ] , "sortReview" : "Most recent" , "additionalReviewProperties" : true , "maxReviewResults" : 200 } Sort Options Most recent - Latest reviews first (recommended) Most relevant - Platform default relevance Most helpful - Highest voted reviews Highest rated - 5-star reviews first Lowest rated - 1-star reviews first Note: The sortReview: "Lowest rated" option may not work consistently across all marketplaces. For quality analysis, collect a large sample and filter by rating in post-processing. Quality Analysis Tips Set high maxReviewResults for statistical significance Look for recurring keywords: "broke", "defect", "quality", "returned" Filter results by rating if sorting doesn't work as expected Cross-reference with competitor products for benchmarking Workflow 3: Seller Intelligence Use case: Find sellers across stores, discover unauthorized resellers, evaluate vendor options. Best for: Brand protection teams, procurement, supply chain managers. Note: This workflow uses Google Shopping to find sellers across stores. Direct seller profile URLs are not reliably supported. Input Configuration { "googleShoppingSearchKeyword" : "Nike Air Max 90" , "scrapeSellersFromGoogleShopping" : true , "countryCode" : "us" , "maxGoogleShoppingSellersPerProduct" : 20 , "maxGoogleShoppingResults" : 100 } Options Field Description googleShoppingSearchKeyword Product name to search scrapeSellersFromGoogleShopping Set to true to extract sellers scrapeProductsFromGoogleShopping Set to true to also extract product details countryCode Target country (e.g., us , uk , de ) maxGoogleShoppingSellersPerProduct Max sellers per product maxGoogleShoppingResults Total result limit Supported Marketplaces Amazon (20+ regions) www.amazon.com , www.amazon.co.uk , www.amazon.de , www.amazon.fr , www.amazon.it , www.amazon.es , www.amazon.ca , www.amazon.com.au , www.amazon.co.jp , www.amazon.in , www.amazon.com.br , www.amazon.com.mx , www.amazon.nl , www.amazon.pl , www.amazon.se , www.amazon.ae , www.amazon.sa , www.amazon.sg , www.amazon.com.tr , www.amazon.eg Major US Retailers www.walmart.com , www.costco.com , www.costco.ca , www.homedepot.com European Retailers allegro.pl , allegro.cz , allegro.sk , www.alza.cz , www.alza.sk , www.alza.de , www.alza.at , www.alza.hu , www.kaufland.de , www.kaufland.pl , www.kaufland.cz , www.kaufland.sk , www.kaufland.at , www.kaufland.fr , www.kaufland.it , www.cdiscount.com IKEA (40+ country/language combinations) Supports all major IKEA regional sites with multiple language options. Google Shopping Use for seller discovery across multiple stores. Running the Extraction Step 1: Set Skill Path SKILL_PATH =~ /.claude/skills/apify-ecommerce Step 2: Run Script Quick answer (display in chat): node --env-file =~ /.claude/.env $SKILL_PATH /reference/scripts/run_actor.js \ --actor "apify/e-commerce-scraping-tool" \ --input 'JSON_INPUT' CSV export: node --env-file =~ /.claude/.env $SKILL_PATH /reference/scripts/run_actor.js \ --actor "apify/e-commerce-scraping-tool" \ --input 'JSON_INPUT' \ --output YYYY-MM-DD_filename.csv \ --format csv JSON export: node --env-file =~ /.claude/.env $SKILL_PATH /reference/scripts/run_actor.js \ --actor "apify/e-commerce-scraping-tool" \ --input 'JSON_INPUT' \ --output YYYY-MM-DD_filename.json \ --format json Step 3: Summarize Results Report: Number of items extracted File location (if exported) Key insights based on workflow: Products: Price range, outliers, MAP violations Reviews: Average rating, sentiment trends, quality issues Sellers: Seller count, unauthorized sellers found Error Handling Error Solution APIFY_TOKEN not found Ensure ~/.claude/.env contains APIFY_TOKEN=your_token Actor not found Verify Actor ID: apify/e-commerce-scraping-tool Run FAILED Check Apify console link in error output Timeout Reduce maxProductResults or increase --timeout No results Verify URLs are valid and accessible Invalid marketplace Check marketplace value matches supported list exactly