Articles on: Frequently Asked Questions (FAQ)

Does Stock Sync able to scrape products from stores?

Store scraping automatically extracts product information from a website without direct access to the underlying database or data feed. Stock Sync does not support custom web scraping, but provides alternative methods to sync catalog data from external storefronts.



How to Set Up External Store Syncing


Go to App → Feed Settings → Connection Method


  1. Review Supplier Platform: Determine whether your supplier's website is hosted on Shopify or another e-commerce platform.
  2. Select Supported Connection: Choose an approved connection method, such as the Shopify Public connection, instead of attempting to scrape raw HTML.
  3. Configure Store Endpoint: Enter the supplier's store URL and authenticate or map the available product endpoints.
  4. Map Product Fields: Align the imported product fields with your store's attributes to complete the feed setup.


Direct web scraping of websites is not supported; rely on structured file feeds or supported e-commerce platform connections.



Store Scraping Policy & Alternative Solutions


1. Custom Web Scraping Policy

Stock Sync cannot scrape custom product data from arbitrary external websites.


Stock Sync does not support custom web scraping, HTML scraping, or crawling third-party storefronts.


Direct website scraping is vulnerable to site layout changes, rate limiting, and access blocks.


2. Shopify Public Connection Alternative

If your supplier runs a Shopify storefront and cannot install the Stock Sync app directly, you can connect using the Shopify Public connection.


  • Supported Platform: Shopify storefronts only.
  • Access Method: Connects via publicly accessible Shopify catalog endpoints rather than custom page scrapers.
  • Primary Use Case: Suppliers who do not provide a direct CSV/XML/API feed or will not install Stock Sync on their own Shopify store.


The Shopify Public connection reads publicly available catalog data without requiring administrative app permissions on the supplier's store.



Key Rules & Technical Details


  • Scraping Prohibition: Stock Sync does not offer automated crawling, CSS-selector scraping, or DOM parsing tools for external websites.
  • Structured Data Requirement: All non-Shopify external feeds require a structured file (CSV, XML, JSON, TXT, XLS/XLSX) or a direct API connection.
  • Public Shopify Feeds: When using the Shopify Public connection method, only products and variants set to visible and publicly listed on the supplier's online storefront can be synced.



Troubleshooting Steps


  • Issue: Supplier does not provide a CSV or API feed and asks you to scrape their site → Solution: Request a scheduled export file (CSV/XML) or an FTP/Dropbox feed, as Stock Sync cannot scrape arbitrary storefront HTML.
  • Issue: Supplier is on Shopify but refuses to install the Stock Sync app → Solution: Use the Shopify Public connection method to connect directly using their public storefront URL.
  • Issue: Certain products are missing when using the Shopify Public connection → Solution: Verify that the products are published to the Online Store sales channel on the supplier's store, as hidden or draft items cannot be retrieved publicly.



Good Articles to Continue


Updated on: 29/10/2026

Was this article helpful?

Share your feedback

Cancel

Thank you!