Skip to main content

Import Products from a URL

This guide explains how to build a product feed automatically by importing from your website.

Product feeds power how Vwam understands and recommends your products. If you don't have a CSV ready, the URL import tool lets you point Vwam at your website and we'll scan it, discover your product pages, and generate a feed for you — no manual data prep required.

Use URL import to:

  • Spin up a product feed without preparing a CSV.

  • Capture product titles, descriptions, prices, and images directly from your site.

  • Get an AI agent recommending products quickly.

  • Keep editing or replacing the generated feed afterward, just like any other feed.

Note: For Shopify stores, use the Shopify integration instead. Shopify provides a real-time catalog sync, while URL import creates a one-time snapshot.


Before you begin

Before importing from a URL:

  • Make sure the website is publicly accessible (not behind a login, paywall, or staging password).

  • Confirm the site uses HTTP or HTTPS.

  • Have the storefront or catalog URL ready (for example, https://yourstore.com).


Import products from a URL

  1. Go to Products.

  2. Click Import from URL.

  3. Enter your website URL (for example, example.com).

  4. Click Import.

Vwam validates the URL and immediately begins scanning the site.

If you omit http:// or https://, Vwam adds https:// automatically.


How URL import works

Once you start an import, Vwam runs a three-stage pipeline in the background:

  1. Discover — Vwam crawls the site to find product pages.

  2. Scrape — Each discovered page is fetched and parsed for product details (title, description, price, image, etc.).

  3. Finalize — Extracted products are written into a collection and made available to your agent.

You can leave the Products page while the import runs. New products will appear in the collection as they finish processing.


Manage imported collections

When the import starts:

  • A new collection is created, named after the website's domain (for example, example.com becomes a collection called Example).

  • If you already had a collection selected, products are added there instead.

  • The collection appears in the Products section and in the feed dropdown inside the Editor. You can rename the collection at any time from the three-dot menu.


Link your feed to an agent

After the import finishes:

  1. Click into your agent from the Dashboard.

  2. In the Editor, locate the Collections section.

  3. Assign the newly created collection to your agent.


Best practices

Review and enrich imported products

URL import only captures the information available on your website. After importing, review the collection and:

  • Add missing product descriptions

  • Add structured attributes such as size, color, or material

  • Verify pricing and image URLs

Start from a catalog or category page

For best results, start the import from:

  • Your homepage

  • A catalog page

  • A category or collection page

Avoid starting from a single product page. The more product links Vwam can discover, the more complete the feed will be.

Re-import when your catalog changes

URL import creates a snapshot of your catalog and does not continuously sync product updates. If your catalog changes significantly:

  • Re-run the URL import

  • Upload a new CSV feed

  • Use the Shopify integration for ongoing synchronization


Next steps

  • Review the generated products for accuracy and completeness.

  • Create an agent and assign the new collection in the Collections section.

  • Test your agent to confirm products display correctly.


FAQ

Which URL should I enter?

  • Use the URL of a page that links to your products — typically your homepage or a main catalog/collection page. Vwam will crawl from there to discover individual product pages.

Does URL import keep my products in sync with my website?

  • No. URL import creates a one-time snapshot. If your catalog changes, you can re-run the import or edit the collection manually. For continuous syncing, use the Shopify integration.

What if my site is behind a login or password?

  • URL import only works on publicly accessible pages. Pages behind authentication, paywalls, or staging passwords can't be scanned.

Why did my import fail with an "Invalid URL" error?

  • The URL must use HTTP or HTTPS and include a valid host. Internal addresses, localhost, and non-web protocols are blocked for security.

Can I import from more than one site?

  • Yes. Each import creates its own collection, and you can run as many imports as you need.

Can I edit products after they're imported?

  • Yes. Imported products behave like any other products in Vwam — you can edit fields, add attributes, or remove items from the collection.

Did this answer your question?