Commerce

Import & Data Management

Bring your existing product catalog into AvidiaTech via CSV, platform exports, or direct connector sync.

Supported Import Formats

CSV (Universal)

Recommended

Any CSV with a url column. The most flexible option.

JSON

Array of product objects. Useful when feeding from another system.

Shopify Product Export

Direct export from Shopify admin → Products → Export. No column mapping needed.

BigCommerce Export

Export from BigCommerce → Products → Export. Auto-detected column format.

CSV Column Reference

The minimum viable CSV has a single column: url. Additional columns enrich the extracted records and improve pipeline quality.

url,sku,name,brand,category,price
https://www.3m.com/3M/en_US/p/d/v000057867/,8210,3M N95 Respirator,3M,Medical PPE,24.99
https://www.boschtools.com/.../GSB-18V-755,GSB18V755,Bosch 18V Combi Drill,Bosch,Power Tools,189.00
https://www.medline.com/product/SensiCare-Gloves/Z05-PF18255,MIIMDS195085,Medline Gloves,Medline,Gloves,

Column	Required	Description
url	Required	Full product URL to extract from (manufacturer or supplier page)
sku	Optional	Your internal SKU or manufacturer part number — used for deduplication
name	Optional	Known product name — pre-fills the extracted name field if provided
brand	Optional	Brand or manufacturer name
category	Optional	Your internal category (e.g., 'Power Tools', 'Medical PPE')
price	Optional	Your selling price — not extracted, passed through directly
description	Optional	Existing description — used as context for AvidiaDescribe if provided
upc	Optional	UPC/EAN — used for matching and deduplication

Column Mapping

If your CSV uses different column names (e.g., "Product URL" instead of "url", "Item Number" instead of "sku"), the column mapping step lets you assign your columns to AvidiaTech's standard fields.

After uploading your file, you'll see a mapping UI that shows your CSV columns on the left and AvidiaTech fields on the right. Drag and drop — or use the dropdowns — to assign each column. Unmapped columns are ignored.

Save your mapping as a template if you regularly import from the same source (e.g., your Grainger export always has the same column names).

Import Validation

Before processing begins, AvidiaTech validates every row in your import. Validation checks for:

✓URL format: must start with http:// or https:// and be a valid URL structure
✓Required fields: url column must be present and non-empty
✓Deduplication: rows with URLs already in your catalog are flagged
✓Encoding: file is valid UTF-8 CSV with consistent delimiters
✓Quota check: row count is compared against your remaining credit balance

Validation results appear before you confirm the import. You can choose to skip invalid rows and proceed with valid rows, or fix the file and re-upload.

Bulk Processing After Import

Once your CSV is imported, you can trigger pipeline runs on all imported products from the import confirmation screen or later from the Products list.

From the import success screen, click Run Pipeline on All Imported Products.
Select which modules to run: Extract only, Extract + Describe, Extract + Describe + SEO, or the full pipeline.
Confirm credit usage and start the bulk job.
Monitor progress in real time under Dashboard → Imports → Bulk Jobs.

Credit note: Each module in the pipeline consumes credits per product. A full pipeline (Extract + Describe + SEO) on 500 products costs 500 extraction + 500 description + 500 SEO credits.

Import History and Error Logs

Every import is logged and accessible from Dashboard → Imports. Each import record shows:

Import date, file name, and row count
Number of rows processed, succeeded, and failed
Downloadable error log (CSV) listing failed rows with error codes
Link to the products created by the import

Download the error log, fix the failing rows, and re-import just the failed rows to minimize credit waste.

Connector Sync (Shopify / BigCommerce / WooCommerce)

If you have a platform integration connected, you can import products directly from your store — no CSV required. From Dashboard → Import, select Import from Store and choose your connected store.

You can filter which products to import: by collection, product type, vendor, tag, or products updated within a date range. AvidiaTech imports the product metadata and uses the existing product URL (from the platform) as the extraction source.

Exporting Processed Data

Once products have been processed through the pipeline, you can export the enriched data:

CSV export: Go to Products → select products → Export. Choose which fields to include (all fields, or only SEO fields, or only descriptions).
Direct push to platform: Use the integration to push processed data directly to Shopify, BigCommerce, or WooCommerce. See the Integrations guide.
API: Retrieve processed data programmatically via GET /api/v1/ingest/:id.

Handling Import Errors

Missing required column: url

Cause: Your CSV doesn't have a column named 'url' (case-sensitive).

Fix: Rename the column to "url" or use the column mapping step to assign the correct column.

Invalid URL format (row 14)

Cause: The URL in row 14 doesn't start with http:// or https://.

Fix: Ensure all URLs include the full protocol. Fix the row and re-upload, or skip it using the "Skip invalid rows" option.

Duplicate URL detected

Cause: One or more rows contain a URL that already exists in your product catalog.

Fix: Select "Skip duplicates" (default) or "Reprocess duplicates" during import configuration.

Quota exceeded

Cause: The number of rows in your CSV exceeds your remaining extraction credit balance.

Fix: Top up your credits in Billing, or use the "Limit to N products" option to import a subset.

File too large

Cause: CSV file exceeds the maximum size for your plan.

Fix: Split your CSV into smaller files (under the limit) and upload in batches.

Import Limits by Plan

Plan	Max Rows / Import	Max File Size	Concurrent Bulk Jobs
Starter	500 rows	5 MB	2 jobs
Growth	10,000 rows	50 MB	10 jobs
Scale	Unlimited	250 MB	50 jobs

Need higher limits? Upgrade your plan or contact us to discuss a custom arrangement for large catalogs.