Shopify Store Database

Real-time discoverable Shopify stores with rich enrichment data. Sourced from Certificate Transparency, refreshed continuously.

⚖️ Legal compliance in progress — Fields marked "legal-gated" are included in the schema but may be withheld pending our legal review (TASK-18). Contact us for the current status.

Record Schema

Each row represents one Shopify store discovered via CT stream — DNS-fingerprinted from the Let's Encrypt cert Shopify provisions for every custom domain. Scraped from the public storefront.

Field Type Sellability Notes
shop_domain string Sellable The *.myshopify.com handle — the store's unique identifier
store_name string (nullable) Sellable Store name set by the merchant
primary_domain string (nullable) Legal-gated Real custom domain. Legally sensitive; may be withheld pending compliance review
description string (nullable) Sellable Store's meta description from the storefront
country string (nullable) Sellable Normalized to ISO 3166-1 alpha-2. Unmappable values are null
currency string (nullable) Sellable ISO 4217 three-letter currency code
product_types string[] Sellable Product-level category labels (raw from Shopify, not curated)
product_tags string[] Sellable Product-level free-form tags
vendors string[] Sellable Brands/manufacturers the store carries
contact_email string (nullable) Legal-gated Email extracted from mailto: links in the homepage. Legally sensitive
social_links string[] Legal-gated Public social profile URLs (Instagram, Facebook, TikTok, etc.)
theme_name string (nullable) Sellable Shopify theme detected from storefront markup
price_min decimal (nullable) Sellable Minimum product price (floored at 0)
price_max decimal (nullable) Sellable Maximum product price (floored at 0)
price_median decimal (nullable) Sellable Median product price (floored at 0)
product_count integer (nullable) Sellable Number of visible products in the catalog
age_band string (derived) Sellable Derived from earliest_product_at. See band definitions below
size_band string (derived) Sellable Derived from product_count. See band definitions below
growth string (derived) Sellable Derived from snapshot history. See definitions below
installed_apps string[] Sellable Detected Shopify app markers (script hosts)
payment_methods string[] Sellable Detected payment providers (Shop Pay, PayPal, Stripe, etc.)
tech_markers string[] Sellable Analytics/tracking markers (GA, Meta Pixel, TikTok, etc.)
scraped_at timestamp Sellable When this record was last refreshed from the storefront

Derived bands

Age, size, and growth are computed from raw fields and snapshot history rather than sold as raw timestamps.

Dimension Bands
Age band from earliest_product_at
  • <3 months — earliest_product_at within the last 90 days
  • 3–12 months — earliest_product_at 90–365 days ago
  • 1–2 years — earliest_product_at 1–2 years ago
  • 2+ years — earliest_product_at older than 2 years
  • unknown — earliest_product_at is null
Size band from product_count
  • 1–10 products — micro / boutique catalog
  • 11–50 products — small catalog
  • 51–200 products — medium catalog
  • 200+ products — large catalog
  • unknown — product_count is null or 0
Growth from snapshot history
  • Growing — product growth ≥ +10 (absolute) in latest snapshot period
  • Stable — product growth between -9 and +9
  • Shrinking — product growth ≤ -10
  • New — fewer than 2 countable snapshots in history

Segment & Filter Taxonomy

Buyers can filter the dataset by any combination of these dimensions. "Useful only" is on by default — it excludes locked, empty, and dead stores so you only see real businesses.

Country
Single-select
ISO 3166-1 alpha-2. Top 30 by shop count, free-text beyond
Currency
Single-select
ISO 4217. Top 30 by shop count, free-text beyond
Category
Multi-select
Raw product_types union (no controlled vocabulary). Future: curated taxonomy
Age band
Single-select
<3 months / 3–12 months / 1–2 years / 2+ years
Size band
Single-select
1–10 / 11–50 / 51–200 / 200+ products
Growth
Single-select
Growing / Stable / Shrinking / New (requires ≥2 snapshots)
Search
Free-text
Matches shop_domain, store_name, primary_domain, contact_email
Useful only
Toggle
On by default: excludes locked, empty, and dead stores
Has email
Toggle
Off by default: restricts to shops with a contact_email

Quality SLA

Published KPIs — transparent targets backed by real-time telemetry. These are observed commitments, not contractual SLAs, and will tighten as the dataset matures.

Freshness lag (p50)
≤ 35 days
Median age of the latest scrape across useful shops. Periodic SQL gauge (every 6h)
Freshness lag (p95)
≤ 90 days
95th percentile age of the latest scrape across useful shops
Dedup rate
≥ 99%
Ratio of unique discovered shops to raw discovery events
Useful ratio
≥ 3% trajectory ≥ 5% in 90 days
Fraction of scraped stores with store_name + product_count > 0. OTEL counter pair
Contact-email coverage
TBD (query live DB)
Fraction of useful shops with a non-null contact_email. OTEL counter pair

Data Freshness

Each store is rescanned automatically on a schedule that reflects its activity:

New stores are discovered continuously from the Certificate Transparency stream. At steady state, the pipeline adds thousands of new shops per day.

Sample Dataset

A deterministic sample of ~100 useful shops can be produced on demand. Contact us to request a sample CSV matching this schema.

Normalization Rules

Field Rule
Country Mapped to ISO 3166-1 alpha-2 at scrape time. Unmappable → null
Prices Floored at 0 on export. Never negative
Contact email Lowercased at scrape time
Social links Deduplicated, sorted, capped at 10
Product attributes Lowercased at scrape time (types, tags, keywords)