Order Validation & Automation — User Guide
Order Validation & Automation is a Shopify app by NV Trends that automatically reviews every new order against rules you define. When an order matches a rule, the app can tag it, cancel it, or place its fulfillment on hold — instantly, without anyone watching the order list.
This guide walks you through the entire app, from installation to advanced duplicate detection, in simple step-by-step instructions.
What the app can do
| Capability | What it means for you |
|---|---|
| Rule-based order checks | Every new order is evaluated against your active rules the moment it is created. |
| Duplicate order detection | Compare a new order with the customer’s previous orders — same email, same product, same address, same total. |
| Automatic tagging | Add tags like REVIEW or DUPLICATE_ORDER so flagged orders stand out instantly. |
| Order cancellation | Cancel orders that match strong validation rules, with a reason and an internal staff note. |
| Fulfillment holds | Stop an order from shipping until your team has reviewed it. |
| Full diagnostics | See exactly which orders were checked, which rules matched, and what actions ran. |
Before you begin
You need:
- A Shopify store with admin access.
- The Order Validation & Automation app installed from the Shopify App Store.
- Permission to approve app charges if you plan to use a paid plan (the Free plan needs no charge approval).
During installation, Shopify will ask you to approve the app’s permissions for reading and writing orders and managing fulfillment holds. These are required for the app’s three actions to work.
The app at a glance
After installation, the app opens inside your Shopify admin with three main areas:
| Area | Purpose |
|---|---|
| Rules | Create, edit, enable, disable, duplicate, and delete your validation rules. |
| Billing | View your current plan, monthly usage, and upgrade or downgrade at any time. |
| Diagnostics | Verify webhooks are healthy and review every order check and action result. |
Step 1 — Create your first rule
The fastest way to understand the app is to build a simple tagging rule. This example tags every order over $500 for review.
- Open the app and go to Rules.
- Click Create new rule.
- Give the rule a clear name, for example
High value order review. - In the conditions section, set up one condition:
- Field:
Total Price - Operator:
Greater Than - Tick Custom value and enter
500
- Field:
- In the actions section, choose Add tags and enter a tag such as
REVIEW. - Check the Live summary panel on the right — it describes in plain language exactly what the rule will do.
- Save the rule and make sure its status is Active.
That’s it. From now on, any new order above $500 is tagged REVIEW automatically. Place a test order in a development store to see it work, then check Diagnostics to see the execution record.
Tip: Start every new rule idea with a tagging action first. Once Diagnostics confirms the rule matches exactly the orders you expect, upgrade the action to cancel or hold.
Step 2 — Understand how rules work
Every rule is built from the same four parts:
- Rule name — a clear label for your team.
- Compare with — which previous orders (if any) the new order is compared against.
- Conditions — the checks that decide whether the rule matches.
- Actions — what happens when the rule matches.
Compare with (comparison window)
Compare with controls how many previous orders are checked when a rule compares the new order against order history:
| Option | What is compared |
|---|---|
Last order | The customer’s most recent previous order |
Last 2 order | The two most recent previous orders |
Last 5 order | The five most recent previous orders |
Current day order | All previous orders placed today |
Last 2 days order | All orders from the last two days |
Last 5 days order | All orders from the last five days |
Day-based options use efficient Shopify order search queries, so they stay fast even on stores with a large order history.
Group logic — AND / OR
Conditions live inside a group, and the group’s logic controls how they combine:
- AND — every condition in the group must match.
- OR — any single condition in the group can match.
You can also add one nested group inside the root group to mix logic. For example:
- Customer Email equals the current order’s email — AND —
- nested group (OR): Shipping Country matches, or Billing Country matches.
Conditions — supported order fields
Rules can check any of these fields on the order:
| Customer & contact | Money & status | Shipping & billing | Products & content |
|---|---|---|---|
| Customer Email | Total Price | Shipping Address Line 1 | Line Item SKU |
| Customer Phone | Subtotal Price | Shipping Country | Line Item Product Title |
| Customer Tags | Currency | Billing Address Line 1 | Line Item Vendor |
| Financial Status | Billing Country | Discount Codes | |
| Fulfillment Status | Shipping Method Title | Note | |
| Payment Gateway Names | Tags | ||
| Risk Level | PO Number |
Operators
| Text comparison | Numeric comparison | List & empty checks |
|---|---|---|
| Equals | Greater Than | In List |
| Not Equals | Less Than | Not In List |
| Contains | Greater Than Or Equal | Is Empty |
| Not Contains | Less Than Or Equal | Is Not Empty |
| Starts With | ||
| Ends With |
Custom value vs. field comparison
Each condition can compare against one of two things:
- Custom value (checkbox ticked) — you type the value yourself, e.g.
Total Price Greater Than 500. - Field comparison (checkbox unticked) — the new order is compared with the same field on a previous order, e.g.
Customer Email Equals [Customer Email]. This is the foundation of duplicate detection.
Step 3 — Set up duplicate order detection
This is the app’s most powerful feature. The recipe below flags orders that look like accidental duplicates.
- Go to Rules and click Create new rule.
- Name it
Duplicate order review. - Set Compare with to
Last 5 order. - Keep group logic on AND, and add these four conditions, each in field comparison mode (Custom value unticked):
Customer EmailEquals[Customer Email]Total PriceEquals[Total Price]Shipping Address Line 1Equals[Shipping Address Line 1]Line Item SKUContains[Line Item SKU]
- Add the action Add tags with tags
REVIEWandDUPLICATE_ORDER. - Save the rule.
Now, whenever a new order matches a previous order on all four signals, it is tagged immediately.
Why four conditions? A single field (like email alone) flags every repeat customer. Combining email, total, address, and product gives reliable duplicate detection with very few false positives.
Note on SKUs: if both the new and the previous order have blank SKUs, the app treats that as a match for the SKU condition. This keeps duplicate detection working on stores that don’t assign SKUs to every product.
Step 4 — Choose your actions
When a rule matches, its actions run in the order you arrange them. You can add several actions to one rule and reorder them with the up/down controls.
Add tags
Adds one or more tags to the order.
- Existing order tags are always preserved.
- Duplicate tags are never added twice.
- Best for “soft” review workflows — the order continues normally but is clearly flagged.
Cancel order
Cancels the order through Shopify’s official API.
- You choose the cancellation reason and an optional internal staff note.
- The app never cancels an order that is already cancelled.
- Use this only for strong validation cases you are confident about.
Set hold on fulfillment
Places the order’s fulfillment on hold so it cannot ship until released.
- If the order has multiple fulfillments, the app applies the hold to each one.
- If Shopify rejects a hold, the reason is logged in Diagnostics.
- Ideal when you want a human to review the order before it ships.
Recommended combination: Add tags first, then Set hold on fulfillment. The tag makes the order easy to find; the hold makes sure it waits for review.
Step 5 — Pick the right plan
The app uses simple monthly plans, billed securely through Shopify’s billing system on a 30-day cycle.
| Plan | Price | Free trial | Orders validated / month | Active rules |
|---|---|---|---|---|
| Free | $0 | — | 50 | 1 |
| Starter | $10 / month | 5 days | 500 | 3 |
| Growth | $25 / month | 5 days | 2,500 | 8 |
| Unlimited | $50 / month | 5 days | Unlimited | Unlimited |
All paid plans start with a 5-day free trial the first time you subscribe — you are only charged after the trial ends, and you can cancel anytime during the trial at no cost. Switching between paid plans later does not restart the trial.
How to change plans
- Open the app and go to Billing.
- Review your current usage — orders processed this cycle and rules in use.
- Click Choose plan on the plan you want.
- Approve the charge on the Shopify confirmation page (paid plans only).
- You are returned to the app with the new plan active.
Downgrading to Free cancels the paid subscription automatically — no support ticket needed.
What happens at the quota limit
If your store reaches its monthly order quota:
- New orders are still received and logged — nothing is ever blocked, delayed, or lost.
- Rule actions are safely skipped, and each skipped order is recorded as
QUOTA_EXCEEDEDin Diagnostics. - Actions resume automatically when the cycle resets, or immediately after an upgrade.
What happens after a downgrade
If the new plan allows fewer active rules than you currently have, the extra rules are automatically switched to Inactive (never deleted). The most recently updated rules stay active first. You can re-enable rules anytime within your plan’s limit.
Step 6 — Verify everything with Diagnostics
The Diagnostics page is your window into what the app is doing.
It shows:
- current webhook subscriptions and their callback URLs
- recent webhook events with processing status
- recent rule executions with matched / not matched results
- per-condition evaluation traces — which conditions passed, which failed, and which previous order was compared
- action results with success or failure details
The app retains the latest 100 webhook events and 100 rule executions per store, and you can clear them anytime with Clear diagnostics.
Troubleshooting checklist
| Problem | What to do |
|---|---|
| A rule did not match | Open Diagnostics and read the evaluation trace — it lists each condition with the expected and actual values, so you can see exactly which check failed. |
| Tags were added but the hold was not applied | Check the action result in Diagnostics. If Shopify rejected the hold, the reason is logged there. |
| Orders are not being checked at all | In Diagnostics, confirm the ORDERS_CREATE webhook subscription exists and the callback URL is current. If not, click Re-register webhooks. |
| Rules became inactive after a plan change | This is the automatic rule-limit enforcement after a downgrade. Re-enable the rules you need within your plan’s limit, or upgrade. |
Best practices
- Name rules clearly —
Duplicate order reviewbeatsRule 3when reading Diagnostics later. - Combine multiple fields for duplicate detection — email + total + address + product is far more reliable than any single field.
- Start soft, then escalate — begin with
Add tags, confirm matches in Diagnostics, then addSet hold on fulfillmentorCancel order. - Reserve cancellation for certainty — cancelling is the strongest action; use it only for rules with a proven match record.
- Check Diagnostics after every rule change — place a test order and confirm the rule behaves as expected before relying on it.
Frequently asked questions
Does the app slow down my checkout or storefront? No. The app works entirely after an order is created, through Shopify’s webhook system. It never touches your storefront, theme, or checkout.
Can I test rules without affecting real orders? Yes — install the app on a Shopify development store, create your rules, and place test orders. Diagnostics shows every evaluation in detail.
What happens to my rules if I uninstall and reinstall? Your rule configurations are preserved on our side. Paid subscriptions are cancelled by Shopify on uninstall, so you simply pick a plan again after reinstalling.
How is billing handled? All charges go through Shopify’s own billing system and appear on your regular Shopify invoice. You can change or cancel your plan anytime from the app’s Billing page.
Getting help
- Use the in-app support widget (chat button in the corner of any app page) to message our team directly.
- Email us at support@nvtrends.com.
- See the product overview and pricing for a feature summary.
