Most e-commerce teams say they care about testing, but a surprising number still judge success with one narrow question: did conversion rate go up?
That lens feels clean, simple, and easy to report on. It also leaves out a big part of the story.
A store can lift conversion rate and still make weaker decisions. It can sell more units by discounting too aggressively, attract lower-value orders with the wrong offer, or push shoppers through checkout in a way that hurts margin. On paper, the test looks like a win. In the business, it may not be one.
That is where Drew Marconi and Intelligems stand out. Instead of treating experimentation as a series of surface-level CRO wins, Marconi’s broader message is that e-commerce brands should test the parts of the business that actually shape profit. That means looking beyond headline metrics and focusing on the levers that affect revenue quality, margin, and long-term growth.
For brands selling on Shopify, that shift matters more than ever.
Why conversion rate became the default metric
There is a reason conversion rate became the center of e-commerce testing. It is easy to understand, easy to measure, and easy to compare. If one version of a page converts more visitors than another, the result feels obvious.
For a long time, that was enough to shape most optimization programs. Brands ran classic A/B testing experiments on headlines, product page layouts, button copy, hero images, or page design. These tests still have value. They can improve clarity, reduce friction, and make the shopping experience smoother.
The problem starts when teams assume that conversion rate is the most important outcome in every situation.
It is not hard to imagine a test that increases conversion while lowering overall business quality. A deeper discount may convince more shoppers to buy, but it may also shrink margin. A free shipping threshold might drive more checkouts, yet reduce profitability if it is set too low. A promotional offer can raise short-term sales while training customers to wait for deals.
That is why conversion rate works best as part of the story, not the whole story.
Drew Marconi’s view of experimentation feels more commercial
What makes Drew Marconi’s perspective interesting is that it treats testing less like a design exercise and more like a business discipline.
That sounds subtle, but it changes everything.
When experimentation is reduced to cosmetic changes, teams end up chasing minor gains in page performance. When experimentation is treated as a commercial strategy, the questions become more valuable. What price creates the best balance between demand and margin? What shipping structure improves order value without turning shoppers away? What offer actually helps the business, not just the click-through rate?
That is much closer to how Intelligems talks about its platform. The company’s positioning is centered on testing the real profit levers of an e-commerce business, including prices, discounts, offers, thresholds, shipping rates, content, personalization, and checkout experiences.
That broader framing matters because it pushes brands to stop treating growth as a traffic problem alone. Often, the biggest gains come from making smarter decisions inside the store itself.
The levers that matter most are often the ones brands avoid testing
A lot of e-commerce brands test the easy things first.
They will test a headline, a layout tweak, or a new image treatment because those changes feel safe. They are easier to launch, easier to explain internally, and less intimidating than touching price or shipping.
But the areas that feel more sensitive are often the ones with the biggest business impact.
Pricing is a good example. Many brands set prices based on instinct, competitor watching, or broad assumptions about what customers will tolerate. That may feel strategic, but it is still guesswork unless it is tested. The same goes for discount testing, promotional offers, bundles, and free shipping thresholds.
These choices shape more than conversion. They influence average order value, profit per visitor, customer expectations, and overall margin.
This is where Marconi’s approach feels especially relevant. Instead of encouraging brands to only optimize presentation, it opens the door to testing the commercial structure behind the shopping experience.
Intelligems expands the definition of e-commerce testing
That broader mindset is one reason Intelligems has carved out a distinct place in the e-commerce experimentation space.
Traditional testing tools often focus on page-level variations. Intelligems pushes further. It gives brands ways to test product prices in real time, compare offer structures, experiment with shipping setups, and run content and onsite optimization experiments across key parts of the funnel.
That shift is important because modern e-commerce is not only about persuading a visitor to click buy. It is about understanding which experience produces the best business result.
A brand might discover that a slightly higher price lowers conversion rate a little but produces stronger profit. Another might learn that a different free shipping threshold lifts AOV enough to offset the change in shopper behavior. Another could find that a different offer works better for a specific audience segment instead of the whole market.
Those are not vanity wins. Those are operating decisions.
Why profit per visitor is becoming a smarter north star
One of the most useful ideas in this conversation is the shift from chasing raw conversion to studying profit per visitor and other profit-aware metrics.
That does not mean conversion rate no longer matters. It still matters. It just should not be treated as the only scoreboard.
For e-commerce teams under pressure, this is a much healthier way to think. Paid acquisition costs are higher than they used to be. Margins are tighter. Consumers are more price aware. Promotions are harder to use carelessly.
In that environment, a test that improves conversion but weakens profitability is not really a win. It is just a prettier report.
A more mature experimentation program asks better questions. Did this change improve gross profit? Did it raise revenue quality? Did it increase the value of each session, each order, or each segment of traffic? Did it support healthier economics over time?
That is the difference between optimization theater and meaningful experimentation.
Personalization becomes more useful when it can be measured
Personalization is one of the most overused words in e-commerce.
Brands talk about it constantly, but in practice, a lot of personalization still runs on assumptions. Teams change messaging, offers, product recommendations, or layouts for different audiences without always knowing whether those changes are producing better results.
This is where the connection between personalization and experimentation becomes powerful.
Intelligems has leaned further into this area, especially through its investment in personalizations, audience targeting, and the acquisition of Because. The logic behind that move is straightforward. A personalized experience is much more valuable when it can be tested, measured, and improved.
Instead of guessing what returning visitors want, brands can compare targeted experiences. Instead of assuming a certain offer will work for a certain segment, they can validate it. Instead of pushing the same promotion to everyone, they can study which approach performs best by audience, traffic source, or shopper behavior.
That kind of testing brings accountability to customer segmentation and shopping experience design.
Checkout is no longer just a fixed endpoint
For years, many brands treated checkout as a place you reached after the real optimization work was done.
That is no longer true.
Checkout has become one of the most important environments in the purchase journey because it sits closest to revenue. Small changes there can affect completion rate, order value, trust, and the overall economics of the sale.
Intelligems has been vocal about checkout testing and checkout personalizations, which signals something bigger about where e-commerce optimization is headed. Brands are no longer satisfied with testing only upper-funnel visuals. They want to understand how messaging, offers, and experience changes behave closer to the point of purchase.
That matters because the shopper’s decision is often shaped by what happens late in the funnel. Shipping clarity, offer framing, urgency, bundling logic, and checkout messaging can all influence whether the order happens and what that order is worth.
When brands start testing checkout seriously, they move from generic optimization to much more intentional purchase journey optimization.
Why this approach matters more in a margin-conscious market
The timing of this shift matters.
E-commerce brands are operating in a tougher environment than the one many of them grew up in. Growth is not as cheap. Paid social is less forgiving. Customer acquisition is more expensive. Founders and operators are under more pressure to justify decisions with real economics.
That makes Marconi’s broader view of experimentation feel especially practical.
Testing is no longer just about squeezing out another conversion lift from the same page template. It is about building a store that makes smarter decisions across pricing, offers, shipping, merchandising, and customer experience.
In other words, testing becomes part of how a brand manages risk.
Instead of rolling out a major price change across the whole store and hoping it works, the team can validate it. Instead of assuming a free shipping threshold is right because competitors use it, they can measure it. Instead of launching personalization that sounds smart in a strategy meeting, they can see whether it actually improves performance.
That is a more disciplined way to grow.
E-commerce testing is growing up
There was a time when experimentation in e-commerce felt like a side project. It lived with a growth manager, a CRO consultant, or a small team focused mostly on page tweaks.
Today, the best experimentation programs feel much more integrated into the business.
They inform pricing strategy. They shape offer logic. They help teams understand segment-level performance. They connect analytics to decision-making. And increasingly, they benefit from smarter tooling, better data access, and AI-assisted workflows that help operators move faster without losing rigor.
That is part of what makes Intelligems relevant right now. The company is not just talking about tests in the old sense. It is building around a more complete idea of e-commerce experimentation, one that connects analytics, personalization, checkout, and profit-focused decision-making.
And that is why Drew Marconi’s perspective lands. He is not simply arguing for more tests. He is pushing for better tests, tied to the numbers that actually matter.
What Drew Marconi’s approach signals for the future of e-commerce
The most interesting part of this story is not only what it says about one company. It says something about where e-commerce itself is heading.
The next phase of optimization will likely be less obsessed with isolated lift metrics and more focused on the full commercial picture. Brands will care more about who converted, what they bought, what it cost to acquire them, what the margin looked like, and whether the change can scale without weakening the business.
That means the future belongs to experiments that are more connected to pricing strategy, offer optimization, shipping strategy, checkout experience, and data-backed personalization.
From that perspective, Drew Marconi is pushing e-commerce testing in a direction that feels overdue. Beyond conversion rate is where the harder questions live. It is also where the more valuable answers tend to be.