MODELDRIFT.WATCH

Sep 30 · Day 21

MINOR · CLAUDE · QUESTION 33

Claude changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 29beforePermalink

Picks read from the answer, in order
  1. Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot Marketing Hub Enterprise
  4. Eloqua
  5. Braze
  6. Iterable
  7. Klaviyo
  8. Transactional/API
  9. SendGrid
  10. Staffbase

The honest answer is that "email marketing platform" covers three very different procurement categories, and the right shortlist depends on which one your stakeholders actually need. Worth nailing down before you go to market:

  • 1.Marketing/campaign email — outbound to prospects and customers, usually owned by Marketing, tied to CRM
  • 2.Transactional/product email — password resets, receipts, notifications, sent via API by Engineering
  • 3.Internal employee communications — all-hands emails to your 5,000 staff, usually owned by Comms/HR

These have different vendors, different price structures, and different security reviews. If your intake request just said "email marketing platform," it's worth a 20-minute call with the requester to find out which.

Shortlists by scenario

B2B marketing (long sales cycles, lead scoring, CRM-centric)

  • •Marketo Engage (Adobe) — deepest B2B automation; expect significant implementation cost and a specialist admin
  • •Salesforce Marketing Cloud Account Engagement (formerly Pardot) — the default if you're already heavily invested in Salesforce
  • •HubSpot Marketing Hub Enterprise — fastest time-to-value, best usability, less customizable at the edges
  • •Eloqua (Oracle) — strong if you're an Oracle shop, otherwise fading in mindshare

B2C / high-volume consumer lifecycle

  • •Braze — strong cross-channel (email, push, in-app), engineering-friendly
  • •Iterable — similar space, often easier for marketers to self-serve
  • •Klaviyo — dominant in ecommerce/DTC, moving upmarket
  • •Salesforce Marketing Cloud Engagement — powerful, but complex and implementation-heavy

Transactional/API

  • •SendGrid (Twilio), Amazon SES (cheapest by far if you have engineering capacity), Postmark, Mailgun

Internal employee comms

  • •Staffbase, Firstup, PoliteMail, ContactMonkey — these integrate with Outlook/Exchange and give you open/read analytics on internal mail, which general marketing tools handle poorly

Procurement-specific things that bite people here

Pricing model is the main trap. Marketing automation is usually licensed on database size (contacts stored), not emails sent. That means your cost ratchets up as Marketing imports lists, and vendors rarely let you tier back down mid-term. Push for: a contact tier with headroom, explicit language allowing downgrade at renewal, and a defined (cheap) overage rate rather than a forced tier upgrade.

Implementation is often the bigger number. For Marketo or Marketing Cloud, systems-integrator fees commonly run 1–2x first-year license. Get SI quotes before signing the license, and consider making the license contingent on a fixed-fee SOW.

Renewal uplift caps. Get a cap (aim for 3–5%) written in for at least two renewal cycles. Without it, year-four increases of 15–20% are common.

Timing leverage. Salesforce's fiscal year ends January 31; Adobe's ends late November/early December. HubSpot and the mid-market players push hard at calendar quarter-end. Aligning your signature date accordingly is real money.

Bundling. If you already have an Adobe or Salesforce enterprise agreement, adding this SKU into that vehicle at the next true-up is usually cheaper than a standalone deal — but it also lengthens your lock-in and makes future switching harder. Worth a deliberate decision rather than a default.

Security/compliance review items: SOC 2 Type II, ISO 27001, subprocessor list, data residency (relevant if you have EU or UK data subjects — check GDPR/UK GDPR transfer mechanisms), DPA with standard contractual clauses, breach notification SLA, SSO/SCIM support, and audit-log retention. If you're in healthcare or financial services, add HIPAA BAA or applicable regulatory requirements to the RFP.

Deliverability. Ask each vendor for dedicated IP options, IP warming support, and whether deliverability consulting is included or a paid add-on. At your volume this materially affects whether the tool works at all.

Exit terms. Data export format and cost, transition assistance period, and termination-for-convenience rights. Also check auto-renewal notice windows — 60–90 days is typical and easy to miss.

Practical next step

If this is a competitive process, three bidders is the sweet spot — enough for price tension, not so many that stakeholder evaluation collapses. Run a scored RFP with Marketing as the functional evaluator and hold pricing negotiation separately after technical selection, so you're not negotiating against a foregone conclusion.

If you can tell me which of the three use cases this is, and whether you're already on Salesforce, Adobe, or Microsoft Dynamics, I can narrow the shortlist considerably and flag the specific contract clauses that matter most for those vendors.

SEP 30afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot Marketing Hub Enterprise
  4. Oracle Eloqua
  5. Braze
  6. Adobe Journey Optimizer
  7. Klaviyo
  8. B2B or B2C?

The honest answer depends on a fork I can't resolve from your question — and the fact that you're in Procurement rather than Marketing makes me want to flag it explicitly: the right platform is usually determined by marketing's use case and your existing CRM/data stack, not by procurement criteria. So my guess is you're either (a) validating a request marketing already made, (b) running a consolidation exercise because you found six email tools on the AP ledger, or (c) facing a renewal and want leverage. Those lead to different advice.

Here's the substance for each path.

The shortlist, by use case

B2B demand gen (complex nurture, lead scoring, long sales cycles):

  • •Adobe Marketo Engage — the B2B standard for your size. Powerful, requires a dedicated marketing ops person or two. Don't buy it if marketing has one generalist.
  • •Salesforce Marketing Cloud Account Engagement (formerly Pardot) — weaker than Marketo but dramatically simpler if you're a Salesforce shop.
  • •HubSpot Marketing Hub Enterprise — easiest to adopt, real enterprise features now, but contact-based pricing gets ugly as the database grows.
  • •Oracle Eloqua — still solid, especially in regulated industries; declining mindshare.

B2C / high-volume consumer messaging:

  • •Braze or Iterable — cross-channel (email, push, in-app), real-time triggering. Braze is the premium option.
  • •Salesforce Marketing Cloud Engagement — very capable, notoriously complex, usually needs an implementation partner.
  • •Adobe Journey Optimizer — if you're already committed to Adobe Experience Cloud.
  • •Klaviyo — if this is ecommerce/DTC.

Transactional email only (receipts, password resets, alerts):
Different category entirely. Twilio SendGrid, Amazon SES, or Postmark. Cheap, API-first. If someone is proposing Marketo for this, they're overbuying by an order of magnitude.

The procurement angle — where you actually add value

This is probably more useful to you than platform names:

Pricing model is the whole game. Contact-based pricing (HubSpot, Marketo) means your cost grows with database size whether or not you email those contacts. Send-based or MAU-based pricing behaves differently. Model 3-year TCO under realistic growth assumptions, not year-one list price. Ask specifically how inactive/unsubscribed contacts are counted.

Implementation is the hidden line item. For Marketo or SFMC Engagement, expect services costs of roughly 0.5–2x the year-one license, often through a third-party SI. Get that scoped before signing the license, not after.

Negotiate the renewal at initial signing. Cap annual uplift (aim for 3–5%), and shorten the auto-renewal notice window — many default to 60–90 days, which is how vendors capture renewals by inertia.

Vendor fiscal calendars matter. Salesforce's FY ends January 31; Adobe's ends late November/early December. Quarter- and year-end timing is real leverage.

Look for consolidation before you look for a platform. At 5,000 people, there's a strong chance multiple business units have separate tools (a Mailchimp here, a Constant Contact there, a SendGrid account someone's engineer set up). Rationalizing that is often a bigger win than optimizing the primary contract.

Contract terms to pin down: data egress and termination assistance (can you get your subscriber data and engagement history out, in what format, at what cost?), DPA and subprocessor list, SOC 2 Type II, and whether dedicated sending IPs are included or upsold. Deliverability is an operational risk that shows up as a marketing performance problem, not a procurement one — but it's cheaper to address in the contract.

What I'd need to know to give you a real recommendation

  • 1.B2B or B2C? Biggest single fork.
  • 2.What CRM? Salesforce, Microsoft, and Adobe shops each have a path of least resistance.
  • 3.Contact volume and monthly send volume?
  • 4.Does marketing have dedicated marketing ops headcount? This determines whether Marketo/SFMC is an asset or shelfware.
  • 5.Any regulatory constraints? HIPAA, financial services, FedRAMP change the field considerably.
  • 6.Is this a net-new buy, a replacement, or a renewal?

Two caveats: I don't have reliable current pricing — this market is heavily negotiated and list prices are mostly fiction — so use Gartner/Forrester plus a benchmarking service (Vendr, Tropic) or peer data for numbers. And my knowledge of this space has a cutoff, so verify vendor positioning and any recent acquisitions independently.

If you tell me the answers to 1–4, I can narrow this to two or three options and flag the specific negotiation traps for each.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-29 permalink

Scored
answered
Received
2026-09-29 09:26:05 UTC
Run
20260929T090007Z-334891
Served by
Claude Platform on AWS · HTTP 200 · finish stop
Size
4,836 characters · 2,950 tokens out incl. hidden reasoning · 44.1 s
Extracted picks, in order · confidence medium
  1. Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot Marketing Hub Enterprise
  4. Eloqua
  5. Braze
  6. Iterable
  7. Klaviyo
  8. Transactional/API
  9. SendGrid
  10. Staffbase

Highlighted: the names the extractor took as picks, where they appear verbatim (10 of 10).

The honest answer is that "email marketing platform" covers three very different procurement categories, and the right shortlist depends on which one your stakeholders actually need. Worth nailing down before you go to market:
1. **Marketing/campaign email** — outbound to prospects and customers, usually owned by Marketing, tied to CRM
2. **Transactional/product email** — password resets, receipts, notifications, sent via API by Engineering
3. **Internal employee communications** — all-hands emails to your 5,000 staff, usually owned by Comms/HR
These have different vendors, different price structures, and different security reviews. If your intake request just said "email marketing platform," it's worth a 20-minute call with the requester to find out which.
## Shortlists by scenario
**B2B marketing (long sales cycles, lead scoring, CRM-centric)**
- **Marketo Engage (Adobe)** — deepest B2B automation; expect significant implementation cost and a specialist admin
- **Salesforce Marketing Cloud Account Engagement (formerly Pardot)** — the default if you're already heavily invested in Salesforce
- **HubSpot Marketing Hub Enterprise** — fastest time-to-value, best usability, less customizable at the edges
- **Eloqua (Oracle)** — strong if you're an Oracle shop, otherwise fading in mindshare
**B2C / high-volume consumer lifecycle**
- **Braze** — strong cross-channel (email, push, in-app), engineering-friendly
- **Iterable** — similar space, often easier for marketers to self-serve
- **Klaviyo** — dominant in ecommerce/DTC, moving upmarket
- **Salesforce Marketing Cloud Engagement** — powerful, but complex and implementation-heavy
**Transactional/API**
- **SendGrid (Twilio)**, **Amazon SES** (cheapest by far if you have engineering capacity), **Postmark**, **Mailgun**
**Internal employee comms**
- **Staffbase**, **Firstup**, **PoliteMail**, **ContactMonkey** — these integrate with Outlook/Exchange and give you open/read analytics on internal mail, which general marketing tools handle poorly
## Procurement-specific things that bite people here
**Pricing model is the main trap.** Marketing automation is usually licensed on *database size* (contacts stored), not emails sent. That means your cost ratchets up as Marketing imports lists, and vendors rarely let you tier back down mid-term. Push for: a contact tier with headroom, explicit language allowing downgrade at renewal, and a defined (cheap) overage rate rather than a forced tier upgrade.
**Implementation is often the bigger number.** For Marketo or Marketing Cloud, systems-integrator fees commonly run 1–2x first-year license. Get SI quotes *before* signing the license, and consider making the license contingent on a fixed-fee SOW.
**Renewal uplift caps.** Get a cap (aim for 3–5%) written in for at least two renewal cycles. Without it, year-four increases of 15–20% are common.
**Timing leverage.** Salesforce's fiscal year ends January 31; Adobe's ends late November/early December. HubSpot and the mid-market players push hard at calendar quarter-end. Aligning your signature date accordingly is real money.
**Bundling.** If you already have an Adobe or Salesforce enterprise agreement, adding this SKU into that vehicle at the next true-up is usually cheaper than a standalone deal — but it also lengthens your lock-in and makes future switching harder. Worth a deliberate decision rather than a default.
**Security/compliance review items:** SOC 2 Type II, ISO 27001, subprocessor list, data residency (relevant if you have EU or UK data subjects — check GDPR/UK GDPR transfer mechanisms), DPA with standard contractual clauses, breach notification SLA, SSO/SCIM support, and audit-log retention. If you're in healthcare or financial services, add HIPAA BAA or applicable regulatory requirements to the RFP.
**Deliverability.** Ask each vendor for dedicated IP options, IP warming support, and whether deliverability consulting is included or a paid add-on. At your volume this materially affects whether the tool works at all.
**Exit terms.** Data export format and cost, transition assistance period, and termination-for-convenience rights. Also check auto-renewal notice windows — 60–90 days is typical and easy to miss.
## Practical next step
If this is a competitive process, three bidders is the sweet spot — enough for price tension, not so many that stakeholder evaluation collapses. Run a scored RFP with Marketing as the functional evaluator and hold pricing negotiation separately after technical selection, so you're not negotiating against a foregone conclusion.
If you can tell me which of the three use cases this is, and whether you're already on Salesforce, Adobe, or Microsoft Dynamics, I can narrow the shortlist considerably and flag the specific contract clauses that matter most for those vendors.

End of response · 51 lines · 4,836 characters · sha256 ec756c89ecb5b499199b4fe7aa2aeaa621a3aff41be10de0aaf441c19594e855

After this run

2026-09-30 permalink

Scored
answered
Received
2026-09-30 09:24:16 UTC
Run
20260930T090007Z-45ce12
Served by
Claude Platform on AWS · HTTP 200 · finish stop
Size
4,694 characters · 3,925 tokens out incl. hidden reasoning · 53.4 s
Extracted picks, in order · confidence medium
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot Marketing Hub Enterprise
  4. Oracle Eloqua
  5. Braze
  6. Adobe Journey Optimizer
  7. Klaviyo
  8. B2B or B2C?

Highlighted: the names the extractor took as picks, where they appear verbatim (8 of 8).

The honest answer depends on a fork I can't resolve from your question — and the fact that you're in Procurement rather than Marketing makes me want to flag it explicitly: the right platform is usually determined by marketing's use case and your existing CRM/data stack, not by procurement criteria. So my guess is you're either (a) validating a request marketing already made, (b) running a consolidation exercise because you found six email tools on the AP ledger, or (c) facing a renewal and want leverage. Those lead to different advice.
Here's the substance for each path.
## The shortlist, by use case
**B2B demand gen (complex nurture, lead scoring, long sales cycles):**
- **Adobe Marketo Engage** — the B2B standard for your size. Powerful, requires a dedicated marketing ops person or two. Don't buy it if marketing has one generalist.
- **Salesforce Marketing Cloud Account Engagement** (formerly Pardot) — weaker than Marketo but dramatically simpler if you're a Salesforce shop.
- **HubSpot Marketing Hub Enterprise** — easiest to adopt, real enterprise features now, but contact-based pricing gets ugly as the database grows.
- **Oracle Eloqua** — still solid, especially in regulated industries; declining mindshare.
**B2C / high-volume consumer messaging:**
- **Braze** or **Iterable** — cross-channel (email, push, in-app), real-time triggering. Braze is the premium option.
- **Salesforce Marketing Cloud Engagement** — very capable, notoriously complex, usually needs an implementation partner.
- **Adobe Journey Optimizer** — if you're already committed to Adobe Experience Cloud.
- **Klaviyo** — if this is ecommerce/DTC.
**Transactional email only (receipts, password resets, alerts):**
Different category entirely. **Twilio SendGrid**, **Amazon SES**, or **Postmark**. Cheap, API-first. If someone is proposing Marketo for this, they're overbuying by an order of magnitude.
## The procurement angle — where you actually add value
This is probably more useful to you than platform names:
**Pricing model is the whole game.** Contact-based pricing (HubSpot, Marketo) means your cost grows with database size whether or not you email those contacts. Send-based or MAU-based pricing behaves differently. Model 3-year TCO under realistic growth assumptions, not year-one list price. Ask specifically how inactive/unsubscribed contacts are counted.
**Implementation is the hidden line item.** For Marketo or SFMC Engagement, expect services costs of roughly 0.5–2x the year-one license, often through a third-party SI. Get that scoped before signing the license, not after.
**Negotiate the renewal at initial signing.** Cap annual uplift (aim for 3–5%), and shorten the auto-renewal notice window — many default to 60–90 days, which is how vendors capture renewals by inertia.
**Vendor fiscal calendars matter.** Salesforce's FY ends January 31; Adobe's ends late November/early December. Quarter- and year-end timing is real leverage.
**Look for consolidation before you look for a platform.** At 5,000 people, there's a strong chance multiple business units have separate tools (a Mailchimp here, a Constant Contact there, a SendGrid account someone's engineer set up). Rationalizing that is often a bigger win than optimizing the primary contract.
**Contract terms to pin down:** data egress and termination assistance (can you get your subscriber data and engagement history out, in what format, at what cost?), DPA and subprocessor list, SOC 2 Type II, and whether dedicated sending IPs are included or upsold. Deliverability is an operational risk that shows up as a marketing performance problem, not a procurement one — but it's cheaper to address in the contract.
## What I'd need to know to give you a real recommendation
1. **B2B or B2C?** Biggest single fork.
2. **What CRM?** Salesforce, Microsoft, and Adobe shops each have a path of least resistance.
3. **Contact volume and monthly send volume?**
4. **Does marketing have dedicated marketing ops headcount?** This determines whether Marketo/SFMC is an asset or shelfware.
5. **Any regulatory constraints?** HIPAA, financial services, FedRAMP change the field considerably.
6. **Is this a net-new buy, a replacement, or a renewal?**
Two caveats: I don't have reliable current pricing — this market is heavily negotiated and list prices are mostly fiction — so use Gartner/Forrester plus a benchmarking service (Vendr, Tropic) or peer data for numbers. And my knowledge of this space has a cutoff, so verify vendor positioning and any recent acquisitions independently.
If you tell me the answers to 1–4, I can narrow this to two or three options and flag the specific negotiation traps for each.

End of response · 49 lines · 4,694 characters · sha256 ae119e344c55e45096e13c0ed15d41c847b199cbc379548be3f2e6bb4a356679

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
anthropic/claude-opus-5
pinned anthropic/claude-opus-5-20260723; alias resolved to anthropic/claude-opus-5-20260723 at 2026-09-30 09:00:07 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
2 added, 4 dropped
Baseline
4 prior days with data; 1 matched the baseline value (2026-09-29)
Responses
before 2026-09-29 09:26:05 UTC, run 20260929T090007Z-334891; after 2026-09-30 09:24:16 UTC, run 20260930T090007Z-45ce12
Detected
2026-09-30 · run 20260930T090007Z-45ce12, started 2026-09-30 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-30/P29/anthropic/claude-opus-5/pick_change/picks/
Event ID
2026-09-30:P29:anthropic/claude-opus-5:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.