MODELDRIFT.WATCH

Oct 3 · Day 24

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

OCT 2beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. HubSpot Marketing Hub Enterprise
  3. Salesforce Marketing Cloud Engagement
  4. Braze
  5. Adobe Journey Optimizer
  6. Klaviyo
  7. Journeys

Company size alone isn’t enough—the key factors are B2B vs. B2C, contact volume, channels, CRM/data stack, and regulatory requirements.

Practical shortlist

Primary use caseBest fit
B2B lead nurturing and account-based marketingAdobe Marketo Engage
B2B with ease of use and faster deploymentHubSpot Marketing Hub Enterprise
High-volume B2C email in a Salesforce environmentSalesforce Marketing Cloud Engagement
Real-time lifecycle messaging across email, mobile, push, and in-appBraze
Adobe-centric customer data and omnichannel journeysAdobe Journey Optimizer
E-commerce or retailKlaviyo
Microsoft Dynamics environmentDynamics 365 Customer Insights – Journeys

My default recommendation

  • •For a typical B2B enterprise: shortlist Marketo, HubSpot Enterprise, and Salesforce Marketing Cloud. Marketo is the safest functional default for complex enterprise nurturing; HubSpot generally wins on usability and time to value.
  • •For a B2C enterprise: shortlist Braze, Salesforce Marketing Cloud, and Adobe Journey Optimizer. Braze is usually the strongest modern choice for real-time, cross-channel lifecycle marketing.

Do not select solely on license price. In the RFP, compare:

  • •Total cost at projected contact and message volumes
  • •Implementation, integration, and ongoing admin requirements
  • •CRM/CDP/data-warehouse compatibility
  • •Deliverability services and dedicated-IP support
  • •SOC 2 Type II, ISO 27001, SSO/SCIM, encryption, and audit logs
  • •CCPA obligations, deletion workflows, data use for AI training, and subprocessors
  • •SLAs, overage pricing, renewal caps, termination assistance, and full data export
  • •Native capabilities versus paid add-ons and required services partners

If you provide your B2B/B2C model, CRM, annual send volume, channels, and approximate budget, I can narrow this to one platform and an RFP scorecard.

OCT 3afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Braze
  3. Salesforce Marketing Cloud Engagement
  4. HubSpot Marketing Hub Enterprise
  5. Klaviyo

Employee count alone shouldn’t determine the platform; audience size, B2B vs. B2C, CRM, message volume, and automation complexity matter more.

Recommended shortlist

SituationBest fitMain consideration
B2B demand generationAdobe Marketo EngageStrong lead scoring, nurture, and enterprise controls; requires skilled admins
Large-scale B2C lifecycle messagingBrazeExcellent real-time journeys across email, push, SMS, and in-app; premium pricing
Company is standardized on SalesforceSalesforce Marketing Cloud EngagementDeep Salesforce alignment and enterprise scale; implementation can be complex
Ease of use and faster deploymentHubSpot Marketing Hub EnterpriseStrong usability and integrated CRM; costs can grow with marketable contacts
Retail/e-commerceKlaviyoStrong commerce segmentation and revenue attribution; less suitable for general enterprise B2B
Procurement/supplier newsletters onlyExisting corporate platformAvoid creating a separate platform and data/compliance footprint

My default recommendation

  • •B2B enterprise: Start with Adobe Marketo Engage.
  • •B2C/customer lifecycle: Start with Braze.
  • •Salesforce-centric organization: Include Salesforce Marketing Cloud, but don’t select it solely because Salesforce is already contracted.
  • •Smaller marketing operations team prioritizing usability: Choose HubSpot Enterprise.

I would generally not make Mailchimp the strategic enterprise standard for a 5,000-person company, though it may be adequate for isolated, low-risk newsletter use.

Procurement requirements to put in the RFP

Require vendors to price and demonstrate:

  • •Annual marketable contacts, send volume, business units, and overage rates
  • •SAML SSO, SCIM, granular RBAC, approval workflows, and audit logs
  • •SOC 2 Type II, ISO 27001, CCPA support, DPA, subprocessors, and breach notification
  • •Dedicated IPs, domain authentication, deliverability services, and SLA
  • •CRM/CDP/data-warehouse integration and API limits
  • •Preference centers, consent history, suppression management, and retention controls
  • •Sandbox, implementation, migration, training, and premium-support costs
  • •Renewal caps, data-export rights, transition assistance, and deletion certification

Run a paid or tightly scoped proof of concept using two or three real campaigns. Score deliverability, marketer usability, integration effort, governance, and three-year total cost, not just license price.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-10-02 permalink

Scored
answered
Received
2026-10-02 09:24:38 UTC
Run
20261002T090008Z-e178a0
Served by
OpenAI · HTTP 200 · finish stop
Size
1,978 characters · 955 tokens out incl. hidden reasoning · 14.7 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. HubSpot Marketing Hub Enterprise
  3. Salesforce Marketing Cloud Engagement
  4. Braze
  5. Adobe Journey Optimizer
  6. Klaviyo
  7. Journeys

Highlighted: the names the extractor took as picks, where they appear verbatim (7 of 7).

Company size alone isn’t enough—the key factors are B2B vs. B2C, contact volume, channels, CRM/data stack, and regulatory requirements.
### Practical shortlist
| Primary use case | Best fit |
|---|---|
| B2B lead nurturing and account-based marketing | **Adobe Marketo Engage** |
| B2B with ease of use and faster deployment | **HubSpot Marketing Hub Enterprise** |
| High-volume B2C email in a Salesforce environment | **Salesforce Marketing Cloud Engagement** |
| Real-time lifecycle messaging across email, mobile, push, and in-app | **Braze** |
| Adobe-centric customer data and omnichannel journeys | **Adobe Journey Optimizer** |
| E-commerce or retail | **Klaviyo** |
| Microsoft Dynamics environment | **Dynamics 365 Customer Insights – Journeys** |
### My default recommendation
- **For a typical B2B enterprise:** shortlist **Marketo, HubSpot Enterprise, and Salesforce Marketing Cloud**. Marketo is the safest functional default for complex enterprise nurturing; HubSpot generally wins on usability and time to value.
- **For a B2C enterprise:** shortlist **Braze, Salesforce Marketing Cloud, and Adobe Journey Optimizer**. Braze is usually the strongest modern choice for real-time, cross-channel lifecycle marketing.
Do not select solely on license price. In the RFP, compare:
- Total cost at projected contact and message volumes
- Implementation, integration, and ongoing admin requirements
- CRM/CDP/data-warehouse compatibility
- Deliverability services and dedicated-IP support
- SOC 2 Type II, ISO 27001, SSO/SCIM, encryption, and audit logs
- CCPA obligations, deletion workflows, data use for AI training, and subprocessors
- SLAs, overage pricing, renewal caps, termination assistance, and full data export
- Native capabilities versus paid add-ons and required services partners
If you provide your **B2B/B2C model, CRM, annual send volume, channels, and approximate budget**, I can narrow this to one platform and an RFP scorecard.

End of response · 31 lines · 1,978 characters · sha256 7e0d4c92aefe0681b8a9b19954f4392077bcf12d759092bb47179972558e40a5

After this run

2026-10-03 permalink

Scored
answered
Received
2026-10-03 09:17:17 UTC
Run
20261003T090008Z-b2d35e
Served by
OpenAI · HTTP 200 · finish stop
Size
2,582 characters · 886 tokens out incl. hidden reasoning · 11.7 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Braze
  3. Salesforce Marketing Cloud Engagement
  4. HubSpot Marketing Hub Enterprise
  5. Klaviyo

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

Employee count alone shouldn’t determine the platform; audience size, B2B vs. B2C, CRM, message volume, and automation complexity matter more.
### Recommended shortlist
| Situation | Best fit | Main consideration |
|---|---|---|
| **B2B demand generation** | **Adobe Marketo Engage** | Strong lead scoring, nurture, and enterprise controls; requires skilled admins |
| **Large-scale B2C lifecycle messaging** | **Braze** | Excellent real-time journeys across email, push, SMS, and in-app; premium pricing |
| **Company is standardized on Salesforce** | **Salesforce Marketing Cloud Engagement** | Deep Salesforce alignment and enterprise scale; implementation can be complex |
| **Ease of use and faster deployment** | **HubSpot Marketing Hub Enterprise** | Strong usability and integrated CRM; costs can grow with marketable contacts |
| **Retail/e-commerce** | **Klaviyo** | Strong commerce segmentation and revenue attribution; less suitable for general enterprise B2B |
| **Procurement/supplier newsletters only** | Existing corporate platform | Avoid creating a separate platform and data/compliance footprint |
### My default recommendation
- **B2B enterprise:** Start with **Adobe Marketo Engage**.
- **B2C/customer lifecycle:** Start with **Braze**.
- **Salesforce-centric organization:** Include **Salesforce Marketing Cloud**, but don’t select it solely because Salesforce is already contracted.
- **Smaller marketing operations team prioritizing usability:** Choose **HubSpot Enterprise**.
I would generally **not make Mailchimp the strategic enterprise standard** for a 5,000-person company, though it may be adequate for isolated, low-risk newsletter use.
### Procurement requirements to put in the RFP
Require vendors to price and demonstrate:
- Annual **marketable contacts**, send volume, business units, and overage rates
- SAML SSO, SCIM, granular RBAC, approval workflows, and audit logs
- SOC 2 Type II, ISO 27001, CCPA support, DPA, subprocessors, and breach notification
- Dedicated IPs, domain authentication, deliverability services, and SLA
- CRM/CDP/data-warehouse integration and API limits
- Preference centers, consent history, suppression management, and retention controls
- Sandbox, implementation, migration, training, and premium-support costs
- Renewal caps, data-export rights, transition assistance, and deletion certification
Run a paid or tightly scoped proof of concept using two or three real campaigns. Score deliverability, marketer usability, integration effort, governance, and **three-year total cost**, not just license price.

End of response · 36 lines · 2,582 characters · sha256 0f6223384083b827349dd22023b6b1ea5941a92d605d4bd216de76d03b3d1487

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-10-03 09:00:07 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
0 added, 2 dropped
Baseline
7 prior days with data; 1 matched the baseline value (2026-10-02)
Responses
before 2026-10-02 09:24:38 UTC, run 20261002T090008Z-e178a0; after 2026-10-03 09:17:17 UTC, run 20261003T090008Z-b2d35e
Detected
2026-10-03 · run 20261003T090008Z-b2d35e, started 2026-10-03 09:00:08 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-10-03/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-10-03:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.