MODELDRIFT.WATCH

Oct 1 · Day 22

MINOR · GPT · QUESTION 33

GPT named a different first choice for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 30beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Journeys
  6. CRM
  7. SSO
  8. Sandbox
  9. Implementation
  10. SLA

Company size alone isn’t enough; the right choice depends mainly on whether you’re marketing to businesses or consumers and your existing CRM/data stack.

Practical shortlist

SituationBest-fit platform
B2B demand generation, lead scoring, complex nurtureAdobe Marketo Engage
Salesforce-centric enterprise, broad cross-channel campaignsSalesforce Marketing Cloud Engagement
High-volume B2C lifecycle marketing across email, mobile, and appBraze or Iterable
Ease of use and fast deployment matter more than maximum complexityHubSpot Marketing Hub Enterprise
Microsoft-centric environment seeking integrated customer journeysDynamics 365 Customer Insights – Journeys

My default recommendation

  • •B2B enterprise: Start with Adobe Marketo Engage, particularly if you have mature revenue operations and complex lead-management requirements.
  • •B2C or digital product: Start with Braze.
  • •Heavily invested in Salesforce: Favor Salesforce Marketing Cloud Engagement, but validate implementation complexity and total cost.
  • •Lean marketing operations team: Favor HubSpot Enterprise; it is generally easier to administer, though it may be less suitable for highly customized, high-scale programs.

Procurement requirements to include in the RFP

Evaluate vendors on:

  • 1.CRM, CDP, data warehouse, and identity integrations
  • 2.Deliverability tooling and dedicated-IP options
  • 3.Consent, suppression, retention, and audit capabilities
  • 4.SSO, SCIM, role-based access, SOC 2, and relevant regulatory support
  • 5.Contact and event limits—not just quoted email volume
  • 6.Sandbox, testing, approval workflows, and business-unit separation
  • 7.Implementation, migration, premium support, and partner costs
  • 8.API limits and fees for data export or additional environments
  • 9.SLA, breach notification, data ownership, and exit assistance
  • 10.Three-year total cost, including expected database growth and overages

Run a proof of concept using one real campaign, one key CRM/data integration, and an inbox-placement test. Score business-user effort and ongoing administration—not just feature breadth.

If I had to select a shortlist without further context, I would RFP Marketo, Salesforce Marketing Cloud, and HubSpot for B2B, or Braze, Iterable, and Salesforce Marketing Cloud for B2C.

OCT 1afterPermalink

Picks read from the answer, in order
  1. Salesforce Marketing Cloud Engagement
  2. Braze
  3. HubSpot Enterprise

For a 5,000-person enterprise, my default recommendation is:

Best choice by situation

  • •Salesforce Marketing Cloud Engagement — Choose if Salesforce is your strategic CRM and you need enterprise-scale email, journeys, governance, and integrations. Strongest “safe” enterprise choice, but expensive and operationally complex.
  • •Adobe Marketo Engage — Best for B2B demand generation, lead nurturing, scoring, and complex sales cycles.
  • •Braze — Best for B2C or product-led lifecycle marketing requiring real-time behavioral triggers across email, mobile, push, and in-app channels.
  • •HubSpot Marketing Hub Enterprise — Best when ease of use and rapid deployment matter more than maximum customization. Validate pricing carefully at high contact volumes.
  • •Oracle Eloqua — Consider for highly complex global B2B environments, especially if Oracle is already strategic, but it is rarely my first greenfield choice.

Practical recommendation

If you use Salesforce CRM, shortlist:

  • 1.Salesforce Marketing Cloud Engagement
  • 2.Braze for B2C, or Marketo for B2B
  • 3.HubSpot Enterprise as the usability/TCO benchmark

Run a scripted proof of concept using your actual use cases rather than feature demos.

Procurement scoring model

  • •Functional fit and journey orchestration: 25%
  • •Integration and data architecture: 20%
  • •Deliverability and sending infrastructure: 15%
  • •Security, privacy, SSO/SCIM, auditability: 15%
  • •Three-year total cost: 15%
  • •Usability, implementation, and support: 10%

Model total cost using marketable contacts, send volume, data storage, API usage, implementation partners, premium support, sandboxes, and overages—not just subscription price. Require CAN-SPAM support, SOC 2 Type II, role-based access, consent management, suppression controls, export rights, SLA credits, and transition assistance.

Bottom line: Use Salesforce Marketing Cloud if you are Salesforce-centered; Marketo for B2B; Braze for high-volume B2C lifecycle marketing; HubSpot if simplicity is the priority.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-30 permalink

Scored
answered
Received
2026-09-30 09:23:22 UTC
Run
20260930T090007Z-45ce12
Served by
OpenAI · HTTP 200 · finish stop
Size
2,416 characters · 779 tokens out incl. hidden reasoning · 13.8 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Journeys
  6. CRM
  7. SSO
  8. Sandbox
  9. Implementation
  10. SLA

Highlighted: the names the extractor took as picks, where they appear verbatim (10 of 10).

Company size alone isn’t enough; the right choice depends mainly on whether you’re marketing to businesses or consumers and your existing CRM/data stack.
### Practical shortlist
| Situation | Best-fit platform |
|---|---|
| B2B demand generation, lead scoring, complex nurture | **Adobe Marketo Engage** |
| Salesforce-centric enterprise, broad cross-channel campaigns | **Salesforce Marketing Cloud Engagement** |
| High-volume B2C lifecycle marketing across email, mobile, and app | **Braze** or **Iterable** |
| Ease of use and fast deployment matter more than maximum complexity | **HubSpot Marketing Hub Enterprise** |
| Microsoft-centric environment seeking integrated customer journeys | **Dynamics 365 Customer Insights – Journeys** |
### My default recommendation
- **B2B enterprise:** Start with **Adobe Marketo Engage**, particularly if you have mature revenue operations and complex lead-management requirements.
- **B2C or digital product:** Start with **Braze**.
- **Heavily invested in Salesforce:** Favor **Salesforce Marketing Cloud Engagement**, but validate implementation complexity and total cost.
- **Lean marketing operations team:** Favor **HubSpot Enterprise**; it is generally easier to administer, though it may be less suitable for highly customized, high-scale programs.
### Procurement requirements to include in the RFP
Evaluate vendors on:
1. CRM, CDP, data warehouse, and identity integrations
2. Deliverability tooling and dedicated-IP options
3. Consent, suppression, retention, and audit capabilities
4. SSO, SCIM, role-based access, SOC 2, and relevant regulatory support
5. Contact and event limits—not just quoted email volume
6. Sandbox, testing, approval workflows, and business-unit separation
7. Implementation, migration, premium support, and partner costs
8. API limits and fees for data export or additional environments
9. SLA, breach notification, data ownership, and exit assistance
10. Three-year total cost, including expected database growth and overages
Run a proof of concept using one real campaign, one key CRM/data integration, and an inbox-placement test. Score business-user effort and ongoing administration—not just feature breadth.
If I had to select a shortlist without further context, I would RFP **Marketo, Salesforce Marketing Cloud, and HubSpot** for B2B, or **Braze, Iterable, and Salesforce Marketing Cloud** for B2C.

End of response · 37 lines · 2,416 characters · sha256 69bfd96be93e00a36c6140fa69d485b94b83f4931f54b1fd810dd0d5837acf17

After this run

2026-10-01 permalink

Scored
answered
Received
2026-10-01 09:24:47 UTC
Run
20261001T090007Z-857bc9
Served by
OpenAI · HTTP 200 · finish stop
Size
2,106 characters · 831 tokens out incl. hidden reasoning · 15.1 s
Extracted picks, in order · confidence high
  1. Salesforce Marketing Cloud Engagement
  2. Braze
  3. HubSpot Enterprise

Highlighted: the names the extractor took as picks, where they appear verbatim (3 of 3).

For a 5,000-person enterprise, my default recommendation is:
### Best choice by situation
- **Salesforce Marketing Cloud Engagement** — Choose if Salesforce is your strategic CRM and you need enterprise-scale email, journeys, governance, and integrations. Strongest “safe” enterprise choice, but expensive and operationally complex.
- **Adobe Marketo Engage** — Best for **B2B demand generation**, lead nurturing, scoring, and complex sales cycles.
- **Braze** — Best for **B2C or product-led lifecycle marketing** requiring real-time behavioral triggers across email, mobile, push, and in-app channels.
- **HubSpot Marketing Hub Enterprise** — Best when ease of use and rapid deployment matter more than maximum customization. Validate pricing carefully at high contact volumes.
- **Oracle Eloqua** — Consider for highly complex global B2B environments, especially if Oracle is already strategic, but it is rarely my first greenfield choice.
### Practical recommendation
If you use Salesforce CRM, shortlist:
1. **Salesforce Marketing Cloud Engagement**
2. **Braze** for B2C, or **Marketo** for B2B
3. **HubSpot Enterprise** as the usability/TCO benchmark
Run a scripted proof of concept using your actual use cases rather than feature demos.
### Procurement scoring model
- Functional fit and journey orchestration: **25%**
- Integration and data architecture: **20%**
- Deliverability and sending infrastructure: **15%**
- Security, privacy, SSO/SCIM, auditability: **15%**
- Three-year total cost: **15%**
- Usability, implementation, and support: **10%**
Model total cost using **marketable contacts, send volume, data storage, API usage, implementation partners, premium support, sandboxes, and overages**—not just subscription price. Require CAN-SPAM support, SOC 2 Type II, role-based access, consent management, suppression controls, export rights, SLA credits, and transition assistance.
**Bottom line:** Use **Salesforce Marketing Cloud** if you are Salesforce-centered; **Marketo** for B2B; **Braze** for high-volume B2C lifecycle marketing; **HubSpot** if simplicity is the priority.

End of response · 32 lines · 2,106 characters · sha256 bf2fd920ad86d77030387f0ea310ec321ffc3cc5f2415d46a1d1ed2413f3b7dc

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-10-01 09:00:06 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
first extracted pick differs from the baseline's (full lists below)
Baseline
6 prior days with data; 5 matched the baseline value (2026-09-25, 2026-09-26, 2026-09-28, 2026-09-29, 2026-09-30)
Responses
before 2026-09-30 09:23:22 UTC, run 20260930T090007Z-45ce12; after 2026-10-01 09:24:47 UTC, run 20261001T090007Z-857bc9
Detected
2026-10-01 · run 20261001T090007Z-857bc9, started 2026-10-01 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-10-01/P29/openai/gpt-5.6-sol/pick_change/picks.top/
Event ID
2026-10-01:P29:openai/gpt-5.6-sol:pick_change:picks.top

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.