MODELDRIFT.WATCH

Sep 14 · Day 5

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 13beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. Iterable
  5. Oracle Eloqua
  6. HubSpot Marketing Hub Enterprise

Employee count alone isn’t enough; the best choice depends on whether you’re primarily B2B, B2C, or sending transactional/lifecycle communications.

My practical shortlist

SituationBest fit
B2B demand generation, complex lead scoring, Adobe ecosystemAdobe Marketo Engage
Salesforce-centric enterprise with broad marketing-cloud needsSalesforce Marketing Cloud
High-volume B2C lifecycle and omnichannel engagementBraze
B2C engagement with strong experimentation and journey flexibilityIterable
Enterprise B2B with highly complex campaigns/governanceOracle Eloqua
Ease of use and rapid deployment outweigh maximum complexityHubSpot Marketing Hub Enterprise

Default recommendation

  • •For a typical 5,000-person B2B enterprise: shortlist Marketo, Salesforce Marketing Cloud, and HubSpot Enterprise. Marketo is the safest functional default for mature demand generation.
  • •For a consumer-facing or high-volume digital business: shortlist Braze, Iterable, and Salesforce Marketing Cloud. Braze is usually the strongest default for real-time lifecycle engagement.
  • •If Salesforce is already your strategic CRM/CDP vendor: give Salesforce Marketing Cloud a commercial advantage, but do not sole-source it—the implementation burden and total cost can be substantial.

Procurement scorecard

Weight the RFP approximately as follows:

  • •Use cases and journey orchestration: 25%
  • •Integration with CRM, CDP, data warehouse, and identity stack: 20%
  • •Deliverability, throughput, and SLA: 15%
  • •Security, privacy, RBAC, auditability, and SSO/SCIM: 15%
  • •Three-year total cost of ownership: 15%
  • •Usability, implementation effort, and vendor support: 10%

Model TCO beyond subscription fees: contact/profile tiers, message overages, data retention, API usage, dedicated IPs, sandboxes, premium support, implementation partners, and required adjacent modules. Negotiate renewal caps, overage bands, data-export rights, SLA credits, and transition assistance.

Bottom line: choose Marketo for enterprise B2B, Braze for high-volume B2C, or Salesforce Marketing Cloud when Salesforce ecosystem consolidation is the dominant requirement.

SEP 14afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Braze
  3. Salesforce Marketing Cloud Engagement
  4. HubSpot Marketing Hub Enterprise
  5. Oracle Eloqua

Company size alone shouldn’t determine the platform. The primary decision is whether you are running B2B demand generation or high-volume B2C lifecycle messaging.

Recommended shortlist

SituationBest fit
B2B lead nurturing, scoring, and complex campaignsAdobe Marketo Engage
B2C lifecycle, mobile/app events, real-time personalizationBraze
Salesforce is your strategic CRM and integration standardization matters mostSalesforce Marketing Cloud Engagement
Ease of use and lower administrative overhead outweigh maximum complexityHubSpot Marketing Hub Enterprise
Very complex global enterprise marketing with an existing Oracle footprintOracle Eloqua

My default recommendation

  • •Typical 5,000-person B2B enterprise: Start with Marketo Engage, with Salesforce Marketing Cloud as the principal alternative.
  • •B2C, product-led, retail, or app-centric enterprise: Start with Braze, with Salesforce Marketing Cloud or Iterable as alternatives.
  • •If you want one platform primarily because Salesforce is already deeply embedded: Choose Salesforce Marketing Cloud, but budget carefully for implementation, specialist labor, and add-on modules.

I would not select Mailchimp or a similar SMB-oriented ESP as the enterprise system of record, though it may remain suitable for isolated departmental use.

Procurement issues that often change the winner

Evaluate three-year total cost, not subscription price alone:

  • 1.Pricing unit: contacts, active profiles, database size, messages, API events, or business units.
  • 2.Implementation: migration, templates, journeys, CRM/CDP integration, IP warming, and deliverability support.
  • 3.Operating labor: required administrators, developers, and agency support.
  • 4.Security: SSO, SCIM, RBAC, audit logs, SOC reports, incident notification, and data deletion.
  • 5.Data rights: AI-training restrictions, subprocessors, retention, portability, and exit assistance.
  • 6.Deliverability: dedicated IP options, sender reputation support, suppression handling, and SLA language.
  • 7.Contract protections: profile-growth bands, overage caps, renewal caps, divestiture rights, and transition periods.

Run a paid proof of concept using three real campaigns and require vendors to quote the same contact volume, message volume, integrations, environments, and support level. For most enterprises, the final decision should be between Marketo and Salesforce Marketing Cloud for B2B, or Braze and Salesforce Marketing Cloud for B2C.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-13 permalink

Scored
answered
Received
2026-09-13 09:16:08 UTC
Run
20260913T090021Z-a7390a
Served by
OpenAI · HTTP 200 · finish stop
Size
2,274 characters · 745 tokens out incl. hidden reasoning · 17.1 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. Iterable
  5. Oracle Eloqua
  6. HubSpot Marketing Hub Enterprise

Highlighted: the names the extractor took as picks, where they appear verbatim (6 of 6).

Employee count alone isn’t enough; the best choice depends on whether you’re primarily B2B, B2C, or sending transactional/lifecycle communications.
### My practical shortlist
| Situation | Best fit |
|---|---|
| B2B demand generation, complex lead scoring, Adobe ecosystem | **Adobe Marketo Engage** |
| Salesforce-centric enterprise with broad marketing-cloud needs | **Salesforce Marketing Cloud** |
| High-volume B2C lifecycle and omnichannel engagement | **Braze** |
| B2C engagement with strong experimentation and journey flexibility | **Iterable** |
| Enterprise B2B with highly complex campaigns/governance | **Oracle Eloqua** |
| Ease of use and rapid deployment outweigh maximum complexity | **HubSpot Marketing Hub Enterprise** |
### Default recommendation
- **For a typical 5,000-person B2B enterprise:** shortlist **Marketo, Salesforce Marketing Cloud, and HubSpot Enterprise**. Marketo is the safest functional default for mature demand generation.
- **For a consumer-facing or high-volume digital business:** shortlist **Braze, Iterable, and Salesforce Marketing Cloud**. Braze is usually the strongest default for real-time lifecycle engagement.
- **If Salesforce is already your strategic CRM/CDP vendor:** give Salesforce Marketing Cloud a commercial advantage, but do not sole-source it—the implementation burden and total cost can be substantial.
### Procurement scorecard
Weight the RFP approximately as follows:
- Use cases and journey orchestration: **25%**
- Integration with CRM, CDP, data warehouse, and identity stack: **20%**
- Deliverability, throughput, and SLA: **15%**
- Security, privacy, RBAC, auditability, and SSO/SCIM: **15%**
- Three-year total cost of ownership: **15%**
- Usability, implementation effort, and vendor support: **10%**
Model TCO beyond subscription fees: contact/profile tiers, message overages, data retention, API usage, dedicated IPs, sandboxes, premium support, implementation partners, and required adjacent modules. Negotiate renewal caps, overage bands, data-export rights, SLA credits, and transition assistance.
**Bottom line:** choose **Marketo for enterprise B2B**, **Braze for high-volume B2C**, or **Salesforce Marketing Cloud when Salesforce ecosystem consolidation is the dominant requirement**.

End of response · 33 lines · 2,274 characters · sha256 cb2abbdaec1685ecb9ba8be4e122fb5defa7224b1875702b7bb8a382cb203529

After this run

2026-09-14 permalink

Scored
answered
Received
2026-09-14 09:29:34 UTC
Run
20260914T090022Z-e98262
Served by
OpenAI · HTTP 200 · finish stop
Size
2,603 characters · 1,032 tokens out incl. hidden reasoning · 18.7 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Braze
  3. Salesforce Marketing Cloud Engagement
  4. HubSpot Marketing Hub Enterprise
  5. Oracle Eloqua

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

Company size alone shouldn’t determine the platform. The primary decision is whether you are running **B2B demand generation** or **high-volume B2C lifecycle messaging**.
### Recommended shortlist
| Situation | Best fit |
|---|---|
| B2B lead nurturing, scoring, and complex campaigns | **Adobe Marketo Engage** |
| B2C lifecycle, mobile/app events, real-time personalization | **Braze** |
| Salesforce is your strategic CRM and integration standardization matters most | **Salesforce Marketing Cloud Engagement** |
| Ease of use and lower administrative overhead outweigh maximum complexity | **HubSpot Marketing Hub Enterprise** |
| Very complex global enterprise marketing with an existing Oracle footprint | **Oracle Eloqua** |
### My default recommendation
- **Typical 5,000-person B2B enterprise:** Start with **Marketo Engage**, with Salesforce Marketing Cloud as the principal alternative.
- **B2C, product-led, retail, or app-centric enterprise:** Start with **Braze**, with Salesforce Marketing Cloud or Iterable as alternatives.
- **If you want one platform primarily because Salesforce is already deeply embedded:** Choose **Salesforce Marketing Cloud**, but budget carefully for implementation, specialist labor, and add-on modules.
I would not select Mailchimp or a similar SMB-oriented ESP as the enterprise system of record, though it may remain suitable for isolated departmental use.
### Procurement issues that often change the winner
Evaluate three-year total cost, not subscription price alone:
1. **Pricing unit:** contacts, active profiles, database size, messages, API events, or business units.
2. **Implementation:** migration, templates, journeys, CRM/CDP integration, IP warming, and deliverability support.
3. **Operating labor:** required administrators, developers, and agency support.
4. **Security:** SSO, SCIM, RBAC, audit logs, SOC reports, incident notification, and data deletion.
5. **Data rights:** AI-training restrictions, subprocessors, retention, portability, and exit assistance.
6. **Deliverability:** dedicated IP options, sender reputation support, suppression handling, and SLA language.
7. **Contract protections:** profile-growth bands, overage caps, renewal caps, divestiture rights, and transition periods.
Run a paid proof of concept using three real campaigns and require vendors to quote the same contact volume, message volume, integrations, environments, and support level. For most enterprises, the final decision should be between **Marketo and Salesforce Marketing Cloud for B2B**, or **Braze and Salesforce Marketing Cloud for B2C**.

End of response · 33 lines · 2,603 characters · sha256 da1493bbae27101722ae42ea2abb6ac0717d96c05b936acec13952dbad181f94

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-14 09:00:21 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
0 added, 1 dropped
Baseline
4 prior days with data; 1 matched the baseline value (2026-09-13)
Responses
before 2026-09-13 09:16:08 UTC, run 20260913T090021Z-a7390a; after 2026-09-14 09:29:34 UTC, run 20260914T090022Z-e98262
Detected
2026-09-14 · run 20260914T090022Z-e98262, started 2026-09-14 09:00:22 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-14/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-14:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.