MODELDRIFT.WATCH

Sep 12 · Day 3

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 11beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Adobe Journey Optimizer

Company size alone shouldn’t determine the platform. For a 5,000-person US enterprise, I’d create this shortlist:

Primary use caseBest-fit platform
Complex B2B lead nurturing and account-based marketingAdobe Marketo Engage
Salesforce-centric CRM and sophisticated cross-channel journeysSalesforce Marketing Cloud
Consumer lifecycle marketing across email, mobile, app, and webBraze or Iterable
Fast deployment and ease of administration outweigh maximum complexityHubSpot Marketing Hub Enterprise
Already standardized on Adobe Experience CloudAdobe Journey Optimizer

Practical recommendation

  • •B2B enterprise: Start with Marketo, Salesforce Marketing Cloud, and HubSpot Enterprise.
  • •B2C/digital product: Start with Braze, Salesforce Marketing Cloud, and Adobe Journey Optimizer.
  • •If Salesforce is already your strategic CRM, Salesforce Marketing Cloud is usually the safest default—though implementation and operating costs can be substantial.
  • •If your priority is B2B nurture, scoring, and sales alignment, Marketo is generally the stronger default.
  • •If simplicity and speed matter more than highly customized journeys, choose HubSpot Enterprise.

Procurement scorecard

I would weight the RFP approximately as follows:

  • •Functional fit and journey orchestration: 25%
  • •CRM, CDP, data warehouse, and API integration: 20%
  • •Deliverability, consent, and preference management: 15%
  • •Security, privacy, SSO/SCIM, RBAC, and auditability: 15%
  • •Three-year total cost, including implementation and overages: 15%
  • •Usability, administration, and vendor support: 10%

Require vendors to disclose pricing drivers—contacts, sends, profiles, API calls, environments, dedicated IPs, support, and implementation—and test them with your projected three-year growth. Also require a proof of concept using an actual campaign and data flow, not a canned demonstration.

If “email marketing” actually means supplier communications or internal employee email rather than customer marketing, these may be overbuilt; a supplier portal, Microsoft 365 tooling, or a dedicated communications platform could be more appropriate.

SEP 12afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. HubSpot Marketing Hub Enterprise
  4. Complex B2B scoring
  5. Usability
  6. Highly complex Oracle-centered B2B environment

For a 5,000-person US enterprise, the best choice depends more on your CRM, customer model, and campaign complexity than employee count.

Practical recommendation

  • •B2B enterprise with complex lead nurturing: Adobe Marketo Engage
  • •Already standardized on Salesforce: Salesforce Marketing Cloud Engagement; consider Account Engagement for primarily B2B use cases
  • •High-volume B2C, mobile, or product-led lifecycle messaging: Braze
  • •Ease of use and faster deployment outweigh maximum sophistication: HubSpot Marketing Hub Enterprise
  • •Very complex global B2B organization already using Oracle: Oracle Eloqua

My default shortlist

For a typical large US B2B enterprise, I would run an RFP with:

  • 1.Adobe Marketo Engage
  • 2.Salesforce Marketing Cloud
  • 3.HubSpot Marketing Hub Enterprise

Add Braze if customer journeys involve substantial app, SMS, push, or real-time behavioral messaging.

How I would decide

PriorityStrongest candidate
Complex B2B scoring, nurturing, and account-based marketingMarketo
Deep Salesforce ecosystem alignmentSalesforce Marketing Cloud
Usability, adoption, and shorter implementationHubSpot
Real-time cross-channel consumer engagementBraze
Highly complex Oracle-centered B2B environmentEloqua

Procurement requirements to emphasize

Evaluate five-year total cost, not license price alone:

  • •Contact/profile and email-volume pricing, including overages
  • •Implementation, migration, integrations, and required partner services
  • •Separate charges for analytics, personalization, sandboxes, APIs, SMS, and deliverability tools
  • •Data ownership, export rights, deletion SLAs, and termination assistance
  • •SOC 2 Type II, SSO/SAML, SCIM, RBAC, audit logs, encryption, and incident notification
  • •CCPA/state privacy support, consent management, suppression controls, and data residency
  • •Deliverability services, dedicated IP options, and support for SPF, DKIM, and DMARC
  • •CRM/CDP/data-warehouse integration and API limits
  • •SLA, premium-support requirements, renewal caps, and limits on unilateral packaging changes

Bottom line

If you are a Salesforce-centered B2B company, start with Salesforce Marketing Cloud versus Marketo. Choose Marketo for marketing-operations depth; choose Salesforce for ecosystem consolidation. If your requirements are comparatively straightforward and administrator usability matters most, choose HubSpot Enterprise. If this is primarily consumer lifecycle marketing, choose Braze rather than a traditional B2B automation platform.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-11 permalink

Scored
answered
Received
2026-09-11 09:31:53 UTC
Run
20260911T090002Z-da0dd3
Served by
OpenAI · HTTP 200 · finish stop
Size
2,248 characters · 985 tokens out incl. hidden reasoning · 28.3 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Adobe Journey Optimizer

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

Company size alone shouldn’t determine the platform. For a 5,000-person US enterprise, I’d create this shortlist:
| Primary use case | Best-fit platform |
|---|---|
| Complex B2B lead nurturing and account-based marketing | **Adobe Marketo Engage** |
| Salesforce-centric CRM and sophisticated cross-channel journeys | **Salesforce Marketing Cloud** |
| Consumer lifecycle marketing across email, mobile, app, and web | **Braze** or **Iterable** |
| Fast deployment and ease of administration outweigh maximum complexity | **HubSpot Marketing Hub Enterprise** |
| Already standardized on Adobe Experience Cloud | **Adobe Journey Optimizer** |
### Practical recommendation
- **B2B enterprise:** Start with **Marketo, Salesforce Marketing Cloud, and HubSpot Enterprise**.
- **B2C/digital product:** Start with **Braze, Salesforce Marketing Cloud, and Adobe Journey Optimizer**.
- If Salesforce is already your strategic CRM, **Salesforce Marketing Cloud** is usually the safest default—though implementation and operating costs can be substantial.
- If your priority is B2B nurture, scoring, and sales alignment, **Marketo** is generally the stronger default.
- If simplicity and speed matter more than highly customized journeys, choose **HubSpot Enterprise**.
### Procurement scorecard
I would weight the RFP approximately as follows:
- Functional fit and journey orchestration: **25%**
- CRM, CDP, data warehouse, and API integration: **20%**
- Deliverability, consent, and preference management: **15%**
- Security, privacy, SSO/SCIM, RBAC, and auditability: **15%**
- Three-year total cost, including implementation and overages: **15%**
- Usability, administration, and vendor support: **10%**
Require vendors to disclose pricing drivers—contacts, sends, profiles, API calls, environments, dedicated IPs, support, and implementation—and test them with your projected three-year growth. Also require a proof of concept using an actual campaign and data flow, not a canned demonstration.
If “email marketing” actually means supplier communications or internal employee email rather than customer marketing, these may be overbuilt; a supplier portal, Microsoft 365 tooling, or a dedicated communications platform could be more appropriate.

End of response · 32 lines · 2,248 characters · sha256 a21b790497a97504003495372544fb13955abd733709a2cc1e48435f2bb2e2e1

After this run

2026-09-12 permalink

Scored
answered
Received
2026-09-12 09:24:58 UTC
Run
20260912T090021Z-c0c86e
Served by
OpenAI · HTTP 200 · finish stop
Size
2,633 characters · 729 tokens out incl. hidden reasoning · 13.7 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. HubSpot Marketing Hub Enterprise
  4. Complex B2B scoring
  5. Usability
  6. Highly complex Oracle-centered B2B environment

Highlighted: the names the extractor took as picks, where they appear verbatim (6 of 6).

For a 5,000-person US enterprise, the best choice depends more on your CRM, customer model, and campaign complexity than employee count.
## Practical recommendation
- **B2B enterprise with complex lead nurturing:** **Adobe Marketo Engage**
- **Already standardized on Salesforce:** **Salesforce Marketing Cloud Engagement**; consider **Account Engagement** for primarily B2B use cases
- **High-volume B2C, mobile, or product-led lifecycle messaging:** **Braze**
- **Ease of use and faster deployment outweigh maximum sophistication:** **HubSpot Marketing Hub Enterprise**
- **Very complex global B2B organization already using Oracle:** **Oracle Eloqua**
### My default shortlist
For a typical large US B2B enterprise, I would run an RFP with:
1. **Adobe Marketo Engage**
2. **Salesforce Marketing Cloud**
3. **HubSpot Marketing Hub Enterprise**
Add **Braze** if customer journeys involve substantial app, SMS, push, or real-time behavioral messaging.
## How I would decide
| Priority | Strongest candidate |
|---|---|
| Complex B2B scoring, nurturing, and account-based marketing | Marketo |
| Deep Salesforce ecosystem alignment | Salesforce Marketing Cloud |
| Usability, adoption, and shorter implementation | HubSpot |
| Real-time cross-channel consumer engagement | Braze |
| Highly complex Oracle-centered B2B environment | Eloqua |
## Procurement requirements to emphasize
Evaluate five-year total cost, not license price alone:
- Contact/profile and email-volume pricing, including overages
- Implementation, migration, integrations, and required partner services
- Separate charges for analytics, personalization, sandboxes, APIs, SMS, and deliverability tools
- Data ownership, export rights, deletion SLAs, and termination assistance
- SOC 2 Type II, SSO/SAML, SCIM, RBAC, audit logs, encryption, and incident notification
- CCPA/state privacy support, consent management, suppression controls, and data residency
- Deliverability services, dedicated IP options, and support for SPF, DKIM, and DMARC
- CRM/CDP/data-warehouse integration and API limits
- SLA, premium-support requirements, renewal caps, and limits on unilateral packaging changes
## Bottom line
If you are a **Salesforce-centered B2B company**, start with **Salesforce Marketing Cloud versus Marketo**. Choose Marketo for marketing-operations depth; choose Salesforce for ecosystem consolidation. If your requirements are comparatively straightforward and administrator usability matters most, choose **HubSpot Enterprise**. If this is primarily consumer lifecycle marketing, choose **Braze** rather than a traditional B2B automation platform.

End of response · 46 lines · 2,633 characters · sha256 b2b1c35adfd66979c9dc00982769c4157acd8b6d34f15a073652db6b0d522134

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-12 09:00:20 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
3 added, 2 dropped
Baseline
2 prior days with data; 1 matched the baseline value (2026-09-11)
Responses
before 2026-09-11 09:31:53 UTC, run 20260911T090002Z-da0dd3; after 2026-09-12 09:24:58 UTC, run 20260912T090021Z-c0c86e
Detected
2026-09-12 · run 20260912T090021Z-c0c86e, started 2026-09-12 09:00:21 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-12/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-12:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.