MODELDRIFT.WATCH

Sep 28 · Day 19

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 27beforePermalink

Picks read from the answer, in order
  1. Salesforce Marketing Cloud Engagement
  2. Braze
  3. Adobe Journey Optimizer / Adobe Campaign
  4. Adobe Marketo Engage
  5. Oracle Eloqua
  6. HubSpot Marketing Hub Enterprise
  7. Iterable

For a 5,000-person US enterprise, the best choice depends more on your customer model and existing technology stack than employee count.

Practical recommendation

Default enterprise choice: Salesforce Marketing Cloud Engagement
Choose it if you already use Salesforce broadly and need high-volume email, complex segmentation, journeys, multiple business units, and enterprise governance.

Better alternatives by use case:

SituationBest-fit platform
Salesforce-centric enterprise, complex B2C campaignsSalesforce Marketing Cloud Engagement
Digital product, app, retail, or real-time omnichannel engagementBraze
Adobe Experience Cloud already deployedAdobe Journey Optimizer / Adobe Campaign
B2B lead nurturing tied to Salesforce CRMAdobe Marketo Engage
Oracle-heavy B2B enterpriseOracle Eloqua
Mid-complexity marketing with ease of administration as the priorityHubSpot Marketing Hub Enterprise
Strong cross-channel orchestration with a more modern UXIterable

My shortlist

For a typical large enterprise RFP, I would shortlist:

  • 1.Salesforce Marketing Cloud — safest broad enterprise option
  • 2.Braze — strongest when real-time customer behavior and mobile/app channels matter
  • 3.Adobe Journey Optimizer — strongest when Adobe is already strategic
  • 4.Marketo Engage — include instead if the use case is primarily B2B demand generation

Procurement guidance

Do not select based on license price alone. Evaluate three-year total cost, including:

  • •Implementation and migration
  • •Systems integrator dependence
  • •Contact, message, API, and data-storage overages
  • •Additional business units and environments
  • •Deliverability services and dedicated IPs
  • •CRM/CDP/data-warehouse integrations
  • •Consent, suppression, retention, and deletion workflows
  • •SSO, SCIM, RBAC, audit logs, and segregation of duties
  • •HIPAA/BAA requirements, if applicable
  • •Support tier and SLA
  • •Exit assistance and data export rights

Require a proof of concept using your actual scenarios: one campaign, one triggered journey, consent changes, suppression handling, reporting, and a production integration. Also require vendors to price against the same contact counts, annual send volume, peak throughput, users, business units, channels, and data-storage assumptions.

Bottom line

  • •Already standardized on Salesforce: buy Salesforce Marketing Cloud, unless product-led real-time engagement is the primary objective.
  • •Consumer-facing digital business with app/mobile engagement: favor Braze.
  • •Adobe-standardized organization: favor Adobe Journey Optimizer.
  • •Primarily B2B lead nurturing: favor Marketo Engage.
  • •Avoid defaulting to HubSpot solely for ease of use if you have complex business-unit, governance, data-volume, or customization requirements.

SEP 28afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. Adobe Campaign / Journey Optimizer
  5. HubSpot Marketing Hub Enterprise

For a 5,000-person enterprise, the right platform depends mainly on your business model and existing technology stack—not headcount alone.

Practical recommendation

SituationBest-fit platform
B2B lead generation and long sales cyclesAdobe Marketo Engage
B2C campaigns with complex journeys and Salesforce already deployedSalesforce Marketing Cloud Engagement
Product-led, mobile-first, or real-time customer messagingBraze
Adobe Experience Cloud is strategicAdobe Campaign / Journey Optimizer
Moderate complexity and ease of use matters more than maximum controlHubSpot Marketing Hub Enterprise

If I had to choose without more context:

  • •B2B enterprise: Marketo Engage
  • •B2C enterprise: Salesforce Marketing Cloud Engagement
  • •Digital product/mobile business: Braze

How I would procure it

Shortlist three vendors and require a proof of concept using your own data and two real campaigns. Score them on:

  • •CRM/CDP/data-warehouse integration
  • •Deliverability tooling and dedicated-IP support
  • •Journey orchestration and personalization
  • •Consent, suppression, and preference management
  • •SSO/SAML, SCIM, RBAC, audit logs, SOC 2, and data-processing terms
  • •CAN-SPAM, CCPA, and any industry-specific requirements
  • •Usability for marketers without engineering support
  • •API limits, data-export rights, and exit assistance
  • •Three-year total cost: licenses, contacts/messages, implementation, support, and services

Avoid selecting solely on license price: implementation, data integration, and ongoing agency/admin costs can materially exceed the apparent software savings. Also negotiate protections against contact-count or message-volume overages, renewal uplifts, and charges for additional business units.

Bottom line: If you use Salesforce and run sophisticated consumer marketing, start with Salesforce Marketing Cloud, Braze, and Adobe. If you are primarily B2B, start with Marketo, Salesforce Account Engagement, and HubSpot Enterprise.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-27 permalink

Scored
answered
Received
2026-09-27 09:24:13 UTC
Run
20260927T090007Z-7adb14
Served by
OpenAI · HTTP 200 · finish stop
Size
2,923 characters · 776 tokens out incl. hidden reasoning · 11.3 s
Extracted picks, in order · confidence high
  1. Salesforce Marketing Cloud Engagement
  2. Braze
  3. Adobe Journey Optimizer / Adobe Campaign
  4. Adobe Marketo Engage
  5. Oracle Eloqua
  6. HubSpot Marketing Hub Enterprise
  7. Iterable

Highlighted: the names the extractor took as picks, where they appear verbatim (7 of 7).

For a 5,000-person US enterprise, the best choice depends more on your customer model and existing technology stack than employee count.
## Practical recommendation
**Default enterprise choice: Salesforce Marketing Cloud Engagement**
Choose it if you already use Salesforce broadly and need high-volume email, complex segmentation, journeys, multiple business units, and enterprise governance.
**Better alternatives by use case:**
| Situation | Best-fit platform |
|---|---|
| Salesforce-centric enterprise, complex B2C campaigns | **Salesforce Marketing Cloud Engagement** |
| Digital product, app, retail, or real-time omnichannel engagement | **Braze** |
| Adobe Experience Cloud already deployed | **Adobe Journey Optimizer / Adobe Campaign** |
| B2B lead nurturing tied to Salesforce CRM | **Adobe Marketo Engage** |
| Oracle-heavy B2B enterprise | **Oracle Eloqua** |
| Mid-complexity marketing with ease of administration as the priority | **HubSpot Marketing Hub Enterprise** |
| Strong cross-channel orchestration with a more modern UX | **Iterable** |
### My shortlist
For a typical large enterprise RFP, I would shortlist:
1. **Salesforce Marketing Cloud** — safest broad enterprise option
2. **Braze** — strongest when real-time customer behavior and mobile/app channels matter
3. **Adobe Journey Optimizer** — strongest when Adobe is already strategic
4. **Marketo Engage** — include instead if the use case is primarily B2B demand generation
## Procurement guidance
Do not select based on license price alone. Evaluate **three-year total cost**, including:
- Implementation and migration
- Systems integrator dependence
- Contact, message, API, and data-storage overages
- Additional business units and environments
- Deliverability services and dedicated IPs
- CRM/CDP/data-warehouse integrations
- Consent, suppression, retention, and deletion workflows
- SSO, SCIM, RBAC, audit logs, and segregation of duties
- HIPAA/BAA requirements, if applicable
- Support tier and SLA
- Exit assistance and data export rights
Require a proof of concept using your actual scenarios: one campaign, one triggered journey, consent changes, suppression handling, reporting, and a production integration. Also require vendors to price against the same contact counts, annual send volume, peak throughput, users, business units, channels, and data-storage assumptions.
## Bottom line
- **Already standardized on Salesforce:** buy **Salesforce Marketing Cloud**, unless product-led real-time engagement is the primary objective.
- **Consumer-facing digital business with app/mobile engagement:** favor **Braze**.
- **Adobe-standardized organization:** favor **Adobe Journey Optimizer**.
- **Primarily B2B lead nurturing:** favor **Marketo Engage**.
- **Avoid defaulting to HubSpot solely for ease of use** if you have complex business-unit, governance, data-volume, or customization requirements.

End of response · 52 lines · 2,923 characters · sha256 f2bf53f484470782824e3589fc2f5126c7afd72d82c2cfede940da72c0833953

After this run

2026-09-28 permalink

Scored
answered
Received
2026-09-28 09:23:47 UTC
Run
20260928T090007Z-07d4be
Served by
OpenAI · HTTP 200 · finish stop
Size
2,083 characters · 886 tokens out incl. hidden reasoning · 14.8 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. Adobe Campaign / Journey Optimizer
  5. HubSpot Marketing Hub Enterprise

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

For a 5,000-person enterprise, the right platform depends mainly on your business model and existing technology stack—not headcount alone.
### Practical recommendation
| Situation | Best-fit platform |
|---|---|
| **B2B lead generation and long sales cycles** | **Adobe Marketo Engage** |
| **B2C campaigns with complex journeys and Salesforce already deployed** | **Salesforce Marketing Cloud Engagement** |
| **Product-led, mobile-first, or real-time customer messaging** | **Braze** |
| **Adobe Experience Cloud is strategic** | **Adobe Campaign / Journey Optimizer** |
| **Moderate complexity and ease of use matters more than maximum control** | **HubSpot Marketing Hub Enterprise** |
**If I had to choose without more context:**
- **B2B enterprise:** Marketo Engage
- **B2C enterprise:** Salesforce Marketing Cloud Engagement
- **Digital product/mobile business:** Braze
### How I would procure it
Shortlist three vendors and require a proof of concept using your own data and two real campaigns. Score them on:
- CRM/CDP/data-warehouse integration
- Deliverability tooling and dedicated-IP support
- Journey orchestration and personalization
- Consent, suppression, and preference management
- SSO/SAML, SCIM, RBAC, audit logs, SOC 2, and data-processing terms
- CAN-SPAM, CCPA, and any industry-specific requirements
- Usability for marketers without engineering support
- API limits, data-export rights, and exit assistance
- Three-year total cost: licenses, contacts/messages, implementation, support, and services
Avoid selecting solely on license price: implementation, data integration, and ongoing agency/admin costs can materially exceed the apparent software savings. Also negotiate protections against contact-count or message-volume overages, renewal uplifts, and charges for additional business units.
**Bottom line:** If you use Salesforce and run sophisticated consumer marketing, start with **Salesforce Marketing Cloud, Braze, and Adobe**. If you are primarily B2B, start with **Marketo, Salesforce Account Engagement, and HubSpot Enterprise**.

End of response · 34 lines · 2,083 characters · sha256 0abaa97c331b6ea6e2baaaa771a0ce4d82c9ee4c355398432c92ae67916baf05

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-28 09:00:07 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
0 added, 2 dropped
Baseline
6 prior days with data; 1 matched the baseline value (2026-09-27)
Responses
before 2026-09-27 09:24:13 UTC, run 20260927T090007Z-7adb14; after 2026-09-28 09:23:47 UTC, run 20260928T090007Z-07d4be
Detected
2026-09-28 · run 20260928T090007Z-07d4be, started 2026-09-28 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-28/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-28:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.