MODELDRIFT.WATCH

Sep 29 · Day 20

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 28beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. Adobe Campaign / Journey Optimizer
  5. HubSpot Marketing Hub Enterprise

For a 5,000-person enterprise, the right platform depends mainly on your business model and existing technology stack—not headcount alone.

Practical recommendation

SituationBest-fit platform
B2B lead generation and long sales cyclesAdobe Marketo Engage
B2C campaigns with complex journeys and Salesforce already deployedSalesforce Marketing Cloud Engagement
Product-led, mobile-first, or real-time customer messagingBraze
Adobe Experience Cloud is strategicAdobe Campaign / Journey Optimizer
Moderate complexity and ease of use matters more than maximum controlHubSpot Marketing Hub Enterprise

If I had to choose without more context:

  • •B2B enterprise: Marketo Engage
  • •B2C enterprise: Salesforce Marketing Cloud Engagement
  • •Digital product/mobile business: Braze

How I would procure it

Shortlist three vendors and require a proof of concept using your own data and two real campaigns. Score them on:

  • •CRM/CDP/data-warehouse integration
  • •Deliverability tooling and dedicated-IP support
  • •Journey orchestration and personalization
  • •Consent, suppression, and preference management
  • •SSO/SAML, SCIM, RBAC, audit logs, SOC 2, and data-processing terms
  • •CAN-SPAM, CCPA, and any industry-specific requirements
  • •Usability for marketers without engineering support
  • •API limits, data-export rights, and exit assistance
  • •Three-year total cost: licenses, contacts/messages, implementation, support, and services

Avoid selecting solely on license price: implementation, data integration, and ongoing agency/admin costs can materially exceed the apparent software savings. Also negotiate protections against contact-count or message-volume overages, renewal uplifts, and charges for additional business units.

Bottom line: If you use Salesforce and run sophisticated consumer marketing, start with Salesforce Marketing Cloud, Braze, and Adobe. If you are primarily B2B, start with Marketo, Salesforce Account Engagement, and HubSpot Enterprise.

SEP 29afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Adobe Experience Cloud/CDP environment
  3. Braze
  4. CRM/CDP/data integration 20%
  5. Three-year TCO 15%

For a 5,000-person enterprise, the right platform depends more on your customer model and existing stack than company size.

Practical shortlist

Best fitRecommended platform
B2B lead generation, scoring, nurture, and CRM alignmentAdobe Marketo Engage
B2B with highly complex segmentation/governance, especially Oracle-centricOracle Eloqua
B2C email plus mobile, app, and real-time lifecycle messagingBraze
B2C enterprise already standardized on SalesforceSalesforce Marketing Cloud
Adobe Experience Cloud/CDP environmentAdobe Journey Optimizer
Microsoft Dynamics environment with moderate complexityDynamics 365 Customer Insights – Journeys
Simpler deployment and lower administrative burdenHubSpot Marketing Hub Enterprise

My default recommendation

  • •Primarily B2B: Start with Marketo Engage, with Eloqua and HubSpot Enterprise as comparison bids.
  • •Primarily B2C/omnichannel: Start with Braze, with Salesforce Marketing Cloud and Adobe Journey Optimizer as comparison bids.
  • •Already deeply invested in Salesforce, Adobe, Microsoft, or Oracle: Give the incumbent ecosystem an integration and TCO advantage—but still run a competitive proof of concept. Ecosystem fit does not automatically mean lower total cost.

What procurement should evaluate

Use a weighted scorecard rather than feature-counting:

  • •Business and journey capability: 25%
  • •CRM/CDP/data integration: 20%
  • •Deliverability and sender support: 15%
  • •Security and governance: 15%
    Require SAML SSO, SCIM, granular RBAC, audit logs, SOC 2 Type II, ISO 27001, DPA/CCPA support, and appropriate data residency.
  • •Three-year TCO: 15%
  • •Implementation, support, and vendor viability: 10%

Require finalists to execute three real journeys using representative data, including consent suppression, preference management, failure handling, and reporting. Test marketer usability as well as architecture.

Contract risks to control

  • •Pricing based on contacts, profiles, messages, API calls, or data storage
  • •Charges for inactive or duplicate profiles
  • •Mandatory implementation partners and premium support
  • •Overage rates and automatic tier upgrades
  • •Dedicated IP and deliverability-service fees
  • •Data export, deletion, and transition assistance at termination
  • •Annual uplift caps and renewal notice periods
  • •SLA credits that are too small to matter
  • •Ambiguous ownership of templates, configurations, and generated data

If I had to make a recommendation without more information: Marketo for a B2B enterprise; Braze for a B2C/digital-product enterprise; Salesforce Marketing Cloud only when Salesforce ecosystem alignment is a major strategic requirement.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-28 permalink

Scored
answered
Received
2026-09-28 09:23:47 UTC
Run
20260928T090007Z-07d4be
Served by
OpenAI · HTTP 200 · finish stop
Size
2,083 characters · 886 tokens out incl. hidden reasoning · 14.8 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. Adobe Campaign / Journey Optimizer
  5. HubSpot Marketing Hub Enterprise

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

For a 5,000-person enterprise, the right platform depends mainly on your business model and existing technology stack—not headcount alone.
### Practical recommendation
| Situation | Best-fit platform |
|---|---|
| **B2B lead generation and long sales cycles** | **Adobe Marketo Engage** |
| **B2C campaigns with complex journeys and Salesforce already deployed** | **Salesforce Marketing Cloud Engagement** |
| **Product-led, mobile-first, or real-time customer messaging** | **Braze** |
| **Adobe Experience Cloud is strategic** | **Adobe Campaign / Journey Optimizer** |
| **Moderate complexity and ease of use matters more than maximum control** | **HubSpot Marketing Hub Enterprise** |
**If I had to choose without more context:**
- **B2B enterprise:** Marketo Engage
- **B2C enterprise:** Salesforce Marketing Cloud Engagement
- **Digital product/mobile business:** Braze
### How I would procure it
Shortlist three vendors and require a proof of concept using your own data and two real campaigns. Score them on:
- CRM/CDP/data-warehouse integration
- Deliverability tooling and dedicated-IP support
- Journey orchestration and personalization
- Consent, suppression, and preference management
- SSO/SAML, SCIM, RBAC, audit logs, SOC 2, and data-processing terms
- CAN-SPAM, CCPA, and any industry-specific requirements
- Usability for marketers without engineering support
- API limits, data-export rights, and exit assistance
- Three-year total cost: licenses, contacts/messages, implementation, support, and services
Avoid selecting solely on license price: implementation, data integration, and ongoing agency/admin costs can materially exceed the apparent software savings. Also negotiate protections against contact-count or message-volume overages, renewal uplifts, and charges for additional business units.
**Bottom line:** If you use Salesforce and run sophisticated consumer marketing, start with **Salesforce Marketing Cloud, Braze, and Adobe**. If you are primarily B2B, start with **Marketo, Salesforce Account Engagement, and HubSpot Enterprise**.

End of response · 34 lines · 2,083 characters · sha256 0abaa97c331b6ea6e2baaaa771a0ce4d82c9ee4c355398432c92ae67916baf05

After this run

2026-09-29 permalink

Scored
answered
Received
2026-09-29 09:25:21 UTC
Run
20260929T090007Z-334891
Served by
OpenAI · HTTP 200 · finish stop
Size
2,792 characters · 947 tokens out incl. hidden reasoning · 15.7 s
Extracted picks, in order · confidence medium
  1. Adobe Marketo Engage
  2. Adobe Experience Cloud/CDP environment
  3. Braze
  4. CRM/CDP/data integration 20%
  5. Three-year TCO 15%

Highlighted: the names the extractor took as picks, where they appear verbatim (3 of 5).

For a 5,000-person enterprise, the right platform depends more on your customer model and existing stack than company size.
### Practical shortlist
| Best fit | Recommended platform |
|---|---|
| B2B lead generation, scoring, nurture, and CRM alignment | **Adobe Marketo Engage** |
| B2B with highly complex segmentation/governance, especially Oracle-centric | **Oracle Eloqua** |
| B2C email plus mobile, app, and real-time lifecycle messaging | **Braze** |
| B2C enterprise already standardized on Salesforce | **Salesforce Marketing Cloud** |
| Adobe Experience Cloud/CDP environment | **Adobe Journey Optimizer** |
| Microsoft Dynamics environment with moderate complexity | **Dynamics 365 Customer Insights – Journeys** |
| Simpler deployment and lower administrative burden | **HubSpot Marketing Hub Enterprise** |
### My default recommendation
- **Primarily B2B:** Start with **Marketo Engage**, with Eloqua and HubSpot Enterprise as comparison bids.
- **Primarily B2C/omnichannel:** Start with **Braze**, with Salesforce Marketing Cloud and Adobe Journey Optimizer as comparison bids.
- **Already deeply invested in Salesforce, Adobe, Microsoft, or Oracle:** Give the incumbent ecosystem an integration and TCO advantage—but still run a competitive proof of concept. Ecosystem fit does not automatically mean lower total cost.
### What procurement should evaluate
Use a weighted scorecard rather than feature-counting:
- **Business and journey capability: 25%**
- **CRM/CDP/data integration: 20%**
- **Deliverability and sender support: 15%**
- **Security and governance: 15%**
Require SAML SSO, SCIM, granular RBAC, audit logs, SOC 2 Type II, ISO 27001, DPA/CCPA support, and appropriate data residency.
- **Three-year TCO: 15%**
- **Implementation, support, and vendor viability: 10%**
Require finalists to execute three real journeys using representative data, including consent suppression, preference management, failure handling, and reporting. Test marketer usability as well as architecture.
### Contract risks to control
- Pricing based on **contacts, profiles, messages, API calls, or data storage**
- Charges for inactive or duplicate profiles
- Mandatory implementation partners and premium support
- Overage rates and automatic tier upgrades
- Dedicated IP and deliverability-service fees
- Data export, deletion, and transition assistance at termination
- Annual uplift caps and renewal notice periods
- SLA credits that are too small to matter
- Ambiguous ownership of templates, configurations, and generated data
If I had to make a recommendation without more information: **Marketo for a B2B enterprise; Braze for a B2C/digital-product enterprise; Salesforce Marketing Cloud only when Salesforce ecosystem alignment is a major strategic requirement.**

End of response · 47 lines · 2,792 characters · sha256 a3d43938187c2f54df96c9a7f73ce4e37757f96f4384f0541abc50b377125078

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-29 09:00:07 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
3 added, 3 dropped
Baseline
6 prior days with data; 1 matched the baseline value (2026-09-28)
Responses
before 2026-09-28 09:23:47 UTC, run 20260928T090007Z-07d4be; after 2026-09-29 09:25:21 UTC, run 20260929T090007Z-334891
Detected
2026-09-29 · run 20260929T090007Z-334891, started 2026-09-29 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-29/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-29:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.