MODELDRIFT.WATCH

Sep 25 · Day 16

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 23beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Iterable

For a 5,000-person US enterprise, the best platform depends more on your customer model and existing stack than company size.

Recommended shortlist

ScenarioBest fitWhy
B2B demand generationAdobe Marketo EngageStrong lead scoring, nurture, CRM integration, attribution, and complex enterprise workflows
Salesforce-centric, high-volume B2CSalesforce Marketing Cloud EngagementDeep Salesforce integration, multi-business-unit controls, journey orchestration, and broad channel support
Digital product / real-time lifecycle marketingBrazeExcellent event-triggered messaging, personalization, mobile/app engagement, and real-time orchestration
Ease of use and faster deploymentHubSpot Marketing Hub EnterpriseLower administrative burden and strong usability, though less suitable for very complex global governance
Modern cross-channel alternativeIterableFlexible lifecycle marketing and generally simpler to operate than legacy enterprise suites

My default recommendation

  • •B2B enterprise: Adobe Marketo Engage
  • •B2C enterprise already using Salesforce: Salesforce Marketing Cloud Engagement
  • •App- or product-led business: Braze

Do not select Salesforce Marketing Cloud solely because you use Salesforce CRM; validate integration effort, data architecture, administrator requirements, and total cost first.

Procurement scorecard

Weight an RFP approximately as follows:

  • •Use-case and journey functionality: 25%
  • •CRM/CDP/data integration: 20%
  • •Security, privacy, SSO/SCIM, audit controls: 15%
  • •Deliverability and dedicated IP support: 10%
  • •Usability and operating-resource requirements: 10%
  • •Reporting and attribution: 10%
  • •Three-year total cost and contractual terms: 10%

Require vendors to price implementation, migration, message/contact overages, sandboxes, premium support, deliverability services, API usage, data retention, and required partner services—not just licenses.

Unless your needs are relatively simple, I would run a three-vendor proof of concept using your actual data and journeys rather than procure from demonstrations alone.

SEP 25afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Enterprise B2B with deep Oracle alignment
  3. Salesforce Marketing Cloud
  4. Braze
  5. HubSpot Enterprise

For a 5,000-person enterprise, my default shortlist would be:

Best fitPlatform
B2B demand generation and complex lead nurturingAdobe Marketo Engage
Salesforce-centric enterprise, especially B2C or high-volume campaignsSalesforce Marketing Cloud Engagement
Product-led lifecycle messaging across email, push, SMS, and in-appBraze
Faster deployment and easier administration, with moderate complexityHubSpot Marketing Hub Enterprise
Enterprise B2B with deep Oracle alignmentOracle Eloqua

My recommendation

  • •Choose Marketo if you are primarily a B2B enterprise with long sales cycles, lead scoring, account-based marketing, and complex CRM workflows.
  • •Choose Salesforce Marketing Cloud if Salesforce is your strategic CRM and you need very high scale, sophisticated customer journeys, or multi-business-unit governance.
  • •Choose Braze if email is part of real-time customer engagement for a digital product rather than traditional campaign marketing.
  • •Choose HubSpot Enterprise if ease of use and speed matter more than maximum customization.

If no additional context were available, I would run a final evaluation between Marketo and Salesforce Marketing Cloud, with the existing CRM architecture as the deciding factor.

Procurement requirements to include

Evaluate three-year total cost, not the license quote alone:

  • •Contact, send-volume, API, data-storage, and business-unit overages
  • •Implementation and systems-integrator costs
  • •Dedicated IPs, deliverability support, and migration services
  • •SSO/SAML, SCIM, role-based access, audit logs, and data residency
  • •SOC 2 Type II, ISO 27001, CCPA, GDPR, CAN-SPAM, and DPA terms
  • •CRM/CDP/data-warehouse integration
  • •SLA, support response times, sandbox access, and disaster recovery
  • •Data export rights, deletion assistance, and capped renewal increases
  • •AI training/data-use restrictions and indemnity
  • •Exit assistance and suppression-list portability

Require finalists to complete a paid or tightly scoped proof of concept using three real workflows: one complex journey, one CRM-triggered campaign, and one compliance/data-export scenario. Avoid selecting purely from demos; implementation quality and deliverability operations often matter more than feature-count differences.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-23 permalink

Scored
answered
Received
2026-09-23 09:23:35 UTC
Run
20260923T090022Z-9b7b3a
Served by
OpenAI · HTTP 200 · finish stop
Size
2,231 characters · 804 tokens out incl. hidden reasoning · 19.5 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Iterable

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

For a 5,000-person US enterprise, the best platform depends more on your customer model and existing stack than company size.
### Recommended shortlist
| Scenario | Best fit | Why |
|---|---|---|
| **B2B demand generation** | **Adobe Marketo Engage** | Strong lead scoring, nurture, CRM integration, attribution, and complex enterprise workflows |
| **Salesforce-centric, high-volume B2C** | **Salesforce Marketing Cloud Engagement** | Deep Salesforce integration, multi-business-unit controls, journey orchestration, and broad channel support |
| **Digital product / real-time lifecycle marketing** | **Braze** | Excellent event-triggered messaging, personalization, mobile/app engagement, and real-time orchestration |
| **Ease of use and faster deployment** | **HubSpot Marketing Hub Enterprise** | Lower administrative burden and strong usability, though less suitable for very complex global governance |
| **Modern cross-channel alternative** | **Iterable** | Flexible lifecycle marketing and generally simpler to operate than legacy enterprise suites |
### My default recommendation
- **B2B enterprise:** Adobe Marketo Engage
- **B2C enterprise already using Salesforce:** Salesforce Marketing Cloud Engagement
- **App- or product-led business:** Braze
Do not select Salesforce Marketing Cloud solely because you use Salesforce CRM; validate integration effort, data architecture, administrator requirements, and total cost first.
### Procurement scorecard
Weight an RFP approximately as follows:
- Use-case and journey functionality: **25%**
- CRM/CDP/data integration: **20%**
- Security, privacy, SSO/SCIM, audit controls: **15%**
- Deliverability and dedicated IP support: **10%**
- Usability and operating-resource requirements: **10%**
- Reporting and attribution: **10%**
- Three-year total cost and contractual terms: **10%**
Require vendors to price implementation, migration, message/contact overages, sandboxes, premium support, deliverability services, API usage, data retention, and required partner services—not just licenses.
Unless your needs are relatively simple, I would run a three-vendor proof of concept using your actual data and journeys rather than procure from demonstrations alone.

End of response · 35 lines · 2,231 characters · sha256 ee97816ad10ff6b1ad95facd739d8cf775a87f96cf85b71658581cbb86875647

After this run

2026-09-25 permalink

Scored
answered
Received
2026-09-25 09:24:37 UTC
Run
20260925T090007Z-f08d1f
Served by
OpenAI · HTTP 200 · finish stop
Size
2,345 characters · 798 tokens out incl. hidden reasoning · 13.4 s
Extracted picks, in order · confidence medium
  1. Adobe Marketo Engage
  2. Enterprise B2B with deep Oracle alignment
  3. Salesforce Marketing Cloud
  4. Braze
  5. HubSpot Enterprise

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

For a 5,000-person enterprise, my default shortlist would be:
| Best fit | Platform |
|---|---|
| B2B demand generation and complex lead nurturing | **Adobe Marketo Engage** |
| Salesforce-centric enterprise, especially B2C or high-volume campaigns | **Salesforce Marketing Cloud Engagement** |
| Product-led lifecycle messaging across email, push, SMS, and in-app | **Braze** |
| Faster deployment and easier administration, with moderate complexity | **HubSpot Marketing Hub Enterprise** |
| Enterprise B2B with deep Oracle alignment | **Oracle Eloqua** |
### My recommendation
- **Choose Marketo** if you are primarily a B2B enterprise with long sales cycles, lead scoring, account-based marketing, and complex CRM workflows.
- **Choose Salesforce Marketing Cloud** if Salesforce is your strategic CRM and you need very high scale, sophisticated customer journeys, or multi-business-unit governance.
- **Choose Braze** if email is part of real-time customer engagement for a digital product rather than traditional campaign marketing.
- **Choose HubSpot Enterprise** if ease of use and speed matter more than maximum customization.
If no additional context were available, I would run a final evaluation between **Marketo and Salesforce Marketing Cloud**, with the existing CRM architecture as the deciding factor.
### Procurement requirements to include
Evaluate three-year total cost, not the license quote alone:
- Contact, send-volume, API, data-storage, and business-unit overages
- Implementation and systems-integrator costs
- Dedicated IPs, deliverability support, and migration services
- SSO/SAML, SCIM, role-based access, audit logs, and data residency
- SOC 2 Type II, ISO 27001, CCPA, GDPR, CAN-SPAM, and DPA terms
- CRM/CDP/data-warehouse integration
- SLA, support response times, sandbox access, and disaster recovery
- Data export rights, deletion assistance, and capped renewal increases
- AI training/data-use restrictions and indemnity
- Exit assistance and suppression-list portability
Require finalists to complete a paid or tightly scoped proof of concept using three real workflows: one complex journey, one CRM-triggered campaign, and one compliance/data-export scenario. Avoid selecting purely from demos; implementation quality and deliverability operations often matter more than feature-count differences.

End of response · 35 lines · 2,345 characters · sha256 70e7b44c7939549703f27262358f799e3f2df43dd25062e6d3beb48c91d3397d

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-25 09:00:06 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
1 added, 1 dropped
Baseline
6 prior days with data; 1 matched the baseline value (2026-09-23)
Responses
before 2026-09-23 09:23:35 UTC, run 20260923T090022Z-9b7b3a; after 2026-09-25 09:24:37 UTC, run 20260925T090007Z-f08d1f
Detected
2026-09-25 · run 20260925T090007Z-f08d1f, started 2026-09-25 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-25/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-25:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.