MODELDRIFT.WATCH

Sep 23 · Day 14

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 22beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. Adobe Journey Optimizer
  5. HubSpot Marketing Hub Enterprise
  6. Klaviyo

Company size alone shouldn’t determine the platform; your customer model, message volume, channels, and existing CRM/data stack matter more.

Best-fit shortlist

Primary use caseRecommended platformWhy
B2B demand generation and lead nurturingAdobe Marketo EngageStrong lead scoring, account-based marketing, complex nurture flows, and CRM integration
Large-scale B2C marketing, especially with SalesforceSalesforce Marketing CloudEnterprise journey orchestration, segmentation, high-volume sending, and broad partner ecosystem
Digital product/customer lifecycle messagingBrazeExcellent real-time, event-triggered email, mobile push, in-app, and cross-channel journeys
Enterprise B2C with Adobe stackAdobe Journey OptimizerStrong fit with Adobe Experience Platform and real-time customer profiles
Ease of use and faster deploymentHubSpot Marketing Hub EnterpriseLower administrative burden and good B2B functionality, though less suitable for extreme scale or complexity
E-commerce/retailKlaviyoStrong commerce integrations and marketer usability; validate enterprise governance and pricing at your volume

My default recommendation

  • •B2B enterprise: Start with Marketo Engage and HubSpot Enterprise in the RFP.
  • •B2C enterprise: Start with Salesforce Marketing Cloud, Braze, and Adobe Journey Optimizer.
  • •If you already have a strategic Salesforce or Adobe agreement, favor that ecosystem—but require a three-year TCO comparison. Integration savings are often offset by implementation, data, and consulting charges.

Procurement requirements to include

Evaluate vendors on:

  • 1.Three-year total cost: contacts/profiles, message volume, API calls, data storage, sandboxes, premium support, implementation, and overages.
  • 2.Data and security: SOC 2 Type II, ISO 27001, SSO/SAML, SCIM, RBAC, audit logs, encryption, retention/deletion, subprocessors, and breach terms.
  • 3.Deliverability: dedicated IP options, domain warming, reputation monitoring, suppression management, and named deliverability support.
  • 4.Integration: CRM, CDP/data warehouse, consent platform, analytics, event streaming, and reverse ETL.
  • 5.Operational fit: marketer usability, approval workflows, templates, localization, business-unit separation, and accessibility.
  • 6.Contract protections: price caps, volume bands, termination assistance, data portability, SLA credits, implementation acceptance criteria, and limits on auto-renewal.
  • 7.Privacy compliance: CAN-SPAM, CCPA/CPRA, GDPR if applicable, consent lineage, and deletion/DSAR workflows.

Avoid choosing solely on per-contact pricing: vendors define “contact,” “profile,” “active user,” and “message” differently. Normalize bids against your actual monthly active profiles, annual send volume, peak throughput, business units, and required channels.

SEP 23afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Iterable

For a 5,000-person US enterprise, the best platform depends more on your customer model and existing stack than company size.

Recommended shortlist

ScenarioBest fitWhy
B2B demand generationAdobe Marketo EngageStrong lead scoring, nurture, CRM integration, attribution, and complex enterprise workflows
Salesforce-centric, high-volume B2CSalesforce Marketing Cloud EngagementDeep Salesforce integration, multi-business-unit controls, journey orchestration, and broad channel support
Digital product / real-time lifecycle marketingBrazeExcellent event-triggered messaging, personalization, mobile/app engagement, and real-time orchestration
Ease of use and faster deploymentHubSpot Marketing Hub EnterpriseLower administrative burden and strong usability, though less suitable for very complex global governance
Modern cross-channel alternativeIterableFlexible lifecycle marketing and generally simpler to operate than legacy enterprise suites

My default recommendation

  • •B2B enterprise: Adobe Marketo Engage
  • •B2C enterprise already using Salesforce: Salesforce Marketing Cloud Engagement
  • •App- or product-led business: Braze

Do not select Salesforce Marketing Cloud solely because you use Salesforce CRM; validate integration effort, data architecture, administrator requirements, and total cost first.

Procurement scorecard

Weight an RFP approximately as follows:

  • •Use-case and journey functionality: 25%
  • •CRM/CDP/data integration: 20%
  • •Security, privacy, SSO/SCIM, audit controls: 15%
  • •Deliverability and dedicated IP support: 10%
  • •Usability and operating-resource requirements: 10%
  • •Reporting and attribution: 10%
  • •Three-year total cost and contractual terms: 10%

Require vendors to price implementation, migration, message/contact overages, sandboxes, premium support, deliverability services, API usage, data retention, and required partner services—not just licenses.

Unless your needs are relatively simple, I would run a three-vendor proof of concept using your actual data and journeys rather than procure from demonstrations alone.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-22 permalink

Scored
answered
Received
2026-09-22 09:27:15 UTC
Run
20260922T090022Z-7ff13b
Served by
OpenAI · HTTP 200 · finish stop
Size
2,982 characters · 907 tokens out incl. hidden reasoning · 23.4 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. Adobe Journey Optimizer
  5. HubSpot Marketing Hub Enterprise
  6. Klaviyo

Highlighted: the names the extractor took as picks, where they appear verbatim (6 of 6).

Company size alone shouldn’t determine the platform; your customer model, message volume, channels, and existing CRM/data stack matter more.
### Best-fit shortlist
| Primary use case | Recommended platform | Why |
|---|---|---|
| **B2B demand generation and lead nurturing** | **Adobe Marketo Engage** | Strong lead scoring, account-based marketing, complex nurture flows, and CRM integration |
| **Large-scale B2C marketing, especially with Salesforce** | **Salesforce Marketing Cloud** | Enterprise journey orchestration, segmentation, high-volume sending, and broad partner ecosystem |
| **Digital product/customer lifecycle messaging** | **Braze** | Excellent real-time, event-triggered email, mobile push, in-app, and cross-channel journeys |
| **Enterprise B2C with Adobe stack** | **Adobe Journey Optimizer** | Strong fit with Adobe Experience Platform and real-time customer profiles |
| **Ease of use and faster deployment** | **HubSpot Marketing Hub Enterprise** | Lower administrative burden and good B2B functionality, though less suitable for extreme scale or complexity |
| **E-commerce/retail** | **Klaviyo** | Strong commerce integrations and marketer usability; validate enterprise governance and pricing at your volume |
### My default recommendation
- **B2B enterprise:** Start with **Marketo Engage** and **HubSpot Enterprise** in the RFP.
- **B2C enterprise:** Start with **Salesforce Marketing Cloud**, **Braze**, and **Adobe Journey Optimizer**.
- If you already have a strategic Salesforce or Adobe agreement, favor that ecosystem—but require a three-year TCO comparison. Integration savings are often offset by implementation, data, and consulting charges.
### Procurement requirements to include
Evaluate vendors on:
1. **Three-year total cost:** contacts/profiles, message volume, API calls, data storage, sandboxes, premium support, implementation, and overages.
2. **Data and security:** SOC 2 Type II, ISO 27001, SSO/SAML, SCIM, RBAC, audit logs, encryption, retention/deletion, subprocessors, and breach terms.
3. **Deliverability:** dedicated IP options, domain warming, reputation monitoring, suppression management, and named deliverability support.
4. **Integration:** CRM, CDP/data warehouse, consent platform, analytics, event streaming, and reverse ETL.
5. **Operational fit:** marketer usability, approval workflows, templates, localization, business-unit separation, and accessibility.
6. **Contract protections:** price caps, volume bands, termination assistance, data portability, SLA credits, implementation acceptance criteria, and limits on auto-renewal.
7. **Privacy compliance:** CAN-SPAM, CCPA/CPRA, GDPR if applicable, consent lineage, and deletion/DSAR workflows.
Avoid choosing solely on per-contact pricing: vendors define “contact,” “profile,” “active user,” and “message” differently. Normalize bids against your actual monthly active profiles, annual send volume, peak throughput, business units, and required channels.

End of response · 32 lines · 2,982 characters · sha256 a4254e49f968950fe7ab9a341f94a45ef52db52f03ed3ae664f5d84b94ce0f3f

After this run

2026-09-23 permalink

Scored
answered
Received
2026-09-23 09:23:35 UTC
Run
20260923T090022Z-9b7b3a
Served by
OpenAI · HTTP 200 · finish stop
Size
2,231 characters · 804 tokens out incl. hidden reasoning · 19.5 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Iterable

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

For a 5,000-person US enterprise, the best platform depends more on your customer model and existing stack than company size.
### Recommended shortlist
| Scenario | Best fit | Why |
|---|---|---|
| **B2B demand generation** | **Adobe Marketo Engage** | Strong lead scoring, nurture, CRM integration, attribution, and complex enterprise workflows |
| **Salesforce-centric, high-volume B2C** | **Salesforce Marketing Cloud Engagement** | Deep Salesforce integration, multi-business-unit controls, journey orchestration, and broad channel support |
| **Digital product / real-time lifecycle marketing** | **Braze** | Excellent event-triggered messaging, personalization, mobile/app engagement, and real-time orchestration |
| **Ease of use and faster deployment** | **HubSpot Marketing Hub Enterprise** | Lower administrative burden and strong usability, though less suitable for very complex global governance |
| **Modern cross-channel alternative** | **Iterable** | Flexible lifecycle marketing and generally simpler to operate than legacy enterprise suites |
### My default recommendation
- **B2B enterprise:** Adobe Marketo Engage
- **B2C enterprise already using Salesforce:** Salesforce Marketing Cloud Engagement
- **App- or product-led business:** Braze
Do not select Salesforce Marketing Cloud solely because you use Salesforce CRM; validate integration effort, data architecture, administrator requirements, and total cost first.
### Procurement scorecard
Weight an RFP approximately as follows:
- Use-case and journey functionality: **25%**
- CRM/CDP/data integration: **20%**
- Security, privacy, SSO/SCIM, audit controls: **15%**
- Deliverability and dedicated IP support: **10%**
- Usability and operating-resource requirements: **10%**
- Reporting and attribution: **10%**
- Three-year total cost and contractual terms: **10%**
Require vendors to price implementation, migration, message/contact overages, sandboxes, premium support, deliverability services, API usage, data retention, and required partner services—not just licenses.
Unless your needs are relatively simple, I would run a three-vendor proof of concept using your actual data and journeys rather than procure from demonstrations alone.

End of response · 35 lines · 2,231 characters · sha256 ee97816ad10ff6b1ad95facd739d8cf775a87f96cf85b71658581cbb86875647

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-23 09:00:22 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
1 added, 2 dropped
Baseline
7 prior days with data; 1 matched the baseline value (2026-09-22)
Responses
before 2026-09-22 09:27:15 UTC, run 20260922T090022Z-7ff13b; after 2026-09-23 09:23:35 UTC, run 20260923T090022Z-9b7b3a
Detected
2026-09-23 · run 20260923T090022Z-9b7b3a, started 2026-09-23 09:00:22 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-23/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-23:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.