MODELDRIFT.WATCH

Sep 25 · Day 16

MINOR · GEMINI · QUESTION 33

Gemini named a different first choice for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 23beforePermalink

Picks read from the answer, in order
  1. Salesforce Marketing Cloud
  2. Adobe Marketo Engage
  3. Braze
  4. HubSpot Enterprise

As a VP of Procurement at a 5,000-person enterprise, your evaluation criteria are fundamentally different from your Chief Marketing Officer’s. While Marketing is looking at features, personalization, and UI, you are looking at Total Cost of Ownership (TCO), vendor consolidation, security/compliance (CCPA/GDPR/SOC 2), integration costs, and pricing scalability.

At 5,000 employees, you are firmly in the enterprise tier. Standard SMB tools (like Mailchimp or Constant Contact) will present security, governance, and data-silo risks.

To give you the best recommendation, the platform you choose should be dictated by three things: Your primary CRM, your business model (B2B vs. B2C), and the pricing structure you are willing to tolerate.

Here is the executive breakdown of the enterprise email marketing platforms you should consider, viewed through a procurement lens.


Category 1: The Enterprise Marketing Clouds (Best for Vendor Consolidation & B2B)

If your company is heavily reliant on a major CRM, sticking within their ecosystem is often the safest procurement bet for data security and vendor consolidation.

1. Salesforce Marketing Cloud (SFMC) or Account Engagement (formerly Pardot)

  • •Best for: Enterprises already using Salesforce CRM. SFMC is for B2C (high volume, omnichannel); Pardot is for B2B (long sales cycles, lead scoring).
  • •Procurement Angle:
  • •Pros: Vendor consolidation (bundle it into your master Salesforce MSA for better leverage). It meets every enterprise security and compliance standard.
  • •Cons/Risks: Exceptionally high implementation costs. You will almost certainly need to hire a certified System Integrator (SI) agency to set it up, which can cost 50% to 150% of the Year-1 software license cost.

2. Adobe Marketo Engage

  • •Best for: Complex B2B enterprises. It is the gold standard for lead routing, scoring, and account-based marketing.
  • •Procurement Angle:
  • •Pros: Deep integrations with major CRMs (Salesforce, Microsoft Dynamics). Highly reliable.
  • •Cons/Risks: Pricing is heavily based on database size. If your marketing team does not routinely purge dead contacts, your renewal costs will skyrocket. It also requires highly specialized, expensive internal talent to run.

Category 2: The Modern Agile Platforms (Best for User Adoption & B2C/App-based)

If your company has a massive consumer database, a mobile app, or wants a platform that requires less heavy IT involvement, look here.

3. Braze (or Iterable)

  • •Best for: B2C enterprises, SaaS, or companies with a strong mobile app presence. They treat email, SMS, and push notifications equally.
  • •Procurement Angle:
  • •Pros: Highly modern architecture; integrates beautifully with enterprise data warehouses (Snowflake, AWS Redshift).
  • •Cons/Risks: Pricing model. Braze prices on Monthly Active Users (MAUs) or data points/events. You must have a strict SLA with Marketing and IT on what data is being sent to Braze, or you will blow through your data allotment and face massive overage fees.

4. HubSpot Enterprise (Marketing Hub)

  • •Best for: Mid-to-large enterprises looking for an "all-in-one" solution that Marketing teams actually enjoy using.
  • •Procurement Angle:
  • •Pros: Extremely low implementation cost compared to Salesforce or Adobe. High user adoption. Very transparent pricing.
  • •Cons/Risks: HubSpot prices based on "Marketing Contacts." Again, if the marketing team imports 1 million unvetted trade-show leads into the system, your SaaS bill will increase automatically.

🔑 The VP of Procurement’s Negotiation & Evaluation Checklist

When your marketing team brings you their preferred vendor, here is where you can mitigate risk and control costs:

  • 1.Interrogate the Pricing Metric:
  • •Per Seat? (Rare in this category).
  • •Per Contact in Database? (e.g., Marketo, HubSpot). Rule: Negotiate strict database limits and demand Marketing implements automated data-cleansing rules so you aren't paying for unsubscribed/dead contacts.
  • •Volume/CPM (Cost Per Mille)? (Paying per 1,000 emails sent). Rule: Negotiate overage buffers. Ask for a 10% tolerance on volume before overage rates kick in.
  • 2.Implementation & Professional Services:
  • •Do not look at the software cost in a vacuum. Ask the vendor: "Are implementation services included, or do we need a 3rd party?" If a 3rd party is required, ask the vendor to introduce 3 preferred partners so you can run an RFP on the implementation costs.
  • 3.Deliverability Services:
  • •At a 5,000-person enterprise scale, you need a Dedicated IP address. Ensure a Dedicated IP and "Deliverability Consulting" hours are baked into the contract.
  • 4.Governance & Security:
  • •Ensure the platform includes Single Sign-On (SSO) and strict Role-Based Access Control (RBAC). You cannot have an intern accidentally emailing your entire customer base or exporting a CSV of PII.

Recommendation on Next Steps

  • 1.If you are B2B and use Salesforce: Direct your team to evaluate Salesforce Pardot vs. Marketo.
  • 2.If you are B2C with massive data volumes: Direct your team to evaluate Braze vs. Salesforce Marketing Cloud.
  • 3.If marketing wants speed and ease of use, and IT is backlogged: Direct your team to evaluate HubSpot Enterprise.

Tip for the negotiation table: The end of the month/quarter is critical for these publicly traded companies (Salesforce, Adobe, HubSpot, Braze). If you can align your procurement timeline to sign in the final week of their fiscal quarter, you can routinely extract 15-25% discounts on multi-year commitments.

SEP 25afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot
  4. Braze
  5. Klaviyo

As a VP of Procurement at a 5,000-employee enterprise, your evaluation criteria are fundamentally different from your CMO’s. While Marketing is looking at feature sets, UI, and campaign capabilities, you are looking at Total Cost of Ownership (TCO), tech stack consolidation, security/compliance, scalability, and pricing leverage.

At your scale, you have outgrown SMB tools like standard Mailchimp or Constant Contact. The right platform depends entirely on your company’s business model and your existing CRM.

Here is the executive breakdown of the platforms you should consider, categorized by use case, along with the procurement angles you need to watch out for.


1. If You Are a B2B Company (Complex Sales Cycles, Lead Scoring)

If your company sells to other businesses, your marketing team needs a platform that handles lead nurturing, account-based marketing (ABM), and tight CRM integration.

  • •Adobe Marketo Engage
  • •The Vibe: The gold standard for enterprise B2B marketing. Highly customizable and powerful.
  • •Procurement Angle: Marketo is notorious for requiring highly specialized (and expensive) certified administrators. When calculating TCO, factor in the cost of talent or an outside agency. Adobe is flexible on discounting at the end of their quarters (specifically late November).
  • •Salesforce Marketing Cloud Account Engagement (formerly Pardot)
  • •The Vibe: The default choice if your enterprise runs on Salesforce CRM.
  • •Procurement Angle: If you are already spending heavily with Salesforce, this is your best play for tech stack consolidation and volume discounting. Avoid buying this if you use a non-Salesforce CRM (like Microsoft Dynamics); the integration headaches aren't worth it.
  • •HubSpot (Enterprise Tier)
  • •The Vibe: The most user-friendly platform. It has the fastest "time-to-value" and lowest implementation costs.
  • •Procurement Angle: HubSpot prices based on "Marketing Contacts." At an enterprise scale, this can spiral out of control if Marketing doesn't practice good data hygiene. Negotiate aggressive volume tiers for contacts upfront.

2. If You Are a B2C Company (High-Volume, Consumer-Facing)

If you are sending millions of emails to consumers, you need a platform built for massive scale, SMS integration, and real-time behavioral triggers.

  • •Salesforce Marketing Cloud (formerly ExactTarget)
  • •The Vibe: A massive, powerful, highly complex beast used by Fortune 500 B2C brands.
  • •Procurement Angle: Implementation costs can easily equal or exceed year-one licensing costs. You must budget for a systems integrator (like Deloitte, Slalom, or specialized agencies).
  • •Braze or Iterable
  • •The Vibe: The modern, agile competitors to Salesforce. They are API-first and excel at cross-channel (Email, SMS, In-App, Push notifications).
  • •Procurement Angle: Pricing is often based on Monthly Active Users (MAUs) or data events rather than just the number of emails sent. You need your marketing and data teams to accurately forecast API calls and data points, or you will get hit with massive overage fees.

3. If You Are E-Commerce Focused

  • •Klaviyo (Enterprise)
  • •The Vibe: Unmatched integration with Shopify Plus and other enterprise e-commerce platforms.
  • •Procurement Angle: Very straightforward ROI tracking, which makes it easy to justify the cost, but their enterprise pricing requires aggressive negotiation as volume scales.

The "Procurement Lens" Checklist for Your RFP

Before you issue an RFP or sign a contract, bring these points to your CMO or VP of Marketing:

  • 1.The "SSO Tax": Many vendors charge extra for SAML/SSO (Single Sign-On) and advanced role-based access control. At 5,000 employees, your CISO will mandate SSO. Ensure this is included in the base platform price, not as a costly add-on.
  • 2.Dedicated IP vs. Shared IP: At your size, you must have dedicated IP addresses to protect your email deliverability reputation. Ensure the cost of IP warm-up and dedicated IPs is included.
  • 3.Data Privacy & Residency: Ensure the vendor includes DPA (Data Processing Agreements) that cover CCPA, GDPR, and whatever industry-specific compliance you need (e.g., HIPAA for healthcare, GLBA for finance).
  • 4.Implementation & Support: Enterprise software is rarely plug-and-play. Ask the vendor to itemize premium support (SLAs with 1-hour response times) and onboarding costs.

Your Next Step

Do not evaluate platforms in a vacuum. Ask your Marketing leader two questions:

  • 1."What is our primary CRM (Salesforce, Dynamics, custom)?" (Your marketing platform must natively speak to this).
  • 2."How are we measuring pricing: by number of contacts in our database, or by the volume of emails/messages we send?"

Once you have those answers, invite two legacy vendors (e.g., Salesforce/Adobe) and one modern challenger (e.g., Braze/HubSpot) to present.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-23 permalink

Scored
answered
Received
2026-09-23 09:23:59 UTC
Run
20260923T090022Z-9b7b3a
Served by
Google · HTTP 200 · finish stop
Size
5,809 characters · 2,768 tokens out incl. hidden reasoning · 24.1 s
Extracted picks, in order · confidence high
  1. Salesforce Marketing Cloud
  2. Adobe Marketo Engage
  3. Braze
  4. HubSpot Enterprise

Highlighted: the names the extractor took as picks, where they appear verbatim (4 of 4).

As a VP of Procurement at a 5,000-person enterprise, your evaluation criteria are fundamentally different from your Chief Marketing Officer’s. While Marketing is looking at features, personalization, and UI, you are looking at **Total Cost of Ownership (TCO), vendor consolidation, security/compliance (CCPA/GDPR/SOC 2), integration costs, and pricing scalability.**
At 5,000 employees, you are firmly in the enterprise tier. Standard SMB tools (like Mailchimp or Constant Contact) will present security, governance, and data-silo risks.
To give you the best recommendation, the platform you choose should be dictated by three things: **Your primary CRM**, your **business model (B2B vs. B2C)**, and the **pricing structure** you are willing to tolerate.
Here is the executive breakdown of the enterprise email marketing platforms you should consider, viewed through a procurement lens.
---
### Category 1: The Enterprise Marketing Clouds (Best for Vendor Consolidation & B2B)
If your company is heavily reliant on a major CRM, sticking within their ecosystem is often the safest procurement bet for data security and vendor consolidation.
#### 1. Salesforce Marketing Cloud (SFMC) or Account Engagement (formerly Pardot)
* **Best for:** Enterprises already using Salesforce CRM. SFMC is for B2C (high volume, omnichannel); Pardot is for B2B (long sales cycles, lead scoring).
* **Procurement Angle:**
* **Pros:** Vendor consolidation (bundle it into your master Salesforce MSA for better leverage). It meets every enterprise security and compliance standard.
* **Cons/Risks:** Exceptionally high implementation costs. You will almost certainly need to hire a certified System Integrator (SI) agency to set it up, which can cost 50% to 150% of the Year-1 software license cost.
#### 2. Adobe Marketo Engage
* **Best for:** Complex B2B enterprises. It is the gold standard for lead routing, scoring, and account-based marketing.
* **Procurement Angle:**
* **Pros:** Deep integrations with major CRMs (Salesforce, Microsoft Dynamics). Highly reliable.
* **Cons/Risks:** Pricing is heavily based on database size. If your marketing team does not routinely purge dead contacts, your renewal costs will skyrocket. It also requires highly specialized, expensive internal talent to run.
---
### Category 2: The Modern Agile Platforms (Best for User Adoption & B2C/App-based)
If your company has a massive consumer database, a mobile app, or wants a platform that requires less heavy IT involvement, look here.
#### 3. Braze (or Iterable)
* **Best for:** B2C enterprises, SaaS, or companies with a strong mobile app presence. They treat email, SMS, and push notifications equally.
* **Procurement Angle:**
* **Pros:** Highly modern architecture; integrates beautifully with enterprise data warehouses (Snowflake, AWS Redshift).
* **Cons/Risks:** **Pricing model.** Braze prices on Monthly Active Users (MAUs) or data points/events. You must have a strict SLA with Marketing and IT on what data is being sent to Braze, or you will blow through your data allotment and face massive overage fees.
#### 4. HubSpot Enterprise (Marketing Hub)
* **Best for:** Mid-to-large enterprises looking for an "all-in-one" solution that Marketing teams actually enjoy using.
* **Procurement Angle:**
* **Pros:** Extremely low implementation cost compared to Salesforce or Adobe. High user adoption. Very transparent pricing.
* **Cons/Risks:** HubSpot prices based on "Marketing Contacts." Again, if the marketing team imports 1 million unvetted trade-show leads into the system, your SaaS bill will increase automatically.
---
### 🔑 The VP of Procurement’s Negotiation & Evaluation Checklist
When your marketing team brings you their preferred vendor, here is where you can mitigate risk and control costs:
1. **Interrogate the Pricing Metric:**
* *Per Seat?* (Rare in this category).
* *Per Contact in Database?* (e.g., Marketo, HubSpot). **Rule:** Negotiate strict database limits and demand Marketing implements automated data-cleansing rules so you aren't paying for unsubscribed/dead contacts.
* *Volume/CPM (Cost Per Mille)?* (Paying per 1,000 emails sent). **Rule:** Negotiate overage buffers. Ask for a 10% tolerance on volume before overage rates kick in.
2. **Implementation & Professional Services:**
* Do not look at the software cost in a vacuum. Ask the vendor: *"Are implementation services included, or do we need a 3rd party?"* If a 3rd party is required, ask the vendor to introduce 3 preferred partners so you can run an RFP on the implementation costs.
3. **Deliverability Services:**
* At a 5,000-person enterprise scale, you need a **Dedicated IP address**. Ensure a Dedicated IP and "Deliverability Consulting" hours are baked into the contract.
4. **Governance & Security:**
* Ensure the platform includes Single Sign-On (SSO) and strict Role-Based Access Control (RBAC). You cannot have an intern accidentally emailing your entire customer base or exporting a CSV of PII.
### Recommendation on Next Steps
1. **If you are B2B and use Salesforce:** Direct your team to evaluate **Salesforce Pardot** vs. **Marketo**.
2. **If you are B2C with massive data volumes:** Direct your team to evaluate **Braze** vs. **Salesforce Marketing Cloud**.
3. **If marketing wants speed and ease of use, and IT is backlogged:** Direct your team to evaluate **HubSpot Enterprise**.
*Tip for the negotiation table:* The end of the month/quarter is critical for these publicly traded companies (Salesforce, Adobe, HubSpot, Braze). If you can align your procurement timeline to sign in the final week of their fiscal quarter, you can routinely extract 15-25% discounts on multi-year commitments.

End of response · 66 lines · 5,809 characters · sha256 1d67589236ab488dcd2e76cf4a5cee37af54b53a6d67be14963c13d6f387faf1

After this run

2026-09-25 permalink

Scored
answered
Received
2026-09-25 09:25:46 UTC
Run
20260925T090007Z-f08d1f
Served by
Google · HTTP 200 · finish stop
Size
5,053 characters · 2,412 tokens out incl. hidden reasoning · 22.4 s
Extracted picks, in order · confidence medium
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot
  4. Braze
  5. Klaviyo

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

As a VP of Procurement at a 5,000-employee enterprise, your evaluation criteria are fundamentally different from your CMO’s. While Marketing is looking at feature sets, UI, and campaign capabilities, you are looking at **Total Cost of Ownership (TCO), tech stack consolidation, security/compliance, scalability, and pricing leverage.**
At your scale, you have outgrown SMB tools like standard Mailchimp or Constant Contact. The right platform depends entirely on **your company’s business model** and **your existing CRM**.
Here is the executive breakdown of the platforms you should consider, categorized by use case, along with the procurement angles you need to watch out for.
---
### 1. If You Are a B2B Company (Complex Sales Cycles, Lead Scoring)
If your company sells to other businesses, your marketing team needs a platform that handles lead nurturing, account-based marketing (ABM), and tight CRM integration.
* **Adobe Marketo Engage**
* **The Vibe:** The gold standard for enterprise B2B marketing. Highly customizable and powerful.
* **Procurement Angle:** Marketo is notorious for requiring highly specialized (and expensive) certified administrators. When calculating TCO, factor in the cost of talent or an outside agency. Adobe is flexible on discounting at the end of their quarters (specifically late November).
* **Salesforce Marketing Cloud Account Engagement (formerly Pardot)**
* **The Vibe:** The default choice if your enterprise runs on Salesforce CRM.
* **Procurement Angle:** If you are already spending heavily with Salesforce, this is your best play for tech stack consolidation and volume discounting. Avoid buying this if you use a non-Salesforce CRM (like Microsoft Dynamics); the integration headaches aren't worth it.
* **HubSpot (Enterprise Tier)**
* **The Vibe:** The most user-friendly platform. It has the fastest "time-to-value" and lowest implementation costs.
* **Procurement Angle:** HubSpot prices based on "Marketing Contacts." At an enterprise scale, this can spiral out of control if Marketing doesn't practice good data hygiene. Negotiate aggressive volume tiers for contacts upfront.
### 2. If You Are a B2C Company (High-Volume, Consumer-Facing)
If you are sending millions of emails to consumers, you need a platform built for massive scale, SMS integration, and real-time behavioral triggers.
* **Salesforce Marketing Cloud (formerly ExactTarget)**
* **The Vibe:** A massive, powerful, highly complex beast used by Fortune 500 B2C brands.
* **Procurement Angle:** Implementation costs can easily equal or exceed year-one licensing costs. You *must* budget for a systems integrator (like Deloitte, Slalom, or specialized agencies).
* **Braze** or **Iterable**
* **The Vibe:** The modern, agile competitors to Salesforce. They are API-first and excel at cross-channel (Email, SMS, In-App, Push notifications).
* **Procurement Angle:** Pricing is often based on Monthly Active Users (MAUs) or data events rather than just the number of emails sent. You need your marketing and data teams to accurately forecast API calls and data points, or you will get hit with massive overage fees.
### 3. If You Are E-Commerce Focused
* **Klaviyo (Enterprise)**
* **The Vibe:** Unmatched integration with Shopify Plus and other enterprise e-commerce platforms.
* **Procurement Angle:** Very straightforward ROI tracking, which makes it easy to justify the cost, but their enterprise pricing requires aggressive negotiation as volume scales.
---
### The "Procurement Lens" Checklist for Your RFP
Before you issue an RFP or sign a contract, bring these points to your CMO or VP of Marketing:
1. **The "SSO Tax":** Many vendors charge extra for SAML/SSO (Single Sign-On) and advanced role-based access control. At 5,000 employees, your CISO will mandate SSO. Ensure this is included in the base platform price, not as a costly add-on.
2. **Dedicated IP vs. Shared IP:** At your size, you must have dedicated IP addresses to protect your email deliverability reputation. Ensure the cost of IP warm-up and dedicated IPs is included.
3. **Data Privacy & Residency:** Ensure the vendor includes DPA (Data Processing Agreements) that cover CCPA, GDPR, and whatever industry-specific compliance you need (e.g., HIPAA for healthcare, GLBA for finance).
4. **Implementation & Support:** Enterprise software is rarely plug-and-play. Ask the vendor to itemize premium support (SLAs with 1-hour response times) and onboarding costs.
### Your Next Step
Do not evaluate platforms in a vacuum. Ask your Marketing leader two questions:
1. *"What is our primary CRM (Salesforce, Dynamics, custom)?"* (Your marketing platform **must** natively speak to this).
2. *"How are we measuring pricing: by number of contacts in our database, or by the volume of emails/messages we send?"*
Once you have those answers, invite **two legacy vendors** (e.g., Salesforce/Adobe) and **one modern challenger** (e.g., Braze/HubSpot) to present.

End of response · 53 lines · 5,053 characters · sha256 11bb475f8bff150ced5126b973de0846a4f391bcbf5aff20f4dd14f2ff1fa957

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
google/gemini-3.1-pro-preview
pinned google/gemini-3.1-pro-preview-20260219; alias resolved to google/gemini-3.1-pro-preview-20260219 at 2026-09-25 09:00:06 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
first extracted pick differs from the baseline's (full lists below)
Baseline
6 prior days with data; 2 matched the baseline value (2026-09-22, 2026-09-23)
Responses
before 2026-09-23 09:23:59 UTC, run 20260923T090022Z-9b7b3a; after 2026-09-25 09:25:46 UTC, run 20260925T090007Z-f08d1f
Detected
2026-09-25 · run 20260925T090007Z-f08d1f, started 2026-09-25 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-25/P29/google/gemini-3.1-pro-preview/pick_change/picks.top/
Event ID
2026-09-25:P29:google/gemini-3.1-pro-preview:pick_change:picks.top

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.