Skip to content

Conversation

@adriandlam
Copy link
Member

@adriandlam adriandlam commented Dec 10, 2025

saw this error in tanstack app:

devtools() plugin listens to port 42069 before the server can listen to 3000 -> port detection in workflow chooses 42069 since it was first

this pr:

  • Add getWorkflowPort() that probes listening ports if there are more than one initially
  • Fixes issue where devtools/inspector ports could be incorrectly detected

@changeset-bot
Copy link

changeset-bot bot commented Dec 10, 2025

🦋 Changeset detected

Latest commit: 4166d55

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
Name Type
@workflow/world-local Patch
@workflow/sveltekit Patch
@workflow/utils Patch
@workflow/cli Patch
@workflow/core Patch
@workflow/world-postgres Patch
workflow Patch
@workflow/errors Patch
@workflow/world-testing Patch
@workflow/builders Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/web-shared Patch
@workflow/ai Patch
@workflow/world-vercel Patch
@workflow/astro Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Contributor

vercel bot commented Dec 10, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview Comment Dec 10, 2025 8:26pm
example-nextjs-workflow-webpack Ready Ready Preview Comment Dec 10, 2025 8:26pm
example-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-astro-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-express-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-fastify-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-hono-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-nitro-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-nuxt-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-sveltekit-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workbench-vite-workflow Ready Ready Preview Comment Dec 10, 2025 8:26pm
workflow-docs Ready Ready Preview Comment Dec 10, 2025 8:26pm

@github-actions
Copy link
Contributor

github-actions bot commented Dec 10, 2025

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 175 0 7 182
✅ 💻 Local Development 252 0 8 260
✅ 📦 Local Production 252 0 8 260
✅ 🐘 Local Postgres 252 0 8 260
✅ 🪟 Windows 26 0 0 26
❌ 🌍 Community Worlds 105 11 0 116
Total 1062 11 31 1104

❌ Failed Tests

🌍 Community Worlds (11 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (8 failed):

  • addTenWorkflow
  • addTenWorkflow
  • retryAttemptCounterWorkflow
  • crossFileErrorWorkflow - stack traces work across imported modules
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 25 0 1
✅ express 25 0 1
✅ fastify 25 0 1
✅ hono 25 0 1
✅ nuxt 25 0 1
✅ sveltekit 25 0 1
✅ vite 25 0 1
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 25 0 1
✅ express-stable 25 0 1
✅ fastify-stable 25 0 1
✅ hono-stable 25 0 1
✅ nextjs-turbopack-stable 26 0 0
✅ nextjs-webpack-stable 26 0 0
✅ nitro-stable 25 0 1
✅ nuxt-stable 25 0 1
✅ sveltekit-stable 25 0 1
✅ vite-stable 25 0 1
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 25 0 1
✅ express-stable 25 0 1
✅ fastify-stable 25 0 1
✅ hono-stable 25 0 1
✅ nextjs-turbopack-stable 26 0 0
✅ nextjs-webpack-stable 26 0 0
✅ nitro-stable 25 0 1
✅ nuxt-stable 25 0 1
✅ sveltekit-stable 25 0 1
✅ vite-stable 25 0 1
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 25 0 1
✅ express-stable 25 0 1
✅ fastify-stable 25 0 1
✅ hono-stable 25 0 1
✅ nextjs-turbopack-stable 26 0 0
✅ nextjs-webpack-stable 26 0 0
✅ nitro-stable 25 0 1
✅ nuxt-stable 25 0 1
✅ sveltekit-stable 25 0 1
✅ vite-stable 25 0 1
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 26 0 0
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 3 0 0
❌ mongodb 25 1 0
✅ redis-dev 3 0 0
❌ redis 25 1 0
✅ starter-dev 3 0 0
❌ starter 18 8 0
✅ turso-dev 3 0 0
❌ turso 25 1 0

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Dec 10, 2025

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.031s (-33.7% 🟢) 1.007s (~) 0.976s 10 1.00x
💻 Local Next.js (Turbopack) 0.040s (+1.3%) 1.017s (~) 0.978s 10 1.27x
🌐 Redis Next.js (Turbopack) 0.041s (+3.0%) 1.017s (~) 0.977s 10 1.30x
🌐 Starter Next.js (Turbopack) 0.041s (+8.8% 🔺) 1.014s (~) 0.973s 10 1.30x
💻 Local Nitro 0.043s (+1.4%) 1.006s (~) 0.963s 10 1.38x
🌐 MongoDB Next.js (Turbopack) 0.047s (-23.5% 🟢) 1.014s (~) 0.967s 10 1.51x
🌐 Turso Next.js (Turbopack) 0.092s (-9.3% 🟢) 1.013s (~) 0.921s 10 2.95x
🐘 Postgres Next.js (Turbopack) 0.119s (-68.2% 🟢) 1.020s (~) 0.900s 10 3.82x
🐘 Postgres Express 0.301s (-22.1% 🟢) 1.013s (~) 0.712s 10 9.63x
🐘 Postgres Nitro 0.322s (-3.2%) 1.012s (-2.1%) 0.690s 10 10.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.630s (+1.2%) 1.526s (-10.1% 🟢) 0.896s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 1.075s (-3.3%) 2.007s (~) 0.932s 10 1.00x
🌐 Starter Next.js (Turbopack) 1.092s (~) 2.010s (~) 0.918s 10 1.02x
💻 Local Next.js (Turbopack) 1.095s (~) 2.011s (~) 0.917s 10 1.02x
🌐 Redis Next.js (Turbopack) 1.100s (~) 2.013s (~) 0.913s 10 1.02x
💻 Local Nitro 1.111s (~) 2.005s (~) 0.895s 10 1.03x
🌐 MongoDB Next.js (Turbopack) 1.295s (-1.6%) 2.012s (~) 0.716s 10 1.21x
🌐 Turso Next.js (Turbopack) 1.323s (+0.6%) 2.012s (~) 0.689s 10 1.23x
🐘 Postgres Next.js (Turbopack) 1.920s (+10.8% 🔺) 2.015s (~) 0.094s 10 1.79x
🐘 Postgres Express 2.125s (-5.0%) 3.015s (~) 0.890s 10 1.98x
🐘 Postgres Nitro 2.164s (-11.2% 🟢) 3.016s (~) 0.851s 10 2.01x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.694s (+1.8%) 3.561s (-2.3%) 0.866s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 10.518s (-2.5%) 11.013s (~) 0.494s 5 1.00x
🌐 Starter Next.js (Turbopack) 10.600s (~) 11.011s (~) 0.411s 5 1.01x
💻 Local Next.js (Turbopack) 10.651s (~) 11.017s (~) 0.366s 5 1.01x
🌐 Redis Next.js (Turbopack) 10.672s (~) 11.020s (~) 0.348s 5 1.01x
💻 Local Nitro 10.774s (~) 11.013s (~) 0.239s 5 1.02x
🌐 Turso Next.js (Turbopack) 12.189s (~) 13.020s (~) 0.831s 5 1.16x
🌐 MongoDB Next.js (Turbopack) 12.223s (-0.5%) 13.022s (~) 0.799s 5 1.16x
🐘 Postgres Next.js (Turbopack) 15.275s (+3.5%) 16.033s (+5.3% 🔺) 0.758s 5 1.45x
🐘 Postgres Nitro 15.592s (-13.8% 🟢) 16.031s (-14.0% 🟢) 0.439s 5 1.48x
🐘 Postgres Express 20.433s (+0.7%) 21.037s (~) 0.605s 5 1.94x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 21.030s (+1.7%) 21.743s (+1.8%) 0.713s 5 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 parallel steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 1.325s (-4.2%) 2.006s (~) 0.680s 5 1.00x
🌐 Redis Next.js (Turbopack) 1.357s (+1.9%) 2.010s (~) 0.653s 5 1.02x
💻 Local Next.js (Turbopack) 1.359s (~) 2.011s (~) 0.652s 5 1.03x
🌐 Starter Next.js (Turbopack) 1.379s (+1.9%) 2.008s (~) 0.629s 5 1.04x
💻 Local Nitro 1.383s (~) 2.005s (~) 0.622s 5 1.04x
🐘 Postgres Next.js (Turbopack) 1.785s (-8.5% 🟢) 2.014s (-16.7% 🟢) 0.230s 5 1.35x
🐘 Postgres Nitro 2.034s (+8.5% 🔺) 2.422s (+9.6% 🔺) 0.388s 5 1.53x
🌐 MongoDB Next.js (Turbopack) 2.119s (-1.6%) 3.011s (~) 0.892s 5 1.60x
🌐 Turso Next.js (Turbopack) 2.219s (~) 3.011s (-0.6%) 0.792s 5 1.67x
🐘 Postgres Express 2.431s (-8.7% 🟢) 3.018s (~) 0.586s 5 1.83x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.077s (+1.7%) 4.806s (-4.5%) 0.729s 5 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

stress test: Promise.all with 100 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 6.609s (+1.7%) 6.930s (~) 0.321s 5 1.00x
🌐 Redis Next.js (Turbopack) 8.030s (+1.9%) 8.401s (+2.4%) 0.372s 4 1.21x
🐘 Postgres Express 8.688s (-2.3%) 9.094s (-4.2%) 0.406s 4 1.31x
🐘 Postgres Nitro 8.873s (-1.4%) 9.267s (-1.7%) 0.393s 4 1.34x
🐘 Postgres Next.js (Turbopack) 8.972s (+4.6%) 9.460s (+6.0% 🔺) 0.487s 4 1.36x
💻 Local Express 11.809s (-12.2% 🟢) 11.898s (-12.5% 🟢) 0.089s 3 1.79x
💻 Local Nitro 13.570s (+3.0%) 13.645s (+2.9%) 0.074s 3 2.05x
💻 Local Next.js (Turbopack) 15.528s (+10.8% 🔺) 15.709s (+9.2% 🔺) 0.181s 3 2.35x
🌐 MongoDB Next.js (Turbopack) 20.024s (+0.6%) 20.523s (~) 0.499s 2 3.03x
🌐 Turso Next.js (Turbopack) 20.186s (+1.6%) 20.524s (~) 0.338s 2 3.05x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 15.586s (-23.1% 🟢) 16.785s (-19.5% 🟢) 1.198s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

stress test: Promise.race with 100 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 6.549s (-1.6%) 6.805s (-1.7%) 0.256s 5 1.00x
🌐 Redis Next.js (Turbopack) 8.550s (+5.4% 🔺) 8.900s (+5.4% 🔺) 0.350s 4 1.31x
🐘 Postgres Express 8.967s (-7.4% 🟢) 9.047s (-8.4% 🟢) 0.080s 4 1.37x
🐘 Postgres Nitro 9.727s (-1.4%) 10.123s (+0.6%) 0.396s 3 1.49x
🐘 Postgres Next.js (Turbopack) 10.192s (+15.2% 🔺) 10.457s (+11.7% 🔺) 0.264s 3 1.56x
💻 Local Express 13.433s (-3.8%) 13.701s (-3.9%) 0.268s 3 2.05x
💻 Local Nitro 13.526s (-2.9%) 13.743s (-2.0%) 0.216s 3 2.07x
💻 Local Next.js (Turbopack) 15.287s (-7.5% 🟢) 16.083s (-4.4%) 0.797s 2 2.33x
🌐 Turso Next.js (Turbopack) 19.911s (-0.9%) 20.525s (~) 0.614s 2 3.04x
🌐 MongoDB Next.js (Turbopack) 20.000s (-0.8%) 20.524s (~) 0.525s 2 3.05x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 15.181s (-22.9% 🟢) 15.654s (-24.5% 🟢) 0.474s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.111s (-36.0% 🟢) 0.999s (+0.7%) 0.012s (-16.7% 🟢) 1.019s (~) 0.908s 10 1.00x
🌐 Starter Next.js (Turbopack) 0.132s (+4.3%) 1.005s (~) 0.000s (+Infinity% 🔺) 1.010s (~) 0.878s 10 1.19x
💻 Local Next.js (Turbopack) 0.139s (~) 1.003s (~) 0.017s (+10.6% 🔺) 1.027s (~) 0.887s 10 1.26x
🌐 Redis Next.js (Turbopack) 0.143s (+3.8%) 1.004s (~) 0.000s (~) 1.013s (~) 0.871s 10 1.29x
💻 Local Nitro 0.172s (~) 0.992s (~) 0.014s (~) 1.020s (~) 0.848s 10 1.56x
🌐 MongoDB Next.js (Turbopack) 0.482s (-6.0% 🟢) 0.965s (+2.9%) 0.000s (+Infinity% 🔺) 1.012s (~) 0.531s 10 4.36x
🌐 Turso Next.js (Turbopack) 0.495s (+4.0%) 0.960s (-2.4%) 0.000s (+Infinity% 🔺) 1.012s (~) 0.517s 10 4.48x
🐘 Postgres Express 1.138s (-50.8% 🟢) 1.901s (-30.4% 🟢) 0.000s (-100.0% 🟢) 2.015s (-33.2% 🟢) 0.877s 10 10.29x
🐘 Postgres Nitro 1.227s (+20.5% 🔺) 1.817s (+4.0%) 0.000s (-100.0% 🟢) 2.013s (+11.1% 🔺) 0.787s 10 11.09x
🐘 Postgres Next.js (Turbopack) 1.334s (+41.8% 🔺) 1.956s (+140.2% 🔺) 0.000s (+100.0% 🔺) 2.017s (+80.9% 🔺) 0.683s 10 12.07x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.656s (+8.9% 🔺) 3.136s (+7.3% 🔺) 0.285s (-12.8% 🟢) 3.843s (+5.4% 🔺) 1.187s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Express 7/7
🐘 Postgres Next.js (Turbopack) 4/7
▲ Vercel Express 7/7
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 💻 Local 5/7
Next.js (Turbopack) 🌐 Starter 5/7
Nitro 💻 Local 5/7
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@adriandlam adriandlam changed the title fix: port detection fix: improve port detection reliability with HTTP probing Dec 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants