feat(lighthouse-ci): render report as Job Summary; sync APPS list to matrix

HazAT · HazAT · commit 8288dcbc41e1 · 2026-05-13T09:11:40.000+02:00
Two changes to make Lighthouse data visible on every run, regardless of trigger:

1. Always write the report markdown to `$GITHUB_STEP_SUMMARY` via
   `core.summary.addRaw().write()`. The Job Summary renders as a styled panel
   at the top of the workflow run page \u2014 visible for PR runs, nightly runs,
   and manual dispatches alike. For PR runs the existing PR comment is still
   posted/updated; for nightly runs the Job Summary becomes the only output
   (was previously just `console.log` to the workflow log, which nobody reads).

2. Trim the hardcoded APPS list from 9 entries down to 2 (default-browser,
   nextjs-16). Only those two apps actually branch on `SENTRY_LIGHTHOUSE_MODE`
   today \u2014 the other seven were carried over from the original planner output
   but were never instrumented. With the stale 9-entry list, the matrix only
   produced 6 of 27 expected cells, tripping the 50%-fill safety check on
   every run and skipping the report entirely. The MEDIUM-severity bugbot
   finding called this out.

When more apps gain `SENTRY_LIGHTHOUSE_MODE` support (tracked in
TODO-aeab11f0), add them to both APPS arrays at the same time.
diff --git a/dev-packages/lighthouse-tests/post-comment.mjs b/dev-packages/lighthouse-tests/post-comment.mjs
@@ -11,19 +11,13 @@ const MODES = ['no-sentry', 'init-only', 'tracing-replay'];
  * Apps and their human-readable SDK labels, matching lighthouse-matrix.mjs.
  * Order here determines row order in each table.
  */
-// Must mirror lighthouse-matrix.mjs APPS. angular, remix, ember, solidstart,
-// and react-router-7-spa are intentionally excluded — see note in
-// lighthouse-matrix.mjs.
+// Must mirror the APPS array in lighthouse-matrix.mjs. Only apps whose Sentry init
+// code actually branches on SENTRY_LIGHTHOUSE_MODE are listed here — listing
+// uninstrumented apps would dilute the 50%-fill safety check below and produce
+// meaningless Δ columns. See lighthouse-matrix.mjs for the full rationale.
 const APPS = [
   { app: 'default-browser', sdk: 'browser' },
-  { app: 'react-19', sdk: 'react' },
-  { app: 'vue-3', sdk: 'vue' },
-  { app: 'svelte-5', sdk: 'svelte' },
-  { app: 'sveltekit-2', sdk: 'sveltekit' },
-  { app: 'astro-5', sdk: 'astro' },
-  { app: 'tanstackstart-react', sdk: 'tanstack-start' },
   { app: 'nextjs-16', sdk: 'nextjs' },
-  { app: 'nuxt-5', sdk: 'nuxt' },
 ];
 
 /**
@@ -150,10 +144,14 @@ async function run() {
 
   const body = `${HEADING}\n\n${tables}${footer}`;
 
+  // Always render the report as a GitHub Actions Job Summary so it's visible on the
+  // workflow run page for every trigger (PR, nightly, dispatch). For PR runs we also
+  // post/update a sticky comment on the PR below.
+  await core.summary.addRaw(body).write();
+  core.info('Wrote Lighthouse report to Job Summary.');
+
   if (!isPR || !prNumber) {
-    // Nightly / non-PR: log to stdout (captured in workflow logs)
-    // eslint-disable-next-line no-console
-    console.log(body);
+    // Nightly / non-PR: Job Summary above is the only output. Nothing to post.
     return;
   }
 
