New APIs will never show a badge for a MediaStyle notification. It seems that for older API versions it needs to be deactivated manually.

Media3 Version

1.0.0-beta02