Skip to content

fix(evaluator): fix tag dropdown for evaluator block #807

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
waleedlatif1 merged 2 commits into from
Jul 28, 2025
Merged

fix(evaluator): fix tag dropdown for evaluator block #807

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
68108ac
fix(evaluator): fix tag dropdown for evaluator block
Jul 28, 2025
adca826
lint
Jul 28, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 34 additions & 2 deletions apps/sim/components/ui/tag-dropdown.tsx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -171,7 +171,23 @@ export const TagDropdown: React.FC<TagDropdownProps> = ({

let blockTags: string[]

if (responseFormat) {
// Special handling for evaluator blocks
if (sourceBlock.type === 'evaluator') {
// Get the evaluation metrics for the evaluator block
const metricsValue = useSubBlockStore.getState().getValue(activeSourceBlockId, 'metrics')

if (metricsValue && Array.isArray(metricsValue) && metricsValue.length > 0) {
// Use the metric names as the available outputs
const validMetrics = metricsValue.filter((metric: any) => metric?.name)
Comment thread
waleedlatif1 marked this conversation as resolved.
blockTags = validMetrics.map(
(metric: any) => `${normalizedBlockName}.${metric.name.toLowerCase()}`
)
} else {
// Fallback to default evaluator outputs if no metrics are defined
const outputPaths = generateOutputPaths(blockConfig.outputs)
blockTags = outputPaths.map((path) => `${normalizedBlockName}.${path}`)
}
} else if (responseFormat) {
// Use custom schema properties if response format is specified
const schemaFields = extractFieldsFromSchema(responseFormat)
if (schemaFields.length > 0) {
Expand Down Expand Up @@ -430,7 +446,23 @@ export const TagDropdown: React.FC<TagDropdownProps> = ({

let blockTags: string[]

if (responseFormat) {
// Special handling for evaluator blocks
if (accessibleBlock.type === 'evaluator') {
// Get the evaluation metrics for the evaluator block
const metricsValue = useSubBlockStore.getState().getValue(accessibleBlockId, 'metrics')

if (metricsValue && Array.isArray(metricsValue) && metricsValue.length > 0) {
// Use the metric names as the available outputs
const validMetrics = metricsValue.filter((metric: any) => metric?.name)
blockTags = validMetrics.map(
(metric: any) => `${normalizedBlockName}.${metric.name.toLowerCase()}`
)
} else {
// Fallback to default evaluator outputs if no metrics are defined
const outputPaths = generateOutputPaths(blockConfig.outputs)
blockTags = outputPaths.map((path) => `${normalizedBlockName}.${path}`)
}
} else if (responseFormat) {
// Use custom schema properties if response format is specified
const schemaFields = extractFieldsFromSchema(responseFormat)
if (schemaFields.length > 0) {
Expand Down