As we discussed during the call, I think the current system is not very transparent when it manages the additional labels that might occur in CTC (blank) or attention-based models (e.g, EOS). I agree with Aku that this is connected with the dataloader and the creation of the label dictionary. We can thus revise this part as well if we want to revise the dataloader part.