Author
Yongmin Li
0 works0 citations
Recent research
- AI & ComputingOpen access
Efficient Grammar-Constrained Decoding via Parser Stack Classification
LLMs are widely used to generate structured output like source code or JSON. Grammar-constrained decoding (GCD) can guarantee the syntactic validity of the generated output, by masking out tokens that violate rules specified by a context-free grammar. However, the online computat...