the gap between llm probabilistic output and smart contract deterministic requirements. how are people actually solving this in production?

Post original

Maybe that intent-to-JSON part should be a back-and-forth talk with LLM, like when coding in planning mode. LLM generates JSON to be approved by human, asks questions about doubtful parameters, human confirms, then that lands on chain. For the intent ambiguity, if you don't want to involve human in process, you might want to double-check by other agent or deterministic testing engine, that keeps AI decisions in reasonable frame and loops with LLM on failure. For the speed you might need to use LLM's in Fast mode and do a solid prompt engineering/context management to minimize inference time.