# Tag Info

1 vote
Accepted

### Would it be possible to involve a proof assistant in the process of training a LLM?

Your post has links with: An article by Stephen Wolfram [ https://writings.stephenwolfram.com/2023/01/wolframalpha-as-the-way-to-bring-computational-knowledge-superpowers-to-chatgpt/ ], stating that ...
• 26
### Why is $\sum_{s} \eta(s)$ a constant of proportionality in the proof of the policy gradient theorem?
Spitballing some ideas here - as $\pi_\theta$ is updated using some gradient optimization process with small steps in the direction of the gradient, the changes to state visits are generally small as ...