New answers tagged

1 vote
Accepted

Would it be possible to involve a proof assistant in the process of training a LLM?

Your post has links with: An article by Stephen Wolfram [ https://writings.stephenwolfram.com/2023/01/wolframalpha-as-the-way-to-bring-computational-knowledge-superpowers-to-chatgpt/ ], stating that ...
2 votes

How to deal with varying number of input images?

There are are couple methods that you may wish to consider for this challenging but interesting problem. In some cases, multiple images are captured because of artifacts in the initial images, so ...
0 votes

How can Transformers handle arbitrary length input?

The accepted answer is wonderful; this answer provides an alternative approach for dealing with variable length inputs. More specifically, what might be done when the input is longer than the maximum ...
2 votes
Accepted

Which calculation to use for GRU

Firstly, I am assuming $r$ is the update to the hidden state. I will call it $\tilde{\mathbf{h}}_t$, because this is how it's called in the paper by Cho et al. that introduced the GRU (where $\mathbf{...
  • 1,157

Top 50 recent answers are included