How to pronounce“q function”in English

to be the Q function so there's two estimators going on with in terms of neural networks those two forward passes here there's two Q's in this equation so

notation so the Q function is just telling you how good and this state action pair is under your current policy um the value function well the state

between the Q function and the state value function meaning how much better is that action than uh what the policy would have

equation that the Q function should

function to a new Q function and uh it's defined by just taking the right hand side of the Bellman equation and uh plugging in um our Q function our new Q

approximately uh the Q function of that policy and then uh you update your

that the Q function should be approximately equal to the back upb value and then we just minimize it with uh