Hi Usingproxy,

In this paper, the proxies are defined as a _trainable_ Module [1]. The proxies' feature vectors contribute to the loss function. Thus, they are learnable.

That being said, other approaches define the proxies as _non-trainable_ constants. In this case, the proxies are initialized to impose a certain characteristic on the proxies. For example, you want to make sure the proxies are orthogonal to each other.

Of course, you can combine the merits of both approach. Make the proxies trainable while imposing an orthogonality regularizer

[1] https://github.com/tjddus9597/Proxy-Anchor-CVPR2020/blob/3310a8d6aabb18b842b77fc5fbadd7d7965cce3d/code/losses.py#L30

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store