So what the JEPA (Joint-Embedding Predictive Architecture) system when it’s being trained is trying to do, is extract as much information as possible from the input, but yet only extract information that is relatively easily predictable.
Exploring Meta AI, Open Source, and the…
So what the JEPA (Joint-Embedding Predictive Architecture) system when it’s being trained is trying to do, is extract as much information as possible from the input, but yet only extract information that is relatively easily predictable.