To pass the data around the relative dependencies of various tokens showing at distinctive areas in the sequence, a relative positional encoding is calculated by some type of Studying. Two well known varieties of relative encodings are:What can be achieved to mitigate this kind of pitfalls? It isn't in the scope of this paper to provide suggestions