Yeah, you should multiply everything in that equation by A^-1
So you get A^-1 * A * A = A^-1 * A * B + 2 * A^-1 * A
This SHOULD simplfy to
A = B + 2*I, where I is the identity matrix.
So, B = A - 2*I
So B =
[ 0 1 -1 ]
[ 0 1 2 ]
[-1 4 1 ]
EDIT: Always check your work... (I just did using Matlab)
>> A*B + 2*A
ans =
5 1 -3
-2 17 12
-5 23 18
>> A * A
ans =
5 1 -3
-2 17 12
-5 23 18