A corner is the only square on the board that can never be flipped. Once you take a corner, you can build stable discs along the edges from it, and the opponent has fewer options on those edges.
So when the opponent gives you a corner, it is usually good to take it. But there are positions where something else gains more than the corner, so it is not "always".
Exercise
Black to move. What is the best move?
Exercise
White to move. What is the best move?