center of Gravitational pull is deep inside the earth.
matter closer to earth experience more pull while matter away from it experience as low pull as it is away.
so
atomospheric pressure is also due to gravitational force on air and thus it keeps on decreasing as you go higher from sea level.

this is the reason behind it.