Gravity is only important insofar that it is capable of compressing the material to high densities. Whether that material is capable of solidifying depends on the competition between Coulombic potential energy and the thermal energy of the particles. The former increases with density, the latter increases with temperature. A dense plasma can still be a gas if it is hot enough.
A rough formula for the exponential scale height of the atmosphere is
$$ h = \frac{kT}{\mu m_u g},$$
where $T$ is the temperature of the gas, $m_u$ is an atomic mass unit, $\mu$ is the number of atomic mass units per particle and $g$ is the surface gravity, with $g = GM/R^2$.
For a typical neutron star with $R=10$ km, $M= 1.4M_{\odot}$, we have $g=1.86\times 10^{12}$ m/s$^2$. The atmosphere could be a mixture of ionised helium ($\mu=4/3$) or perhaps iron ($\mu = 56/27$), so let's say $\mu=2$ for simplicity. The temperature at the surface of the neutron star will change with time; typically for a young pulsar, the surface temperature might be $10^{6}$ K.
This gives $h = 2$ mm.
Why is this not a "solid"? Because the thermal energy of the particles is larger than the coulombic binding energy in any solid lattice that the ions could make. That is not the case in the solid surface below the atmosphere because the density grows very rapidly (from $10^{6}$ kg/m$^{3}$ to more than $10^{10}$ kg/m$^{3}$ (where solidification takes place) only a few cm in, because the scale height is so small. Of course the temperature increases too, but not by more than a factor of about 100. After that, the density is high enough for electron degeneracy, and the material becomes approximately isothermal and at a small depth the "freezing temperature" falls below the isothermal temperature.