Your guess on the requirement for calculus is correct. What you need to do is integrate the moon's distance over one orbit to find an average distance.
Starting from the equation below, the Moon's (or really any orbiting body's) orbital distance, $r$, as a function of azimuthal angle $\theta$ is given by the Orbit Equation.
$$r(\theta) = \frac{L^2}{m^2\mu}\frac{1}{1+e\cos(\theta)}$$
In this equation, the variables have the following definitions:
- $r$ - The distance the body is from the body it is orbiting.
- $\theta$ - The angle of the body at a given point in the orbit, as measured from the periapsis. This means $\theta = 0$ at periapsis and $\theta = \pi$ at apoapsis.
- $L$ - The orbital angular momentum of the body. This is simply given by $mrv$ where $m$ is the mass, $r$ is the distance at any point in the orbit, and $v$ is the orbital velocity at that point. Because the orbital angular momentum is conserved, any point along the orbit will give the same value. The fact sheet you linked to gives both the apoapsis distance and the velocity at that point so you could calculate $L$ from this.
- $m$ - As above, the mass of the orbiting body. Note that technically the formula for $L$ cancels with the $m$ in this equation, which is why you often see the $L^2/m^2\mu$ portion often written as $\ell^2/\mu$ where $\ell$ is the angular momentum per unit mass (i.e., just $rv$).
- $\mu$ - The standard gravitational parameter of the system, given by $G(m_1 + m_2)$ where $m_1$ and $m_2$ are the masses of the two bodies involved (the Earth and the Moon in this case) and $G$ is the gravitational constant.
- $e$ - The eccentricity of the orbit. Also on the fact sheet.
So there's a bit of work here, but you can find all the numbers and plug them in to the equation.
Now, here comes the calculus part. In order to find the average orbital distance, $\bar{r}$, you have to integrate $r(\theta)$ over an entire orbit. So the average becomes
$$\bar{r} = \frac{1}{2\pi}\int_0^{2\pi} r(\theta)\ d\theta = \frac{\ell^2/\mu}{2\pi}\int_0^{2\pi} \frac{1}{1+0.0549\cos(\theta)}\ d\theta$$
I have no interest in doing that nasty integral so I'll just plug it into a calculator for me. I find that this works out to the following:
$$\bar{r} = 1.00151\frac{\ell^2}{\mu}$$
This boils down to just calculating $\ell$ and $\mu$ now and plugging in. Using the fact sheet you linked in your question, I find the following values of $\ell = 3.922\times10^{11}\:\mathrm{m^2/s}$ and $\mu = 4.033\times10^{14}\:\mathrm{m^3/s^{-2}}$. Which means, when I plug those numbers into the equation, I get a mean orbital distance of
$$\bar{r} = 384\ 234\:\mathrm{km}$$
However, all of that was a lot of work to calculate something that could've been arrived at much easier. Remember above, I said that $L$ is conserved so the value is constant at any point in the orbit. Thus you can say $r_1v_1 = r_2v_2$ and because the fact sheet gives you the radius and velocity at apogee and the average velocity, you can easily calculate the average radius. You'll find the same value though.
And here again, we've done more work than we need. We integrated over the true anomaly to find the average orbital distance, but that's just the semi-minor axis which is $383\ 800\:\mathrm{km}$, not too far off from what I calculated. We could've just looked it up from the get go!