The Wikipedia article on voids is pretty good (though IMO unusually awkwardly written.) The key thing is that voids are not empty, they are just large volumes which have a lower density (typically around 10% of average) compared with the rest of the universe.
These low density areas still contain stars and galaxies, just fewer of them and the galaxies they contain tend to be smaller. The Lambda-Cold-Dark-Matter (LCDM) model, which is currently favored as our best description of the universe, predicts that the voids should not have many large galaxies in them, but should have a fair scattering of small, diffuse galaxies (SDGs). (A small diffuse galaxy is, well, small compared with the Milky Way --
sized more like the Magellanic Clouds or one of the small galaxies which are being devoured by the Milky Way today such as the Sagittarius dwarf. They are also more spread out than the Magellanic Clouds.)
Here's an interesting senior thesis reporting on a search for small diffuse galaxies in voids. (They think they found some, but need confirmation.)
You ask what the night sky would look like from within a void. First, we'll assume you're in one of the SDGs, though this wouldn't make a huge difference. What you'd see mostly is whatever planets share your solar system -- they'd be comparable in brightness to our own planets from Earth. You'd also see a few dim stars. SDGs tend not to have much star formation, so there would be very few young stars and thus very few intrinsically bright stars. The visible stars would all be ones which happened to be nearby. And because SDGs are diffuse, there'd be many fewer nearby stars. At a guess there would be 20-200 naked eye stars, with only a handful of magnitude 3 or brighter. (Compare that with 6000 naked eye stars visible from Earth.)
There would be no naked eye galaxies. The SDG itself would not appear as a milky way, but more like the Zodiacal Light -- a vague glow dimly visible under exceptional conditions.
This would be a world whose astronomy would be heavily focused on the planets.
(Planetary formation might be quite different in SDGs, but I don't know even to try to speculate on how it would be different. So I assume that the planetary system would be similar to ours. YMMV.)