Well according to the article "Have we seen a white hole?" (Byrd, 2011) there are some claims that scientists (specifically "The Revival of White Holes as Small Bangs" (Retter and Heller)) may have detected a white hole; however, this claim seems to be shrouded in controversy, as this observation may actually have a more stellar explanation.
However, the article from Retter and Heller offer a hypothesis as to what white holes are, from the article linked before:
We thus suggest that the emergence of a white hole, which we name a ‘Small Bang’, is spontaneous – all the matter is ejected at a single pulse. Unlike black holes, white holes cannot be continuously observed rather their effect can only be detected around the event itself.
Which, if the authors are correct, would explain why we don't see/detect them and white holes (unlike black holes) are unique because they supposedly spew matter, rather than extract.
One major caveat is that it is not clear as to where this matter that spews out comes from.