Well... it's hard to say exactly what happens when you fly close to a blackhole, as that's one of the areas of physics that there's still a huge amount of debate about. There's been a big controversy for years for example over whether the event horizon is "no drama" or a firewall. Because with our current models, both should occur, and both are mutually contradictory. Some of the more recent work has been leaning toward eliminating the physical event horizon entirely, with there only existing an apparent horizon. Everything that falls in is released eventually as the black hole evaporates (effectively "frozen in time"), but due to the exponentially-growing mass/energy densities experienced by infalling objects, it's all effectively irrecoverably scrambled, like a firewall. But technically, the information is not lost. Hawking seemed convinced by this concept late in his life, although it lacks a rigorous backing at this point in time.
Some of my favourite work I've seen has been towards introducing a space-dilatory inflation force, with effects only over very short-distances (similar to the strong force). So we don't see this force in "normal" situations; it only becomes apparent in extreme conditions, like those at black holes. When such a model is implemented properly, both the singularity and event horizon disappear; infalling matter converges to a surface that from an infinite-distance observer position appears 2d, with there being no "inside". The neat part about it is that it also explains inflation; the Big Bang can just be modeled as an extremely large evaporating black hole, and each evaporating black hole as its own new universe. There's still a lot of work to do, however; I haven't seen any new papers on this recently (although I admittedly haven't been following the topic very well of late).
If I am correct in my understanding, in any of the "no true event horizon" models, it would seem to you like you were part of the infalling matter that formed the black hole itself - that you were part of the formation event. From your perspective, you fall into an ever-more distorted region of spacetime and evaporate in the ever-increasingly intense conditions, which to an infinite-distance observer's point of view is actually the black hole's evaporation innumerable eons later. From the infaller's perspective, it all happened quickly. From the infinite observer's perspective, the universe has all but died of heat death by the time your information is released. The mass-energy is released into what's otherwise a void, and effectively its own mini-universe.
Of course, that's some pretty heavy extrapolation when you're talking about things that far in the future, given the fact that we don't know have a good model on dark energy, either! Conceptually, I would so love it if dark energy would in some way or another end up inflating black hole masses, at least some to "big bang"-sizes - each yielding not a mini-universe from its evaporation, but a full-fledged universe. Of course, what I would conceptually "like" to be real has no bearing on whether it actually is!