Unfortunately, that "extra bit of paperwork" can prove to be somewhere between "quite a bit" and "impossible to do it correctly without expensive professional help".
First, it is not easy to find professional help with US taxes outside the US. The people who provide such services usually do so for corporations and affluent individuals and price their services accordingly. In the real of middle class wages, that means you're going to pay a significant part of your income if you need such help.
Second, the taxation treaties that are meant to prevent double taxation are worded in a way that makes them hard (up to impossible) to understand for someone without legal training.
Third, taxation can have quite a few quirks, for example how securities and their earnings are taxed (I believe the US taxes 'virtual' profits, while other countries may tax realized profits - and the financial institutions there only provide a report of those. Good luck figuring out the figures you need to report to the IRS.)
If you're a US citizen living abroad, make $15k (fifteen k) per year *and* have to file US taxes, you have two choices - do the paperwork yourself (no chance to get it right) and hope for the best, or pay a significant chunk of your meagre income to a professional, if you can find one.
Then move to a nice tax free area of the world and mail the IRS a photocopy of your middle finger every april? Sounds fair.
That's pretty much how the world does it (except for the "mail something to the tax authorities" part - if you're not a resident, you don't have to mail anything to the tax authorities, because you're not liable to pay any taxes), with the exception of two countries, one of them being some third-world place that most people won't find on a map.