If it's a single cylinder (dunno), you'll lose power. You can swap pipes, but each are designed for different purposes. A 250 fatty may act like a top end pipe on the 500 due to it's larger displacement.
A for SURE restriction would be the stinger, increase the size. Most DEFINITELY increase it. You'll lose a ton o' power from that right away. If you want a quick fix, increase the ID by 2x or make it 75% larger. If you want maximum power, play around with different stinger sizes (and lengths).