You might want to try FFmpeg. If you disable all the encoders and most of the other stuff, dead code stripping should make it reasonably small, and it can actually use Altivec for JPEG decoding.