So instead of using standard blitting functions, now you have to set up a 3D context, set up structures, make a surface, and use a texture on the surface. And what do you get for that?
Lanczos? No? Bicubic? Maybe? What?
And scrolling won't be faster either. Pretty much every chip made since the mid 90's has a 2D accelerator.
This is a square peg and a round hole. Sure, you can do it, but why would you?