I think it's a non-driver related problem. I found a USB sound interface and plugged it in and the output sound sounded the same.

edit -- Figured it out. I didn't have my BusRatio specified in my boot plist. Audio is perfect now and also the system seems to be running smoother.