We've tried most of the specialist seafood restaurants but at the end of the day we always go back to a place called OX Seafood Restaurant on the beach in Pak Nam Pran.
Menu only in Thai, but also a pictorial menu.
The freshest seafood you'll find - BYO wine is also ok there.