Not exactly pocket-sized, but definitely portable and quite a bit impressive. Also, and as is usual with these things, this portable Atari 7800 is a Ben Heck creation, sporting a shiny 7" LCD screen, an A/V output jack, rechargeable batteries and a combination driving / paddle controller. See it over at Engadget and read a bit more on it at Joystiq. Oh, and here is a detailed presentation of the portable and how it was built by Mr. Heckendorn himself.
Related posts: the Atari 2600 handheld, GBA Tekken Advance, an Emmy for Atari Lynx, and a portable MegaDrive