It depends on what you mean by "succeed".
If you mean succeed in the classical sense, as in to make as much money as possible with absolutely no regard to personal health, relationships, etc. then it will be much harder if you are not programming all the time. People who get jobs at Google, VMware, etc. are either geniuses or work 60-80 hour weeks to make the money that they do (generally, this is not a broad paintbrush here).
However, I do not view success that way. To me, working all the time and forgetting about health, relationships, etc. is quite easy to do. I've met plenty of people who make way more money at my age who also don't have any real friends or hobbies. They are part of a "get rich or die trying" diatribe which seems to me doesn't leave much for happiness. I've seen more unhappy rich people than happy ones. To me, that is not success. What is very difficult to do is to have a balance where you can leave work and pursue healthy, creative endeavors and foster a balanced life where work is only a part of it (albeit a significant part).
You get to define what success means to you. Me, personally, I work to live, not live to work. I like programming and learning, but I also love my hobbies, exercising, and dating. I have recently gotten into photography as a hobby, and I love it. I also believe that a good programmer is a creative programmer, and I believe that my new hobby will help me at work as well, to think outside the box.
Keep in mind that the way to truly make lots of money and "succeed" is to get into management and lead lots of people. If you don't take the time to develop the social skills necessary for this, a programmer will be a programmer forever. Programmers have a glass ceiling once they hit 40 or so, but for management, the sky is the limit.