Chances are your job is going to be in 'Central Hong Kong' which is the area just in the heart of Hong Kong Island by Victoria Harbor. The banks and business district are all around here, as are the majority of expats working in Hong Kong.
That said, you may or may not want a place close to Central for commuting purposes. Some love the idea of walking to work (though walking home is usually uphill because of the geography of the city) while others want to get away from the hustle and bustle and look at Stanley (on the South Side of the Island) or Discovery Bay, an expat community a ferry ride away.
Regardless of where you want to live, the one piece of UNIVERSAL advice from nearly every expat is RENT SHORT TERM FIRST! There are thousands of corporate apartment units available on a weekly basis, and the wise expat will find themselves in one of these buildings for a few weeks while they get their 'feet on the ground' looking for apartments. There are so many things you cannot see on a beautiful apartment website, like 'is there a fire station next door' and '100 Chinese restaurants below cooking up smells that come in my window' and 'where is the bus to my office from my apartment'--things like that which really require feet on the ground.
You can also generally get a much better rate walking around the buildings and haggling with the agents than you get arguing over the phone or Internet.