la Punta, as a neighborhood, is not that bad and cannot be compared to other parts of Callao which have a bad reputation due to high crime.
However, it has several other disadvantages which would lead my choice to other local destinations in Lima:
First of all, La Punta is not tsunami safe!
Indeed, to arrive to La Punta or to leave La Punta, you may have to travel through some not that safe areas.
And this is the most important for me: If it is not summer in Lima, you are 7 to 9 month in foggy and very moist weather in La Punta.
I live in Chosica, and though I would not recommend it to everybody, it has some really nice advantages:
350 days of SUN through the year and a dry climate! Yes, THIS makes a good mood!
Though traffic increases considerably on the Carretera Central, Chosica still is a "quite" town, i.e. there is not much crime.
You even have a Metro and a Plaza Vea. Hey, not that bad!
There is a sufficient number of hospitals and doctors in Chosica, so you are not completly lost.
Disadvantages in Chosica:
Getting to Lima takes about 1 to 1,5 hours if there is a lot of traffic.
(So, I seldom travel to Lima...I get most what I need in Chosica)
Since many people noticed during the last years that Chosica is a nice place to live, prices of real estate increased terribly!
In February or March huaycos (landslips) can occur. Then, the carretera may be closed for some days.
If you do not have to work in Lima, then my personal choice would be Chosica.